The present invention relates to an ultrasound diagnostic apparatus, and in particular to a technique for forming a display image of a diagnosis target.
Techniques for displaying an ultrasound image of a tissue or the like in a display image suited for diagnosis are known from the related art, and various display images exist as the display image for these techniques, corresponding to the type of the tissue or the like and the contents of the diagnosis. As the tissue or the like, a plurality of follicles in a living body are in some cases a target of ultrasound diagnosis.
Each follicle is in many cases observed in a shape approximately close to an ellipse, and, for example, a major axis of each follicle along a longitudinal direction thereof and minor axes orthogonal to the major axis are used as measurements in diagnosis of each follicle. Because of this, for example, many users desire a cutting-plane image including the major axis and the minor axes of the follicle when the ultrasound image data is three-dimensionally obtained and the cutting-plane image of each follicle is displayed.
However, in the process of setting the position of the cutting plane for the follicle to include the major axis and the minor axes of the follicle, if the setting is to be manually performed by the user, the user is forced to execute complicated operation. In particular, in a living body, a large number of follicles exist close to each other at high density, and the manual setting of the cutting plane for each of the large number of follicles requires a great amount of work.
In such a circumstance, the present inventors have researched and developed techniques for forming a display image suitable for diagnosis for a diagnosis target such as, for example, the follicle. In the formation of the display image, it is desirable to refer to the form of the diagnosis target; that is, the size and shape of the diagnosis target. An example of a feature quantity showing the form of the diagnosis target is the major axis identified along a longitudinal direction of the diagnosis target (refer to Patent Document 1)
The present invention was conceived in the process of the above-described research and development, and an advantage thereof is realization of a display image of a diagnosis target according to the form of the diagnosis target.
According to one aspect of the present invention, there is provided an ultrasound diagnostic apparatus comprising a probe which transmits and receives ultrasound to and from a diagnostic region; a transmitting and receiving unit which controls the probe to obtain a reception signal from the diagnostic region; a target identifying unit which identifies image data of a diagnosis target in image data of the diagnostic region formed based on the reception signal; a coordinate system setting unit which sets, based on the image data of the diagnosis target, a diagnostic coordinate system based on a form of the diagnosis target; a coordinate system matching unit which matches with each other a display coordinate system forming a basis of a display image and the diagnostic coordinate system, to place the image data of the diagnosis target in the display coordinate system; and a display image forming unit which forms a display image of the diagnosis target based on the image data of the diagnosis target placed in the display coordinate system.
In the above-described configuration, the image data of the diagnostic region may be formed, for example, with a plurality of echo data which are two-dimensionally arranged or a plurality of voxel data which are three-dimensionally arranged. When the image data of the diagnostic region are two-dimensional data, the diagnostic coordinate system and the display coordinate system are desirably two-dimensional coordinates. When the image data of the diagnostic region are three-dimensional data, the diagnostic coordinate system and the display coordinate system are desirably three-dimensional coordinates or two-dimensional coordinates. In addition, although the diagnostic coordinate system and the display coordinate system are desirably orthogonal coordinate systems, there may be used coordinate systems other than the orthogonal coordinate system, such as coordinate systems suited for the form of scanning of the ultrasound probe.
In the above-described configuration, the display coordinate system and the diagnostic coordinate system are matched with each other. For example, one coordinate system is placed in the other coordinate system such that a certain matching condition is satisfied. The matching condition is, for example, a relative placement relationship between a coordinate axis and a coordinate plane defining one coordinate system, and a coordinate axis and a coordinate plane defining the other coordinate system, or the like. As an example, there exists a form in which one coordinate axis of the display coordinate system and one coordinate axis of the diagnostic coordinate system are overlapped with each other. Alternatively, one coordinate axis of the display coordinate system and one coordinate axis of the diagnostic coordinate system may be matched in a manner to intersect each other with a certain intersection angle.
With the above-described configuration, because the diagnostic coordinate system based on the form of the diagnosis target and the display coordinate system are matched with each other when the image data of the diagnosis target are to be placed in the display coordinate system, placement of the image data corresponding to the form of the diagnosis target is realized, and a display image of the diagnosis target according to the form of the diagnosis target can be formed.
According to another aspect of the present invention, there is provided an ultrasound image processor comprising a target identifying unit which identifies image data of a diagnosis target in ultrasound image data; a coordinate system setting unit which sets, based on the image data of the diagnosis target, a diagnostic coordinates system based on a form of the diagnosis target; a coordinate system matching unit which matches with each other the display coordinate system forming a basis of a display image and the diagnostic coordinate system, to place the image data of the diagnosis target in the display coordinate system; and a display image forming unit which forms a display image of the diagnosis target based on the image data of the diagnosis target placed in the display coordinate system.
According to another aspect of the present invention, for example, a program which realizes the functions of the target identifying unit, the coordinate system setting unit, and the coordinate system matching unit described above may be used to cause a computer to realize these functions so that the computer functions as the ultrasound image preprocessor described above.
According to various aspects of the present invention, a display image of a diagnosis target according to the form of the diagnosis target can be formed.
As the probe 10, a three-dimensional probe which scans the ultrasound beam (transmission beam and reception beam) in a three-dimensional space and three-dimensionally collects the echo data is preferable. For example, a scanning plane electrically formed by a plurality of transducer elements which are arranged one-dimensionally (1-D array transducer) may be mechanically moved to three-dimensionally scan the ultrasound beam. Alternatively, a plurality of transducer elements arranged two-dimensionally (2-D array transducer) may be electrically controlled to three-dimensionally scan the ultrasound beam. Alternatively, there may be employed a two-dimensional ultrasound probe which scans the ultrasound beam within a tomographic plane.
When the ultrasound beam is scanned in the three-dimensional space and echo data are collected, echo data (voxel data) for a plurality of voxels forming the three-dimensional data space corresponding to the three-dimensional space are stored in a memory or the like (not shown). For the plurality of voxels forming the three-dimensional data space, various processes are executed by a target identifying unit 20 and the subsequent units. These processes will now be described. For a portion (structure) shown in
In a living body, the plurality of follicles exist at high density, very close to each other. Therefore, in the ultrasound image, as shown in
In the erosion and separation process, at each scan position, if there is at least one voxel with the voxel value of “0” among the 26 peripheral voxels in the filter 120, the voxel value of the voxel of interest positioned at the center of the filter 120 is set as “0.” For example, when the voxel of interest has a voxel value of “1” (follicle), and at least one of the peripheral voxels has a voxel value of “0” (background), the voxel value of the voxel of interest is converted to “0” (background). By the filter 120 being scanned once over the entire region of the three-dimensional data space 100 and the filtering process being executed for each scan position, the erosion process of one step is completed. The conversion of the voxel value with regard to the voxel of interest is executed after the filter 120 is scanned once over the entire region of the three-dimensional data space 100. In other words, the conversion of voxel value is not executed in the middle of scanning of the filter 120, and the filter process is executed at any scan position based on the voxel value before the conversion.
When the erosion process of one step is completed as described above and the voxel value is converted based on the result of the erosion process, an erosion process of a second step is executed on the three-dimensional data space 100 formed of the converted voxel values. In the erosion process of second step also, the same filter process as the erosion process of the first step is executed. Specifically, in each scan position, if there is at least one voxel with a voxel value of “0” among the 26 peripheral voxels in the filter 120, the voxel value of the voxel of interest positioned at the center of the filter 120 is converted to “0.” The conversion of the voxel value is executed after the filter 120 is once scanned over the entire region of the three-dimensional data space 100.
The target identifying unit 20 repeatedly executes the stepwise erosion process n times (where n is a natural number). The number of repetitions n is suitably determined according to the size of each voxel, the size of the filter, etc., and is set, for example, to be about 10 or less. Alternatively, there may be employed a configuration in which the user can adjust the number n.
In the case of two-dimensional configuration, in place of the filter 120 shown in
Referring again to
After the labeling process is applied, the target identifying unit 20 applies a dilation process on each of a plurality of follicles in the voxel data forming the three-dimensional data space and to which the labeling process is applied; that is, the image data after the labeling process shown in
The target identifying unit 20 repeatedly executes the dilation process to stepwise dilate the follicle F n times (where n is the same number as the number of erosion processes). In the dilation process at each step, a filter for the dilation process is used, and the filter is scanned over the entire region in the three-dimensional data space. In the dilation process also, the three-dimensional filter 120 corresponding to a total of 27 voxels shown in
In the case where the voxel of interest positioned at the center of the filter 120 (
In the case when the voxel of interest has a label of 0 (background), if there are labels (follicle) other than the label of 0 among the 26 peripheral voxels and the labels include different label numbers (follicles different from each other), the voxel of interest is set to the label of 0. In other words, the voxel of interest is maintained at the label of 0, and becomes a boundary between follicles which differ from each other.
On the other hand, when the voxel of interest positioned at the center of the filter 120 has a label of M (follicle), the voxel of interest is maintained with the label of M regardless of the status of the peripheral voxels.
When the filter 120 shown in
When the dilation and boundary process of one step is completed in this manner and the label value is converted based on the result, the dilation and boundary process of a second step is executed on the three-dimensional data space 100 formed of the converted label values. In the dilation and boundary process of the second step also, the filter process identical to that of the first step is executed. Specifically, at each scan position, the filter process is executed according to the condition shown in
The target identifying unit 20 repeatedly executes the stepwise dilation and boundary process n times. The number of repetitions n is desirably identical to the number of repetitions n of the erosion process. In this manner, as shown in
In the dilation and boundary process also, when a two-dimensional configuration is employed, in place of the filter 120 shown in
In the present embodiment, as shown in
In the process of identifying each follicle, for example, the user can designate a desired label to identify the follicle corresponding to the label. In addition, because the follicles are separated, on an image displaying the plurality of follicles, the user may designate a desired follicle by operating a display form such as a cursor, so that only an image of the follicle thus designated is displayed.
In the present embodiment, when the follicle designated by the user is displayed, a display image corresponding to the form of the follicle is formed. As a feature quantity related to the form of the follicle, a three-axes calculating unit 30 shown in
Referring again to
In order to obtain a covariance matrix, an average position m is calculated by Equation 1. In Equation 1, Pi represents a coordinate value in the three-dimensional data space (refer to
Using the average position m of Equation 1, a covariance matrix C shown in Equation 2 is calculated. The covariance matrix C shown in Equation 2 is a 3×3 matrix, and is a symmetric matrix having 6 independent components shown in Equation 3.
In the primary component analysis using the covariance matrix C, eigenvectors of the covariance matrix C obtained by Equations 2 and 3 are calculated, and an eigenvector corresponding to a maximum eigenvalue is set as the first primary component. In the present embodiment, a direction of the first primary component obtained using the covariance matrix C is set as the major axis of the follicle. With this process, the major axis passing through the center of gravity of the follicle and along the longitudinal direction of the follicle is identified. In addition, directions of a second primary component and a third primary component obtained using the covariance matrix C are set as the two minor axes of the follicle. For example, a direction of the second primary component is set as a first minor axis and a direction of the third primary component is set as a second minor axis. In this manner, the major axis and two minor axes orthogonal to the major axis are identified as three axes of the follicle.
Alternatively, in the image data of the follicle, the major axis may be set along a straight line connecting the center of gravity and a pixel which is farthest away from the center of gravity. However, because there may be a case where the farthest pixel is noise or the like, the setting of the major axis by the primary component analysis is more desirable.
When three axes are identified by the three-axes calculating unit 30, a diagnostic coordinate system setting unit 40 sets a diagnostic coordinate system based on the form of the follicle. The diagnostic coordinate system setting unit 40 sets a diagnostic coordinate system having three axes of the follicle as the coordinate axes.
Referring again to
In
In consideration of the above, the coordinate system matching unit 50 first translates the diagnostic coordinate system with respect to the display coordinate system to coincide the origin of the display coordinate system and the origin of the diagnostic coordinate system. In this process, the voxel data (image data) related to the follicle F is also translated with the diagnostic coordinate system.
Then, the coordinate system matching unit 50 compares the axis corresponding to the major axis of the follicle F; that is, the first axis of the diagnostic coordinate system, and each of the XYZ axes of the display coordinate system, and identifies, among the XYZ axes, an axis having a smallest angle with respect to the first axis. For example, inner products between the first axis and the XYZ axes are compared to identify the axis having the smallest angle with respect to the first axis. The diagnostic coordinate system is then rotationally moved such that the identified axis and the first axis overlap each other. For example, when the X-axis is identified as the axis having the smallest angle with respect to the first axis, as shown in (C) of
The coordinate system matching unit 50 then compares the second axis of the diagnostic coordinate system corresponding to the minor axis of the follicle F and the remaining axes of the display coordinate system, and identifies an axis having a smallest angle with respect to the second axis. For example, when the first axis and the X axis are overlapped, among the remaining axes; that is, the Y-axis and the Z axis, the axis having the smallest angle with respect to the second axis is identified. The diagnostic coordinate system is then rotationally moved so that the identified axis and the second axis overlap each other. For example, when the Z axis is identified as having the smallest angle with respect to the second axis, as shown in (D) of
When the diagnostic coordinate system is an orthogonal coordinate system, if the first axis and the second axis are overlapped with the X axis and the Z axis, the third axis is placed along the Y axis. In (D) of
Referring again to
Because the display coordinate system and the diagnostic coordinate system are matched as shown in
For example, in the three-dimensional image shown in
For example, when the user identifies the follicle F1 using the three-dimensional image, the three-axes calculating unit 30 identifies the three axes of the follicle F1 (refer to
In
In this manner, in the present embodiment, the user selects a desired follicle from a plurality of follicles, and a tomographic image including three axes of the identified follicle is formed. Because of this, complicated operation by the user, for example, an operation for setting the cutting plane or the like, can be reduced, and, desirably, the operation for setting the cutting plane can be omitted.
In addition, in the matching of the display coordinate system and the diagnostic coordinate system, the coordinate axes having the minimum intersecting angle are overlapped, and, thus, the rotational movement of the diagnostic coordinate system can be minimized, and visual discomfort of the user felt due to the rotational movement can be minimized.
Alternatively, for the identified follicle F1, measurement values such as the length of the major axis, the lengths of the two minor axes, and the volume may be displayed as a part of the display image 62. In addition, because the plurality of follicles are separated from each other and identified (refer to
An ultrasound diagnostic apparatus according to a preferred embodiment of the present invention has been described. Alternatively, for example, at least one of the target identifying unit 20, the three-axes calculating unit 30, the diagnostic coordinate system setting unit 40, the coordinate system matching unit 50, and the display image forming unit 60 shown in
10 PROBE; 20 TARGET IDENTIFYING UNIT; 30 THEE-AXES CALCULATING UNIT; 40 DIAGNOSTIC COORDINATE SYSTEM SETTING UNIT; 50 COORDINATE SYSTEM MATCHING UNIT; 60 DISPLAY IMAGE FORMING UNIT; 62 DISPLAY IMAGE 70 DISPLAY
Number | Date | Country | Kind |
---|---|---|---|
2011-089927 | Apr 2011 | JP | national |
Filing Document | Filing Date | Country | Kind | 371c Date |
---|---|---|---|---|
PCT/JP2012/059346 | 4/5/2012 | WO | 00 | 10/10/2013 |