Patent Application
20070293755
The present invention relates to a technique for obtaining a tomogram of a subject from a medical image diagnosis device (modality) including X-ray CT device, MRI device and ultrasound device, and capable of simultaneously displaying 3-dimensional configuration of the obtained observation target organ and positional relationship between the observation target organ and the surrounding organs.
The present application accompanies the claim of priority in Paris, based on Japanese Patent Application No. 2004-276576 by Japanese Patent Law, and is to be incorporated by reference for receiving the benefit of Japanese Patent Application No. 2004-276576.
For example, upon performing examination of organs with motion such as a heart, it is possible to diagnose abnormal motional state such as calcification of cardiac muscle or infarction of the heart through displaying the measurement result in real time. Imaging and display in real time is now practically applied in images such as two-dimensional tomograms of a heart.
Recently the analysis of organs with motion by 3-dimensional images have been attempted since the form of organs sequentially changes and it is hard to grasp the entire configuration of organs with motion only by 2-dimensional image.
However, construction of a 3-dimensional image of organs with motion requires a large amount of data to be calculated, thus the technique for real-time display has not been established in spite of current state of computers with high-speed calculation.
Given this factor, a work around method has been provided which is for displaying a 3-dimensional image of an organ-region and a cross-section of an arbitrary position side-by-side, obtaining a 3-dimensional configuration of an organ and information of the cross-sectional image, and adding information on the 3-dimensional depth direction on the 2-dimensional image of the cross-sectional image (for example, Patent Document 1).
Patent Document 1: JP-A-2000-107182
However, in Patent Document 1, the invention lacks the idea of displaying 3-dimensional configuration of a target region from arbitrary directions and information on surrounding organs hidden in the 3-dimensional image simultaneously.
The objective of the present invention, therefore, is to provide a medical image display device, method and program capable of displaying 3-dimensional configuration of a target region from arbitrary directions and information on surrounding organs hidden in the 3-dimensional image simultaneously.
A medical image display device of the present invention comprises:
tomogram input means for inputting a plurality of tomograms obtained by a medical imaging device;
3-dimensional image construction means for constructing a 3-dimensional image by layering the tomograms inputted;
arbitrary cross-section image construction means for cutting the 3-dimensional image at an arbitrary cross-section and constructing the cross-section image from the plurality of tomograms;
superimposed image construction means for constructing an superimposed image of the 3-dimensional image and the arbitrary cross-section image according to positional information on the tomogram; and
display means for displaying the superimposed image thus constructed.
A medical image display method of the present invention includes:
a tomogram input step for inputting a plurality of tomograms obtained by a medical imaging device;
a 3-dimensional image construction step for constructing a 3-dimensional image by layering the tomograms inputted;
an MPR image construction step for cutting the 3-dimensional image at an arbitrary cross-section and constructing the cross-section from the tomograms;
a superimposed image construction step for constructing an superimposed image of the 3-dimensional image and the arbitrary cross-section image according to positional information on the tomogram;
a display step for displaying the superimposed image thus constructed.
A medical image display program of the present invention run on a computer includes:
a tomogram input process for inputting a plurality of tomograms obtained by a medical imaging device;
a 3-dimensional image construction process for constructing a 3-dimensional image by layering the tomograms inputted;
an MPR image construction process for cutting the 3-dimensional image at an arbitrary cross-section and constructing the cross-section from the tomograms;
a superimposed image construction process for constructing a superimposed image of the 3-dimensional image and the arbitrary cross-section image according to positional information on the tomogram;
a display process for displaying the superimposed image thus constructed.
In accordance with the present invention, information on the 3-dimensional configuration from arbitrary directions and information on the surrounding region hidden in the 3-dimensional image can be displayed simultaneously.
A medical image display method, medical image display program and medical image display device of the present invention are carried out by such a computer system illustrated in
As for the diagrams to be used for the description of the present embodiment, the parts having the same function are encoded with the same codes, and the repeated descriptions are omitted.
The computer system is provided with CPU 10, magnetic disk 13 connected via CPU 10 and data transfer bus 1A, main memory 14, controller 15 and display memory 18.
CPU 10 is for executing the calculation for region extraction or the calculation for constructing the projection image. Magnetic disk 13 is for receiving the medical tomograms imaged by medial imaging device 11 via network such as LAN 12 and storing them. Main memory 14 is for storing the medical tomogram data or intermediate steps of calculation while calculating for the region extraction. Controller 15 is provided with mouse 16 or keyboard 17 connected for inputting the starting point for the extraction or parameters necessary for region extraction, and an operator inputs information such as parameters using mouse 16 or keyboard 17. Display device 19 has units such as display memory 18 to use for displaying the results of region extraction, a liquid crystal display or CRT.
Controller 20 comprises target organ region extracting unit 30 connected to input device 21 and memory device 22, 3-dimensional image data construction device 31 regarding the target region, MPR image construction unit 32 and superimposed image construction unit 33. The medical image display device of the present invention is operated by the method according to the procedure in the flow chart shown in the respective embodiments through the program carried out by a computer.
First embodiment of the present invention will now be described using the diagrams.
(Step 50)
The operator inputs a group of medical tomograms imaged by X-ray CT device or MRI device by operating image read-in button 41 of GUI 40 using an input device such as mouse 16. The inputted images are displayed on image display region 42. The slice of image to be displayed out of the inputted medical tomogram group may be selected at the discretion of the operator through operating slice-forwarding scroll bar 43 using an input device such as mouse 16 or keyboard 17.
Also, the operator can display the inputted images with the arbitrary gradation by operating gradation conversion scroll bar 44 using an input device such as mouse 16 or keyboard 17.
(Step 51)
The operator specifies the target organ region on a medial tomogram image such as an X-ray CT image or MR image being displayed on image display region 42 of GUI 40 by operating an input device such as mouse 16.
(Step 52)
CPU 10 extracts the specified organ region using the region extraction method (region growing method) disclosed in, for example, Japanese Patent No. 2845995.
(Step 53)
CPU 10 constructs a 3-dimensional image of the target organ region extracted in step 52, using a method such as the surface rendering method or volume rendering method. It may be set so that the operator can arbitrarily choose whether to use the surface rendering method or volume-rendering method by operating combo box 45 on GUI 40 using an input device such as mouse 16.
For example, image 62 in
(Step 54)
CPU 10 constructs an MPR image that is cut at the cross-section with a discretional slope and has the discretional coordinate in the superimposed medical tomographic images as a center. The MPR image is constructed, in the case that the cardiac muscle image group in
(Step 55)
CPU 10 constructs a superimposed image of the 3-dimensional image of the target organ region and the MPR image. Here, the positional relationship of the 3-dimensional image and MPR image is made to coincide with the actual positional relationship by matching the coordinate. For example, an image like superimposed image 80 in
(Step 56)
CPU 10 displays the constructed superimposed image of the 3-dimensional image and MPR image on superimposed image display region 46 on GUI 40.
Here, the angle of the displayed 3-dimensional image may be set so that the operator can freely change the angle by dragging mouse 16 on superimposed image display region 46. Upon rotation of the 3-dimensional image, the MPR image can be set to rotate at the same time maintaining the positional relationship. Or, it can be set so that the operator can rotate only the cross-section for constructing an MPR image while maintaining the display angle of the 3-dimensional image. When the cross-section rotates, the MPR image to be displayed naturally varies in compliance with the position of the cross-section. Or, it may be set so that the operator can move only the central position of the cross-section for constructing an MPR image by dragging mouse 16 on display region 46 of the superimposed image while maintaining the angle of the 3-dimensional image and the cross-section for constructing the MPR image. The displayed MPR image varies in compliance with the movement of the central position of the cross-section.
As to the options to be operated using a mouse such as the rotation of the 3-dimensional image, the rotation of the cross-section for constructing an MPR image and the movement of the cross-section for constructing the MPR image, it may be set so that only one option can be carried out, or that the operator can choose to switch modes such as the rotation or the movement and can carry out all of the options. These modes may be set as selective in, for example, rotation mode combo box 47 on GUI 40.
With such setting, observation of the 3-dimensional configuration of the target region from arbitrary directions and information on the surrounding organs of the 3-dimensional image can be obtained simultaneously.
The second embodiment of the present invention will be described using the diagrams. An example of the GUI for implementing the present embodiment is shown in
(Step 100)
The operator inputs a medical tomogram group such as X-ray CT images or MR images imaged by X-ray CT apparatus or MRI apparatus by pushing image read-in button 91 of GUI 90 using an input device such as mouse 16. The inputted images are displayed on image display region 92. It may be set so that the operator can select the slice of image to display out of the inputted medical tomogram group by operating slice-forwarding scroll bar 93 using an input device such as mouse 16 or keyboard 17. It also may be set so that the operator can display the inputted images with arbitrary gradation through operating gradation-converting scroll bar 94 using an input device such as mouse 16 or keyboard 17.
(Step 101)
The operator specifies the organ region to be the observation target on a medical tomogram such as an X-ray CT image or MR image being displayed on image display region 92 of GUI 90 by operating an input device such as mouse 16.
(Step 102)
CPU 10 extracts the specified organ region using, for example, the region growing method.
(Step 103)
CPU 10 constructs an MPR image that is cut at the cross-section with a discretional slope and has the discretional coordinate in the superimposed medical tomographic images as a center.
(Step 104)
CPU 10 acquires the value of transparency from transparency-setting scroll bar 95.
Step 105)
CPU 10 constructs a 3-dimensional image of the organ region for the observation target extracted in step 102, using the surface rendering method or volume rendering method. It may be set so that the operator can freely change whether to use the surface rendering method or volume rendering method by operating combo box 96 on GUI 90 using an input device such as mouse 16.
(Step 106)
CPU 10 constructs a superimposed image of a 3-dimensional image of the target organ region and the MPR image. Then the coordinate is set so that the positional relationship between the 3-dimensional image and MPR image coincides with the actual positional relationship. Also, by superimposing the 3-dimensional image translucently displaying using transparency obtained in step 104, the superimposed image turns out as seen in image 110 of
(Step 107)
CPU 10 displays the superimposed image of the constructed 3-dimensional image and MPR image on superimposed image display region 97 on GUI 90.
Here, it may be set so that the operator can freely change the display angle of the 3-dimensional image by dragging mouse 16 on superimposed image display region 97. Upon rotation of the 3-dimensional image, the MPR image can be set to rotate at the same time maintaining the positional relationship. Or, it may be set so that the operator rotates only the cross-section for constructing an MPR image while maintaining the angle of the 3-dimensional image by dragging mouse 16 on display region 97 of the superimposed image. When the cross-section rotates, the displayed MPR image naturally varies in compliance with the position of the cross-section. Alternatively, it may also be set so that the operator moves only the central position of the cross-section for constructing an MPR image while maintaining the angle of the 3-dimensional image and the cross-section for constructing MPR image by dragging mouse 16 on display region 97 of the superimposed image. The displayed MPR image varies in compliance with the movement of the displayed MPR image.
As for the options to be operated using a mouse such as the rotation of the 3-dimensional image, the rotation of the cross-section for constructing an MPR image and the movement of the cross-section for constructing the MPR image, it may be set so that only one option can be carried out, or that the operator can choose to switch modes such as the rotation and can carry out all of the options. These modes may be set as selective in, for example, rotation mode combo box 98 on GUI 90.
(Step 108)
The operator may arbitrarily change transparency of the 3-dimensional image as necessary by operating transparency setting scroll bar 95 using an input device such as mouse 16 or keyboard 17 while observing the superimposed image displayed on superimposed image display region 97 on GUI 90.
In the 3-dimensional image construction process, step 104 is to proceed immediately when transparency of the 3-dimensional image is changed, and the new superimposed image is constructed.
Accordingly, information on both the 3-dimensional image set as translucent and the MPR image can be obtained simultaneously by superimposing them.
The third embodiment of the present invention will now be described using the diagrams. An example of the GUI to carry out the present embodiment is shown in
(Step 130)
The operator inputs the medical tomogram group such as X-ray CT images or MRI images being imaged by X-ray CT apparatus or MRI apparatus, by pushing image read-in button 121 on GUI 120 using an input device such as mouse 16.
The inputted image is displayed on image display region 122. The slice of image to be displayed may be selected out of the inputted medical tomogram group at the discretion of the operator through operating slice-forwarding scroll bar 123 using an input device such as mouse 16 or keyboard 17. Also, the operator can display the inputted images with the arbitrary gradation through the operation of gradation conversion scroll bar 124 using an input device such as mouse 16 or keyboard 17.
(Step 131)
The operator specifies a target organ region on a medial tomogram image such as an X-ray CT image or MR image being displayed on image display region 122 of GUI 120 by operating an input device such as mouse 16.
(Step 132)
CPU 10 extracts the specified organ region using, for example, the region growing method.
(Step 133)
CPU 10 constructs a 3-dimensional image of the target organ region extracted in step 132, using the surface rendering method or volume rendering method. It may be set so that the operator can arbitrarily choose whether to use the surface rendering method or volume-rendering method by operating combo box 125 on GUI 120 using an input device such as mouse 16.
(Step 134)
CPU 10 acquires the value of transparency from transparency-setting scroll bar 126.
(Step 135)
CPU 10 constructs an MPR image that is cut at the cross-section with a discretional slope and has the discretional coordinate in the superimposed medical tomographic images as a center.
(Step 136)
CPU 10 constructs a superimposed image of a 3-dimensional image of the target organ region and the MPR image. Then the coordinate is set so that the positional relationship between the 3-dimensional image and MPR image coincides with the actual positional relationship. Also, by superimposing the MPR image and translucently displaying using transparency obtained in step 134, the superimposed image turns out as seen in image 140 of
(Step 137)
CPU 10 displays the superimposed image of the constructed 3-dimensional image and MPR image on superimposed image display region 127 on GUI 120.
Here, it may be set so that the operator can freely change the display angle of the 3-dimensional image by dragging mouse 16 on superimposed image display region 127, or that the MPR image rotates while maintaining the positional relationship at the same time the 3-dimensional image rotates. Or, it may be set so that the operator rotates only the cross-section for constructing an MPR image while maintaining the angle of the 3-dimensional image by dragging mouse 16 on display region 127 of the superimposed image. When the cross-section rotates, the displayed MPR image naturally varies in compliance with the position of the cross-section. Alternatively, it may also be set so that the operator moves only the central position of the cross-section for constructing an MPR image while maintaining the angle of the 3-dimensional image and the cross-section for constructing MPR image by dragging mouse 16 on display region 127 of the superimposed image. The MPR image varies in compliance with the movement of the displayed MPR image.
As for the options to be operated using a mouse such as the rotation of the 3-dimensional image, the rotation of the cross-section for constructing an MPR image and the movement of the cross-section for constructing the MPR image, it may be set so that only one option can be carried out, or that the operator can choose to switch modes such as the rotation and can carry out all of the options. These modes may be selected in, for example, rotation mode combo box 128 on GUI 120.
(Step 138)
The operator may arbitrarily change transparency of the 3-dimensional image as necessary by operating transparency setting scroll bar 125 using an input device such as mouse 16 or keyboard 17 while observing the superimposed image displayed on superimposed image display region 127 on GUI 120. In 3-dimensional image construction process, step 134 is to proceed immediately when transparency of the 3-dimensional image is changed, and the new superimposed image is constructed. Accordingly, information on both the 3-dimensional image set in translucent and the MPR image can be obtained simultaneously by superimposing them.
The fourth embodiment of the present invention will now be described using the diagrams. An example of the GUI for carrying out the present embodiment is shown in
(Step 160)
The operator inputs a medical tomogram group such as X-ray CT images or MRI images being imaged by an X-ray CT apparatus or MRI apparatus, by pushing image read-in button 151 on GUI 150 using an input device such as mouse 16.
The inputted image is displayed on image display region 152. The slice of image to be displayed may be selected out of the inputted medical tomogram group at the discretion of the operator through operating slice-forwarding scroll bar 153 using an input device such as mouse 16 or keyboard 17. Also, the operator can display the inputted images with the arbitrary gradation through the operation of gradation conversion scroll bar 154 using an input device such as mouse 16 or keyboard 17.
(Step 161)
The operator specifies a target organ region on a medial tomogram image such as an X-ray CT image or MR image being displayed on image display region 152 of GUI 150 by operating an input device such as mouse 16.
(Step 162)
CPU 10 extracts the specified organ region using, for example, the region growing method.
(Step 163)
CPU 10 acquires transparency for the 3-dimensional image and the MPR image from transparency-setting scroll bar 155.
(Step 164)
CPU 10 constructs a 3-dimensional image of the target organ region extracted in step 152, using the surface rendering method or volume rendering method. It may be set so that the operator can arbitrarily choose whether to use the surface rendering method or volume-rendering method by operating combo box 156 on GUI 150 using an input device such as mouse 16.
(Step 165)
CPU 10 constructs an MPR image that is cut at the cross-section with a discretional slope and has the discretional coordinate in the superimposed medical tomographic images as a center.
(Step 166)
CPU 10 constructs a superimposed image of a 3-dimensional image of the target organ region and the MPR image. Then the coordinate is set so that the positional relationship between the 3-dimensional image and MPR image coincides with the actual positional relationship. Also, the 3-dimensional image and the MPR image are superimposed using transparency obtained in step 163. The superimposed image turns out as seen in image 170 of
(Step 167)
CPU 10 displays the superimposed image of the constructed 3-dimensional image and MPR image on superimposed image display region 157 on GUI 150.
Here, it may be set so that the operator can freely change the display angle of the 3-dimensional image by dragging mouse 16 on superimposed image display region 157, or that the MPR image rotates while maintaining the positional relationship at the same time the 3-dimensional image rotates. Or, it may be set so that the operator rotates only the cross-section for constructing an MPR image while maintaining the angle of the 3-dimensional image by dragging mouse 16 on display region 157 of the superimposed image. When the cross-section rotates, the MPR image being displayed naturally varies in compliance with the position of the cross-section. Alternatively, it may also be set so that the operator moves only the central position of the cross-section for constructing an MPR image while maintaining the angle of the 3-dimensional image and the cross-section for constructing MPR image by dragging mouse 16 on display region 157 of the superimposed image. The MPR image varies in compliance with the movement.
As for the options to be operated using a mouse such as the rotation of the 3-dimensional image, the rotation of the cross-section for constructing an MPR image and the movement of the cross-section for constructing the MPR image, it may be set so that only one option can be carried out, or that the operator can choose to switch the modes such as the rotation and can carry out all of the options. These modes may be set as selective in, for example, rotation mode combo box 158 on GUI 150.
(Step 168)
The operator may arbitrarily change transparency of the 3-dimensional image as necessary by operating transparency setting scroll bar 155 using an input device such as mouse 16 or keyboard 17 while observing the superimposed image displayed on superimposed image display region 157 on GUI 150. As soon as transparency is changed, the process after the 3-dimensional image construction process in step 164 is executed, and a new superimposed image is constructed.
Accordingly, the target for setting translucent state, that is 3-dimensional image or MPR image can be selected.
While the method for displaying the superimposed image by superimposing the 3-dimensional image and the cut cross-sectional image is described in embodiments 1-4, it may be set so that the cross-sectional image is displayed next to these superimposed images. Also, it can be set to select as to display only 3-dimensional image or to superimpose the images, by on/off switching.
While an example for superimposing the 3-dimensional image and MPR image as to the medical image for one time phase is described in embodiments 1˜4, in relation to an organ with periodic motion such as a heart and there are a plurality of tomogram group for each time phase of the heartbeat being imaged, the superimposed images of the 3-dimensional image and MPR image described in embodiments 1˜4 may be constructed and continuously displayed in cine-mode according to the progression of the time phase of the heartbeat as shown in images 183˜185 of
As for the concrete example shown in
While an example of citing a heart as observation target is described, an organ other than the cardiac muscle such as, for example, a blood vessel or lung may be the target.
The present invention provides a medical image display method, program and device capable of simultaneously displaying a 3-dimensional image including information on the target organ region and an MPR image including information on the surrounding organs of the target organ. This makes it possible to grasp the positional relationship of the target organ configuration and the surrounding organs thereof simultaneously.
Moreover, since only the target organ is displayed 3-dimensionally and the MPR image is used to display the surrounding organs, the calculation time can be shortened and the rotational display or movie display of the images can be executed at high speed.
Furthermore, by setting transparency to the 3-dimensional images or MPR images, it is possible to obtain information on the region hidden behind a 3-dimensional image or the region hidden in the back surface of an MPR image at the same time.
| Number | Date | Country | Kind |
|---|---|---|---|
| 2004-276576 | Sep 2004 | JP | national |
| Filing Document | Filing Date | Country | Kind | 371c Date |
|---|---|---|---|---|
| PCT/JP05/17446 | 9/22/2005 | WO | 3/23/2007 |
