Patent Application
20110018871
The present invention relates to a medical image display device and medical image display method, in particular to a medical image display device and medical image display method capable of providing medical images which are appropriate for diagnosis.
In the conventional techniques, the following two image display methods have been used to diagnose inside of a hollow organ (for example, an intestines).
The conventional technique disclosed in Patent Document 1 displays the condition of organs such as intestines, bronchial tube and blood vessel as a virtual 3-dimensional image while moving an endoscopic viewpoint.
Also, the conventional technique disclosed in Patent Document 2 cuts through a hollow organ along the extended direction, performs panoramic projection on the wall surface of the hollow organ formed in approximately tubular shape, and 2-dimensionally displays it as a deployment image.
Patent Document 1: Japanese Patent No. 3632862
Patent Document 2: JP-A-H8-249492
However, the following problems still remains in the above-mentioned conventional techniques.
The hollow organs in an intestines, etc. have places that the extended direction thereof curves drastically. The conventional technique in Patent Document 1, in the respective viewpoints on the center line which passes through the center of the extended hollow organ (the line that connects the positions on which the viewpoints are sequentially placed in Patent Document 1), generates a pseudo-3-dimensional image in the tangent line direction of the center line. Therefore, when the hollow organ at the position placed slightly beyond the viewpoint curves drastically, the shadow of the drastically curved intestines generates a part that can not be displayed on a pseudo-3-dimensional image.
Also, in the conventional technique of Patent Document 2, in the respective set positions on the center line, a 2-dimensional image is generated based on the result of the projection performed on the plane which is orthogonal to the center line from the set position to the respective directions in the plane. However, in the places where the hollow organ drastically curves, there are cases that the planes which are orthogonal to the center line cross each other between the different respective set positions. In those cases, along with progress of the respective set positions in the hollow organ on the center line, the wall, etc. of the hollow organ often cannot be sequentially projected on the 2-dimensional plane and partly projected while being overlapped, which leads to generation of artifacts on a deployment image.
The objective of the present invention is to provide a medical image display device and medical image display method capable of generating high quality images even in the case that a hollow organ includes the places that curve drastically.
In order to achieve the above-mentioned objective, the image display device of the present invention comprises:
Also, the above-mentioned objective is achieved by the image display device comprising:
Also, the above-mentioned objective is achieved by the image display device comprising:
Also, the above-mentioned objective is achieved by the image display device comprising:
In accordance with the present invention, it is possible to provide a medical image display device and medical image display method capable of generating high quality images even in the case that a hollow organ includes places that bend drastically.
The embodiments of the present invention will be described below referring to the attached diagrams. In all diagrams for explaining the embodiments of the invention, the same function parts are represented by the same reference numerals, and the duplicative description thereof is omitted.
The CT image is used as a medical image and an intestinal canal is cited as a hollow organ which is an observation or diagnosis target in the following embodiments, the present invention is not limited to these embodiments. Any medical images taken by a medical image diagnostic apparatus capable of obtaining a tomographic image of an object such as an MRI apparatus, ultrasonic imaging apparatus, scintillation camera, PET device or SPECT device may be used as a medical image. Also, a hollow organ besides an intestinal canal such as a blood vessel or bronchial tube may be used as a target.
CPU 101 executes computer programs, and controls the respective components that are connected to CPU 101. Concrete examples of the computer program are to acquire the center line passing through near the center of a hollow organ included in medical image data, to calculate the index indicating the degree of bending of the center line such as the curvature at the respective positions on the center line, or to create a virtual endoscope image of the hollow organ to be provided for diagnosis with small strain or a deployment image wherein the hollow organ is sliced open along the extended direction thereof according to the calculated index.
Controller 102 transmits various data such as displacement magnitude data of the position of mouse 103 which is detected by the sensor provided to the mouse or input data of a switch button provided in mouse 103 to CPU 101 via data transfer bus 109. An operator moves a cursor of mouse 103 to an image displayed on display 108 or a switch made by software such as a radio switch. The operator inputs predetermined input data by further clicking mouse 103 at the moved position. Keyboard 104 is an input device for inputting mainly letters such as ID information for specifying the medical image to be read out from magnetic disk 106 or a diagnostic report of the medical image displayed on display 108.
Main memory 105 is used as a working area of computer program such as for loading various computer programs from magnetic disk 106 or storing medical image data or intermediate steps of calculation upon calculation executed by various computer programs. Magnetic disk 106 receives computer program or a tomographic image of an object imaged by medical image diagnostic apparatus 110 via LAN 111 or data transfer bus 109, and stores the received information. Magnetic disk 106 here is a collective term of external storage devices in computer system. The external storage device includes all storage media such as a flexible disk, optical (magnetic) disk, ZIP memory and USB memory. Display memory 107 temporarily stores the data for displaying on a screen from among the calculation result executed by CPU 101 before transmitting signals to display 108.
Display 108 displays the medical images and variety of information thereof which are signal-transmitted from display memory 107.
Data transfer bus 109 transfers data between the respective components connected thereto according to the programs executed to CPU 101.
Medical image diagnostic apparatus 110 is for obtaining tomographic images such as an X-ray CT apparatus. LAN 111 capable of transmitting/receiving signals is used for connecting medical image diagnostic apparatus 110 and medical image display device. LAN may be a public circuit such as the internet.
Next, embodiments 1˜6 will be described referring to the diagrams.
First embodiment of the present invention will be described using
(Step 200)
An operator executes predetermined operations using an input device such as mouse 103 or keyboard 104, and inputs a medical tomographic image taken by medical image diagnostic apparatus 110, for example, a multi-slice image taken by an X-ray CT apparatus to main memory 105. In other words, the main memory is, in the present embodiment, used as storage means for storing the slice images of the object obtained by a medical image diagnostic apparatus.
(Step 201)
CPU 101 extracts the center line of a hollow organ to be the observation target using the hollow organ center line extraction method disclosed in, for example, JP-A-2006-42969 from the medical tomographic image inputted in step 200. More concretely, in paragraph number 0016 (step 63) of JP-A-2006-42969, the method is disclosed, in the region extraction method that extracts a whole blood vessel as moving a viewpoint forward while acquiring the cross-sectional regions which are orthogonal to the extended direction of the blood vessel considering continuity of the blood vessel region, to connect the line which passes the center of the blood vessel region by connecting the barycenters of the respective blood vessel cross-sectional regions acquired in the process of extraction. The present embodiment executes the method based on the above-described method. In this regard, while the center line which is acquired in the present embodiment is a curve, the curve thereof can be depicted by assembly of 3-dimensional positional coordinates formed by a row of multiple points, and the positional coordinate of the respective points are stored in a storage device. In other words, CPU 101 in the present step is used as extraction means to extract the center line passing through the region and the center thereof of the hollow organ of the object from the slice image stored by the storage means.
(Step 202)
CPU 101 sets a viewpoint for generating a virtual endoscope image, on the center line. In this embodiment, however, the viewpoint is set on the center line which is extracted in step 201 to display a virtual image by a moving image in such a way that as if an actual endoscope moves through inside of the hollow organ and gradually while renewing the viewpoint from one end to the other end of the center line. In other words, CPU 10 is to be used in the present embodiment as 3-dimensional image generation means for generating a virtual 3-dimensional image of the inner wall of the hollow organ viewed from the viewpoint being sequentially moved from one end to the other end of the center line as to be described in the steps below. Therefore, in step 202, one end of the center line which is extracted in step 201 is set first as the initial position of the viewpoint, the position of viewpoint is sequentially and gradually moved until it reaches the other end, and the process of step 203˜209 are to be repeated as to be described below. Hereinafter, steps 203˜209 which are to be executed while moving the viewpoint in step 202 will be described in order.
(Step 203)
CPU 101 calculates, at each viewpoint set in step 202, direction vector DE which makes the length 1, in the tangent line direction at the viewpoint. More concretely, CPU 101 calculates the direction vector of the line segment which connects each viewpoint and the adjacent viewpoint thereof from the assembly of the 3-dimensional positional coordinates used for depicting the center line, and adjusts the length of the vector to be unit length (1). In the present step, for example, as shown in
(Step 204)
CPU 101 sets a reference point on the center line. Here, the reference point is to be used for calculating the degree of the curve in the vicinity of each viewpoint set in step 202. For example, the point which is moved forward from viewpoint 302 alongside of center line 301 for the portion of distance L is set as reference point 304. The value which is empirically obtained in advance may be constantly used for distance L, or an operator may arbitrarily set distance L using an input device such as mouse 103 or keyboard 104.
(Step 205)
CPU 101 calculates direction vector DR which makes its length 1 at the reference point set in step 204 using the same method as in step 203. For example, direction vector DR is to be calculated as direction vector 305 in the tangent line direction of the center line at reference point 304 as shown in
(Step 206)
CPU 101 obtains index C indicating the degree of the curve (hereinafter referred to as “curve value”) using direction vector DE at the viewpoint which is acquired in step 203 and direction vector DR at the reference point which is acquired in step 205. For example, index C sets inner product of the two vectors as the curve value as shown in expression 1.
C={right arrow over (DE)}•{right arrow over (DR)} (expression 1)
When the inner product as shown in the expression (1) is selected as index C, if the value is greater the curve becomes moderate and if the value is smaller the curve becomes sharper.
(Step 207)
CPU 101 obtains direction vector DV for creating a virtual endoscope image using the curve value C which is acquired in step 206. For example, direction vector DV is set according to expression (2).
{right arrow over (DV)}={right arrow over (DE)}+α(1.0−C){right arrow over (DR)} (expression 2)
Here, the coefficient which is empirically determined may be used for proportionality constant “a”, or an operator may arbitrarily set the coefficient for proportionality constant “a” using an input device such as mouse 103 or keyboard 104. For example, direction vector DV in which the virtual endoscope image is created is to be calculated as direction vector 306 as shown in
(Step 208)
CPU 101 creates a virtual endoscope image in direction DV which is acquired in step 207 using the method for creating the virtual endoscope image disclosed, for example, in Patent Document 1. Therefore in the present embodiment, according to the curve of the hollow organ, CPU 101 is used as means to change the direction in which the virtual 3-dimensional image viewed from the viewpoint, to the direction of the curve.
Here, value which is empirically determined may be used for the view range for creating the virtual endoscope image (hereinafter referred to as “view angle”), or an operator may arbitrarily set the view angle using an input device such as mouse 103 or keyboard 104.
(Step 209)
CPU 101 displays the virtual endoscope image created in step 208 on display 108.
As described above, the medical image display device and the medical image display method in the present embodiment is effective in improving accuracy in examining the inner wall area of a hollow organ of an object, since even the portion in the viewpoint that is shaded due to the region which curves drastically in a virtual endoscope image can be seen by the fine adjustment of the direction vectors for creating the virtual endoscope image. As a result, it is possible to reduce the possibility of missing diseased areas in observation of a diagnostic image.
For example,
While the curve value is defined here as expression 1, different values such as curvature may be used for the curve value. It is preferable to use the index wherein calculation can be quickly executed as in expression 1.
Also, for parameter L or proportionality constant “a” for calculating the curve value, the value of a function having the viewpoint angle of the virtual endoscope as variable may be set instead of using the values which are empirically acquired or arbitrarily set by an operator. For example, when the view angle is large, it is preferable to set a small value of distant L or proportionality constant “a” since the influence due to drastic change in the extending direction of the hollow organ is not very great. Also, when the view angle is small, it is preferable to set a large value of distant L or proportionality constant “a” large since the influence due to drastic change in the extending direction of the hollow organ is great.
Also, in the present embodiment, since the direction in which a virtual 3-dimensional image is created is changed according to the expression (2), means to change the direction for creating the virtual 3-dimensional image viewed from the viewpoint to the direction of the bending curvature is capable of changing the direction for creating the virtual 3-dimensional image viewed from the viewpoint more greatly when the degree of bending curvature is greater. In the present embodiment, degree of the bending curvature is expressed in the expression (1), by the inner product of the unit vector in the tangent line direction at each viewpoint position and the unit vector in the tangent line direction at the position which is apart from each specified position for a predetermined distance.
Embodiment 2 in the present invention will be described referring to
Step 600˜step 607 will be omitted here since they are practically the same as step 200˜step 207 in embodiment 1. In the present embodiment, a viewpoint is replaced by a target point, and a virtual endoscope image is replaced by a deployment image.
(Step 608)
CPU 101 executes the rendering process, as shown in
(Step 609)
CPU 101 displays the deployment image which is obtained by repeating the process of steps 602˜608 at the respective target points on the center line, on display 108.
CPU 101 is used as means to create a deployment image of the hollow organ, while moving a target point from one end to the other end of the center line, by executing the rendering process on the cross section which passes through the target point and is orthogonal to the center line, and is also used as means to change the direction for setting the cross section according to the bending curvature of the hollow organ so as to prevent generation of artifacts.
In this embodiment, since the direction in which a deployment image is created is changed according to the expression (2) shown in embodiment 1, means to change the direction for creating the deployment image viewed from the target point to the direction of the bending curvature is capable of changing the direction for creating the deployment image viewed from the target point more greatly when the degree of bending curvature is greater. In the present embodiment, degree of the bending curvature is expressed in the expression (1), by the inner product of the unit vector in the tangent line at each viewpoint position and the unit vector in the tangent line at the position which is apart from each specified position for a predetermined distance. Also, degree of the bending curvature may be expressed by the measure of the curvature at the respective target points.
As described above, the medical image display device and medical image display method of the present embodiment is effective in improving accuracy in examining an inner wall area of a hollow organ of an object where the hollow organ drastically curves. The specific effect of the present embodiment is that deployment images, more specifically the inner wall, etc. of a hollow organ with less strain even in sharp curves is sequentially projected on a 2-dimensional plane, and is possible to provide deployment images without partially overlapped projection thus without artifacts.
On the other hand, by using the present embodiment as shown in
Embodiment 3 of the present embodiment will be described referring to
(Step 1000)
An operator executes a predetermined operation using an input device such as mouse 103 or keyboard 104, and inputs the medical tomographic image which is taken by medical image diagnostic apparatus 110 (for example, a multi-slice image) to main memory 105.
(Step 1001)
CPU 101 extracts the center line of the target hollow organ from the medical tomographic image inputted in step 1000 using the center-line extracting method of hollow organs disclosed in, for example, JP-A-2006-42969 as described in embodiment 1.
(Step 1002)
CPU 101 sets the target point for calculating the index which indicates the degree of a curve in the hollow organ (hereinafter referred to as “curve value”) on the center line. More concretely, in the present embodiment, by moving the position of the target point in small steps from the start point to the end point of the center line extracted in step 1001, and repeats the curve value calculation process indicated below in steps 1003˜1006.
(Step 103)
CPU 101 calculates direction vector DE which makes the measure 1 in the tangent direction of the target point at each target point set in step 1002 using the method described in step 203 of embodiment 1.
(Step 104)
CPU 101 sets a reference point on the center line using the method described in step 204 of embodiment 1 (step 1005).
CPU 101 calculates direction vector DR which makes the length 1 at the reference point set in step 1004 using the same method as step 203.
(Step 1006)
CPU 101 obtains index C which indicates the degree of a curve (hereinafter referred to as a “curve value”) using direction vector DE of the target point acquired in step 1003 and direction vector DR of the reference point acquired in step 1005, using the method described in step 206 of embodiment 1. For example, as shown in expression (3), the inner product of the two vectors is set as the curve value in index C.
C={right arrow over (DE)}•{right arrow over (DR)} (expression 3)
(Step 1007)
CPU 101 acquires the focal point to be used for creating a deployment image in steps 1007˜1009. For that purpose, range of the target point for setting the focal point to be used for creating the deployment image is set on the center line. The range of the target point is to be set, out of all the points from the start point to the endpoint on the center line extracted in step 1001, at the point wherein the curve value acquired in step 1006 is less or equal than a predetermined value. While the threshold value need to be set so that a sharp curve region falls within the value equal or less than the predetermined value, the threshold value maybe the empirically determined value or the value set by an operator as desired using an input device such as mouse 103 or keyboard 104.
(Step 1008)
CPU 101 obtains the point to be at the peak of the curve out of the continuing points, from among the target points which belong to the sharp curve region set in step 1007. The apex of the curve can be obtained, for example, by acquiring the displacement of the coordinate which forms the center line by second order differential, and using the inflexion point thereof. For example, as shown in
(Step 1009)
CPU 101 obtains the focal point to be used for creating a deployment image using the apex coordinate of the curve acquired in step 1008. The method for acquiring the focal point will be described using
(Step 1010)
CPU 101 sets a target point for creating a deployment image. Here, the viewpoint belongs to the portion from the start point to the end point of the range for creating the deployment image out of the center line which is extracted in step 1001, and steps 1010˜1012 are to be repeated while renewing the viewpoint.
(Step 1011)
CPU 101 sets the plane for executing the rendering including the target point for the creation of the deployment image. In this setting, the setting method is changed depending on whether the target point belongs to the sharp curve region acquired in step 1008 or not. When the viewpoint does not belong to the sharp curve region, the cross section which passes through the viewpoint and is orthogonal to the center line is set as the rendering plane. On the other hand, the rendering plane setting method in the case that the viewpoint belongs to the sharp curve region will be described using
(Step 1012)
CPU 101 executes the rendering process by radially setting the line segments which is referred to as the ray from the target point on the center line toward intraluminal wall with respect to the plane set in step 1011. The rendering result in the respective rays is set as the pixel value of the corresponding pixels on the deployment image.
(Step 1013)
CPU 101 displays the deployment image created by the processes up to step 1012 on display 108.
As described above, the medical image display device and medical image display method of the present embodiment is effective in improving accuracy in examining the inner wall area in the observing organ of an object in the region where the hollow organ drastically curves. Also, the specific effect of the present embodiment is to provide deployment images with less strain even in sharp curve regions, which leads to improvement of diagnostic efficiency.
While the curve value is defined as seen in expression 3 here, other values such as curvature may be used as the curve value. In this regard, however, that it is desirable that the index can be calculated quickly as in expression 3.
Embodiment 4 of the present invention will be described below using
In embodiment 1, the method for reducing dead spaces upon creating virtual endoscope images is exemplified. In embodiment 4, the case will be exemplified that the created virtual endoscope image and the direction of the central viewpoint thereof are displayed on graphical user interface (hereinafter referred to as GUI).
CPU 101 displays the virtual endoscope image at the respective viewpoints created by the processing flow shown in
On 3-dimensional image 1502, the viewpoint direction of the virtual endoscope image is displayed as arrow 1505 at the position corresponding to the display viewpoint number. In this manner, the medical image display device and medical image display method of the present embodiment is effective in improving efficiency and accuracy in examining the inner wall area of a hollow organ in an object in the region where the hollow organ drastically curves. Also, the specific effect of the present embodiment is that the position and the direction in which a virtual endoscope image viewed at the present time can be recognized at a glance.
As shown in
Embodiment 5 of the present invention will be described below referring to
d=k(C+1) (4)
Here, value which is empirically obtained may be used for k, or an operator may arbitrarily set k using an input device such as mouse 103 or keyboard 104. For example, on hollow organ 1600, the interval between viewpoints in the region of the hollow organ having a sharp curve become narrow as seen in viewpoint 1601 and viewpoint 1602, and the interval between viewpoints in the region having a moderate curve become wide as seen in viewpoint 1603 and viewpoint 1604.
In other words, in the present embodiment, the intervals between viewpoints to be sequentially moved are varied in accordance with bending curvature of the hollow organ.
In this manner, the medical image display device and medical image display method of the present embodiment is effective in improving efficiency and accuracy in examining the inner wall area of a hollow organ of an object in the region where the hollow organ drastically curves. Also, the specific effect of the present embodiment is, in the case that the operator performs observation while renewing the viewpoint such as creating virtual endoscope images, that accuracy in observing the curve region where it is easy to miss the information can be improved since the intervals of viewpoints are narrower in sharper curves. Also, the present embodiment can be applied also to interval setting of target points in the case of sequentially creating deployment images described in embodiment 2.
Embodiment 6 of the present invention will be described below referring to
In embodiment 2 and embodiment 3, the method for creating a deployment image of a hollow organ while reducing strain is exemplified. In embodiment 6, the case that the relationship between the position on the created deployment image and the position on the 3-dimensional image thereof is displayed on graphical user interface (hereinafter referred to as GUI) will be exemplified.
CPU 101 displays the deployment image created by the processing flow shown in
The preferable embodiments of the medical image display device and medical image display method according to the present invention have been described above. However, the present invention is not limited to these embodiments. It is obvious that persons skilled in the art can make various kinds of alterations or modifications within the scope of the technical idea disclosed in this application, and it is understandable that they belong to the technical scope of the present invention.
| Number | Date | Country | Kind |
|---|---|---|---|
| 2008-072807 | Mar 2008 | JP | national |
| Filing Document | Filing Date | Country | Kind | 371c Date |
|---|---|---|---|---|
| PCT/JP2009/054871 | 3/13/2009 | WO | 00 | 9/17/2010 |
