The present invention relates to a medical image diagnosing support method and apparatus for accurately displaying a progression of pulmonary emphysema.
The present application claims the benefit of the priority under the Paris Convention based on a Japanese Patent Application No. 2004-222711 according to Japanese Patent Law, and claims the benefit of the Japanese Patent Application No. 2004-222711 which is incorporated herein by reference.
Pulmonary emphysema is a disease featured by the irreversible progression after occurrence. So it is an important technology that can provide image diagnosing information which allows an early detection of pulmonary emphysema and an assessment of progression of the pulmonary emphysema, to doctors.
Actually, an image diagnosing technology for assessing a progression of pulmonary emphysema includes: extracting a lung field region and a pulmonary emphysema region from a tomographic image having the entire lung field region based on thresholds; calculating a ratio of the pulmonary emphysema region to the entire lung field region; and displaying the outer contour of the pulmonary emphysema region in different colors depending on the value of the ratio so that the progression of pulmonary emphysema can be intuitively understood (for example, see Japanese Patent Application Laid-Open No. 2003-10171).
Patent Document: Japanese Patent Application Laid-Open No. 2003-10171
However, in the extraction method disclosed in the Japanese Patent Application Laid-Open No. 2003-10171, there is a possibility of an excess extraction since extra several pixels are extracted to be added to the original size of a pulmonary emphysema region. That is, the Japanese Patent Application Laid-Open No. 2003-10171 was made without consideration for enhancing accuracy in extracting a pulmonary emphysema region.
In an aspect of this disclosure, there is provided a medical image diagnosing support method and apparatus, and an image processing program which can achieve improved accuracy in extracting a pulmonary emphysema region.
In another aspect of this disclosure, there is provided a medical image diagnosing support method that includes: a site region extracting step for obtaining a tomographic image which is picked up by a medical image diagnosing apparatus and extracting a predetermined site region from the obtained tomographic image; a first region extracting step for extracting a first lesion candidate region from the site region based on pixel values of the site region extracted in the predetermined site region extracting step; a second region extracting step for extracting a second lesion candidate region from the site region based on a distribution of the pixel values of the site region extracted in the predetermined site region extracting step; and a region correcting step for correcting the first lesion candidate region extracted in the first region extracting step by using the second lesion candidate region extracted in the second region extracting step.
The predetermined site is preferably the lung, and the lesion candidate is preferably the pulmonary emphysema herein. However, since the site may be lumen organs such as the enteric canal, and the lesion candidate may be applied to detect cancer cells, the term “predetermined site” and the term “lesion candidate” are used herein.
In another aspect, there is provided a medical image diagnosing support apparatus that includes: a site region extracting device which obtains a tomographic image which is picked up by a medical image diagnosing apparatus and extracts a predetermined site region from the obtained tomographic image; a first region extracting device which extracts a first lesion candidate region from the site region based on pixel values of the site region extracted by the predetermined site region extracting device; a second region extracting device which extracts a second lesion candidate region from the site region based on a distribution of the pixel values of the site region extracted by the predetermined site region extracting device; and a region correcting device which corrects the first lesion candidate region extracted by the first region extracting device by using the second lesion candidate region extracted by the second region extracting device.
In another aspect, there is provided an image processing program that enables a computer to execute: a reading step for reading a tomographic image picked up by a medical image diagnosing apparatus; a site region extracting step for extracting a predetermined site region from the obtained tomographic image; a first region extracting step for extracting a first lesion candidate region from the site region based on pixel values of the site region extracted in the predetermined site region extracting step; a second region extracting step for extracting a second lesion candidate region from the site region based on a distribution of the pixel values of the site region extracted in the predetermined site region extracting step; a region correcting step for correcting the first lesion candidate region extracted in the first region extracting step by using the second lesion candidate region extracted in the second region extracting step; and a displaying step for displaying the first lesion candidate region.
Thus, the accuracy in extracting a lesion candidate region can be improved.
A medical image diagnosing support apparatus includes a central processing unit (CPU) 10, a medical tomographic image pickup apparatus 11, a magnetic disk 13, a main memory 14, a mouse 15 and a mouse controller 16, a key board 17, a display memory 18, a CRT display 19, a printer 20, local area network (LAN) 12 and a common bus 12a for electrically connecting each of the above components.
The CPU 10 controls the operation of each of the above components. The medical tomographic image pickup apparatus 11 is a medical image diagnosing apparatus such as an X-ray CT apparatus, a magnetic resonance imaging apparatus, an ultrasound image diagnosing equipment, and a nuclear medical apparatus which can measure tomographic images of an object to be examined. The LAN 12 means not only a short-range network, but also the one which enables a connection to various communication networks such as the Internet and a telephone line, and allows sending and receiving of image data between the apparatus and the other computer or a data base. The magnetic disk 13 stores a plurality of tomographic image data of patients, operation programs, and the like. The main memory 14 stores control programs for the medical image diagnosing support apparatus. The mouse 15 and the mouse controller 16 are used to manipulate soft switches on a screen. The key board 17 is used to set various parameters. The display memory 18 temporarily stores image data for displaying. The CRT display 19 displays images based on the image data obtained from the display memory 18. The printer 20 outputs a report as a diagnostic imaging result, for example.
In this embodiment, only the magnetic disk 13 is connected to the apparatus as a memory unit other than the main memory 14, but a FDD, a hard disk drive, a CD-ROM drive, an optical magnetic disk (MO) drive, a ZIP drive, a PD drive, and a DVD drive may be connected as well.
Operations of the diagnostic image diagnosing support apparatus of
First, when a screen to input an ID of an object to be examined is displayed on the display 19 of the medical image diagnosing support apparatus, an operator inputs an ID number of a patient. Then, a target tomographic image to be diagnosed which corresponds to the patient ID number among tomographic images picked up in advance by the medical tomographic image pickup apparatus 11 is read out from the magnetic disk 13.
[Step S21]
The CPU 10 calls a subroutine to perform a lung field region extracting processing to the read out tomographic image.
[Step S31]
A threshold processing is applied to the read out tomographic image to generate a binary image. A threshold at this point is set to be a value which distinctly separate target regions to be calculated. Alternatively, a CT value for the highest frequency in the range of CT values of the tomographic image may be set to the median to calculate the lower limit and the upper limit of the range of CT values so that the calculated thresholds can be set to be the lower limit and the upper limit of the range of CT values.
[Step S32]
A labeling processing for individual identification is applied to the binary image generated at Step S30, to generate a two-dimensional label image.
[Step S33]
A label region having the largest area is extracted as a target region to be calculated from the label image which is two-dimensionally generated at Step S32.
[Step S34]
A filling processing is applied to a missing part between adjacent regions in the target region to be calculated at Step S33 to generate a body region.
[Step S35]
A determination identification processing is applied to the region extracted at Step S33 and the body region generated at Step S34 to extract a lung field region. Then the processing goes to step 22 of
[Step S22]
Next, a subroutine is called to a perform trachea/bronchial tube region eliminating processing.
Now, the trachea/bronchial tube region eliminating processing will be explained in detail in the order of the steps therein.
[Step S41]
The trachea/bronchial tube region is eliminated from the lung field region extracted at Step S21 by utilizing the characteristic shape of the trachea/bronchial tube region. This processing may be performed by eliminating small regions which are isolated in the lung field region around its centroid from the lung field region of each tomographic image.
[Step S42]
The parts of the trachea/bronchial tube region extracted at Step S41 which are overlapped with the lung field region extracted at Step S21 are eliminated. Then the processing goes to step 23 of
[Step S23]
Next, a subroutine is called to perform an enteric canal eliminating processing. In this processing, a part where the lung field is in contact with the diaphragm is eliminated since the contacting part is influenced by the intestine. In this processing, the centroid of the lung field region extracted at Step S21 and Step S22 is set to be the starting point, and the processings of
[Step S51]
It is determined if there is a lung field region at the same position between the axial slices, in the lung field region extracted at Step S21 and Step S22. When there is an overlapped lung field region, the next slice is processed. When there is no overlapped lung field region, the processing goes to Step S52.
[Step S52]
The region having no overlap between the axial slices is eliminated. Then the processing goes to step 24 of
Alternatively, instead of the processings in
[Step S24]
Next, a subroutine is called to perform a lung field region dividing processing. In this processing, the lung field may be divided into upper right/middle/lower lung fields, or upper right/lower lung fields, but the lung field may be divided into the inner and outer parts in each tomographic image.
[Step S61]
In the lung field region extracted at steps S21 to S23, the peripheral portion of the lung field region extracted in each tomographic image is identified.
[Step S62]
A circle region around the pixel at the peripheral portion identified at Step S61 is set to be a mask region. The radius of the region is set to be 2 cm as an initial value, but may be set to be any value by an operator.
[Step S63]
A processing for discriminating and identifying between the lung field region extracted at steps S21 to S23 and the mask region set at Step S62 is performed. The part of the lung field region which is overlapped with the mask region is set to be a lung field outside region, while the part of the lung field region which is not overlapped with the mask region is set to be a lung field inside region. Then the processing goes to step 25 of
[Step S25]
Next, a subroutine is called to perform a pulmonary emphysema region detecting processing.
[Step S71]
A threshold processing is applied to the lung field region extracted at steps S21 to S23 to generate a binary image. The threshold in this processing is set to be −910 which is lower than a mean CT value in the lung field of a normal object to be examined. Alternatively, a threshold may be set based on an analysis result obtained by using a discriminant analysis method.
[Step S72]
From the pulmonary emphysema region extracted at Step S71, regions having a diameter of less than 3 mm which are believed to be the alveoli are eliminated.
[Step S73]
For the lung field region extracted at steps S21 to S23, a distribution of the CT values in the target region 81 of
The above distribution of the CT values is calculated by using at least one of the area ratio, the mean ratio, and the standard deviation ratio of the predetermined site region and the lesion candidate region.
The area ratio can be obtained most easily only by counting the number of pixels in each region, and the mean ratio and the standard deviation ratio can improve the accuracy in detecting a lesion candidate region more than the area ratio because the mean ratio and the standard deviation ratio use pixel values of the region. A combination of the area ratio, the mean ratio, and the standard deviation ratio can further improve the accuracy in detecting a lesion candidate region.
The distribution of the CT values may be calculated by dividing the lung field region in at least two parts and using at least one of the area ratio, the mean ratio, and the standard deviation of the divided predetermined site regions and the pulmonary emphysema region. This allows the area ratio, the mean ratio, and the standard deviation to be calculated based on the local pixel values of the divided regions, so that a detailed adjustment for the accuracy in detecting a lesion candidate region can be achieved compared to the case in which the entire site region is used.
[Step S74]
Only the part of the region extracted at Steps S71 and S72 which is overlapped with the region extracted at Step S73 is extracted. Then the processing goes to step 26 of
[Step S26]
Next, a subroutine is called to perform an analyzing processing. Based on the information of the lung field region extracted at Steps S21 to S23, the lung field region divided at Step S24, and the pulmonary emphysema region extracted at Step S25, on a per tomographic image basis, the area, the mean value, the standard deviation, and the upper limit and lower limit of the 95% confidence interval relative to the mean value of the lung field region, and the area, the mean value, the standard deviation, and the upper limit and lower limit of the 95% confidence interval relative to the mean value of the pulmonary emphysema region are calculated to form pairs with the corresponding values. Similarly, on an entire lung field and each lung field unit basis, analysis results are calculated. In this embodiment, the range of confidence interval relative to the means value is initially set to 95%, but may be set to any other percentage by an operator.
[Step S27]
Next, a measurement result displaying processing is executed. Based on the analysis result for the entire lung field at Step S26, the pulmonary emphysema region is displayed in a different color.
A screen 101 displays a read-in tomographic image, a screen 102 displays a display image of a measurement result, and a screen 103 displays analysis results. The screen 103 of
In the above display, the tomographic image and the lesion candidate region may be superimposed to be displayed.
This enables a diagnosis to be intuitively made on the position relationship between the tomographic image and the lesion candidate region.
Alternatively, in the above display, the lesion candidate region may be displayed next to the tomographic image.
This allows the pixel value of the tomographic image which would be hidden in the superimposed display to be analyzed.
Alternatively, in the above display, a soft switch for switching between display/non-display modes of the lesion candidate region may be displayed on the display screen so that the display can be selected using a pointing device. This enables an operator to select only the tomographic image to be displayed for diagnosis, or both of the tomographic image and the lesion candidate region to be displayed.
Alternatively, the analysis results for each tomographic image such as those shown as the reference numeral 103 in
The medical image diagnosing support apparatus stores the information of the regions around the bronchial tubes shown in
When an operator clicks the pulmonary emphysema region displayed on the display 19 using the mouse 16, the pop-up window 123 of
This embodiment includes: the extracting step 21 for obtaining a tomographic image which is picked up by the medical tomographic image pickup apparatus 11, and extracting a predetermined site region from the obtained tomographic image; the steps 22 to 24 for extracting a first lesion candidate region from the site region based on pixel values of the site region extracted in the predetermined site region extracting step; the step 25 for extracting a second lesion candidate region from the site region based on a distribution of pixel values of the extracted site region; and the step 26 for correcting the first lesion candidate region extracted in the first region extracting step by using the extracted second lesion candidate region.
These steps enable any extraction errors occurred in a lesion candidate region which are caused by individual differences such as a body type of objects to be examined to be corrected.
The image processing program includes: a reading section for reading a tomographic image from an image database which is connected via the medical tomographic image pickup apparatus 11, the magnetic disk 23, or the LAN 12; a site region extracting section 10b for extracting a predetermined site (for example, lung region) from the read-in tomographic image; a first region extracting section 10c for extracting a first lesion candidate region from the predetermined site region based on pixel values of a predetermined site region; a second region extracting section 10d for extracting a second lesion candidate region from the predetermined site region based on pixel values of the predetermined site region; a region correcting section 10e for correcting the first lesion candidate region by using the second lesion candidate region; and a display controlling section 10f for displaying the first lesion candidate region. The display controlling section 10f controls displays on the screen 103 of
In the above embodiment, various processings are performed based on tomographic images which are read in, but similar processings can be performed based on projection images which are picked up by using X-ray diagnostic apparatuses or DR apparatuses as well as the tomographic images.
The present invention can be applied to not only to image processings based on medical images but also to a general technology for processing images in which a first pixel values region and a second pixel values region are extracted from images which are read in advance, and the first pixel values region is corrected based on the second pixel values region.
Number | Date | Country | Kind |
---|---|---|---|
2004-222711 | Jul 2004 | JP | national |
Filing Document | Filing Date | Country | Kind | 371c Date |
---|---|---|---|---|
PCT/JP2005/013819 | 7/28/2005 | WO | 00 | 1/25/2007 |
Publishing Document | Publishing Date | Country | Kind |
---|---|---|---|
WO2006/011545 | 2/2/2006 | WO | A |
Number | Name | Date | Kind |
---|---|---|---|
5319551 | Sekiguchi et al. | Jun 1994 | A |
5732121 | Takeo et al. | Mar 1998 | A |
6363163 | Xu et al. | Mar 2002 | B1 |
6463167 | Feldman et al. | Oct 2002 | B1 |
20020009215 | Armato et al. | Jan 2002 | A1 |
20030018245 | Kaufman et al. | Jan 2003 | A1 |
20030103665 | Uppaluri et al. | Jun 2003 | A1 |
20030179915 | Goto | Sep 2003 | A1 |
20040086162 | Doi et al. | May 2004 | A1 |
20040101089 | Karau et al. | May 2004 | A1 |
20040120561 | Goto | Jun 2004 | A1 |
20060050943 | Ozaki et al. | Mar 2006 | A1 |
Number | Date | Country |
---|---|---|
8-110939 | Apr 1996 | JP |
9-167238 | Jun 1997 | JP |
2845995 | Jan 1999 | JP |
2003-10171 | Jan 2003 | JP |
2003-70781 | Mar 2003 | JP |
2004-180932 | Jul 2004 | JP |
Number | Date | Country | |
---|---|---|---|
20080298658 A1 | Dec 2008 | US |