The invention relates generally to methods and an apparatus for identifying regions in images, and more particularly to methods and apparatus for labeling anatomical structures in medical images.
In many imaging applications, specifically medical imaging applications, the images are often analyzed to identify various anatomical structures such as organs, lesions, etc. For example, a chest X-ray radiograph or a computed tomography (CT) image can be employed to facilitate the detection of lung cancer. Specifically, CT images advantageously provide a description of anatomy in great detail and consequently is being increasingly are used for detecting and following the evolution of lesions that may lead to potential cancers.
For example, for the detection of lung and colon cancer, radiologists search for the presence of nodules and polyps in the lung and colon using advanced lung analysis (ALA) and computed tomographic colonography (CTC) techniques. Radiologists detect nodules in the lung by viewing axial slices of the chest. However, CT systems generally provide several images for a single CT scan. Consequently, a considerable amount of information is presented to the radiologist for use in interpreting the images and detecting suspect regions that may indicate disease. The considerable amount of data associated with a single CT scan presents a time-consuming process to the radiologist. Furthermore, this substantial amount of data may disadvantageously lead to missed cancer detection, as it is difficult to identify a suspicious area in an extensive amount of data. In addition, the sheer size of the CT volumes results in significant variability in radiological readings and clinically important nodules are missed.
Techniques variously described as computer aided detection, or computer assisted detection or computer assisted diagnosis, and often referred to by the acronym “CAD” have emerged as a viable approach for aiding the radiologists in the detection of lung nodules in chest radiographs and thoracic CT scans, as well as for detecting and diagnosing other anatomies and disease states.
Several CAD techniques have been developed to highlight the anatomical structures present in various regions in the image. In one specific technique, the regions are identified and labeled according to the local shape of their surrounding structures. In one more specific technique used to identify lung cancer, an Eigen analysis of a Hessian matrix is used as a tool to classify voxels as belonging to a vessel or a nodule. However, such techniques consider a very small neighborhood of each voxel needed to compute image derivatives and thus are not very robust and/or accurate in identifying the structures.
It may therefore be desirable to develop a robust technique and system for processing image data that advantageously facilitates substantially superior initial shape-based identification of regions in an image that can be consequently used for the analysis of the object being examined.
Briefly, according to one embodiment of the invention, a method for assigning labels to regions in an image is provided. The method comprises deriving a probabilistic model for a plurality of geometrical structures, computing a regional response around a region in the image, computing a region score for each geometrical structure using the plurality of probabilistic models and labeling the region in the image based on the region score.
In another embodiment, a medical imaging system for labeling anatomical structures in an image is provided. The system comprises an image processor configured to compute a regional response around a voxel of interest in the image, compute a voxel score for each anatomical structures based on a plurality of probabilistic models, label the voxel in the image based on the region score and a display unit configured to display the image including the labeled anatomical regions.
In another embodiment, a computed tomography (CT) system for labeling anatomical structures in a CT image is provided. The system comprises an image processor configured to compute a regional response around a voxel of interest in the CT image, compute a voxel score for each anatomical structures based on a plurality of probabilistic models, label the voxel in the image based on the region score. The system further comprises a display unit configured to display the CT image including the labeled anatomical structures.
In another embodiment, a computer-readable medium storing computer instructions for instructing a computer system to labeling regions in an image. The computer instructions include deriving a probabilistic model for a plurality of geometrical structures, computing a regional response around a region in the image, computing a region score for each geometrical structure using the plurality of probabilistic models and labeling the region in the image based on the region score.
These and other features, aspects, and advantages of the present invention will become better understood when the following detailed description is read with reference to the accompanying drawings in which like characters represent like parts throughout the drawings, wherein:
The source of radiation 12 may be positioned near a collimator 14, which may be configured to shape a stream of radiation 16 that is emitted by the source of radiation 12. The stream of radiation 16 passes into the imaging volume containing the subject to be imaged, such as a human patient 18. The stream of radiation 16 may be generally fan-shaped or cone-shaped, depending on the configuration of the detector array, discussed below, as well as the desired method of data acquisition. A portion 20 of radiation passes through or around the subject and impacts a detector array, represented generally at reference numeral 22. Detector elements of the array produce electrical signals that represent the intensity of the incident X-ray beam. These signals are acquired and processed to reconstruct an image of the features within the subject.
The radiation source 12 is controlled by a system controller 24, which furnishes both power, and control signals for CT examination sequences. Moreover, the detector 22 is coupled to the system controller 24, which commands acquisition of the signals generated in the detector 22. The system controller 24 may also execute various signal processing and filtration functions, such as for initial adjustment of dynamic ranges, interleaving of digital image data, and so forth. In general, system controller 24 commands operation of the imaging system to execute examination protocols and to process acquired data. In the present context, system controller 24 also includes signal processing circuitry, typically based upon a general purpose or application-specific digital computer, associated memory circuitry for storing programs and routines executed by the computer, as well as configuration parameters and image data, interface circuits, and so forth.
In the embodiment illustrated in
Additionally, as will be appreciated by those skilled in the art, the source of radiation 12 may be controlled by an X-ray controller 30 disposed within the system controller 24. Particularly, the X-ray controller 30 is configured to provide power and timing signals to the X-ray source 12.
Further, the system controller 24 is also illustrated comprising a data acquisition system 34. In this exemplary embodiment, the detector 22 is coupled to the system controller 24, and more particularly to the data acquisition system 34. The data acquisition system 34 receives data collected by readout electronics of the detector 22. The data acquisition system 34 typically receives sampled analog signals from the detector 22 and converts the data to digital signals for subsequent processing by a computer 36.
The computer 36 typically is coupled to or incorporates the system controller 24. The data collected by the data acquisition system 34 may be transmitted to the computer 36 for subsequent processing and reconstruction. The computer 36 may include or communicate with a memory 38 that can store data processed by the computer 36 or data to be processed by the computer 36. It should be understood that any type of memory configured to store a large amount of data might be utilized by such an exemplary system 10. Moreover, the memory 38 may be located at the acquisition system or may include remote components, such as network accessible memory media, for storing data, processing parameters, and/or routines for implementing the techniques described below.
The computer 36 may also be adapted to control features such as scanning operations and data acquisition that may be enabled by the system controller 24. Furthermore, the computer 36 may be configured to receive commands and scanning parameters from an operator via an operator workstation 40, which is typically equipped with a keyboard and other input devices (not shown). An operator may thereby control the system 10 via the input devices. Thus, the operator may observe the reconstructed image and other data relevant to the system from computer 36, initiate imaging, and so forth.
A display 42 coupled to the operator workstation 40 may be utilized to observe the reconstructed image. Additionally, the scanned image may also be printed by a printer 44, which may be coupled to the operator workstation 40. The display 42 and printer 44 may also be connected to the computer 36, either directly or via the operator workstation 40. The operator workstation 40 may also be coupled to a picture archiving and communications system (PACS) 46. It should be noted that PACS 46 might be coupled to a remote system 48, radiology department information system (RIS), hospital information system (HIS) or to an internal or external network, so that others at different locations may gain access to the image data. Additionally, a computer aided diagnosis (CAD) unit 50 may be operably coupled to the computer 36. It may be noted that the CAD unit 50 may include software configured to apply a CAD algorithm to the image data. Further, the CAD unit 50 may also be coupled to the display 42, where the image data may be displayed on the display. In practice, the CAD unit 50 may be part of the data acquisition system 34, or may be a completely separate component, typically remote from the data acquisition system 34, and configured to analyze image data stored on a memory, such as the PACS 46.
It should be further noted that the computer 36 and operator workstation 40 may be coupled to other output devices, which may include standard or special purpose computer monitors and associated processing circuitry. One or more operator workstations 40 may be further linked in the system for outputting system parameters, requesting examinations, viewing images, and so forth. In general, displays, printers, workstations, and similar devices supplied within the system may be local to the data acquisition components, or may be remote from these components, such as elsewhere within an institution or hospital, or in an entirely different location, linked to the image acquisition system via one or more configurable networks, such as the Internet, a virtual private network or the like.
As noted above, an exemplary imaging system utilized in a present embodiment may be a CT scanning system 52, as depicted in greater detail in
In typical operation, the X-ray source 12 projects an X-ray beam from the focal point 62 and toward detector array 22 (see
Thus, as the X-ray source 12 and the detector 22 rotate, the detector 22 collects data related to the attenuated X-ray beams. Data collected from the detector 22 then undergoes pre-processing and calibration to condition the data to represent the line integrals of the attenuation coefficients of the scanned objects. The processed data, commonly called projections, may then be filtered and backprojected to formulate an image of the scanned area. A formulated image may incorporate, in certain modes, less or more than 360 degrees of projection data. Once reconstructed, the image produced by the system of
The reconstructed image may be further analyzed using a CAD algorithm to enable a radiologist examining the image to identify certain anatomical structures in the image. For example, the CAD algorithm can be used to label lung nodules in CT images of the lungs and polyps in images of the colon, identify lesions in liver images, identify aneurysms in neural and cardiac images, detect pulmonary embolisms in lung images, vessel tree extraction and junction/branch detection The CAD algorithm is configured to identify several regions of interest in the image and process the regions to compute a corresponding region score. The region score is then used to label the anatomical structures for further diagnosis. The manner in which the algorithm is applied to the image is described in further detail in
After acquiring the image, a region in the acquired image is identified. In one embodiment, the region includes a pixel of interest or a voxel of interest. The region may comprise several voxels or pixels. In one embodiment, each voxel in the image is thresholded to identify the region. The region usually represents various anatomical structures such as lung nodules, vessels, etc.
In step 72, a regional response of the region is computed. In one embodiment, the regional responses of a non-linear filter are computed for the voxel of interest. Regional response is defined as a response computed for the region and/or a specified neighborhood of voxels around the region. In one embodiment, the size of the neighborhood voxels identified can be set based on the size of the structures of interest to be identified. A particular embodiment uses the principal curvatures of isosurfaces at each voxel as the regional response.
In step 74, a region score is computed for the identified region using a plurality of probabilistic models. The region score represents a value that indicates a likelihood of the region belonging to a specific anatomical structure such as vessel or a nodule. In one embodiment, the region score comprises of the probability of observing the given curvature data for the region due to a specific anatomical structure. In another embodiment, the region score comprises of a function of the intensity data for the region.
In step 76, the region is labeled by using the region score. In a further embodiment, the labeled regions may be displayed to a radiologist with different colors for different anatomical structures for better visualization of the image.
The probabilistic models are derived by approximating or modeling an anatomical structure through a geometric shape or a combination of geometric shapes. The anatomical structures are then represented using model parameters. The distribution of the response is derived as a function of the model parameters. Each model has its parameters and these parameters have a range of values that they can assume.
In a further embodiment, a probability distribution describing the likeliness of a particular parameter assuming a particular value is also derived. For deriving such a distribution, geometric and physical constraints are applied along with the incorporation of existing medical knowledge. In a more specific embodiment, the probability distribution of responses are computed for specific shape models that are absent and/or for noisy images.
The technique described in
In one embodiment, a Bayesian framework is used for the computation of the region score. Let M={Mi, i=1, . . . , N}, be a set of parametric models with parameter mi in the domain Mi, that is miεMi. One of the Mi representing each possible label is to be attached to data ‘D’ associated to a voxel ‘x’. In a Bayesian formulation, the region score for each model Miε can be computed by using Bayes' law:
The label for the voxel ‘x’ can then be assigned through some function that compares the region score for the different models. In one embodiment, the label assigned is the one corresponding to the model with the maximum evidence, i.e.,
Assuming D to be a set of individual data Dj, i.e., D={Dj, j=1, . . . , M}, three alternatives paths can be followed. The first path is to assume that each datum Dj is independent of every other distinct datum in the set D given a choice of model Mi, followed by marginalization over miεMi, i.e.,
The second path is to assume that each datum Dj is independent of every other distinct datum in the set D given a choice of model Mi and its parameters mi, again followed by marginalization over miεMi, i.e.,
The third path is to not to assume any independence but marginalize over miεMi, i.e.,
To compute the region score ‘p(Dj|mi, Mi, x)’ in equation (1), a parametric model Mi and the datum DjεD for the set D associated to the voxel ‘x’ is defined. In one embodiment, an outlier model M1, a nodule model M2, a vessel model M3, a pleural or wall nodule model M4, a pleural or wall ridge model M5, and a junction model M6 are considered. The last five models, jointly referred to as anatomical models, are representative of the structures that can be found in lungs. The first model is a catch-all for all models that does not correspond to any one of the anatomical models. The first model is used to account for variability in the anatomical models.
As described in
where the orthonormal columns of the 3×2 matrix Z span the null space of ∇I.
The matrix C=−ZTHZ/∥∇I∥ represents the curvature data of the volume image at voxel ‘x’. The curvature data thus obtained is compared to the curvature data of the nodule model M2 to estimate the likelihood of the voxel to be labeled a nodule. The manner in which nodule model is generated is described below.
Typically, the nodule model M2 chosen to represent a nodule is a solid ellipsoid with similar concentric ellipsoidal isosurfaces such that the outermost isosurface is an ellipsoid with semi-axis given by a=b<=c, where a, b and c are the lengths of the three semi-axes, i.e.,
where ρ=[0, 1], θ=[0, 2π), Φ=[−π/2, π/2], and each choice of ρεΠ defines a different isosurface.
Let ‘x’ be a point in the range R2 ⊂ R3 of M2, randomly chosen according to a uniform distribution on R2, i.e., the probability that ‘x’ will be inside a subregion of M2 depends on the volume measure of the subregion. Consider the random variables Π2, Φ2 given by:
Π2: R2→R,xρ(x)εΠ
Φ2: R2→R2,xφ(x)εΦ
The joint cumulative probability distribution function of Π2 and Φ2, PΠ2, Φ2 (ρ, φ) is computed from the expression for the fractional volume of the solid obtained from the ellipsoid M2 when only the subset (0, ρ)×θ×(−π/2, φ) of its domain is considered, and is given by:
PΠ2,Φ2(ρ,φ)=(ρ3(sin φ+1))/2
Therefore, the joint probability density PΠ2, Φ2(ρ, φ) of Π2 and Φ2 is:
PΠ2,Φ2(ρ,φ)=3ρ2(cos φ)/2*I(ρ)Iφ(Φ)
Now consider, the random vector K: R2→R, xk(x)=(k1, k2). Using standard results in transformations of random variables and considering a probability α2 of an outlier, the joint probability density ρK2(K|a, c) of K12 and K22 from, produces
The models for the vessel M3, a pleural or wall nodule M4, a pleural or wall ridge M5, and a junction M6 can be generated using the same technique described above. The region score generated by equation (4) can be compared with the probability density of the nodule model as described in equation (5) to determine the probability of the region being a nodule.
As can be seen from the techniques described above the computer 36 may use the computer aided diagnosis (CAD) unit 50 to identify regions of interest in the image. The computer processor is configured to process the data corresponding to the regions of interest to produce a region score. The region score is then compared to the various models that can be generated using the techniques described above to identify and label the anatomical structures in the image.
The above described invention has several advantages including robust and accurate estimates of identifying and labeling the region as the computation takes into consideration a neighborhood of voxels around the region and probabilistic models computed from various geometrical shapes.
While only certain features of the invention have been illustrated and described herein, many modifications and changes will occur to those skilled in the art. It is, therefore, to be understood that the appended claims are intended to cover all such modifications and changes as fall within the true spirit of the invention.
This application is related to Provisional Application U.S. Ser. No. 60/847,777, entitled “Local Anatomical Signatures”, filed Sep. 28, 2006, the contents of which are herein incorporated by reference and the benefit of priority to which is claimed under 35 U.S.C. 119(e).
The US Government may have certain rights in this invention pursuant to subcontract number 1-0378 under prime contract number W81XWH-1-0378 awarded by the Department of Defense.
Number | Name | Date | Kind |
---|---|---|---|
5255187 | Sorensen | Oct 1993 | A |
5617459 | Makram-Ebeid et al. | Apr 1997 | A |
5823993 | Lemelson | Oct 1998 | A |
5917929 | Marshall et al. | Jun 1999 | A |
6266435 | Wang | Jul 2001 | B1 |
6272233 | Takeo | Aug 2001 | B1 |
6320976 | Murthy et al. | Nov 2001 | B1 |
6434262 | Wang | Aug 2002 | B2 |
6817982 | Fritz et al. | Nov 2004 | B2 |
6865300 | Kokemohr | Mar 2005 | B2 |
6944330 | Novak et al. | Sep 2005 | B2 |
6983063 | Novak et al. | Jan 2006 | B1 |
7024027 | Suri et al. | Apr 2006 | B1 |
7058210 | Mundy et al. | Jun 2006 | B2 |
7233191 | Wang et al. | Jun 2007 | B2 |
7298879 | Wiemker | Nov 2007 | B2 |
20030179021 | Braun et al. | Sep 2003 | A1 |
20040146193 | Imamura et al. | Jul 2004 | A1 |
20040151356 | Li et al. | Aug 2004 | A1 |
20050105788 | Turek et al. | May 2005 | A1 |
20060079743 | Ferrant et al. | Apr 2006 | A1 |
Number | Date | Country |
---|---|---|
7323024 | Dec 1995 | JP |
8052127 | Feb 1996 | JP |
11056828 | Mar 1999 | JP |
2003225231 | Aug 2003 | JP |
2004222776 | Aug 2004 | JP |
2004283188 | Oct 2004 | JP |
2005246032 | Sep 2005 | JP |
2006506163 | Feb 2006 | JP |
WO2007137569 | Dec 2007 | WO |
Entry |
---|
Paulo et al. (“Model-based analysis of local shape for lesion detection in CT scans”, MICCAI, vol. 3749, pp. 688-695, Oct. 2005). |
H. Yoshida and J. Nappi, “Three-Dimensional Computer-Aided Diagnosis Scheme for Detection of Colonic Polyps”, IEEE Transactions on Medical Imaging, vol. 20, No. 12, Dec. 2001, pp. 1261-1274. |
Staal et al., “Ridge-Based Vessel Segmentation in Color Images of the Retina”, IEEE Transactions on Medical Imaging, vol. 23, No. 4, Apr. 2004, pp. 501-509. |
Paulo R. S. Mendonca et al., “Model-Based Analysis of Local Shape for Lesion Detection in CT Scans”, Medical Image Computing and Computer-Assisted Intervention, vol. 3749 in Lecture Notes in Computer Science, Oct. 2005, pp. 688-695. |
Li et al., “Lung Cancers Missed at Low-Doe Helical CT Screening in a Gen. Pop: Comp. of Clinical, Histopathologic, and Imaging Findings”, Radiology, vol. 225, No. 3, pp. 673-683, 2002. |
Kakinuma et al., “Detection Failures in Spiral CT Screening for Lung Cancer: Analysis of CT Findings”, Radiology, vol. 212, pp. 61-66, 1999. |
Sato et al., “Three-dimension Multi-scale Line Filter for Segmentation and Visualization of Curvilinear Structures in Med. Images”, Med. Image Analysis, vol. 2, pp. 143-168, 1998. |
Li et al., “Selective Enhancement Filters for Nodules, Vessels, and Airway Walls in Two- and Three-Dimensional CT Scans”, Med. Phys., vol. 30, No. 8, pp. 2040-2051, 2003. |
McCulloch et al., “Reader Variability and Computer Aided Detection of Suspicious Lesions in Low-Doe CT Lung Screening Exams”, Radiology, vol. 226, No. 2: 37A, 1 page, 2003. |
Intellectual Property Office Search Report dated Aug. 25, 2010. |
Werner et al., “A New, Universal and Fast Switching Gate-Drive Concept for SiC-JFETs Based on Current Source Principle”, Power Electronics Specialists Conference, (IEEE), pp. 2640-2645, 2006. |
Number | Date | Country | |
---|---|---|---|
20080080770 A1 | Apr 2008 | US |
Number | Date | Country | |
---|---|---|---|
60847777 | Sep 2006 | US |