The present invention is directed to computer-aided diagnosis techniques for detecting lung cancers based on digital or digitized images. More specifically, the present invention addresses normalization techniques used in adjusting contrast in such images.
Lung cancer is the leading cause of all cancer death in United States as well as worldwide. Nevertheless, it is generally expected that the early detection of asymptomatic lung cancers, when followed by prompt treatment, can prolong patient survival and increase the possibility for improvement of the cure rate. Over the past half century, many studies showed that radiologists overlook as many as 30% of lung nodules in routine diagnosis, even though many of the nodules can actually be visible in retrospect. Advanced image processing techniques and state-of-the-art computer-aided detection (CAD) are demonstrating their great usefulness in helping radiologists in their clinical practice to detect more cancers earlier. The RapidScreen RS-2000 (TM) system, developed by Deus Technologies, LLC, is a commercially available computer-aided detection (CAD) system for automated detection of early-stage lung cancer on digitized PA (posterior-anterior) or AP (anterior-posterior) frontal chest images. This system is film-based, and the digital chest images are typically obtained from a charge-coupled device (CCD) film scanner.
Although films are still widely used in radiological practices and procedures worldwide, more and more hospitals and clinics in the United States, Europe, and Japan are moving from film-based to filmless operations. This change has been driven by technologists' use of CR (Computer Radiography) and DR (Digital Radiography) systems to acquire radiographic examinations and store them to a PACS (Picture Archive and Communication System) and radiologists' corresponding use of networks and review stations to make diagnoses. Filmless radiology provides an ideal and streamlined environment for applying CAD technologies and systems to help radiologists improve their diagnosis accuracy and efficiency. In order to apply, for example, the RapidScreen RS-2000 (TM) technology and system to direct digital PA or AP frontal chest images obtained by CR, DR, or retrieved PACS, it is necessary to verify that the detection performance for lung nodules on these direct digital frontal chest images is not inferior to that on images digitized from films through the CCD film scanner.
Currently, there are several medical imaging device companies that manufacture and market a number of CR and DR chest imaging systems. Although CR and DR imaging systems typically have a much larger exposure dynamic range than conventional screen-film systems, the digital chest images of PA or AP and corresponding lateral views are post-processed, displayed, and stored in film-like form in order for radiologists to read them and make diagnoses. Generally, the properties of these digital but film-like chest images acquired from different CR or DR systems vary significantly in terms of pixel resolution (i.e., pixel size in millimeters), gray scale depth (maximum pixel value bits) of each pixel, and image contrast. This is due to the fact that various manufacturers use their own proprietary post-processing methods and techniques to generate the corresponding film-like chest images.
In order for the nodule detection algorithms of a CAD system like the RapidScreen RS-2000 (TM) system to deal with varieties of frontal chest images and obtain similar detection performance (in terms of sensitivity and false positives per each image), the digital images have to be pre-processed for normalization to make them as similar as possible, regardless of the acquisition methods of the digital images. What would be desirable would be a pre-processing method/system that performs such normalization.
The present invention cures the above-mentioned deficiencies of the prior art by providing a uniform normalization method to pre-process the digitized images scanned from various film scanners and original CR and DR digital chest images prior to performing CAD techniques on them.
In one embodiment of the invention, a method of processing x-ray images in digital form comprises the steps of: (a) inputting an x-ray image in digital form; (b) determining one or more normalization factors based on the pixels of the input x-ray image; (c) performing normalization on the input x-ray image by applying the one or more normalization factors to the pixels; and (d) outputting a normalized digital x-ray image.
In a further embodiment of the invention, the method is embodied in the form of software on a computer-readable medium. In yet a further embodiment of the invention, the computer-readable medium, containing software embodying the method, is part of a computer system.
Applicable Definitions
In describing the invention, the following definitions are applicable throughout (including above).
A “computer” refers to any apparatus that is capable of accepting a structured input, processing the structured input according to prescribed rules, and producing results of the processing as output. Examples of a computer include: a computer; a general purpose computer; a supercomputer; a mainframe; a super mini-computer; a mini-computer; a workstation; a microcomputer; a server; an interactive television; a hybrid combination of a computer and an interactive television; and application-specific hardware to emulate a computer and/or software. A computer can have a single processor or multiple processors, which can operate in parallel and/or not in parallel. A computer also refers to two or more computers connected together via a network for transmitting or receiving information between the computers. An example of such a computer includes a distributed computer system for processing information via computers linked by a network.
A “computer-readable medium” refers to any storage device used for storing data accessible by a computer. Examples of a computer-readable medium include: a magnetic hard disk; a floppy disk; an optical disk, like a CD-ROM or a DVD; a magnetic tape; a memory chip; and a carrier wave used to carry computer-readable electronic data, such as those used in transmitting and receiving e-mail or in accessing a network.
“Software” refers to prescribed rules to operate a computer. Examples of software include: code segments; instructions; computer programs; and programmed logic.
A “computer system” refers to a system having a computer, where the computer comprises a computer-readable medium embodying software to operate the computer.
The invention is now described in further detail with reference to the accompanying drawings, in which:
FIGS. 1(a)-1(f) show output images from various imaging sources;
FIGS. 3(a)-3(f) show the images of FIGS. 1(a)-1(f) following processing using the CPVN process without windowing;
FIGS. 4(a)-4(f) show the images of FIGS. 1(a)-1(f) following processing using the PVGSN process without windowing;
FIGS. 5(a) and 5(b) show signatures obtained from the corresponding horizontal and vertical lines, respectively, shown in
The present invention involves the processing of an input digital (or digitized) x-ray image to create a normalized image of appropriate format.
Lung nodule detection algorithms of a CAD system will typically require some given gray value depth and pixel resolution. For example, the lung nodule detection algorithms of the RapidScreen RS-2000 (TM) system, which will be used as an exemplary system throughout this description (but to which the present invention is not limited) require that the input frontal digital chest image have a 10-bit gray value depth (i.e., each pixel with pixel value ranging from 0 to 1023) and the pixel resolution (pixel size) around 0.7 mm (i.e., each pixel representing 0.7 mm in size). It should be noted that the smallest size of nodule that could be detected by the RapidScreen RS-2000 (TM) system is about 5 mm in diameter, which is about 7 times larger than the required pixel resolution (0.7 mm in size) of the input chest images. The current film-based RapidScreen RS-2000 (TM) system, using a CCD film scanner, is used to generate a baseline digital chest image from the 14″×17″ film with 150 dpi (or pixel size of 0.167 mm for each dot pixel) resolution and 16-bit gray scale depth (pixel value ranging from 0 to 65535). The image matrix size of the original scanned image is 2100×2550 (2 k×2 k). Thus, the original image size is reduced by a factor of four to a basic input image requirement 525×637 with the corresponding pixel resolution increased to 0.67 mm. This image matrix size reduction or pixel size increase is used to reduce computing time and to avoid the false positives resulting from some fine vessel structures.
In addition to the reduction of computing time and false positives due to the fine vessel structures mentioned above, the image size averaging reduction method can also remove some noise pixels in the original CR and DR chest images. These noise pixels may cause repeatability problems for algorithms that detect lung nodules in chest images. As an example for the PRN, a DR PA chest image from Hologic Inc., in Bedford, Mass. has a pixel size of 0.139 mm with image matrix of 2560 (width)×3072 (height) pixels. The RF is thus obtained as 0.7/0.139=5. Therefore, the normalized pixel size is 5·0.139=0.695 mm and the corresponding reduced matrix size of the image for input to the detection algorithms is 640×768. The pixel value of each pixel of the reduced input image is obtained from the average of these pixel values within the corresponding 5×5 square-box in the original DR PA chest image.
Digital x-ray images may also, or alternatively, be normalized according to the actual values of the pixels, to achieve a desired range of pixel values (i.e., image contrast). The original raw digital chest images generated from CR and DR systems have a linear response between gray scale values and x-ray exposures of a much wider dynamic range than for film-based systems. However, a logarithmic conversion is usually applied to transfer the raw images to their film-like version for radiologists to read and make diagnoses. The converted, film-like digital chest images produced from different CR and DR systems thus have different properties, as shown in
FIGS. 1(b)-1(f) display the appearances of five CR and DR film-like chest images without applying any windowing operation. Specifically,
As indicated in the previous section, the nodule detection algorithms of the exemplary RapidScreen RS-2000 (TM) system require that the input images have a gray scale depth of 10 bits. In addition, the nodule detection performance is vulnerable to the large variations in image contrast among digital chest images resulting from different CR and DR imaging systems. Therefore, in order to maintain the generalization of nodule detection performance over CR, DR, and film-scanned digital images, it is desirable to develop a uniform pixel value normalization method that is effective for digital images from any system, of any manufacturer. One pixel value normalization according to the invention is defined as contrast pixel value normalization (CPVN) and is described in detail in the following paragraph.
Note that the denominator value is 1024 for the 10-bit resolution of the exemplary RapidScreen RS-2000 (TM) system, but it may vary in systems of varying resolutions, as would be known to one skilled in the art.
Let PVCPVN(i,j) denote the integer value of the pixel element at line i and row j of the image matrix after CPVN, and the PVorig(ij) be the corresponding pixel value in the original input image matrix. Then the PVCPVN(ij) can be expressed by
where i=0,1,2,3, . . . w−1, and j=0,1,2,3, . . . h−1. The w and h represent the width and height, in pixels, of the input image, respectively. It should be noted that for an input image, the pixel values range depends on the gray scale depth, as shown in the fourth column of
If the PVmin and PVmax are taken according to the minimum and maximum values of the input image gray scale depth, instead of the values obtained from the rectangular ROI at the center of the image, the CPVN becomes the pixel value gray scale normalization (PVGSN). The pixel value gray scale normalization (PVGSN) will normalize pixel values to a 10-bit gray scale without any modification of image contrast, as shown in FIGS. 4(a)-4(f), which, again, correspond to the respective images of FIGS. 1(a)-1(f). Therefore, nodule detection performance on the input images after PVGSN deteriorates seriously for digital CR and DR chest images obtained from different imaging systems, as will be discussed further below. In other words, when applying PVGSN instead of CPVN, performance of detection results on images obtained from various CRs, DRs, and various film scanners decreases significantly.
To quantitatively evaluate the effectiveness of CPVN on image contrast normalization, we introduce the concept of signature contrast (SC). As shown in
To further demonstrate the effectiveness of CPVN on LC normalization for multiple sources of digital chest images, we can perform a Student-t test to the null hypothesis on the average SCs. Here, the average SC is defined as the average value of the average horizontal SC and average vertical SC. The null hypothesis is that there is no difference in the average SC among digital chest images from various sources. For the image sets used for
Some embodiments of the invention may be embodied in the form of software instructions on a machine-readable medium. Such an embodiment is illustrated in
Digital images from various imaging systems can have different image properties such as pixel resolution, gray scale depth and image contrast. It is likely that these differences will greatly affect the performance of CAD algorithms that are typically trained and tested by one type of image source. The present invention provides an effective uniform image normalization method (CPVN) that can minimize these differences in the image properties. Nodule detection CAD algorithms achieve a high level of generalization for digital images from multiple sources of imaging systems.
As mentioned above, the specific embodiments above are described in the context of the exemplary RapidScreen RS-2000 (TM) system. However, the invention is not to be understood as being limited to such embodiments, and it would be well within the understanding of one of ordinary skill in the art to make the associated adjustments in the invention. For example, as discussed above, the RapidScreen RS-2000 (TM) system uses 10-bit resolution. However, other systems may use other resolutions, and it is to be understood that the invention is equivalently applicable to such systems.
The invention has been described in detail with respect to various embodiments, and it will now be apparent from the foregoing to those skilled in the art that changes and modifications may be made without departing from the invention in its broader aspects. The invention, therefore, as defined in the appended claims, is intended to cover all such changes and modifications as fall within the true spirit of the invention.
This application draws priority from U.S. Provisional Patent Application No. 60/484,653, entitled, “Lung Contrast Normalization on Direct Digital and Digitized Chest Images for Computer-Aided Detection (CAD) of Early-Stage Lung Cancer,” filed on Jul. 7, 2003, and incorporated by reference herein in its entirety.
Number | Date | Country | |
---|---|---|---|
60484653 | Jul 2003 | US |