This invention relates in general to digital radiography, and in particular to the imaging of a long human body part, such as the spine or legs, using a storage phosphor-based computed radiography system.
When a long segment of the human body is imaged using the conventional screen-film technique, special cassettes and films of extended length are used, such as 30×90 cm and 35×105 cm. As medical institutions are migrating from analog screen-film systems to digital modalities, such as computed radiography (CR), these types of exams impose a significant challenge. This is because the size of digital detector is limited. For example, the largest CR storage phosphor cassette from several major CR vendors is limited to 35×43 cm, which can only image a portion of the long body part at a time. To address this problem, several methods have been proposed. European Patent EP0919856A1 discloses a way of staggering several storage phosphor cassettes together. The cassettes can be in the alternating (FIG. 1A), staircase-wise (FIG. 1B), or oblique (
The sub-images acquired by the individual storage phosphor screens must be stitched together to create a composite full image. The stitched full image should be distortion-free for the purposes of diagnostic interpretation and geometric measurement. U.S. Pat. No. 4,613,983, issued Sep. 23, 1986, inventors Yedid et al., discloses a method to reconstruct a composite radiographic image from a set of sub-images. However, this method is applicable only when the relative position between the sub-images is precisely controlled by the acquisition hardware. For any of the configurations shown in
It is therefore desirable to develop an image processing algorithm that can (1) automatically perform image demagnification, (2) automatically detect and correct the translation and rotation displacements between the sub-images, and (3) form a composite full image that has high geometric fidelity without relying on external reference markers.
According to the present invention, there is provided a solution to the problems discussed above.
According to a feature of the present invention, there is provided a method of forming a composite digital image comprising:
providing 1-N digital images formed from 1-N contiguous segments of a larger radiographic image recorded in 1-N overlapping storage phosphor screens wherein N is equal to or greater than 2 and wherein the image content in the overlapped region of contiguous images is the same, and the end edge of a screen nearest an x-ray source is present in both contiguous images;
selecting a pair of contiguous digital images, wherein one image is closer to said x-ray source than said other image;
correcting for any geometric distortion if applicable in said pair of digital images based on the distance between x-ray source and said storage phosphor screen;
determining any rotational displacement and any vertical displacement between said pair of digital images by matching said end edge of said one image present in said pair of images;
correcting for image orientation based on any said rotational displacement if applicable;
determining any horizontal displacement between said pair of digital images by correlating the image content in said overlapping regions of said pair of digital images;
stitching said pair of digital images together to form a larger composite digital image along said one image edge based on any said horizontal and vertical displacement; and
repeating said correcting for any geometric distortion to said stitching with the larger composite image and the next consecutive overlapping digital image until all N digital images are stitched together to form a full composite image.
The invention has the following advantages.
1. Enables the generation of a composite full image from a plurality of sub-images without requiring the use of external reference markers to perform geometric distortion corrections.
2. Preserves a high degree of geometric accuracy in the stitched image.
3. Results in improved image quality in a reconstructed (composite) image by minimizing the presence of shadows of non-anatomic structures superimposed on the anatomic regions of interest.
The shadow of the middle screen top edge is recorded in image 301, and the shadow of the bottom edge is recorded in image 303.
In general, the present invention relates to the radiographic imaging of an elongated object such as the full spine, e.g., for diagnosing scoliosis, or leg of a human subject.
US Patent Application by Brahm, Odea, Rogers, Wang proposes a method that is a hybrid between the cassette stacking and storage phosphor screen stacking methods. As shown in
When an x-ray exposure is taken with any of the cassette/phosphor screen setups shown in
The relationship between any two consecutive screens is equivalent for the screen configurations shown in
In order that the front screen overlap edge be completely present in the front image, which is usually not available or guaranteed in a conventional CR reader, the CR reader should be capable of over-scanning the front phosphor screen beyond the overlap edge. Using the modified image in
Image de-magnification is performed in elements 505-508 after a patient is exposed (box 500), and a plurality of storage phosphor screens is read and digitally stored to create images 1 . . . N (N>=2). There is a slight screen location dependent, geometric distortion (magnification) introduced to the captured images because the phosphor screens are not exactly co-planar. The further the screen from the x-ray source, the greater the magnification factor. For example, using 180 cm as the reference distance from the x-ray source to the screen, an image acquired with the screen placed at 181 cm will be 0.6% larger. This distortion impacts the stitching precision and if not corrected may introduce a discontinuity adjacent to the seam line in the stitched image. It is therefore necessary to perform image de-magnification. This correction becomes more important as the source-to-screen distance is decreased. To correct for the magnification distortion, a virtual reference detector plane is defined and all the captured images are normalized to this plane. This reference detector plane can be defined anywhere in the x-ray path, such as the anti-scatter grid surface plane. The equations to de-magnify an image and normalize the de-magnified image to the virtual detector plane are given by:
x′=gx,
y′=gy,
g=D/D0. (1)
The parameters x and y are image pixel coordinates in the vertical and horizontal axes, respectively; x′ and y′ are the new image pixel coordinates, respectively g is a constant; and D0 and D respectively are the distances from the x-ray source to the reference detector plane and the distance from the x-ray source to the physical storage phosphor screen that captures the image. As shown in
This group of equations is applicable for all the screen configurations shown in
x′=g(x)×x,
y′=g(x)×y,
g(x)=((Db−Dt)×(x−xmin)/(xmax−xmin)+Dt)/D0 (2)
The parameters Dt and Db are the distances from the x-ray source to the top and the bottom of screen, respectively; xmin and xmax are the minimum and maximum image pixel coordinate in the vertical axis. Equation 2 ensures that each image pixel is remapped to the reference detector plane based on its physical distance from the x-ray source. The amount of computation for image demagnification can be reduced nearly in half for the screen setups in
The next step Element 509 (
Using the front image as an example,
Second, the one-dimensional derivative of the image is computed in the vertical direction. A one-dimensional derivative operator, such as [−1,0,1], [−1,0,0,0,1], or [−1,0,0,0,0,0,] etc., is preferred because the pixel value discontinuity only occurs across the edge direction, which is always nearly horizontal, and because of the computational efficiency advantages. A predefined threshold is used to select only those candidate edge transition pixels that are of greater magnitude and of falling slope. Element 603 shows the results from this step.
Third, a linear function is fitted to the candidate edge pixels and the best fitting parameters are obtained when the least square error is reached. Element 604 shows the fitted linear function overlaid on top of the edge transition pixels. The fitting parameters describe the ending edge location and orientation:
x=kf×y+af, (3)
where af and af are the fitting parameters with kf the orientation and af the offset of the front screen overlap edge in the front image. Similarly, this process is conducted for the back image 610, except rising edge transition pixels are searched instead inside a narrow band 614 at the beginning of the back image. A new function is obtained by least-square-error fit:
x=kb×y+ab, (4)
where kb and ab are the fitting parameters with kb the orientation and ab the offset of the back screen overlap edge in the back image. Element 616 shows the fitted linear function overlaid on top of the edge transition pixels.
Once the screen overlap edge location is successfully found in the front image, it is compared with its shadow in the back image for image registration. To locate the shadow of the front screen overlap edge in the back image, an approach similar to element 511 is used. This is possible because the pixel values in the back image also undergo a strong signal intensity decrement in the screen overlap region due to the high attenuation of the incident x-rays by the front screen during the x-ray exposure. In order to locate the shadow of the front screen overlap edge, the location of the narrow band needs to be defined in the back image. This can be calculated based on the size of the overlap regions (S in mm), which is a priori, the image pixel size (psize in mm), and the average location of the identified back screen overlap edge. The distance from the center of the narrow band to the beginning of the back image is given by:
d=S/psize+(kb×yc+ab). (5)
where yc is the center image pixel coordinate in the horizontal axes. The function that is obtained using the least-square-error fit to describe the shadow of the front screen overlap edge in the back image can be depicted as:
x=k×y+a, (6)
where k and a are the fitting parameters with k the orientation and a the offset. (See elements 622, 623, and 624 in FIG. 6).
Theoretically, parameters kf and k should be equal because they both represent the orientation of the front screen overlap edge. However, they may differ by as much as several degrees in practice for several reasons such as misalignment between the two phosphor screens during the x-ray exposure or screen positioning variations in the CR reader during the readout process. The deviation between kf and k represents the orientation misalignment between the front and back images. To assure a seamless composite image after stitching, and to preserve high geometric fidelity, this misalignment must be corrected. However, the correction can be ignored if the misalignment is fairly small. For example, in the case when it only generates a maximum of several pixel gap i.e., kf−k×ymax<3 where ymax is the maximum image pixel coordinate in the horizontal direction.
Misalignment correction is accomplished by rotating either the front or the back image. If the front image is to be rotated, the rotation angle is θ=atan(k)−atan(kf), if the back image is to be rotated, the angle is θ=atan(kf)−atan (k), or if both images are to be rotated, the angle is −atan(kf) and atan(k) respectively for the front and back images. Element 513 (
x′=x cos θ+y sin θ,
y′=−x sin θ+y cos θ, (7)
where (x′, y′) are the new coordinates in the rotated image, and θ is the rotation angle. For the simplicity of the description, the symbols ka, kb, k, aa, ab, and a will be used to represent the new transformed values.
The vertical displacement between the front and back image, x_offset, is defined as the vertical distance from each pixel in the back image to origin of the front image and is given by:
x_offset=af−ab. (8)
Using the vertical displacement guarantees that the front and the back images are stitched along the overlap edge of the front screen.
Once the back screen overlap edge, as described by kb and ab, and the shadow of the front screen overlap edge, as described by ka and aa, are successfully identified, the location of the screen overlap region in the back image can be defined. The screen overlap region in the back image is located between the back screen overlap edge and the shadow of the front screen overlap edge. The size of the region is calculated based on the equation given by:
overlap_size=(k×yc+a)−(kb×yc+ab), (9)
and the vertical displacement from the back image origin is:
overlap_offsetb=(kb×yc+ab). (10)
Using the computed value of overlap_size, the corresponding region in the front image is derived. This is the region of the same size but with a vertical displacement from the image origin defined by:
overlap_offsetf=xmax−(ka×yc+aa)−overlap_size. (11)
The process of extracting the image overlap regions is represented by element 515 (FIG. 5). After the screen overlap regions are extracted from both images, as shown by elements 702 and 703 in
The image content recorded in the overlap regions are the same except for some horizontal displacement, y_offset, between the corresponding pixels. A one-dimensional correlation function is computed to find the displacement using the formula given by
c(Δ)=Σi,jF(xi,yj)×B(xi,yj+Δ), (12)
where F(xi, yj) and B(xi, yj) is the pixel value at (xi, yj) in the extracted overlap region from the front and back images, respectively, and Δ is the horizontal displacement parameter for correlation. The Δ value at which c(Δ) reaches a maximum is the optimal value for y_offset.
After the front and the images have been demagnified and rotated if applicable, and x_offset and y_offset have been found, the back image is stitched to the front image. Each pixel of the front image is copied to the stitched image buffer except those pixels that are beyond the screen overlap edge line. Each pixel in the back image is copied to the stitched image buffer with an displacement defined by x_offset and y_offset except those pixels before the shadow of the front screen overlap edge. The resultant larger image is shown in FIG. 8A. The process conducted in this paragraph is represented by element 517 (FIG. 5).
Once the first two consecutive images are stitched, the resultant larger image will be grouped with a next consecutive image, and again, a front image and back image are identified, and the same processes from elements 509 to 517 (
It will be understood that the invention may be applied to the stitching together of any number of over-lapped images produced by radiographic techniques. The invention would also be applicable to digital images resulting from overlapping conventional radiographic film images that have been digitized.
The invention has been described in detail with particular reference to certain preferred embodiments thereof, but it will be understood that variations and modifications can be effected within the spirit and scope of the invention.
Number | Name | Date | Kind |
---|---|---|---|
4613983 | Yedid et al. | Sep 1986 | A |
5123056 | Wilson | Jun 1992 | A |
5833607 | Chou et al. | Nov 1998 | A |
5986279 | Dewaele | Nov 1999 | A |
6459094 | Wang et al. | Oct 2002 | B1 |
6563943 | Sasada | May 2003 | B1 |
6600831 | Sasada | Jul 2003 | B1 |
6714680 | Sasada | Mar 2004 | B1 |
6757418 | Wei et al. | Jun 2004 | B2 |
Number | Date | Country |
---|---|---|
0 866 342 | Sep 1998 | EP |
0 919 856 | Jun 1999 | EP |
0 919 858 | Jun 1999 | EP |
2000-232976 | Aug 2000 | JP |
2000-241920 | Sep 2000 | JP |
2000-250153 | Sep 2000 | JP |
2000-258861 | Sep 2000 | JP |
2000-267210 | Sep 2000 | JP |
2000-275760 | Oct 2000 | JP |
2000-275761 | Oct 2000 | JP |
2000-285252 | Oct 2000 | JP |
2000-339444 | Dec 2000 | JP |
2001-202507 | Jul 2001 | JP |
2001-274974 | Oct 2001 | JP |
2001-307085 | Nov 2001 | JP |
Number | Date | Country | |
---|---|---|---|
20030048938 A1 | Mar 2003 | US |