The present invention relates to dual image x-ray imaging, and more particularly, to soft tissue image reconstruction in dual energy imaging.
High energy photons, like x-rays, which can pass through objects before being absorbed, are widely used in security, medical imaging, and industrial applications. Unlike in normal images, in x-ray images, 3D objects are projected into 2D images and appear semi-transparent. In dual energy x-ray imaging, two images are acquired with x-rays at high and low energy spectra. Due to different attenuation coefficients of bone and soft tissue, it is possible to separate different layers for bone and soft tissue from these dual energy images, to allow more accurate inspection of the bone and soft tissue regions in the x-ray images. In chest x-ray imaging, the dual energy images can be formulated as I1=a·B+b·S and I2=c·B+d·S if there is no motion during the acquisition of I1 and I2. Constants a, b, c, and d reflect the attenuation coefficients of the bone (B) and soft tissue (S) to the high and low x-ray spectra. The two layers (B and S) can then be individually reconstructed by weighted subtraction between I1 and I2.
Although some motion can be prevented while acquiring the dual energy x-ray images (e.g., holding breath to stop rib motion), some motion is inevitable (e.g., heart beating). For a more realistic model, it can be assumed that one layer (e.g., bone) is static or its motion has been compensated, but the other layer (e.g., soft tissue) has different motion. The image formation model considering such motion is defined as:
I
1
=a·B+b·S
I
2
=c·B+d·T
S(S) (1)
where TS(s) is the relative soft tissue motion after compensating the bone motion. Weighted subtraction cannot be used to reconstruct the layers in this case, since weighted subtraction generates artifacts due to the motion. In order to reconstruct the soft tissue image where motion is observed, inpainting is used. Inpainting is implemented by solving a Poisson equation whose right side is the divergence of the modified high-dose gradient of the soft tissue ∇·
The present invention provides a method and system for soft tissue image reconstruction for dual energy x-ray imaging. Embodiments of the present invention utilize a multigrid method for solving partial differential equations (PDE) to solve the Poisson equation for soft tissue image reconstruction. Since it is difficult to apply the multigrid method to irregular domains, embodiments of the present invention setup Poisson equation for a rectangular range including static and motions regions of dual energy x-ray images.
In one embodiment of the present invention, a soft tissue image is reconstructed based on a soft tissue gradient field extracted from dual energy x-ray images. The divergence of the soft tissue gradient field is downsampled to a coarsest resolution level, and a soft tissue image is generated based on the divergence of the soft tissue gradient field at the coarsest level. The soft tissue image is interpolated to a next finest resolution level, and refined by at least one coarse grid correction cycle at the current resolution level. The coarse grid correction cycle calculates a defect based on the current soft tissue image, downsamples the defect to the coarsest level, calculates a correction based on the defect at the coarsest level, and upsamples the correction to the current resolution level to refine the current soft tissue image. The interpolation and refinement of the soft tissue image is repeated until the soft tissue image is refined at the finest resolution level.
In another embodiment of the present invention, first and second dual energy images are received. A gradient field is extracted from the first dual energy image, and a soft tissue gradient field is generated by removing bone gradients. A soft tissue image is reconstructed by using a multigrid method to solve a Poisson equation for the soft tissue image based on a Laplacian operator on the soft tissue image and a divergence of the soft tissue gradient field.
These and other advantages of the invention will be apparent to those of ordinary skill in the art by reference to the following detailed description and the accompanying drawings.
The present invention relates to a method and system for soft tissue image reconstruction for dual energy x-ray imaging. Embodiments of the present invention are described herein to give a visual understanding of the soft tissue image reconstruction method. A digital image is often composed of digital representations of one or more objects (or shapes). The digital representation of an object is often described herein in terms of identifying and manipulating the objects. Such manipulations are virtual manipulations accomplished in the memory or other circuitry/hardware of a computer system. Accordingly, is to be understood that embodiments of the present invention may be performed within a computer system using data stored within the computer system.
Embodiments of the present invention utilize a multigrid method to reconstruct a soft tissue image from a soft tissue gradient extracted from dual energy x-ray images. Instead of decomposing intensity values in dual energy x-ray images, the gradient is decomposed into different layers, and bone and soft-tissue images can be reconstructed using separated gradient fields by solving a Poisson equation. The Poisson equation is solved using a multigrid method that estimates an initial solution at a coarser resolution, and iteratively refines the solution at finer resolutions.
At step 104, the gradient of the first image (i.e., the high energy image) I1 is extracted. Since gradient features are sparse, the gradient ∇I1 is almost the same as the soft tissue gradient for most pixels of I1, except for regions that have bone boundaries. Since ∇I1=a·∇B+b·∇S, for gradient regions that have no bone boundaries, the soft tissue gradient can be obtained from one image, as ∇S=∇I1/b. In regions that have bone boundaries, the soft tissue gradient and bone gradient usually have different orientations, hence allowing better decomposition. For the regions that have bone boundaries, the bone gradients are aligned between the dual energy images according to Equation (1). Accordingly, these regions can be detected utilizing ∇I1 and ∇I2.
At step 106, the bone gradient is removed from the gradient of the first image in order to generate the soft tissue gradient field. According to Equation (1), the bone gradient should appear in both I1 and I2 at the same location along the same orientation. Therefore, for regions that have bone boundaries, the gradients ∇I1 and ∇I2 have a ratio of approximately a/c. For regions dominated by the soft tissue gradient, the ratio is around b/d if there is no soft tissue motion, and the ratio can be arbitrary if the soft tissue has moved. This provides an important cue to discriminate bone and soft tissue gradients. This concept used with a structure tensor can detect the existence and estimate the orientation of bone boundaries.
The structure tensor is a 2×2 matrix that can be estimated from a set of oriented quadrature filters as follows:
where qk is the output from quadrature filter k and nk is the orientation vector of the quadrature filter k. I is the identity tensor and α is a constant depending on tensor dimension. In order to detect the existence of a bone gradient for removal, it is estimated if the quadrature filter output is from a bone gradient or not. If the oriented quadrature filter output on image I1 (i.e., qk,1) and image I2 (i.e., qk,2) have a given ration (i.e., qk,1/(qk,1+qk,2)≈a/(a+c)), it indicates that the filter output is mainly from a bone gradient. Assuming the ration is corrupted by Gaussian distributed noise, the probability that the quadrature filter output belongs to bone boundaries is given as follows:
Accordingly, the tensor defined in Equation (2) can be modified as follows to represent a bone gradient tensor:
The eigenvalues of the tensor matrix (i.e., λ1 and λ2) can be calculated. If there are bone boundaries in the neighborhood, the eigenvalues are larger. Thus, the regions that contain bone boundaries can be detected by thresholding on λ12+λ22 for further bone gradient removal.
For the regions that contain bone gradients, it is possible that they also contain soft tissue gradients. Accordingly, the bone gradient must be separated from the soft tissue gradient. The structure tensor, which is used to detect the bone gradient, can also be used to estimate the bone gradient orientation. The bone boundary orientation can be calculated by θ=arctan(2I12/(I22−I11+C)). To remove bone gradient, the gradient vector (i.e., ∇I1) is projected to the angle that is parallel to the bone boundaries (i.e., nθ). Accordingly, the soft tissue gradient field calculation can be expressed as:
At step 108, the soft tissue image is reconstructed based on the soft tissue gradient field. Given the gradient field of the soft tissue layer, G=∇S, a soft tissue image S is reconstructed whose gradient field is closest to G. One natural way to achieve this is to solve the equation ∇Ŝ=G. However, since the original gradient field is modified, the resulting gradient field is not necessarily integrable. Some part of the modified gradient may violate ∇×G=0 (i.e., the curl of the gradient is 0). In such a case, the potential function Ŝ must be determined such that its gradients are closest to G in the sense of least square by searching the space of all 2D potential function, that is, to minimize the following integral in 2D space:
f=min∫∫F(∇Ŝ,G)dxdy (6)
where F(∇Ŝ,G)=∥∇Ŝ−G∥2. According to the Variational Principle, a function F that minimizes the integral must satisfy the Euler-Lagrange equation:
A 2D Poisson equation can then be derived, as follows:
∇2Ŝ=∇·G (8)
where ∇2 is the Laplacian operator,
and ∇·G is the divergence of the vector field G, which is defined as
In order to solve the Poisson equation (Equation (8)), we can use the Neumann boundary conditions Ŝ·{right arrow over (n)}=0, where n is the normal on the boundary Ω. In this case, the intensity gradients can be approximated by the forward difference:
∇Ŝ=[Ŝ(x+1,y)−Ŝ(x,y),Ŝ(x,y+1)−Ŝ(x,y)]T,
and the Laplacian is represented as:
∇2Ŝ=−4Ŝ(x,y)+Ŝ(x−1,y)+Ŝ(x+1,y)+Ŝ(x,y+1)+Ŝ(x,y−1).
The divergence of the gradient can be approximated as:
∇·G=Gx(x,y)−Gx(x−1,y)+Gy(x,y)−Gy(x,y−1).
The Poisson equation of Equation (8) results in a large system of linear equations. The Poisson equation can be thought of as a linear elliptic problem Lu=f where u represents the soft tissue image (Ŝ), L represents the Laplacian operator (∇2), and f represents the divergence of the soft tissue gradient field (∇·G). When trying to solve the linear elliptical problem Lu=f on a uniform grid with mesh size (i.e., image size) h, the discretized equation is expressed as:
Lhuh=fh. (9)
Iterant solvers assume an initial solution uh0 and iteratively refine the solution by solving the defect equation:
Lhvh=−dh, (10)
where vh=uh−uh0 and dh=Lhuh0−fh. The defect dh measures the accuracy of the initial solution, and is used to calculate a correction vh to refine the initial solution.
Conventional relaxation methods, such as Jacobi or Gauss-Seidel, solve an approximate simplified defect equation:
Ahvh=−dh. (11)
For Jacobi iteration, Ah is the diagonal part of Lh, and for Gauss-Seidel iteration, Ah is the lower triangle part of Lh. These conventional relaxation methods correct high frequency error quickly, but suppress low frequency error very slowly.
According to an embodiment of the present invention, the multigrid method coarsifies the defect equation rather than simplifying it. In particular the multigrid method approximates Lh at a coarser resolution level with a smaller equation:
LHvH=−dH, (12)
where H is the coarser mesh size (resolution level), such as H=2h. Since Lh has smaller dimension, this equation is easier to solve, and it focuses more on a low frequency error. In order to define the defect dH at the coarser resolution, a restriction operator IhH, which downsamples dh is defined as:
dH=IhHdh. (13)
Once a correction solution vH is obtained at the coarse level, a prolongation operator IHh, which upsamples vH is defined as:
vh=IHhvH. (14)
The restriction and prolongation operators satisfy:
IHhIhH=I. (15)
Note that the restriction and prolongation operators are not square matrices. Therefore, the coarse grid operator Lh is defined by:
LH=IhHLhIHh. (16)
Referring to
At step 208, the current soft tissue image is refined by performing at least one coarse grid correction cycle.
Returning to
At step 212, the soft tissue image is output. The output soft tissue image was interpolated to the finest resolution level, and refined by at least one coarse grid correction cycle at the finest resolution level. The soft tissue image can be output by displaying the soft tissue image, for example on a display of a computer system. The soft tissue image can also be output by storing the soft-tissue image, for example, in a computer readable medium, storage, or memory of a computer system. The soft tissue is used in the dual energy imaging method of
The multigrid method of
It is non-trivial to apply the FMG method to an irregular domain because the boundary may not be downsampled correctly, which can prevent convergence. To solve this problem, the irregular domain Ω is expanded into a rectangle R that occupies the whole image except for some marginal pixels. In Ω, the right hand side is still defined as the divergence of the modified gradient of the high dose (high energy) image, while in R\Ω, the Laplacian of the subtracted image in specified where linear subtraction works well. In this way, the FMG method can be applied to a domain of arbitrary shape. The pixels in R\Ω are no longer fixed strictly, but are still very similar to those in the subtracted image.
Returning to
At step 112, the soft tissue image and the bone image are output. The soft tissue and bone images can be output by displaying the soft tissue image, for example on a display of a computer system. The soft tissue and bone images can also be output by storing the soft-tissue image, for example, in a computer readable medium, storage, or memory of a computer system.
The above-described methods for dual energy imaging and soft tissue image reconstruction may be implemented on a computer using well-known computer processors, memory units, storage devices, computer software, and other components. A high level block diagram of such a computer is illustrated in
The foregoing Detailed Description is to be understood as being in every respect illustrative and exemplary, but not restrictive, and the scope of the invention disclosed herein is not to be determined from the Detailed Description, but rather from the claims as interpreted according to the full breadth permitted by the patent laws. It is to be understood that the embodiments shown and described herein are only illustrative of the principles of the present invention and that various modifications may be implemented by those skilled in the art without departing from the scope and spirit of the invention. Those skilled in the art could implement various other feature combinations without departing from the scope and spirit of the invention.
This application claims the benefit of U.S. Provisional Application No. 60/982,491, filed Oct. 25, 2007, the disclosure of which is herein incorporated by reference.
Number | Date | Country | |
---|---|---|---|
60982491 | Oct 2007 | US |