The present invention relates to image reconstruction, and more particularly to tomographic image reconstruction in medical imaging.
Tomographic image reconstruction refers to reconstructing an image from a set of projection measurements that are described by a Radon transform. The Radon transform provides a mathematical basis for reconstructing tomographic images from measured projection data. The Radon transform of an image is commonly referred to as a sinogram. Tomographic image reconstruction reconstructs an image by determining pixel values based on the sinogram of the projection data. This is described in greater detail in A. Kak and M. Slaney, Principles of Computerized Tomographic Images, IEEE Press, 1988.
In practice, the number and the quality of the projection measurements is often limited, which effects the quality of the images reconstructed from the projection measurements. For example, in medical imaging, low-dose diagnostic tomographic imaging is commonly used to reduce the risks of excessive radiation to a patient, and can greatly restrict the number and quality of projection measurements. Non-iterative reconstruction algorithms do not typically handle the limited projection measurements well, and often produce significant streaking artifacts. One such non-iterative algorithm is the well known Filtered Back Projection (FBP) algorithm, which is described in A. Kak and M. Slaney, Principles of Computerized Tomographic Images, IEEE Press, 1988. Interpolation in Radon space has been proposed to reduce the artifacts in the non-iterative algorithms. However, applying prior knowledge of image shapes and borders in the null space of the projections is typically very difficult.
Iterative methods have achieved better results than the non-iterative methods by incorporating prior knowledge in the image space to regularize the reconstruction in an iterative operation scheme. In such iterative methods, an objective function typically consists of a data fidelity term, which enforces the similarity between the measured sinogram and a forward projection of the reconstructed image, and a regularization term, which enforces the prior knowledge about the signal (e.g. smooth surface with sharp edges). However, the optimization of the objective function is typically based on a gradient descent method. The derivative on the data fidelity term results is a back projection in each iteration, which typically provides blurry results and converges slowly. Furthermore, the step size to update in the gradient-descent direction is usually set small due to convergence issues, which further increases the number of iterations necessary for convergence significantly.
The present invention provides a method and system for image reconstruction which converges quickly and provides accurate results. Embodiments of the present invention divide iterative image reconstruction into two stages, one stage in the image space and one stage in the Radon space.
In one embodiment of the present invention, adaptive filtering in the image space is performed to generate an artifact-reduced reconstructed image of the current sinogram residue. This artifact-reduced reconstructed image of the current sinogram residue represents an update or descent direction in the image space. The adaptive filtering regularizes the reconstructed image of the current sinogram residue based on prior constraints. The update direction is transformed into the Radon space, and a step size is determined which minimizes a difference between the current sinogram residue and a Radon transform of the artifact-reduced reconstructed image of the current sinogram residue in the Radon space. The minimized difference between the current sinogram residue and a Radon transform of the artifact-reduced reconstructed image of the current sinogram residue is the next sinogram residue. These steps may be repeated iteratively for each next sinogram residue until the solution converges. A final reconstruction result (image) is generated by combining artifact-reduced reconstructed images generated for each sinogram residue.
These and other advantages of the invention will be apparent to those of ordinary skill in the art by reference to the following detailed description and the accompanying drawings.
a)-3(c) illustrate exemplary projection data used to test an embodiment of the present invention;
a)-4(c) illustrate exemplary results of an embodiment of the present invention compared to a conventional iterative method;
The present invention is directed to a method for tomographic image reconstruction. The present invention can be applied to any medical imaging technology, including computed tomography (CT), magnetic resonance imaging (MRI), etc. Embodiments of the present invention are described herein to give a visual understanding of the signal downsizing method. It is to be understood, that these embodiments may be performed within a computer system using data stored within the computer system. Accordingly, some steps of the method can occur as internal representations within the computer system.
Traditional iterative image reconstruction methods discretize the Radon transform operator to form weight factors between each image pixel intensity and each sinogram value. This set of weight factors is represented as the system matrix A, and represents the forward projection from the image to the sinogram. By stacking the known sinogram values into a vector b, the reconstruction problem can be formulated as solving a linear system of a vector x representing the unknown image to be reconstructed, such that Ax=b. Regularization based on signal properties, such as smooth surface and edge modeling, is usually necessary to assure valid solutions due to the ill-posed nature of inverse problems. Regularization enforces some prior knowledge about the signal to be reconstructed. Accordingly, the objective function can be designed as follows:
J=∥Ax−b∥2α∥Rx∥2 (1)
where ∥Ax−b∥2 is a data fidelity term, ∥Rx∥2 is a regularization term, and α is the weight of the regularization term. The data fidelity term enforces the similarity between the measured sinogram with the forward projection of the reconstructed image to ensure that the reconstructed image resembles the true object. However, in some cases there usually could be multiple solutions that satisfy the data fidelity term. The regularization term attempts to enforce prior knowledge of the image to favor the solutions that conform to the prior knowledge. For example, a common prior knowledge constraint is that a pixel usually has similar intensity to neighboring pixels. This can be referred to as a smoothness constraint. To enforce this smoothness constraint, it is possible to define a regularization term as “∥x−average intensity in the neighborhood∥2”. This term will give high penalty for the solutions that are not smooth.
The optimization of the objective function of Equation (1) in conventional methods is typically performed by gradient descent methods based on the derivative:
∂J/2∂x=(ATA+αRTR)x−ATb (2)
where AT represents a back projection operator, which reconstructs a sinogram into an image. However, back projection derived from the derivative cannot effectively pick up the high frequency structures in the image, and suffers from slow convergence.
In this optimization framework, it can be seen that on one hand, the reconstructed image must be updated based on the regularization terms to enforce various prior knowledge and constraints on the image. These prior knowledge and constraints are typically more effectively enforced in the image space rather than the Radon space. On the other hand, it is also necessary to match sinograms to enforce the data fidelity term of the objective function, which can be more effectively performed in the Radon space. Conventional methods address these two parts of the objective function simultaneously and hence are difficult to optimize.
According to an embodiment of the present invention, tomographic image reconstruction can be performed in a two-stage method, in which one stage is performed in the image space and one stage is performed in the Radon space.
At step 102, an image I(i)AR 204 is reconstructed from a sinogram residue sino(i) 202 for the ith iteration. The initial sinogram residue sino(0) is the original sinogram. The original sinogram is projection measurements that can be measured by a scanning device, such as a CT scanner. The image I(i)AR is an artifact-reduced image obtained using adaptive filtering on the Filtered Back Projection (FBP) of the sinogram residue sino(i). Since Filtered Back Projection (FBP) reconstructs an image from the sinogram residue, but induced streak artifacts may occur under low-dose imaging, the regularization term R of Equation (1) provides good signal modeling for adaptively filtering the artifacts while preserving sharp object boundaries. The artifact-reduced image I(i)AR represents a refined feasible update direction in the signal subspace.
FBP is used to relate the sinogram residue to the image space by providing an image that matches the sinogram residue. In addition, FBP picks up high frequency components faster than back projection, such that functional handling with edges and other regions becomes easier in image space. However, the FBP reconstructed image does not satisfy prior signal modeling constraints (e.g., smoothness constraint) and cannot be used directly with additional regularization. Therefore, according to an embodiment of the present invention, image space adaptive filtering is used to enforce the regularization term. Based on smoothness constraints in a Bayesian image restoration context, this method restores an image Î (instead of using the FBP result directly) that optimizes the following objective function, in which the subscript p indicates the signal estimated at pixel p:
where λi (i=1, 2, 3) weights each constraint, and Īfbp.p is the average intensity of the FBP reconstructed image in the neighborhood of p.
The first term of Equation (3) enforces that the estimated signal should look like the FBP reconstructed image. The second term models the signal property and prefers a smooth signal. ep represents a pixel-based edge modeling process which varies between 0 and 1. When ep=1, it disables the smoothness constraint and preserves sharp edges. A penalty λ3 is introduced to prevent treating all pixels as edges. From the initial FBP result, the object boundaries with artifacts are obtained. A sobel edge detector is tuned to adjust different sizes and thresholds accordingly to identify the edges of the object structures. If this process is revisited during another iteration, the threshold varies. Thus, an adaptive threshold is used. Since artifacts are hard to remove compared to weak object structures (which can be recovered in future iterations), it is possible to manually tune the threshold in the first iteration. This removes artifacts as mush as possible at the expense of removing some weak structures as well. It is also possible to estimate the histogram of the sobel detection to find the Cumulative Density Function (CDF) and compute the percentile based threshold. In future iterations, this percentile can be used as an adaptive threshold, instead of manually tuning the threshold in every iteration.
In the second term of Equation (3), using predetermined weights for averaging to achieve a smooth signal, Īfbp causes blurring in the vicinity of edges. Bilateral filtering can be used to obtain Īfbp, since it is efficient and non-iterative. While normal low pass filtering averages neighboring pixel intensity values with decreasing weights for pixels at larger distances, a bilateral filter adds a second dimension to measure radiometric similarity. This dimension assigns greater weights to those pixels with an intensity that is similar to the center pixel intensity. In a space variable representation, a bilateral filtered image Ibil(
where c is the normalization factor. σ1 controls spatial low pass filtering, while σ2 controls discrimination. Smooth regions share similar pixel intensities across their neighborhood, so the pixel intensity differences from artifacts are much smaller than a tuned σ2, making the second exponential of Equation (4) close to 1. Thus, bilateral filtering smoothes away artifacts. However, when the filtering operation reaches pixels at the edges, the intensity difference of neighboring pixels in the smooth regions are significantly larger than σ2, making the second exponential close to 0, which cancels contributions from those pixels and adaptively achieves an intensity-selective filtering. In this way, artifacts are removed without blurring the edges.
The terms of Equation (3) can be combined to achieve the smoothness constraint efficiently in image space in order to model the object being reconstructed in terms of its boundary and to define a pixel based weighting function ep based on edge detection threshold th, which is adapted from what pixel intensity represents in image space. To preserve edges, ep weights the original FBP reconstruction result Ifbp more on the structure boundaries. In addition, to remove artifacts, ep weights the bilateral-filtered reconstruction Ibil more on non-boundary parts. Thus the artifact reduces image IAR is produced as:
IAR=Î=(1−ep)Ibil+epIfbp. (5)
ep is chosen to be a tunable function of intensity difference from the threshold th, and bounded between 0 and 1, such that:
where k tunes the steepness of the function, and Ifbp.p refers to the intensity of pixel p in the image Ifbp.
Returning to
At step 106, a step size a(i) is determined based on the sinogram residue sino(i) and the step size sino(i)AR for iteration A Based on the linearty of the Radon transform, the Radon transform of the reconstructed image can be decomposed as:
A(I+a(i)I(i)AR)=A(I)+a(i)A(I(i)AR). (7)
In the image space, the reconstruction result I can be updated after each iteration as follows:
I←I+a(i)I(i)AR (8)
and the next sinogram residue estimate sino(i+1) can be calculated as:
sin o(i+1)=sin o(i)−sin o(i)AR (9)
In each iteration, a(i) must be determined to minimize the data fidelity term:
Accordingly, the step size at a(i) can be obtained by setting the derivative of the fidelity term expressed in Equation (10) equal to zero and solving for a(i), such that:
a(i)=(sin o(i)T sin o(i)AR)/∥sin o(i)AR∥2 (11)
At step 108, the next sinogram residue sino(i+1) is calculated based on the update direction sino(i)AR and the step size a(i). As illustrated in
At step 110, it is determined whether the solution has converged. For example, the next sinogram residue sino(i+1) can be compared with a threshold value. If the next sinogram residue sino(i+1) is less than the threshold value, it is determined that the solution has converged. If the next sinogram residue sino(i+1) is not less than the threshold value than, it is determined that the sinogram residual error has not yet been minimized so the solution has not yet converged. If the solution has not yet converged, the method proceeds to step 112. If the solution has converged, the solution proceeds to step 114.
At step 112, the method proceeds to next iteration and steps 102-108 are repeated for i+1. Accordingly, the method returns to step 102 and reconstructs an image I(i+1)AR from the sinogram residue sino(i+1) for the iteration i+1. As shown in
At step 114, a final reconstructed image is generated by combining the reconstructed images of the sinogram residues generated at each iteration. Accordingly, the final reconstruction result can be expressed as:
I=a(0)I(0)AR+ . . . +a(i)I(i)AR+ . . . . (12)
Thus, the final reconstructed image is a sum of “steps” in the image space, where each step is a product of a descent direction IAR and a step size a.
a)-3(c) illustrate exemplary projection data used to test an embodiment of the present invention.
a)-4(c) illustrate exemplar results of reconstructing the sinogram 302 of
The above-described method for image reconstruction can be implemented on a computer using well-known computer processors, memory units, storage devices, computer software, and other components. A high level block diagram of such a computer is illustrated in
The foregoing Detailed Description is to be understood as being in every respect illustrative and exemplary, but not restrictive, and the scope of the invention disclosed herein is not to be determined from the Detailed Description, but rather from the claims as interpreted according to the full breadth permitted by the patent laws. It is to be understood that the embodiments shown and described herein are only illustrative of the principles of the present invention and that various modifications may be implemented by those skilled in the art without departing from the scope and spirit of the invention. Those skilled in the art could implement various other feature combinations without departing from the scope and spirit of the invention.
This application claims the benefit of U.S. Provisional Application No. 60/783,177, filed Mar. 16, 2006, the disclosure of which is herein incorporated by reference.
Number | Name | Date | Kind |
---|---|---|---|
5416815 | Hsieh | May 1995 | A |
5420788 | Vissers | May 1995 | A |
6026142 | Gueziec et al. | Feb 2000 | A |
6570951 | Hsieh | May 2003 | B1 |
6915005 | Ruchala et al. | Jul 2005 | B1 |
6980022 | Shumarayev et al. | Dec 2005 | B1 |
7386088 | Deman et al. | Jun 2008 | B2 |
20050105693 | Zhao et al. | May 2005 | A1 |
20090238337 | Wang | Sep 2009 | A1 |
Number | Date | Country | |
---|---|---|---|
20070217566 A1 | Sep 2007 | US |
Number | Date | Country | |
---|---|---|---|
60783177 | Mar 2006 | US |