The current invention is generally related to an image processing and system, and more particularly related to optimize image generation by adaptively determining parameter values in an iterative reconstruction algorithm based upon certain information such as statistical information.
For volume image reconstruction, an iterative algorithm has been developed by various groups. One exemplary algorithm is a total variation (TV) minimization iterative reconstruction algorithm for application to sparse views and limited angle x-ray CT reconstruction. Another exemplary algorithm is a TV minimization algorithm aimed at region-of-interest (ROI) reconstruction with truncated projection data in many views, i.e., interior reconstruction problem. Yet another exemplary algorithm is a prior image constrained compressed sensing (PICCS) method. In general, total-variation-based iterative reconstruction (IRTV) algorithms have advantages for sparse view reconstruction problems.
In the prior art attempts, the data processing procedure of well-known IRTV algorithms is illustrated in
One prior art processing procedure as illustrated in
A second prior art processing procedure as illustrated in
Determination of the above described parameter values or coefficients such as a and β in
In some detail, the parameters generally include a regularization strength parameter and a relaxation parameter in the iterative reconstruction scheme. These two parameters control certain characteristics in the reconstructed image. For example, if the regularization strength parameter value is increased, the noise is reduced in the IR image while error is increased in matching the real data. On the other hand, if the relaxation parameter is increased, error is reduced in matching to the real data while noise is increased in the IR image. For example, as the error is reduced in matching to the real data, edges in the reconstructed image appear sharp, and the reconstructed image has a better resolution at the cost of blurriness in the background due to the increased noise. For these reasons, the regularization strength parameter and the relaxation parameter need to be balanced for optimal image quality.
In practice, a pair of the fixed values for the regularization strength parameter and the relaxation parameter does not appear to accommodate all clinical demands in the IR reconstructed images. That is, a particular pair of the fixed parameter values may improve image quality in one particular clinical application. On the other hand, the same fixed parameter values generally may not improve image quality in another clinical application.
To improve image quality in the IR reconstructed image for different applications based upon data acquired under various conditions, the manual adjustment of these parameters requires a large amount of time and or may be often an impossible task for users. In view of the above discussed prior art problems, a practical solution is still desired for implementing an iterative reconstruction algorithm that includes an automatic and adaptive determination of the parameter values or coefficients.
Referring now to the drawings, wherein like reference numerals designate corresponding structures throughout the views, and referring in particular to
The multi-slice X-ray CT apparatus further includes a high voltage generator 109 and a current regulator 111 that respectively control a tube voltage and a tube current in the X-ray tube 101 through a slip ring 108 so that the X-ray tube 101 generates X ray in response to a system controller 110. The X rays are emitted towards the subject S, whose cross sectional area is represented by a circle. The X-ray detector 103 is located at an opposite side from the X-ray tube 101 across the subject S for detecting the emitted X rays that have transmitted through the subject S. The X-ray detector 103 further includes individual detector elements or units that are conventional integrating detectors.
Still referring to
The above described data is sent to a preprocessing device 106, which is housed in a console outside the gantry 100 through a non-contact data transmitter 105. The preprocessing device 106 performs certain corrections such as sensitivity correction on the raw data. A storage device 112 then stores the resultant data that is also called projection data at a stage immediately before reconstruction processing. The storage device 112 is connected to the system controller 110 through a data/control bus, together with a reconstruction device 114, an input device 115, a display device 116 and the scan plan support apparatus 200. The scan plan support apparatus 200 includes a function for supporting an imaging technician to develop a scan plan.
One embodiment of the reconstruction device 114 further includes various software and hardware components. According to one aspect of the current invention, the reconstruction device 114 of the CT apparatus advantageously determine parameter values or coefficients that are used in improving image quality in a predetermined iterative reconstruction (IR) algorithm. In general, the reconstruction device 114 in one embodiment of the current invention operates the total variation iterative reconstruction (TVIR) algorithm, which performs on the projection data an ordered subset simultaneous algebraic reconstruction technique (OS-SART) step and a TV minimization step.
During the ordered subsets simultaneous algebraic reconstruction technique (OS-SART), the reconstruction device 114 also performs two major operations. Namely, the reconstruction device 114 re-projects the image volume to form the computed projection data and back-projects the normalized difference between the measured projection' and the computed projection data to reconstruct an updated image volume. In further detail, one embodiment of the reconstruction device 114 re-projects the image volume by using the ray tracing technique where no coefficient of the system matrix is cached. Moreover, one embodiment of the reconstruction device 114 simultaneously re-projects all rays in a subset. In the back-projection, one embodiment of the reconstruction device 114 uses a pixel-driven technique to back-project all of the normalized difference projection data in a subset to form the desired updated image volume. This and other embodiments performing other iterative reconstruction algorithms such as simultaneous algebraic reconstruction technique (SART) are optionally included in the current scope of the invention as more particularly claimed in the appended claims.
The OS-SART and TV steps provide somewhat opposing effects on the image quality during the reconstruction. After OS-SART, some sharpness is resulted due to a reduced number of errors in matching the real data while noise is increased in the updated image. As a result, the update image may appear sharp but noisy at the same time. In the total variation (TV) minimization step, one embodiment of the reconstruction device 114 repeats the TV minimization step X times where X is a predetermined number to improve noise at the cost of resolution.
One embodiment of the reconstruction device 114 advantageously determines a tradeoff between a resolution level and a noise level by updating an image using a pair of parameter values or coefficients to weight the result of OS-SART (data fidelity update) and that of TV minimization (regularization update) in a predetermined iterative reconstruction algorithm so as to optimize image quality. That is, for each iteration, at least two parameter values or coefficients are adaptively determined for the data fidelity update and the regularization update in an automatic manner so that the control for minimizing the noise and the error is more efficient than determining one coefficient and then the other coefficient. The adaptively determined coefficients are applied to the data fidelity update and the regularization update before updating the image from a previous iteration in a predetermined IR algorithm.
Now referring to
The SART unit performs on the original image x(n−1) to reduce an error amount in matching the real data and outputs a first intermediate image or image update xSART(n), which now has an increased amount of noise. The SART unit also outputs the image update xSART(n) to an α+β determination unit to determine a relaxation parameter value or a first coefficient β based upon the changes in the current iteration. The first intermediate image or image update xSART(n) is weighted by the relaxation parameter value or the first coefficient β. By the same token, the original image x(n−1) is weighted by a complementary relaxation parameter value or a first complementary coefficient (1−β). The two weighted images are summed together to a first normalized SART updated image xS(n). During this independent process, the original image x(n−1) is not updated.
In an independent manner, the TV unit performs on the original image x(n−1) to reduce a noise level and outputs a second intermediate image or image update xREG(n), which now has an increased amount of error in matching the real data. The TV unit also outputs the image update xREG(n) to the α+β determination unit to determine a regularization parameter value or a second coefficient α based upon the changes in the current iteration. The second intermediate image or image update xREG(n) is weighted by the regularization strength parameter value or the second coefficient α. By the same token, the original image x(n−1) is weighted by a complementary regularization strength parameter value or a second complementary coefficient (1−α). The two weighted images are summed together to a second noanalized TV updated image xR(n). During this independent process, the original image x(n−1) is not updated.
The a α+β determination unit generally determines optimal parameter values or coefficients in an efficient manner. The optimal values are determined in a certain predetermined manner for the relaxation parameter value or the first coefficient β and the regularization strength parameter value or the second coefficient α. One exemplary manner is based upon statistical information such as variance in noise and error in matching the real data. Any combination of the noise and error variance is optionally used to determine the optical parameter values.
After the first normalized SART updated image xS(n) and the second normalized TV updated image xR(n) are independently obtained, these two images are added together while they are being normalized to output a reconstructed image x(n). The first normalized SART updated image xS(n) is also called the data fidelity update and is further optionally weighted by a noise-resolution parameter value or a third coefficient λ. In this regard, the second normalized TV updated image xR(n) is also called the regularization update and is further optionally weighted by a complementary noise-resolution parameter value or a third complementary coefficient (1−λ). That is, the independently determined data fidelity and regularization updates are optionally normalized by the third pair of coefficients, and λ and (1−λ), which are generally determined by a user in an empirical manner. One exemplary user interface for determining the λ value is implemented as a turning knob.
Finally, the original image x(n−1) is updated based upon the reconstructed image x(n) in a single step. That is, for each iteration, the data fidelity update and the regularization update are summed together at the same time in a single step to generate the reconstructed image x(n) so that the original image x(n−1) is now updated. Thus, an image is updated once by using both the data fidelity update and the regularization update together at the same time so that the control for minimizing the noise and the error is more efficiently and effectively exerted than by applying these updates in a sequential manner. Consequently, the noise-resolution trade-off is substantially improved in the total-variation-based iterative reconstruction technique (TV-IR) such as TV-OS-SART.
Now referring to
Still referring to
Finally, in a step S30, it is determined as to whether or not the iteration needs to end a predetermined iterative reconstruction algorithm such as OS-SART and SART in one exemplary process according to the current invention. In one exemplary process, the termination condition may be based upon a predetermined number of iterations. In another exemplary process, the termination condition may be based upon a predetermined condition in iterations. In any case, if the process is not yet ready to terminate as decided in the step S30, the exemplary process repeats from the step S10. On the other hand, if the step S30 determines that the exemplary process is to be terminated, the exemplary process outputs a reconstructed image and terminates its process.
Now referring to
Now referring to
For the noise-based determination, the steps S11Sn through S14Sn ultimately determine a weighted noise change. In a first step S11Sn, given an image x(n−1) at iteration n−1, noise n(n−1) is determined in the image x(n−1). A predetermined reconstructive technique including SART is applied to the image x(n−1) with a fixed relaxation parameter value having a strong value such as 1 so as to obtain xSART(n)=SART [x(n−1)] and to compute nSART(n) in a step S12Sn from xSART(n). Based upon the above determined noise values n(n−1) and nSART(n) in the steps S11Sn and step S12Sn, the noise change ΔnSART=nSART(n)−n(n−1) is determined in the step S13Sn. Finally, a weighted noise change ΔnS=βΔnSART, where β is the SART strength parameter or the relaxation parameter in S14Sn.
By the same token, for the error-based determination, the steps S11Se through S14Se ultimately determine a weighted error change. In a first step S11Se, given an image x(n−1) at iteration n−1, data fidelity error ε(n−1) is determined in the image x(n−1). A predetermined reconstructive technique including SART is applied to the image x(n−1) with a fixed relaxation parameter value having a strong value such as 1 so as to obtain xSART(n)=SART[x(n−1)] and to compute εSART(n) in a step S12Se from xSART(n). Based upon the above determined data fidelity error values ε(n−1) and εSART(n) in the steps S11Se and step S12Se, the data fidelity error change ΔεSART=εSART(n)−ε(n−1) is determined in the step S13Se. Finally, a weighted data fidelity error change ΔεS=βΔεSART, where β is the SART strength parameter or the relaxation parameter in S14Se.
In details, the SART update or data fidelity update xS(n) is defined by xS(n)=x(n−1)+β(xSART(n)−x(n−1)), where (xSART(n)−x(n−1))is obtained in terms of ΔnSART alone, ΔεSART alone or a combination of ΔnSART and ΔεSART as illustrated in a step S15S of
Now referring to
For the noise-based determination, the steps S11Rn through S14Rn ultimately determine a weighted noise change. In a first step S11Rn, given an image x(n−1) at iteration n−1, noise n(n−1) is determined in the image x(n−1). A predetermined regularization technique including total variation (TV) minimization is applied to the image x(n−1) with a fixed regularization parameter value having a strong value such as 1 so as to obtain xREG(n)=REG [x(n−1)] and to compute nREG(n) in a step S12Rn from xREG(n). Based upon the above determined noise values n(n−1) and nREG(n) in the steps S11Rn and step S12Rn, the noise change ΔnREG=nREG(n)−n(n−1) is determined in the step S13Rn. Finally, a weighted noise change ΔnR=αΔnREG, where α is the TV strength parameter or the regularization strength parameter in S14Rn.
By the same token, for the error-based determination, the steps S11Re through S14Re ultimately determine a weighted error change. In a first step S11Re, given an image x(n−1) at iteration n−1, data fidelity error ε(n−1) is determined in the image x(n−1). A predetermined regularization technique including TV minimization is applied to the image x(n−1) with a fixed regularization parameter value having a strong value such as 1 so as to obtain xREGn=REG[x(n−1) and to compute εREG(n) in a step S12Re from xREG(n). Based upon the above determined regularization error values ε(m−1) and εREG(n) in the steps S11Re and step S12Re, the regularization error change ΔεREG=ε(n−1) is determined in the step S13Re. Finally, a weighted regularization error change ΔεR=αΔεREG, where α is the TV strength parameter or the regularization strength parameter in S14Re.
In details, the TV update or regularization update xR(n) is defined by xR(n)=x(n−1)+α(xREG(n)−x(n−1)), where (xREG(n)−x(n−1)) is obtained in terms of ΔnREG alone, ΔεREG alone or a combination of ΔnREG and ΔεREG as illustrated in a step S15R of
Now referring to
In a step S20, the noise and error in the final image x(n) are approximated based upon the above assumptions. Δn=λΔnS+(1−λ)ΔnR: The noise An in the final image x(n) is a sum of the weighted noise change after SART.λΔnS, where ΔnS=βΔnS=βΔnSART and the weighted noise change after TV (1−λ)ΔnR, where ΔnR=αΔnREG. Similarly, Δε=λΔεS+(1−λ)ΔεR: the error Δε in the final image x(n) is a sum of the weighted error change after SART λΔεS, where ΔεS=βΔεSART and the weighted error change after TV(1−λ)ΔεR, where ΔεR=αΔεREG.
Now referring to a step S21 in
ƒ(α, β)=(n(n−1)+Δn)2+w(ε(n−1)+Δε)2
where a parameter w is a “scaling” parameter so that Δn and Δε ascertained to be of the same magnitude. The parameter w is used to equalize the weight of both factors, and it can be decided only once based on how errors and noise are computed. It can also be used to control the weight of each factor
To find the minimum, the equations,
are solved using the following notations for simplicity.
n=n
(n−1)>0
e=ε
(n−1)>0
s=Δn
SART>0
t=Δn
REG<0
u=Δε
SART21 0
v=Δε
REG>0
Based upon the above notations, g and h are now defined as follows:
g=n+Δn=n+λβs+(1−λ)αt
h=e+Δε=e+λβu+(1−λ)αv.
Then, the following derivatives are determined as follows:
By relating the above defined g and h to the function ƒ(α,β),
Another way to optimize the coefficients α and β is defined by the following equations. To optimize a regularization parameter a, some statistical information such as variance is used to determine the regularization parameter value.
where α is the coefficient while an amount of the variance is Var{x(n)} at the particular iteration of n, Var{x(n−1)} at the particular iteration of n−1 and Var{xREG(n)} after the predetermined regularization process. For example, the amount of the variance is defined by noise variance. Alternatively, the amount of the variance is defined by error variance.
To optimize a relaxation parameter β, some statistical information such as variance is used to determine the relaxation parameter value.
where β is the coefficient while an amount of the variance is Var{x(n)} at the particular iteration of n, Var{x(n−1)} at the particular iteration of n−1 and Var{xREG(n)} after the predetermined relaxation process. For example, the amount of the variance is defined by noise variance. Alternatively, the amount of the variance is defined by error variance.
In the above discussed parameter value optimization, one exemplary error determination is expressed in the following equation. For example, an amount of the data fidelity error ε is determined for a particular image volume xn based upon the same equation.
where i is a ray index ranging from 0 to N, which is Nview Nseg Nch. Nview denotes a number of views, Nseg denotes a number of segments, and Nch denotes a number of channels. Di is a statistical weight corresponding to each measurement of the ray i. R° denotes original raw data, and Rn denotes reprojected data from volume xn. ρ is an arbitrarily selected number. For example, if ρ=2, the right side of the above equation resembles root mean square error (RMSE). Although RMSE is suitable if data differences have normal distribution, RMSE provides a large weight on outliers. On the other hand, if ρ=1, the right side of the above equation resembles mean absolute error (MAE), which is more suitable in general for non-Gaussian variables. The arbitrarily selected value of p=1 seems more stable.
Now referring to
Now referring to
In this regard, to analyze iteration convergence, the slopes of the predetermined Geodesic curve are determined. That is, the slope ms of V1 and the mR of V2 are respectively defined as follows:
m
S=|ΔεS/ΔnS|
m
R
=|ε
R
/Δn
R|
To ascertain that a predetermined algorithm converges, the final image stays on the predetermined Geodesic curve. That is, to have the converging effect, the slopes should have a mS>mR. Once mS=mR is reached, additional iterations no longer converge. Note also that once mS=MR is reached, the denominator AD-BC of
collapses, and optimal parameter values cannot be found.
Now referring to
Now referring to
It is to be understood, however, that even though numerous characteristics and advantages of the present invention have been set forth in the foregoing description, together with details of the structure and function of the invention, the disclosure is illustrative only, and that although changes may be made in detail, especially in matters of shape, size and arrangement of parts, as well as implementation in software, hardware, or a combination of both, the changes are within the principles of the invention to the full extent indicated by the broad general meaning of the terms in which the appended claims are expressed.