This disclosure relates generally to methods, systems, and apparatuses for Magnetic Resonance Imaging (MM) reconstruction.
Imaging inverse problems such as reconstruction, deblurring, super-resolution, inpainting, or denoising can be solved by assuming the target image is sparse in the wavelet domain. Orthogonal wavelet transforms are not shift-invariant; image features are processed differently depending on their position with respect to the wavelet grid, and this can result in blocking artifacts.
Techniques to solve the proximal operation performed during reconstruction have been developed, such as the utilization of an undecimated redundant wavelet transforms in conjunction with a nested inner algorithm inside the main solver (e.g. Chambolle-Pock or Dykstra inside FISTA).
Dynamic contrast-inhanced (DCE) MRI involves injection of a contrast agent (CA) into the patient and observing the dynamic intake of the CA into tissue at several different points in time using MRI. Image reconstruction methods apply multiple shifted wavelet transforms at each iteration, which incurs an extra computational cost of at least a factor of 2 per image dimension. Additionally, exact undecimated wavelet methods also store the wavelet coefficients of the image, which are larger than the image by a factor of two in every dimension. This becomes very large with large-dimension use-cases such as dynamic volumetric reconstruction (3D+T), motion-compensated imaging, multi-contrast imaging including flow or diffusion, etc.
In some embodiments, a method comprises acquiring navigation signal data during navigation scans at each of a plurality of points in time. A plurality of magnetic resonance imaging (MRI) k-space data corresponding to an imaged object are acquired at the plurality of points in time using Cartesian sampling, the k-space data including at least two spatial dimensions, time and an assigned motion state. The respective motion state for each of the k-space data are computed based on navigation data. At least one image is reconstructed from the plurality MRI k-space data using k-space data corresponding to at least two motion states and the same point in time to reconstruct the at least one image.
In some embodiments, a magnetic resonance (MR) imaging device has a plurality of coils, and is configured to collect data representing an MR image from an object. A processor has a storage device for storing frequency components of the data acquired using a Cartesian acquisition strategy during acquisition of the frequency components, the processor programmed for acquiring navigation signal data during navigation scans at each of a plurality of points in time. A plurality of magnetic resonance imaging (MRI) k-space data corresponding to an imaged object are acquired at the plurality of points in time using Cartesian sampling, the k-space data including at least two spatial dimensions, a time, and a motion state. The respective motion state for each of the k-space data are computed based on navigation data. At least one image is reconstructed from the plurality MM k-space data using k-space data corresponding to at least two motion states and the same point in time to reconstruct the at least one image.
In some embodiments, a non-transitory machine-readable storage medium encoded with computer program code, wherein when a processor executes the computer program code, the processor performs a method comprising acquiring navigation signal data during navigation scans at each of a plurality of points in time. A plurality of magnetic resonance imaging (MRI) k-space data corresponding to an imaged object are acquired at the plurality of points in time using Cartesian sampling, the k-space data including at least two spatial dimensions, a time. The respective motion state for each of the k-space data are computed based on navigation data. At least one image is reconstructed from the plurality MM k-space data using k-space data corresponding to at least two motion states and the same point in time to reconstruct the at least one image.
This description of the exemplary embodiments is intended to be read in connection with the accompanying drawings, which are to be considered part of the entire written description. In the description, relative terms such as “lower,” “upper,” “horizontal,” “vertical,”, “above,” “below,” “up,” “down,” “top” and “bottom” as well as derivative thereof (e.g., “horizontally,” “downwardly,” “upwardly,” etc.) should be construed to refer to the orientation as then described or as shown in the drawing under discussion.
This disclosure describes several embodiments directed at methods, systems, and apparatuses Magnetic Resonance Imaging (MRI) reconstruction using wavelet regularization. The techniques described herein may be applied to many if not all compressed sensing (CS) use-cases to provide an overall performance improvement without sacrificing image quality. U.S. Patent Application Publication No. US 2016/0247263 by Mailhe et al. describes use of wavelets for regularization and reconstructing magnetic resonance images, and is incorporated by reference herein in its entirety. U.S. Patent Application Publication No. US2016/0146915 by Mailhe et al. describes a compressed sensing process for reconstructing magnetic resonance images, and is incorporated by reference herein in its entirety.
Some embodiments described herein use a Cartesian data acquisition method with a gating signal that is separate from spatial image data and time (perfusion state). The gating signal is representative of the motion state. Using Cartesian based acquisition simplifies computations and speeds up image processing. Some embodiments use the gating signal to resolve images collected in all motion states MRI scanning. Other embodiments use a hybrid approach, in which the gating signal is used to resolve images collected in all motion states at selected times (e.g., at certain perfusion states), and to only resolve images collected in a single or multiple selected motion states at all other times.
System Architecture
Further RF (radio frequency) module 20 provides RF pulse signals to RF coil 18, which in response produces magnetic field pulses which rotate the spins of the protons in the imaged body of the patient 11 by ninety degrees or by one hundred and eighty degrees for so-called “spin echo” imaging, or by angles less than or equal to 90 degrees for so-called “gradient echo” imaging. Gradient and shim coil control module 16 in conjunction with RF module 20, as directed by central control unit 26, control slice-selection, phase-incoding, readout gradient magnetic fields, radio frequency transmission, and magnetic resonance signal detection, to acquire magnetic resonance signals representing planar slices of patient 11.
In response to applied RF pulse signals, the RF coil 18 receives MR signals, i.e., signals from the excited protons within the body as they return to an equilibrium position established by the static and gradient magnetic fields. The MR signals are detected and processed by a detector within RF module 20 and k-space component processor unit 34 to provide an MR dataset to an image data processor for processing into an image. In some embodiments, the image data processor is located in central control unit 26. However, in other embodiments such as the one depicted in
A magnetic field generator (comprising coils 12, 14 and 18) generates a magnetic field for use in acquiring multiple individual frequency components corresponding to individual data elements in the storage array. The individual frequency components are successively acquired using a Cartesian acquisition strategy as the multiple individual frequency components are sequentially acquired during acquisition of an MR dataset representing an MR image. A storage processor in the k-space component processor unit 34 stores individual frequency components acquired using the magnetic field in corresponding individual data elements in the array. The row and/or column of corresponding individual data elements alternately increases and decreases as multiple sequential individual frequency components are acquired. The magnetic field acquires individual frequency components in an order corresponding to a sequence of substantially adjacent individual data elements in the array and magnetic field gradient change between successively acquired frequency components is substantially minimized.
Central control unit 26 uses information stored in an internal database to process the detected MR signals in a coordinated manner to generate high quality images of a selected slice(s) of the body (e.g., using the image data processor) and adjusts other parameters of system 100. The stored information comprises predetermined pulse sequence and magnetic field gradient and strength data as well as data indicating timing, orientation and spatial volume of gradient magnetic fields to be applied in imaging. Generated images are presented on display 40 of the operator interface. Computer 28 of the operator interface includes a graphical user interface (GUI) enabling user interaction with central control unit 26 and enables user modification of magnetic resonance imaging signals in substantially real time. Display processor 37 processes the magnetic resonance signals to provide image representative data for display on display 40, for example.
Regularization
Many challenges in medical imaging such as reconstruction, denoising or super-resolution can be modeled mathematically as ill-posed linear inverse problems:
y=Ax+n (1)
where the goal is to reconstruct an unknown signal y from partially incomplete data x that is corrupted by measurement noise n. The matrix A models the measurement system. In case of parallel MRI it is often modeled as A=FS with F representing the (partial) Fourier transform and S containing the coil sensitivities. Because the system is underdetermined, there exist infinitely many solutions to it and additional constraints to the solution are imposed. A standard approach to the estimator of Equation (1) is as follows:
where 1/2 ∥y−Ax∥22 is the data fidelity term to enforce the solution to be close to the measurements and the function Φ(x) is called the regularizer with λ>0 being the regularization parameter to balance the trade-off between the data fidelity and the regularization.
In some embodiments the solution is sparse with respect to a given basis, meaning having only few non-zero coefficients in that basis. Compressed sensing is a signal processing technique, in which the sparsity of a signal is exploited to recover it from far fewer samples than required by the Shannon-Nyquist sampling theorem. A popular approach in compressed sensing is a wavelet based framework and promoting sparsity in a given wavelet basis such as Haar. However, having the measure of non-zeroes ∥•∥oas a regularizer is NP-hard. Thus, in case of a wavelet based compressed sensing, the regularizer has often the form of ∥Wx∥1 and promotes sparsity with respect to the l1-norm that is a convex approximation to the l0 pseudo-norm. Here W represents a wavelet transform. In general, W can be any linear operator depending on the underlying problem. For example, for MRI reconstruction, some embodiments use an undecimated wavelet transform due to its translation invariance. However, the choice of algorithms to solve the optimization problem depends on the underlying regularizer. An efficient algorithm to solve Equation (1) is the iterative shrinkage/thresholding algorithm (ISTA), which is a special case of so called forward-backward splitting algorithms. A forward-backward splitting algorithm splits the problem into functions f1=1/2∥y−Ax∥22 and f2=λΦ(x) and uses them individually. Since f2 is often non-smooth it is processed via its proximity operator. The iterative scheme takes a gradient step on the function f1 (forward step) and evaluates the proximity operator of function f2 at that new point (backward step). Redundant wavelet transforms can be handled by using a Chambolle-Pock type algorithm for the proximal step. However, from a practical perspective, using orthogonal wavelets have the advantage of reducing the memory consumption and therefore faster processing times.
Given a function g(x), the proximal operator is the solution of the minimization problem:
Note that Equation (3) is essentially a denoising problem. Many functions have closed form solutions of their proximal operator. Of special interest in this work is the proximal operator of the l1-norm, which yields the soft-shrinkage operator defined as the point-wise shrinkage function:
τsoft(x,λ)=max{|xi|−λ, 0}sign(xi) (4)
An efficient algorithm to solve Equation (2) that utilizes proximal operations is the iterative shrinkage/thresholding algorithm called ISTA and its accelerated version called Fast-ISTA (FISTA). The algorithm below is derived from the perspective of the majorization-minimization (MM) prescription. MM minimizes a convex surrogate to a function rather than the function itself. Consider a function Q(Θ|Θm) of Θ that depends on a fixed parameter Θm. Given a function f(Θ), Q (Θ|Θm) is said to majorize f at the point Θm if
Q(Θ|Θm)≧f(Θ) for all Θ, (5)
Q(Θm|Θm)=f(Θm) (6)
The minimizer of the function Q can be shown to descent the function f such that
f(Θm+1)≦f(Θm) (7)
The minimization problem shown in Equation (2) can be split into two functions f(x)=1/2∥y−Ax∥22 and Φ(x). Incorporating this into the MM presecitpion, one can majorize F:=f(x)+Φ(x) by a first order approximation at a given point xkwith:
Q(x|xk)=f(xk)+∇f(xk)(x−xk)=1/2∥x−xk∥22+λΦ(x) . (8)
Q satisfies the conditions in Equations (5) and (6) for a given xk and with λ∈ (0,1/L], where L is a Lipschitz constant of ∇f and Φ(x)≧0∀x.
Iteratively minimizing Q yields the IST algorithm:
Equation (9) admits the form of Equation (3) with u=xk−∇f(xk) and thus, the IST algorithm can also be written as:
If Φ=0, Equation 10 comprises minimizing a smooth convex function and, thus, reduces to the simple gradient method. If Φis the l1-norm, proxλΦ yields the closed form solution given in Equation 4.
ISTA can be further adapted with an accelerated scheme referred to as Fast ISTA or simply FISTA. FISTA includes an extrapolating step in the algorithm:
where the initializers are τ1=1 and y=x0. Additionally, FISTA can be further generalized in a form referred to as relaxed ISTA where the extrapolation step is expressed as:
z
k+1
=x
k
+γ
k(xk−xk−1), (12)
and arbitrary k.
The techniques discussed above apply if Φ(•) is separable. However, in a wavelet based framework, one often encounters Φ(x)=∥Wx∥1. If W is an orthogonal transform, Φ(•) is separable and the above techniques can be applied for finding sparse solutions. In practical settings however, orthogonal wavelet transforms lack shift-invariance. In MRI reconstruction this yields to more noise and block artifacts in the reconstructed image compared to undecimated wavelet transforms. On the other hand, undecimated or redundant transforms have higher memory consumption because of the missing decimation step.
DCE MRI
In clinical practice, abdominal dynamic contrast-inhanced (DCE) MRI is performed using multiple breath-hold acquisitions over a period of minutes. In particular iterative reconstruction techniques can provide continuous free-breathing acquisitions with high spatio-temporal resolution into clinical range. This provides patient comfort and robustness, and also aims at quantitative imaging. Some embodiments disclosed herein resolve motion-states as an additional dimension in the image reconstruction. Some embodiments use a Cartesian acquisition strategy with a motion-state detection based on additional navigation scans. The navigation scans are aligned with fat preparation pulses (e.g., frequency selective pulses) and come at practically no time cost. Motion-states are determined by clustering the imaging scans based on those navigation signals, so that imaging scans within a given cluster have navigation signal values closer to each other than to the navigation signal values of imaging scans in other clusters.
A 3D Cartesian spoiled Volume-Interpolated Breath-hold Examination (VIBE) gradient echo (GRE) sequence supporting spectral fat suppression can be extended to support variable-density sampling of the phase-incoding plane as well as the acquisition of a navigation signal as follows:
Some embodiments are suitable for DCE MRI in liver or other tissue. When imaging the liver, the liver is moving during air inhalation and exhalation, because image acquisition is slow (relative to the motion). Motions of the diaphragm are reflected onto the liver during this slow scanning. DCE MRI makes a series of images of the tissue. The series of images captures physical motions and also image contrast changes (due to CA movement into and out from the liver). CS shortens acquisition time per image. CS can allow the patient to breathe freely during acquisition of the sequence of images, because there is little reduction in image quality due to very small motion during the acquisition of a single one of the images. With CS, one can continuously acquire data, and retrospectively exclude data outside of the observation window.
In some embodiments, data acquisition captures data in five dimensions. In addition to three spatial dimensions, time provides a fourth dimension. Because general CA inflow behavior is known empirically, the key points in time for dynamic imaging (relative to CA injection time) can be predicted, and the time is representative of perfusion state. A fifth dimension corresponding to motion states is captured. A clinical application is perfusion where there is CA flowing in, and the intensity of the CA within the body changes. The exemplary methods resolve motion as well as inflow (time domain). For DCE MRI, the time at which the CA is expected to reach tissue (such as the liver) is known empirically, and is an additional significant independent variable for the image resolution.
In some embodiments, given a self-navigation signal in the general form of a sinusoidal curve, the system assigns certain amplitude values of the self-navigation signal to certain motion states, such as inhale and exhale. A simple system can use two motion states for inhalation and exhalation. In other embodiments, additional motion states are used, corresponding to additional positions between maximum inhalation and maximum inhalation.
The total amplitude range of the signal 202 can be divided into any desired number of ranges, each corresponding to a respective motion state. In some embodiments, each motion state corresponds to a respective cluster of k-space data. For example, in
For multiple time points, the sampling is generated in ascending order according to a Gaussian distribution, guaranteeing that at each time point the expectation value for acquiring a phase-incoding step differs from its actual acquisition number by at most one. The set of phaselncoding steps is assigned to the echo trains following the fat preparation pulses.
For navigation, an additional GRE module is played out after each fat suppression pulse differing from the imaging scans only in the readout. The latter is put in head-feet direction.
The 3D Cartesian data are supplemented with the time dimension and a fifth dimension defining a motion state.
X(x, y, z, t)→X(x, y, z, tDCE, tMotionState)
For DCE, the time dimension identifies the contrast agent (CA) uptake state. For liver images, the relevant motion state can define diaphragm position. For example,
Regularization applied on all spatial, DCE and motion-state directions, with different regularization levels, using.
The extra respiratory motion-state dimension is used to disentangle dynamic contrast enhancement and respiratory motions. Additional data are acquired for a small liver dome region showing how the diaphragm is moving to directly image respiratory motion.
Some embodiments acquire the navigating signal together with k-space data, compute motion states, cluster the k-space data according to motion state of the navigation signal and label each acquired k-space data with the corresponding motion state, and then decide how to use this data. In the case of acquired data acquired outside of the relevant window, the system does not discard the data, but suppresses their relevance.
The method concatenates image data into large 4D or 5D cube. The 4D cube includes 2D spatial data, plus time and motion state. The 5D cube includes 3D spatial data, plus time and motion state. Regularization is performed on the 4D or 5D cube. During reconstruction, the images may be adjusted to try to make images corresponding to neighboring motion states look similar to each other. Each motion state should be a faithful representation of its data, while at the same time, adjacent motion states should be similar to each other. This is done by applying wavelet transform over the entire 4D or 5D cube of data. It's 5D, but sometimes it is reconstructed as 2D or 3D spatial, plus time, plus motion state.
Using a generalized k-means algorithm, the navigation signal is clustered into N motion-states by minimizing
with Si,r being the ith navigation scan at the rth time point. C is a motion state, i is a scan index, r is a time index, m is a mean motion state, N is a number of motion states, R is the number of points in time, Si,r is a value of the navigation signal data for an ith navigation scan at an rth point in time. Alpha (α) is a tuned parameter that regulates whether centroids within a time-point are determined for each time point separately (α=0) or whether the same centroids are used for all time-points (α=infinity). In some embodiments, α is set to 0.1 for reconstruction.
with W being a redundant wavelet transformation (e.g., Haar or Debauchies), λ the regularization strength and F consisting of multiplication with coil-sensitivities, Fourier transformation and masking.
In addition a reconstruction using a fixed gating acceptance for a single motion-state (referred to as hard-gating) provides a basis for comparison with soft-gating as described herein. In some embodiments, the system displays a second image reconstructed using the fixed gating signal adjacent to at least one image reconstructed using the motion state data, such as shown in
Experiments
A DCE-MRI scan of the liver was performed in free breathing on a clinical 3T scanner (MAGNETOM Skyra, Siemens Healthcare, Erlangen, Germany). Parameters of the VIBE acquisition included FoV=380×345×192 mm3, image matrix=320×290×64, TE/TR=1.8/3.76 ms, flip angle=10°, 6-fold acceleration in the phase-encoding with the probability distribution of the variable sampling at the borders dropping to ⅕ of its central value as well as 16 time points with a temporal resolution of 11,57s each. Reconstruction was performed using a C++ prototype for the case of 6 motion-states and for a gating acceptance of 40%, respectively.
The acquired navigation signal Si,r(z) (
The signal for the selected coil element is binned into 16 time points, assigned motion indices for 6 motion-states as well as clustering according to motion index for each time point, separately.
Reconstructed images close to the liver dome are shown in
The techniques described herein permit free-breathing liver DCE for Cartesian acquisitions when imaging scans are clustered according to motion-states. Reconstruction times and image volumes scale at least linear in the motion-states. Other embodiments include a variable number of motion-states or a combination with hard-gating.
At step 1002, a loop including steps 1004 to 1008 is performed for each image.
At step 1004, a fat suppression technique, such as a fat preparation pulse is performed. In various embodiments, the fat suppression method can include difference in resonance frequency with water by means of frequency selective pulses, phase contrast techniques, short T1 relaxation time by means of inversion recovery sequences (STIR technique), a so-called Dixon method, or a hybrid technique combining two or more of these fat suppression techniques such as SPIR (spectral presaturation with inversion recovery).
At step 1006, the navigation signal data for the image are acquired. In some embodiments, for imaging the liver, the navigation signal has a frequency band corresponding to motion of the patient's diaphragm. In other embodiments, the navigation signal corresponds to a frequency band corresponding to motion of the patient's heart.
At step 1008, the k-space data for the image are sampled using a Cartesian trajectory. In some embodiments, the k-space data are acquired in ascending order according to a Gaussian distribution.
At step 1010, the k-space data are clustered using a clustering method, such as a k-means algorithm.
At step 1012, the motion state for each of the k-space data are computed based on the clustering. Each of the k-space data is labeled with its corresponding motion state.
At step 1014, at least one image is reconstructed using k-space data corresponding to at least two motions states corresponding to the same point in time. In some embodiments, at least one image is reconstructed using k-space data corresponding to all of the motions states corresponding to the same point in time.
Extra Dimension (XD) Hybrid
In some embodiments, as described above, the system reconstructs images using data from all motion states at multiple time points. In other embodiments, the system uses a first number of motion states for reconstruction at certain time points, and uses a second number of motion states for reconstruction at other time points, where the first number and second number are different from each other. For example, in some embodiments, referred to herein as the XD hybrid approach, the system only performs full motion state resolution for certain time points, and performs resolution for a single motion state at the remaining time points. For example, in some embodiments, a first image is reconstructed from k-space data corresponding to a first number of motion states acquired at the first time, and a second image is reconstructed from k-space data corresponding to a second number of motion states acquired at the second time, where the second number is different from the first number.
For example, given a 2 min. scan, the system can perform full motion state resolution every 10 seconds, and the image is resolved for a single motion state at the remaining time points.
According to this embodiment of an XD Hybrid method, the final image for a critical time and desired motion state is obtained from:
minx
Xt=2D+t data at desired motion state
Xm=2D+motion states (+t) data at arterial phase(s)
Xtum=2D data at arterial phase(s) and the desired motion state; the average of Xt and Xmat each iteration
ψt=3D wavelet transform. Thresholding scale along t.
ψm=3D (or 4D) wavelet transform. Thresholding scale along motion (and t if multiple arterial phases)
Although
At step 1102, the 5D k-space data are acquired and labeled as described above with respect to
At step 1104, a loop including steps 1106-1110 is repeated for each image.
At step 1106, a determination is made whether the image corresponds to a critical point in time. For example, in a perfusion study, a time corresponding to a maximum concentration of a CA in the tissue being imaged is a critical point in time. If the image corresponds to a critical time, step 1110 is executed. If the image does not correspond to a critical time, step 1110 is executed.
At step 1108, the image is reconstructed using k-space data corresponding to a single motion state at multiple points in time, to increase performance.
At step 1110, the image is reconstructed using k-space data corresponding to all of the motion states acquired at that same point in time, to increase image quality.
The XD Hybrid method provided improved image quality at critical points in time, and improved image reconstruction time for images acquired at non-critical points in time.
The methods and system described herein may be at least partially embodied in the form of computer-implemented processes and apparatus for practicing those processes. The disclosed methods may also be at least partially embodied in the form of tangible, non-transitory machine readable storage media encoded with computer program code. The media may include, for example, RAMs, ROMs, CD-ROMs, DVD-ROMs, BD-ROMs, hard disk drives, flash memories, or any other non-transitory machine-readable storage medium, wherein, when the computer program code is loaded into and executed by a computer, the computer becomes an apparatus for practicing the method. The methods may also be at least partially embodied in the form of a computer into which computer program code is loaded and/or executed, such that, the computer becomes a special purpose computer for practicing the methods. When implemented on a general-purpose processor, the computer program code segments configure the processor to create specific logic circuits. The methods may alternatively be at least partially embodied in a digital signal processor formed of application specific integrated circuits for performing the methods.
Although the subject matter has been described in terms of exemplary embodiments, it is not limited thereto. Rather, the appended claims should be construed broadly, to include other variants and embodiments, which may be made by those skilled in the art.
This application claims the benefit of U.S. Provisional Patent Application No. 62/266,511, filed Dec. 11, 2015, which is expressly incorporated by reference herein in its entirety.
Number | Date | Country | |
---|---|---|---|
62266511 | Dec 2015 | US |