The present disclosure relates to systems and methods for medical imaging and, in particular, to ultrasound imaging. Certain examples of the disclosure provide systems and methods for super-resolution compressed ultrasound imaging capable of micrometer resolutions. This disclosure comprises of systems and methods for (i) acquisition; and (ii) processing of ultrasound imaging data.
Ultrasound is an imaging modality that is relatively cheap, risk-free, radiation-free and portable.
However, in some applications, the resolution of ultrasound images is very low, limiting the application of this imaging modality. For example, ultrasound brain vascular imaging has not been clinically achieved due to spatial resolution limitation in ultrasound propagation through the human skull; this limits the application of ultrasound in Traumatic Brain Injury (TBI) for emergency situations. Another example is breast cancer screening where ultrasound is not solely and frequently used for population-based screening of the breast cancer due to ultrasound-limited resolution.
The second problem with ultrasound is that in some applications, there is a need to use a large number of transducers (sometimes as high as a couple of thousands) producing several hundreds of frame rate per second and each frame has several of hundreds of image lines. Therefore, the processing power is high in current ultrasound machines to be able to process a large amount of data in real-time. In order to use ultrasound in emergency and point-of-care applications, the imaging system should be compact with lower acquisition and processing requirements.
Therefore, there are two aspects in improving the performance of current ultrasound systems (i) to improve the image quality not by increasing the quantity of the acquired data; and (ii) to accelerate the acquisition and processing rates and at the same time not dropping the quality in terms of image resolution, Signal-to-Noise ratios (SNRs), and contrast.
Compressive sensing (CS) approaches provide an alternative to the classical Nyquist sampling framework and enable signal reconstruction at lower sampling rates, for example by Candes et. al., in “Robust uncertainty principles: exact signal reconstruction from highly incomplete frequency information,” IEEE Transactions on Information Theory, vol. 52, no. 2, pp. 489-509, February 2006. The idea of CS is to merge the compression and sampling steps. In recent years, the area of CS has branched out to a number of new applications like radar, communications, and ultrasound imaging.
All the proposed CS approaches in ultrasound imaging is using a non-adaptive beamforming (“spatial filtering”) to reconstruct the final image in ultrasound. This non-adaptive beamforming in based on a Delay-and-Sum (DAS), which is a preferred beamforming method in current ultrasound machines. In the DAS approach, relevant time-of-flights from each transducer element to each point in the region of interest (ROI) are compensated and then a summation is performed on all the aligned observations to form the image. The DAS beamformer is independent of data with fixed weights and in order to apply this techniques in time domain, the data samples should be high enough even more than the rate dictated by the Shannon-Nyquist theorem. Now, combining DAS with CS provides lower resolution as compared to applying super resolution techniques like Time Reversal MUltiple SIgnal Classification (TR-MUSIC) and Capon methods.
The time reversal (TR)-based imaging methods utilize the reciprocity of wave propagation in a time-invariant medium to localize an object with higher resolution. The focusing quality in the time-reversal method is decided by the size of the effective aperture of transmitter-receiver array. This effective aperture includes the physical size of the array and the effect of the environment. A complicated background will create the so-called multipath effect and can significantly increase the effective aperture size, which enhances the resolution of the acquired images.
Most of the previous computational time reversal based imaging methods uses the eigenstructure of the TR matrix to image the targets. Generally, the singular value decomposition (SVD) of the TR matrix is needed for every frequency bin and for every space-space TR-matrix. For ultrawideband (UWB) imaging, the SVDs of space-space TR matrices are utilized and combined to form the final image. There are two problems with this configuration: (i) the computational complexity of repeating the SVD of the TR matrix in every frequency bin is very high limiting the usage of this technique in real-time ultrasound system and (ii) at each frequency, the singular vectors have an arbitrary and frequency-dependent phase resulted from the SVD.
In UWB TR_MUSIC method, only the magnitude of the inner products are combined along the bandwidth and these arbitrary phases cancel out, therefore, the problem of incoherency does not exist for non-noisy data. However, the super-resolution property of TR-MUSIC disappears as the signals become noisy which is due to the random phase structure induced by noise. A modified version of TR-MUSIC, Phase Coherent MUSIC (PC-MUSIC) uses a re-formulation of TR-MUSIC, which retains the phase information and also applies averaging of the pseudospectrum in frequency to cancel out the random phase degradation of TR-MUSIC in case of noisy data. The problem with PC-MUSIC is that since it uses phase information and disregards the phase response of the transducers, its ability to localize the targets at their true locations is adversely impacted as explained in “Super-resolution ultrasound imaging using a phase-coherent MUSIC method with compensation for the phase response of transducer elements,” IEEE Transactions on Ultrasonics, Ferroelectrics, and Frequency Control, vol. 60, no. 6, pp. 1048-1060, June 2013.
A modification to PC-MUSIC was proposed by Labyed et al. to compensate the transducer phase response by developing an experimental method to estimate the phase responses beforehand. The computational complexity of this modification is still high as the SVD is needed for every frequency bin across the bandwidth and the image is formed by averaging these pseudospectrums for points in the region-of-interest (ROI). Also, the efficiency of this incoherent approach depends on the SNRs of the individual frequency bins.
Frequency matrices were proposed previously by Kaveh et al. in “Focusing matrices for coherent signal-subspace processing,” IEEE Transactions on Acoustics, Speech and Signal Processing, vol. 36, no. 8, pp. 1272-1281, August 1988, for finding the direction-of-arrival of multiple wideband sources using passive arrays. Li et. al modified these matrices to be used in active arrays with robust Capon beamformers in ultrasound imaging.
An embodiment of the present invention that is described herein provides a method comprising of sending ultrasound plane wave to a ROI comprising of multiple point scatterers form the transducer elements of the array sequentially, a low-dimensional data acquisition method to receive the backscatters from the medium by all the transducer elements and a super-resolution image reconstruction method to form the final image of the ROI irrespective of the sparsity of the received signals.
In disclosed embodiment, the low-dimensional acquisition method is based on the principle of compressive sensing and sparse recovery. By way of example, the sensing matrices are based on random Gaussian matrices and the recovery is based on Fourier transform or wave atom of the received data channel. The reader is referred to the following publication that is hereby expressly incorporated by reference and is written by the current writer of this patent application: “Wave Atom Based Compressive Sensing and Adaptive Beamforming for Ultrasound Imaging”, IEEE ICASSP 2015, PP. 2474-2478.
By way of example, sub-Nyquist sampling schemes that can be used in the low-dimensional sampling by unit 303 are described by Gedalyahu et al., in “Multichannel Sampling of Pulse Streams at the Rate of Innovation,” IEEE Transactions on Signal Processing, volume 59, number 4, pages 1491-1504, 2011, which is incorporated herein by reference. Example hardware that can be used for this purpose is described by Baransky et al., in “A Sub-Nyquist Radar Prototype: Hardware and Algorithms,” IEEE Transactions on Aerospace and Electronics Systems, pages 809-822, April 2014, which is incorporated herein by reference.
In another embodiment, the recovered signals in frequency are used to form the full data matrix. The beamforming uses focused frequency time reversal (FFTR) matrices to focus in frequency for UWB ultrasound signals, as well as time reversal Phase Coherent MUltiple Signal Classification (PC-MUSIC) algorithm to focus spatially on the target location. This combined method, which is referred to as FFTR-PCMUSIC, is motivated by the pressing need to improve the resolution of diagnostic ultrasound systems. Compared with the TR matched filter (TRMF) and incoherent TR-MUSIC approaches, the method proposed in this disclosure has lower computational complexity, higher visibility, higher robustness against noise, and higher accuracy for imaging point targets when the targets are micrometer distance apart. The reader is referred to the following publication that is hereby expressly incorporated by reference and is written by the current writer of this patent application: “Super-resolution Ultrawideband Ultrasound Imaging using Focused Frequency Time Reversal MUSIC”, IEEE ICASSP, 2015, 887-891.
The FFTR-PCMUSIC uses the TR focusing in time and space to achieve high temporal and spatial resolution. The background Green's function at the focused frequency is used as the steering vector to form the final image. This method reduces the effect of noise on target localization accuracy as well as the computational complexity needed for subspace-based methods for UWB ultrasound data by using frequency-focusing matrices together with the focused frequency Green's function. Effectively, the maximum resolution achieved by the FFTR-PCMUSIC is inherently limited by the SNR and the bandwidth of the transducers.
The transducer array (M transducers) shown in
All the transducers in the array are sending a plane wave one by one and the same transducer array receives and records the backscatters from the medium. As shown in
The Green's function of the medium is the spatio-temporal impulse response of the medium shown as “501” in
where zi is the location of the transducer i array as shown as unit “500” in
with c being the sound propagation speed, and α is the amplitude of the attenuation coefficient of the environment, see “Super-resolution ultrasound imaging using a phase-coherent MUSIC method with compensation or the phase response of transducer elements,” IEEE Transactions on Ultrasonics, Ferroelectrics, and Frequency Control, vol. 60, no. 6, pp. 1048-1060, June 2013.
The pressure filed at the received transducer location i is
y
ij(ω)=Hij(ω)Qj(rl,ω)G(zi,rl,ω)+vij(ω) (2),
where Hij(ω) is the forward-backward frequency response of the transducers i and j, and vij(ω) is the measurement noise.
The signals yij(ω) is filtered and sparsified in the frequency domain by way of example using a wavelet de-noising tool as shown in
The filtered signal yij(ω) is down-sampled (“102”) to 1/k'th of the original samples using the random sensing matrices φ, reducing the sampling matrix size to K×M, with K<<N as follows:
x
ij
=φy
ij
+e (3)
where xij is the down-sampled data at transducer i and e is the measurement error. This phase is just to get the down-sampled data and in practice, this stage is the output of the modified data acquisition system of an ultrasound system shown in
In recovery, a regularized-l1 optimization is used to find the sparsest solution of yij by way of example as the wave atom basis or Fourier basis. The optimization problem is
½∥φyij−xij∥2+τ∥Ψyij+e (4)
where Ψ is the wave atom or Fourier dictionary, τ is a regularization parameter, and ∥.∥2, ∥.∥1 are l2- and l1-norms of the vectors. The minimization formula in (4) finds the signals yij. This step is shown in
The signals yij are filtered to increase the SNR before going to the beamforming process as shown in unit 105.
In practice, the step in [0031] is not needed and it is directly acquired at the modified data acquisition of the ultrasound system shown in
After recovery of signals, to beamform the M signals for image reconstruction, the FFTR-PCMUSIC method is used as shown in
This method uses the TR-PCMUSIC in conjunction with TR-based frequency focusing matrices to reduce the computational complexity of incoherent TR-MUSIC as well as phase ambiguity of the PCMUSIC in a noisy ultrasound environment. In FFTR-PCMUSIC, the SVD is applied once into a focused frequency TR matrix through finding unitary focusing matrices and applying a weighted averaging of the focused TR matrix over the bandwidth. This averaging reduces the effect of noise in space-space FFTR-PCMUSIC since the signal subspace is used after focusing in frequency. Also, after forming the FFTR matrix, the signal and noise subspaces are used once in forming the pseudo-spectrum which peaks at the locations of the point targets.
In step 100291 we have the reconstructed signal {tilde over (y)}m, denoting Q as the frequency band of interest after signal sparsifying in frequency domain, and ωq being the frequency of each band. Then, we have Q of M×M space-space matrices K(ωq) as follows.
K(ωq)=F(ωq)Σl=1Lτlg(ωq,rl)gT(ωq,rl)+v(ωq) (5)
where L is the number of scatterers shown in
g(ωq,rl)=eiφ(ω
F(ωq) takes care of both the field generated at the source location Qj(rl,ω) and the frequency response of the transducers, assuming all to be the same. The frequency dependent phase of the transducer is denoted as φ(ωq).
In practice, the transducer phase response can be calculated by experimenting on a single point target embedded at a known location of a homogeneous environment, as demonstrated in “Super-resolution ultrasound imaging using a phase-coherent MUSIC method with compensation or the phase response of transducer elements,” IEEE Transactions on Ultrasonics, Ferroelectrics, and Frequency Control, vol. 60, no. 6, page. 1048-1060, June 2013.
The TR matrix T(ωq)=K(ωq)HK(ωq) is computed at every frequency bin. In order to find the focused frequency TR matrix {tilde over (T)}(ω0), I am using the unitary matrices B(ωq) to minimize the difference between T(ω0) and the transformed TR matrix at frequency q with the following minimization problem.
min ∥K(ω0)H−B(ωq)K(ωq)H∥F (7)
B(ωq)=V(ωq)U(ωq)H, (8)
where V(ωq) and U(ωq) are the right and left singular vectors of the TR matrix K(ωq)HK(ω0). Then, the coherently focused TR operator is the weighted average of the transformed matrix of TR with unitary matrix B(ωq) as follows.
{tilde over (T)}(ω0)=Σq=0Q−1βqB(ωq)T(ωq)B(ωq)H (9)
where βq is the weight proportional to the SNR of q'th bin. These steps are shown in
The advantage with this approach is that the Green's function at the focused frequency is used for image formation. It is worth noting that for incoherent TR-MUSIC and PC-MUSIC, the array steering vector should be computed for every frequency bin over the entire grid, which is computationally expensive.
The final step will be to form the pseudo-spectrum of the FFTR-PCMUSIC as follows.
where Ũ(ω0, r) and {tilde over (V)}(ω0, r) are the left and right singular matrices at the focused frequency resulted from the SVD of {tilde over (T)}(ω0), g(ω0, r) is the background green's function at the focused frequency and observation point r in the ROI. (Refer to unit “109” in
As shown in
which peaks at the location of scatterers with high resolution.
By way of example,
The system of
The digital rf data acquired in module 304 of
The DSP board comprises of a programming executable in the processor to recover the full capture matrix from the sparse data acquired by the low-dimensional acquisition module.
The DSP board comprises of a programming executable in the processor to reconstruct the image of the ROI using the FFTR-PCMUSIC method.
The user interface module in
The signal path presented in
The 2D ROI, the transducer array, and the point-like targets are shown in
In addition to ultrasound, non-limiting examples of other applications that embodiments of the invention can apply are microwave imaging for breast cancer screening as well as functional brain imaging.
By way of example, the results from simulation of the ROI with 2, 3, and 10 point targets, real acquired data from wire phantom and the ultrasound system are demonstrated in
By way of example, the generated image from real ultrasound machine to a wire and point like phantom are presented in
According to disclosed examples, the present disclosure provides a method including the steps of acquiring and processing ultrasound data by transmitting an ultrasound plane wave through elements of a transducer array to a Region-Of-Interest (ROI) that contains at least one point target; acquiring the signal data in response to the ultrasound data using a low-dimensional data acquisition system; reconstructing the signal data from the low-dimensional data acquisition system to a full capture data in frequency domain using compressive sensing and sparse signal recovery techniques; beamforming the full capture data with a super-resolution focused frequency technique to generate an image of the target using a time reversal matrix at the focused frequency and a green's function of the background medium at the focused frequency; and sending the image to be displayed on a display screen of an ultrasound system.
The method may be carried out using a non-transitory computer-readable medium.
The ultrasound data may be transmitted through multiple transducers reflecting the ultrasound data from the target using the low-dimensional data acquisition system.
The method may include recovering the signal data using a sparse signal recovery technique before beamforming.
The method may further include the steps of: filtering the signal data to suppress noise in a frequency band of interest; and down-sampling the signal data below the Nyquist rate using random sensing and Fourier matrices.
The recovering may be based on an optimization technique including applying a regularized l1-norm in frequency domain to estimate the data signals acquired by the low-dimensional acquisition system to the full capture data.
The signal data may be recovered from the low-dimensional sampling for a pair of transmit and receive transducers to the full capture data in frequency domain.
The beamforming may include filtering to place the signal data in an effective band of interest before generating the image.
The beamforming may include forming the time reversal matrix for multiple frequency bins within a bandwidth of interest.
The beamforming may include using focusing matrices to focus the time reversal matrix in frequency domain.
The focusing matrices may be configured to minimize the difference between the full capture data matrix at the focused frequency and the full capture data at frequency bins within the frequency band of interest.
The method may include applying a subspace-based technique to the full capture matrix in frequency domain.
The focused frequency may be formed using a weighted average of a plurality of transformed time reversal matrices at frequency bins and using a signal-to-noise ratio of the signal data within the frequency bin as weighting coefficients.
The beamforming may use the focused time reversal matrix and a time reversal PCMUSIC technique to focus spatially at the location of the targets within the ROI.
The green's function of the ROI at the focused frequency may be used to generate a pseudo-spectrum of the ROI in PCMUSIC. The pseudo-spectrum may include density contrast data relating to one or more point targets within said ROI. The green's function of the ROI may receive parameters selected from one or more of: the dimension of the transducer elements, the speed of sound, the geometry of the ROI, and the phase response of the transducer.
The beamforming may image the point targets irrespective of the targets being well resolved.
According to disclosed examples, the present disclosure also provides an apparatus including a transducer configured to send and acquire ultrasound data; a data acquisition module for low-dimensional sampling of signal data; a data processing unit for recovering the signal data from the low-dimensional ultrasound data to full-rate data; a two-dimensional image reconstructing unit to generate an image of the ROI; and a user interface module that links the data processing unit to a display screen for image display purposes.
The transducer may be in communicable connection to a computer to excite one or more elements of the transducer sequentially by a plane wave, and record the received signals from the ROI.
The ultrasound data may be acquired by the data acquisition module. The acquisition module may include processing circuitry using random Gaussian and Fourier matrices for sub-Nyquist sampling to acquire ultrasound data. The ultrasound data may be further processed by a programming executable in the data processing unit. The data processing unit may process the signal data acquired by the low-dimensional sampling unit to reconstruct an image of the ROI. The data processing unit may be configured to beamform the recovered signals using a focused frequency time reversal matrix. The data processing unit may be configured to reconstruct the image of the ROI using the pseudo-spectrum of TR-PCMUSIC technique. The image may be sent to a user interface module for display on the display screen.
While a number of exemplary aspects and examples have been discussed above, those of skill in the art will recognize certain modifications, permutations, additions and sub-combinations thereof.
The present application claims the benefit of U.S. provisional patent application No. 62/099,680 filed on Jan. 5, 2015 and entitled SYSTEMS AND METHODS FOR SUPER-RESOLUTION COMPACT ULTRASOUND IMAGING, the entire contents of which are incorporated herein by reference.
Filing Document | Filing Date | Country | Kind |
---|---|---|---|
PCT/CA2016/050006 | 1/5/2016 | WO | 00 |
Number | Date | Country | |
---|---|---|---|
62099680 | Jan 2015 | US |