This application relates to ultrasound imaging and more specifically to beamforming of ultrasound transmit and receive signals, for example using elastic interpolation.
Ultrasound imaging is often performed by sequential insonification of a medium using focused beams. Each focused beam allows the reconstruction of a single image line. A 2D image is typically made of few tens or hundreds of lines and is created by the sequential reconstruction of each line in the image, the time for reconstructing each line depending on the image depth. Therefore, the time to build an image (e.g., frame rate) is dependent on the image depth and spatial resolution (e.g., number of image lines). Reconstructing an image line from signals received from elements of a transducer array is typically a computationally intensive process involving algorithms or specifically designed electronics to time the firing of the elements of the array and subsequent reception and processing of the received signals. In other examples, unfocused beams (e.g., plane waves) may be used to insonify a larger area with a single beam and reconstruct images at higher frame rates. A variety of synthetic aperture techniques that may involve single element transmits with diverging spherical waves may be used. Either way, with any existing techniques for insanitation and reconstruction of image data, improved methods and systems which reduce the number of elements in a transducer array or reduce the amount of times that transducer elements are fired for generating an image may be desired.
A method in accordance with the present disclosure may include transmitting one or more ultrasound pulses toward a medium from a transducer array, detecting a plurality of received echo signals responsive to the one or more ultrasound pulses using one or more elements of the transducer array, and generating an interpolated signal by interpolating a signal characteristic of at least two existing echo signals. The existing echo signals may include at least two echo signals selected from the plurality of received echo signals and previously interpolated echo signals, and the interpolating may be performed concurrently with or following temporal alignment of the at least two existing echo signals. The temporal alignment may be responsive to one or more features of the at least two existing echo signals, which may be a different from the signal characteristic being interpolated. The method may further include generating ultrasound image data based on one or more received echo signals and the interpolated signal.
In some examples of the method, the interpolating a signal characteristic of at least two existing echo signals may include calculating a respective envelope for each of the at least two echo existing echo signals, and estimating an envelope of the interpolated signal by interpolating between the envelopes of the at least two existing echo signals. In some examples, the temporal alignment may include estimating a temporal characteristic of the interpolated signal and aligning the interpolated signal relative to the at least two echo signals based on the temporal characteristic. In some examples, the temporally aligning the interpolated signal may include calculating a displacement vector for a respective envelope of each of the at least two echo signals, weighting the displacement vectors according to an interpolation factor, and averaging the weighted displacement vectors to generate the temporal characteristic of the interpolated signal. In some examples of the method, the calculating a respective envelope for the at least two echo signals may be performed using a Hilbert transform. In some embodiments, the temporal alignment may be responsive to one or more features different from the signal characteristic being interpolated. For example, the temporal alignment may be responsive to estimated envelopes of the existing echo signals. In some embodiments, the generating an interpolated signal by interpolating a signal characteristic of at least two existing echo signals includes interpolating between existing signals from more than one transmit pulse.
In some embodiments, the signal characteristic of at least two of the plurality of echo signals may correspond to at least one of an amplitude, a phase, or both the amplitude and the phase of the at least two echo signals. In some embodiments, the method may further include identifying auxiliary information regarding the transducer array and configuring the interpolating of the signal characteristic based in part on the auxiliary information. In some embodiments, the auxiliary information may include information about the spacing between elements of the transducer array, and the configuring the interpolating may include selecting a number of signals to be interpolated between received echo signals based on the spacing between elements. In some embodiments, the method may further include coherently combining the at least two echo signals and the interpolated signal to generate a beamformed signal. In some embodiments, the generating ultrasound image data may include coupling the beamformed signal to a Doppler processor, a B-mode processor, or both, to generate Doppler image data, a B-mode image data, or both.
The methods described herein may be embodied as circuitry or executable instructions configured to cause an ultrasound imaging system to perform the steps of any of the methods described herein. For example, embodiments of the present disclosure may include non-transitory computer-readable medium comprising executable instructions, which when executed cause a processor of an ultrasound imaging system to perform any of the methods herein.
An ultrasound imaging system according to some examples of the present disclosure may include a transducer array configured to transmit an ultrasound pulse toward a medium and receive ultrasound echoes responsive to the ultrasound pulse and a beamformer configured to receive a plurality of echo signals corresponding to the ultrasound echoes. The beamformer may be further configured to generate an interpolated signal by interpolating a signal characteristic of at least two existing echo signals, wherein the at least two existing echo signals include at least two adjacent echo signals selected from of the plurality of received echo signals and previously interpolated echo signals, and wherein the beamformer is configured to perform the interpolating concurrently with or following temporal alignment of the at least two existing echo signals, the temporal alignment being responsive to one or more features of the at least two existing echo signals. The system may further include a processor configured to generate ultrasound image data based on one or more received echo signals and the interpolated signal.
In some embodiments, the beamformer may be configured to calculate an envelope of each of the at least two existing echo signals and temporally align the at least two existing signals based on the envelopes of the at least two existing echo signals. In some embodiments, the beamformer may be configured to generate the interpolated signal by interpolating a signal characteristic of at least two existing echo signals includes interpolating between existing signals from more than one transmit pulse. In further embodiments, the beamformer may be configured to temporally align the at least two existing echo signals responsive to one or more signal properties different from the signal characteristic being interpolated. In some embodiments, the beamformer may be configured to calculate a displacement vector for a respective envelope of each of the at least two echo signals, weight the displacement vectors according to an interpolation factor, and average the weighted displacement vectors to generate the temporal characteristic of the interpolated signal.
In some embodiments, the system may further include a controller configured to control the beamformer, wherein the beamformer is configured to receive auxiliary information regarding the transducer array from the controller. In some embodiments the auxiliary information may include information about spacing of elements of the transducer array and the beamformer may be configured to interpolate signals in accordance with an interpolation sequence selected based in part on the auxiliary information. In some embodiments, the beamformer may be configured to interpolate a number of signal lines between received echo signals and the number may be selected based on the spacing of elements of the transducer array. In some embodiments, the system may further include an ultrasound probe including the transducer array and the beamformer according to the examples herein may be located in the ultrasound probe.
Certain details are set forth below to provide a sufficient understanding of embodiments of the disclosure. However, it will be clear to one skilled in the art that embodiments of the disclosure may be practiced without these particular details. Moreover, the particular embodiments of the present disclosure described herein are provided by way of example and should not be used to limit the scope of the disclosure to these particular embodiments.
Generally described, in delay and sum ultrasonic beamforming systems, ultrasound pulses are transmitted using one or more elements of an ultrasound array and resulting echoes from one or more elements of the array are acquired and digitized by the receive electronics. To form a scan-line representing a single line-of-sight within the image, received echoes from one or more transmit firings are delayed appropriately to compensate for time of flight differences to each location on the line of sight and back again and then summed together with appropriate weights. If the transmit and/or receive apertures are inadequately sampled, then the delay and sum process may cause constructive interference not just at the expected location (the “main lobe”) but also at other steering angles, forming so-called “grating lobes” and introducing artifacts into the resulting image. Such constructive interference is a form of aliasing. To minimize grating lobes, phased array transducers may be manufactured with closely spaced elements at a pitch on the order of ½ wavelength and transmission and reception involves most or all elements within the aperture. In many applications, for instance phased array catheters for intravascular ultrasound (IVUS) imaging, the design of adequately sampled arrays may be technically challenging or costly, and the need to pulse and receive on every element may cause similar issues with system design and frame rates. Therefore, systems and methods for forming an adequate image using more sparsely separated elements and/or fewer transmit/receive may be desirable in the field of ultrasound imaging.
As described herein, interpolation, and more specifically elastic interpolation, may be performed on the received signals (e.g., per channel signal data) to estimate signals for missing elements in the array, such as elements that are not configured to fire in a given transmit or to estimate signals that could have been obtained with a more densely packed array. This approach can be used to increase frame rates and use fewer elements while still generating similar image quality to using all the elements of the array. Additionally or alternatively, by using information about the axial and, optionally, lateral correlation of the echo signals, nominal Nyquist limitations can be overcome and grating lobes commonly associated with under-sampled elements can be suppressed. Such a method may be applied to 1, 1.x and 2-dimensional array transducers and/or beamformers and microbeamformers with under-sampled or sparse apertures. In some embodiments, for example in synthetic aperture systems, elastic interpolation may also, advantageously, be employed to reduce the number of transmit/receive sequences necessary to form an ultrasound image.
Generally speaking, the process of elastic interpolation involves calculating a new signal (e.g., an “interpolated echo signal”) from two or more existing (measured or calculated) signals by 1) time-aligning the existing signals, and then 2) combining the time aligned signals to form the interpolated signal. The time-alignment step may be responsive to features of the existing signals (e.g., a feature of an existing echo signal such as the amplitude, phase, and/or respective envelopes of the existing signal) and may vary from sample to sample along the signal. Additionally, in the context of the present application, the term “existing” signals may be used to refer to signals arising from a single transmit pulse, or they may be signals arising from different transmitted pulses. They may also be interpolated signals (e.g., interpolated echo signals). For example, it may sometimes be desirable to interpolated previously interpolated echo signals and the techniques described herein can be equally applied to such a scenario.
In accordance with principles of the present invention, beamforming (e.g., on transmit or receive) may involve elastic interpolation which involves the adaptive local temporal alignment of signals responsive to the signal properties of the detected signal as part of the interpolation process. In some embodiments, the signal processing steps may include the steps of calculating an envelope for each received echo signal, aligning envelopes of the echo signals for example using an optical-flow based technique, and elastically aligning the signals to the missing line signal. In some examples, calculating the envelopes of each echo may be performed using a Hilbert transform. Alignment of the envelopes may be performed, for example using forward and backward displacement vectors, u(k) and v(k), respectively. The vectors u(k) and v(k) may be calculated to map each sample k from the first signal line to the second signal line and vice versa. Signals from the first and second lines may then be elastically aligned to the missing line location, for example by mapping it to ½ of the forward vector u(k) associated with the first line and ½ of the backward vector v(k) associated with the second line, and then averaging the signals together to form an estimate of the missing line signal.
Once the forward and backward vectors between two neighboring received signals have been defined, a missing signal can be interpolated and elastically aligned using the forward and backward vectors u(k) and v(k). Signal characteristics (e.g., signal envelope) for the missing signals may be estimated from the envelopes of the neighboring received signals and temporal characteristics (e.g., the time delay) of the missing signals may be estimated at least in part from the forward and backward vectors u(k) and v(k). The missing signals are thus interchangeably referred to herein as interpolated signals to reflect that they are not received signals but are instead computationally derived. For example, a missing signal (e.g., interpolated signal 313b) may be estimated based, at least in part, on the calculated envelopes of the neighboring received signals 313a and 313c and the forward and backward vectors u(k) and v(k), for example by mapping the maximum of the envelope for the missing signal to a location equal to the average of ½ of the forward vector v(u), labeled as 317 in
Thus, as described, the process of time-alignment may involve, for example with reference to
As will be appreciated, elastic interpolation may be performed in this manner to estimate signals that are missing for any number of reasons, such as due to the use of a sparse array (e.g., where the transducer elements may be spaced farther apart than may be computationally desirable) or due to the use of fewer number of elements for a given firing sequence. It is common to use fewer than all elements in an array in a given firing sequence as it is typical to have a greater number of transducer elements than available signal lines within the receiving electronics (e.g., the beamformer). Thus, the techniques described herein may compensate for loss missing signals regardless of the underlying cause for the missing signals. The signal processing steps described herein may be incorporated within the beamformer, which is typically implemented using one or more application specific integrated circuits (ASICs), field programmable gate arrays (FPGAs) or a high end digital signal processor (DSP) or multiple DSPs. The beamformer processing may be implemented using any combination of hardware and software components as may be suitable for a given application. As will be further appreciated, signals may be elastically interpolated in accordance with the examples herein to include signals for receive beamforming or transmit beamforming. Additionally, interpolation may be performed between signals from more than one transmit pulse. In this manner, interpolated signals for a variety of scenarios may be obtain, including but not limited to interpolate signals from additional (virtual) elements not present in the transducer, interpolate signals from missing, inactive or omitted receive elements, interpolate signals to replace echoes from defective elements, interpolate signals to replace echoes from missing or omitted transmitted pulses.
In some embodiments, auxiliary information may be utilized to enhance the elastic interpolation. For example, auxiliary information regarding the transducer array such as a distance of the spacing between elements of the array may be used to determine how many interpolation steps should be performed to obtain a sufficient quality image and/or determine the factor applied to the vectors, e.g., ½ to both the forward and backward vectors in the illustrated example, but different factors may be used in other embodiments. In some embodiments, multiple missing lines may be interpolated between two neighboring received lines, and a factor other than ½ may be used for the forward and backward vectors at each interpolated line. The factor may depend upon the number of signal lines being interpolated. For example, in a scenario where two missing lines are interpolated, factors of ⅓ and ⅔ (or some other values) of the forward and backward vectors, respectively, may be used for elastically aligning a missing line closest to the first received line and factors of ⅔ and ⅓ (or some other values) of the forward and backward vectors, respectively, may be used for elastically aligning a missing line closest to the second received line. In other examples, the auxiliary information may also include information about the timing and/or sequencing of the transmitted pulses. The elastic interpolation process may be repeated for each pair of neighboring received lines to obtain a signal data set including the original received signals and the interpolated signals. The signals in the signal data set may then be further processed, e.g., temporally adjusted by time delays 214, weighted by weights 215, and summed to obtain an enhanced beamformed signal.
The ultrasound imaging system 400 in the embodiment in
In some embodiments, the microbeamformer 416 may be coupled by a probe cable to a transmit/receive (T/R) switch 418, which switches between transmission and reception and protects the main beamformer 422 from high energy transmit signals. In some embodiments, for example in portable ultrasound systems, the T/R switch 418 and other elements in the system can be included in the ultrasound probe 412 rather than in a separate ultrasound system base. The ultrasound system base typically includes software and hardware components including circuitry for signal processing and image data generation as well as executable instructions for providing a user interface.
The transmission of ultrasonic pulses from the transducer array 414 may be controlled by the microbeamformer 416, which may be controlled by the transmit controller 420. The transmit controller 420 may be coupled to the T/R switch 418 and the beamformer 422. In some embodiments, the transmit controller 420 may be coupled to the beamformer 422 using a parallel data transfer link which is configured to transmit simultaneously data for multiple or all image lines in a field of view or from multiple or all points within the field of view of the array. The transmit controller 420 may also be coupled to the user interface 424 and receive input from the user's operation of a user controls. The user interface 424 may include one or more input devices such as a control panel, which may include one or more mechanical controls (e.g., buttons, encoders, etc.), touch sensitive controls (e.g., a trackpad, a touchscreen, or the like), and other known input devices.
Another function which may be controlled by the transmit controller 420 is the direction in which beams are steered. Beams may be steered straight ahead from (orthogonal to) the transducer array 414, or at different angles for a wider field of view. In some embodiments, the partially beamformed signals produced by the microbeamformer 416 may be coupled to the beamformer 422 where partially beamformed signals from individual patches of transducer elements may be combined into a fully beamformed signal. Beamforming with elastic interpolation of intermediate signals as described herein may be performed by the microbeamformer, the beamformer, or both. The beamformed signals are coupled to processing circuitry 450, which may include a signal processor 426, a B-mode processor 428, a Doppler processor 460, or combinations thereof.
In embodiments of the present invention, the beamformer 422 (or in some cases, the microbeamformer) may include an interpolator 423 which performs elastic interpolation in accordance with the present examples, e.g., in accordance with the process described with reference to
In some embodiments, the user interface 424 may be configured to display an interface e.g., for receiving instructions for the interpolator 423 or beamformer 422 or microbeamformer 416. The user interface 424 may also be coupled to the beamformer 422 and, thus, coupled to the interpolator 423. The user interface 424 may be configured to provide instructions that control the beamformer, for example to configure the beamformer to receive auxiliary information regarding the transducer array. For example, the auxillary information may include a distance (or spacing) between elements of the transducer array. The user interface 424 may be configured to provide instructions to the interpolator 423 to calculate a time of flight adjustment based on the distance between elements of the transducer array. For example, a user may execute a program at the user interface 424 that provides such instructions to the interpolator 423.
The signal processor 426 can process the received echo signals in various ways, such as bandpass filtering, decimation, I and Q component separation, and harmonic signal separation. The signal processor 426 may also perform additional signal enhancement such as speckle reduction, signal compounding, and noise elimination. The processed signals may be coupled to a B-mode processor 428 for producing B-mode image data. The B-mode processor can employ amplitude detection for the imaging of structures in the body. The signals produced by the B-mode processor 428 may be coupled to a scan converter 430 and a multiplanar reformatter 432. The scan converter 430 is configured to arrange the echo signals in the spatial relationship from which they were received in a desired image format. For instance, the scan converter 430 may arrange the echo signal into a two dimensional (2D) sector-shaped format, or a pyramidal or otherwise shaped three dimensional (3D) format. The multiplanar reformatter 432 can convert echoes which are received from points in a common plane in a volumetric region of the body into an ultrasonic image (e.g., a B-mode image) of that plane, for example as described in U.S. Pat. No. 6,443,896 (Detmer). A volume renderer 434 may generate an image of the 3D dataset as viewed from a given reference point, e.g., as described in U.S. Pat. No. 6,530,885 (Entrekin et al.).
In some embodiments, the signals from the signal processor 426 may also be coupled to a Doppler processor 460, which may be configured to estimate the Doppler shift and generate Doppler image data. The Doppler image data may include color data which is then overlaid with B-mode (i.e. grayscale) image data for display. The Doppler processor 460 may be configured to filter out unwanted signals (i.e., noise or clutter associated with non-moving tissue), for example using a wall filter. The Doppler processor 460 may be further configured to estimate velocity and power in accordance with known techniques. For example, the Doppler processor may include a Doppler estimator such as an auto-correlator, in which velocity (Doppler frequency) estimation is based on the argument of the lag-one autocorrelation function and Doppler power estimation is based on the magnitude of the lag-zero autocorrelation function. Motion can also be estimated by known phase-domain (for example, parametric frequency estimators such as MUSIC, ESPRIT, etc.) or time-domain (for example, cross-correlation) signal processing techniques. Other estimators related to the temporal or spatial distributions of velocity such as estimators of acceleration or temporal and/or spatial velocity derivatives can be used instead of or in addition to velocity estimators.
In some examples, the velocity and power estimates may undergo further threshold detection to further reduce noise, as well as segmentation and post-processing such as filling and smoothing. The velocity and power estimates are then mapped to a desired range of display colors in accordance with a color map. The color data, also referred to as Doppler image data, is then coupled the scan converter 430 where the Doppler image data is converted to the desired image format and overlaid on the B-mode image of the tissue structure containing the blood flow to form a color Doppler overlay image.
Output (e.g., B-mode images, Doppler images) from the scan converter 430, the multiplanar reformatter 432, and/or the volume renderer 434 may be coupled to an image processor 436 for further enhancement, buffering and temporary storage before being displayed on an image display 438. A graphics processor 440 may generate graphic overlays for display with the images. These graphic overlays can contain, e.g., standard identifying information such as patient name, date and time of the image, imaging parameters, and the like. For these purposes the graphics processor may be configured to receive input from the user interface 424, such as a typed patient name or other annotations. In some embodiments, one or more functions of at least one of the graphics processor, image processor, volume renderer, and multiplanar reformatter may be combined into an integrated image processing circuitry (the operations of which may be divided among multiple processor operating in parallel) rather than the specific functions described with reference to each of these components being performed by a discrete processing unit. Furthermore, while processing of the echo signals, e.g., for purposes of generating B-mode images or Doppler images are discussed with reference to a B-mode processor and a Doppler processor, it will be understood that the functions of these processors may be integrated into a single processor.
During experimental testing of embodiments of the present disclosure, images showing fully sampled and sparsely sampled conventional arrangements were compared against embodiments in which interpolation was performed on transmit and/or receive in accordance with the present disclosure.
The method may further include detecting echoes responsive to the transmitted pulses, as shown in block 608. Echoes may be detected using one or more elements of the array. In some embodiments fewer number of elements may be used during a transmit and a receive (also referred to as active elements) than may be physically present in the array. That is some elements may be inactive during any given firing sequence (e.g., transmit/receive cycle). Signals generated by the probe responsive to detected echoes may be referred to herein as received or measured echo signals, while signals generated by the electronics of the probe or ultrasound system (e.g., using interpolation as described herein) may be referred to as calculated echo signals. The received or measured echo signals and the calculated echo signals may collectively be referred to as existing echo signals (that is, existing before a given interpolation step). It will be understood that interpolation according to the present examples may be performed on any two or more existing echo signals, whether measured or calculated.
Referring back to
In some examples, the method may optionally utilize auxiliary information (as shown in block 612), such as information about the distance or spacing of elements in the array. In other embodiments, the auxiliary information may include information about the timing and sequencing of the transmitted pulses. The interpolation may be configurable based on the auxiliary information. For example a different number of signal lines may be interpolated between neighboring received lines if the spacing is greater (e.g., in the case of a sparser array) than when using a more densely packed array and/or when utilizing/activating more elements in a given transmit/receive sequence. Optionally, the interpolation factors (e.g., for weighing of the displacement vectors) may depend upon the auxiliary information. As described, to produce imaging data, the beamforming process may also include coherently combining the signal data set that includes at least two existing echo signals and the interpolated signal to generate a beamformed signal. The beamformed signals may then be coupled to a processor (e.g., a signal processor and subsequently to a B-mode processor and/or Doppler processor) to generate the image data and hence images for display.
Referring to the example in
In various embodiments where components, systems and/or methods are implemented using a programmable device, such as a computer-based system or programmable logic, it should be appreciated that the above-described systems and methods can be implemented using any of various known or later developed programming languages, such as “C”, “C++”, “FORTRAN”, “Pascal”, “VHDL” and the like. Accordingly, various storage media, such as magnetic computer disks, optical disks, electronic memories and the like, can be prepared that can contain information that can direct a device, such as a computer, to implement the above-described systems and/or methods. Once an appropriate device has access to the information and programs contained on the storage media, the storage media can provide the information and programs to the device, thus enabling the device to perform functions of the systems and/or methods described herein. For example, if a computer disk containing appropriate materials, such as a source file, an object file, an executable file or the like, were provided to a computer, the computer could receive the information, appropriately configure itself and perform the functions of the various systems and methods outlined in the diagrams and flowcharts above to implement the various functions. That is, the computer could receive various portions of information from the disk relating to different elements of the above-described systems and/or methods, implement the individual systems and/or methods and coordinate the functions of the individual systems and/or methods described above.
In view of this disclosure it is noted that the various methods and devices described herein can be implemented in hardware, software and firmware. Further, the various methods and parameters are included by way of example only and not in any limiting sense. In view of this disclosure, those of ordinary skill in the art can implement the present teachings in determining their own techniques and needed equipment to affect these techniques, while remaining within the scope of the disclosure. The functionality of one or more of the processors described herein may be incorporated into a fewer number or a single processing unit (e.g., a CPU) and may be implemented using application specific integrated circuits (ASICs) or general purpose processing circuits which are programmed responsive to executable instruction to perform the functions described herein.
Further, the present system may also include one or more programs which may be used with conventional imaging systems so that they may provide features and advantages of the present system. Certain additional advantages and features of this disclosure may be apparent to those skilled in the art upon studying the disclosure, or may be experienced by persons employing the novel system and method of the present disclosure. Another advantage of the present systems and method may be that conventional medical image systems can be easily upgraded to incorporate the features and advantages of the present systems, devices, and methods.
Of course, it is to be appreciated that any one of the examples, embodiments or processes described herein may be combined with one or more other examples, embodiments and/or processes or be separated and/or performed amongst separate devices or device portions in accordance with the present systems, devices and methods.
Finally, the above-discussion is intended to be merely illustrative of the present system and should not be construed as limiting the appended claims to any particular embodiment or group of embodiments. Thus, while the present system has been described in particular detail with reference to exemplary embodiments, it should also be appreciated that numerous modifications and alternative embodiments may be devised by those having ordinary skill in the art without departing from the broader and intended spirit and scope of the present system as set forth in the claims that follow. Accordingly, the specification and drawings are to be regarded in an illustrative manner and are not intended to limit the scope of the appended claims.
Filing Document | Filing Date | Country | Kind |
---|---|---|---|
PCT/EP2018/059611 | 4/16/2018 | WO | 00 |
Number | Date | Country | |
---|---|---|---|
62488924 | Apr 2017 | US |