1. Technical Field
The present invention generally relates to ultrasound systems, and more particularly to an ultrasound system and a method of forming ultrasound images.
2. Background Art
An ultrasound system has become an important and popular diagnostic tool due to its non-invasive and non-destructive nature. Modern high-performance ultrasound imaging diagnostic systems and techniques are commonly used to produce two- or three-dimensional images of internal features of patients.
The ultrasound system generally uses a probe comprising an array of transducer elements to transmit and receive ultrasound signals. The ultrasound system forms an image of human internal tissues by electrically exciting transducer elements to generate ultrasound signals that travel into the body. Echoes reflected from tissues and organs return to the transducer elements and are converted into electrical signals, which are amplified and processed to produce an ultrasound image data.
The ultrasound system provides an M-mode (motion mode) image periodically showing the motion of a target object. The ultrasound system first displays a B-mode image of the target object and then displays bio-information of the target object, which corresponds to an M-mode line set on the B-mode image, over the elapse of time.
In the conventional ultrasound system, however, a probe should be moved to observe different portions of a target object. Thus, there are problems in that B-mode and M-mode images for different portions of the target object cannot be provided at the same time. Further, it takes a long time to form the B-mode and M-mode images for different portions of the target object.
The probe 110 may include an array transducer containing a plurality of transducer elements for transmitting ultrasound signals to a target object and receiving ultrasound echo signals from the target object. The target object may contain a periodically moving object. The transducer elements may convert the ultrasound echo signals into electrical reception signals.
The beam forming and signal processing unit 120 may be operable to focus the electrical reception signals, and amplify and process the focused signals. The volume data forming and reconstructing unit 130 may form volume data for a 3-dimensional ultrasound image of the target object based on the focused signals received from the beam forming and signal processing unit 120. The volume data forming and reconstructing unit 130 may be operable to calculate a beat period of the moving object contained in the target object and reconstruct the volume data based on the calculated beat period. When the object is a heart, the beat period may be a heartbeat period.
As shown in
The volume data forming unit 131 may form volume data for forming a 3-dimensional ultrasound image of the target object based on the focused signals, which are consecutively received from the beam forming and signal processing unit 120.
The pre-processing unit 132 may be operable to reduce or remove noises from an ultrasound image. The noise reduction may preferably be performed upon at least one of horizontal and vertical cut plane images 210 and 220, which are obtained by horizontally or vertically cutting the ultrasound volume data, as shown in
The pre-processing unit 132 may decompose the horizontal cut plane image in a wavelet domain into sub-band images HH, HL, LH and LL (wavelet transform). The pre-processing unit 132 may calculate wavelet coefficients in each sub-band image. The pre-processing unit 132 may perform soft-thresholding upon the calculated wavelet coefficients. That is, if the calculated wavelet coefficient is smaller than the threshold, then the pre-processing unit 132 may reset the wavelet coefficient to zero. If the wavelet coefficient is greater than the threshold, then the pre-processing unit 132 may subtract the threshold from the wavelet coefficient to thereby reset the wavelet coefficient. The soft-thresholding may not be carried out for the sub-band image LL, wherein the sub-band image LL represents low frequency (vertical)—low frequency (horizontal) image. The soft-thresholding can be carried out by the following equation in accordance with the present invention.
wherein, Wjf(t) represents a coefficient of a high frequency at a jth level decomposed in the wavelet domain, sign()represents a sign of the coefficients, Th represents a threshold having a constant value, and Wj{circumflex over (f)}(t) represents a resulting wavelet coefficient from performing the soft-thresholding. Thereafter, the pre-processing unit 132 may reconstruct the decomposed images through inverse wavelet transform to thereby obtain the horizontal cut plane image with the noises reduced.
The ROI setting unit 133 may set a region of interest (ROI) on the pre-processed horizontal cut plane image. In order to set the ROI, the ROI setting unit 133 may perform horizontal projection upon the pre-processed horizontal cut plane image to thereby obtain projected values that are sum of the brightness of all pixels along horizontal projection lines, as shown in
wherein, fn represents a horizontally projected signal, and Mean represent a mean of the projected values. The positions nT and nB may be used as boundaries of the ROI.
The ROI setting unit 133 may use the boundaries nT and nB of ROI to mask the horizontal cut plane image, thereby removing regions that are located outside the boundaries nT and nB, as shown in
The VOI setting unit 134 may be operable to set a volume of interest (VOI) in the volume data by using the ROI. The VOI setting unit 134 may select frames including the moving object within the target object. A plurality of vertical lines may be set in the horizontal cut plane image and standard deviation of brightness of the vertical lines may be used to select the frames. For example, the moving object may be the heart of a fetus. Since the heart includes valves (displayed in a bright portion) as well as atria and ventricles (displayed in a dark portion), the image of the heart relatively has a high contrast. Thus, the vertical lines including a heart region may be found by using the standard deviation of the brightness of the vertical lines. Also, since the contrast of neighboring vertical lines within the heart region rapidly changes, the vertical lines included in the heart region may be more accurately selected by considering standard deviation of the neighboring vertical lines. This is to allow the vertical lines, which are not included in the heart region and have a high contrast, to be excluded from the vertical lines included in the heart region.
The VOI setting unit 134 may select three vertical lines having a maximum standard deviation difference between the neighboring vertical lines in order to detect reference frames for setting VOIs. Pseudo codes of algorithm for selecting three vertical lines are as follows:
wherein, σk
The VOI setting unit 134 may be operable to collect the neighboring frames of each of the three reference frames and set the VOIs with the ROIs set on the collected frames.
V
wherein, {circumflex over (k)}i represents the positions of three vertical lines having a maximum standard deviation in the horizontal cut plane image (i.e., frame positions), fROI(k) represents the ROI in a kth frame, and V
The correlation coefficient curve calculating unit 135 may calculate the correlation coefficient curves for a constant time by using the VOIs set in the VOI setting unit 134. The correlation coefficient curve is calculated through the following equation.
wherein, E[Vk] and E[V
represent the mean of standard deviation of brightness within the VOIs at k and {circumflex over (k)}i positions, and ρi(Vk,V{circumflex over (k)}
The period setting unit 136 may detect a heartbeat period.
Subsequently, the period setting unit 136 may set candidate periods by using right and left zero crossing points of a central zero crossing point at each of the three filtered correlation coefficient curves. That is, the period setting unit 136 may calculate six candidate periods of the heartbeat (Pn).
PFHB=mode(pn) (5)
wherein, Pn represents six candidate periods detected from three correlation coefficient curves formed from the VOI, and PFHB represents a period having the highest frequency among the six candidate periods.
Subsequently, the period setting unit 136 may set a new reference frame, which is away from the reference frame by the global period, and then set a search region including a predetermined number of frames adjacent to the new reference frame. The period setting unit 136 may be operable to calculate the correlation coefficients between the VOI in the reference frame and each VOI in each frame included in the search region. If a correlation coefficient of an arbitrary frame is maximal among the correlation coefficients of the frames included in the search region and the correlation of the arbitrary frame is greater than a value obtained by multiplying a predetermined weight by an average of the correlation coefficients, then an interval between the arbitrary frame and the reference frame is determined as the local period. Thereafter, the period setting unit 136 may set a new reference frame, which is away from the arbitrary frame by the global period. Then, the above process for calculating the local period is repeatedly carried out to the end of the volume data, thereby obtaining total local periods.
The ultrasound data reconstructing unit 137 may perform a linear interpolation for the frames included within each local period by using the global period set in the period setting unit 136. The ultrasound data reconstructing unit 137 may be operable to calculate a ratio (r) of the local period to the global period as the following equation.
Thereafter, an interpolation frame (I′) is calculated as the following equation using the ratio (r) of the local period to the global period.
I′=Δ2×In+Δ1×In+1 (7)
wherein, In and In+1 and represent frames adjacent to the interpolation frame I′, Δ1 and Δ2 represent the distances between the adjacent frames and the interpolation frames, and wherein Δ1 and Δ2 are determined according to the ratio (r) of the local period to the global period. This interpolation process is carried out for frames included in all local periods such that the same number of frames is contained in each local period.
The ultrasound data reconstructing unit 137 may reconstruct the interpolated volume data to provide a 3-dimensional ultrasound image showing a figure of the heartbeat.
Further, when the 3-dimensional volume data are acquired by scanning the target object, the object (e.g., expectant mother or fetus) may be moved. This makes it difficult to accurately detect the heartbeat period of the fetus. Accordingly, the ultrasound system may further include a motion compensating unit. The motion compensating unit compensates for the motion of the expectant mother or the fetus by matching the brightness of pixels between a previously set VOI and a currently set VOI. The motion compensating unit may be operable to calculate the motion vectors by summing the absolute differences of brightness of pixels between the previously set VOI and the currently set VOI. For example, assuming that the VOI at a nth frame is expressed as Vn(m), the VOI at a next frame can be expressed as Vn(m+1). In such a case, a variable m represents the combination of n−1, n and n+1. The motion compensating unit may move Vn(m) up, down, right and left (i, j), and then calculate the absolute differences of brightness of pixels between Vn(m) and Vn(m+1) at each position. A motion vector may be estimated at a position where the absolute difference is minimal. The sum of the absolute difference is calculated as the following equation.
wherein, W represents a predefined motion estimated range, K represents a total number of the frames, i, j represent motion displacements, k,l represent the position of a pixel in the frame included in VOI, and m represents the number of the frames.
The input unit 140 may receive setup information from a user. The setup information may include reference frame setup information, M-mode line setup information and rotation setup information of a 3-dimensional ultrasound image. The processor 150 may be operable to form an M-mode image signal. The M-mode image may be formed by using the reconstructed volume data based on the setup information inputted from a user through the input unit 140.
The processor 150 may form a reference frame image 410 by using the reconstructed volume data based on the reference frame setup information as illustrated in
Further, a different reference frame image may be formed based on reference frame setup information while the previously formed M-mode images 431, 432 and 433 are displayed. In such a case, at least one M-mode line may be set on each of the different reference frame images. Also, at least one M-mode image corresponding to the M-mode line may be formed by extracting data from the reconstructed volume data.
In accordance with another embodiment of the present invention, reference frame setup information for forming a plurality of reference frame images may be inputted through the input unit 140. The processor 150 may form reference frame images by using the reconstructed volume data based on the reference frame setup information. At least one M-mode line may be set on each reference frame image. The processor 150 may extract data corresponding to the M-mode line set on each reference frame image from the reconstructed volume data and forms M-mode image signals for M-mode images based on the extracted data.
In accordance with yet another embodiment of the present invention, the processor 150 may form a 3-dimensional ultrasound image 510 as illustrated in
The display unit 160 may receive the reference frame image signals, the 3-dimensional ultrasound image signals and the M-mode image signals to display the reference frame image, the 3-dimensional ultrasound image and the M-mode image.
As mentioned above, the present invention may display M-mode images for different portions of the target object without moving a probe.
In accordance with one embodiment of the present invention, there is provided an ultrasound system, including: a probe operable to transmit ultrasound signals to a target object containing a periodically moving object and receive ultrasound echo signals reflected from the target object; a volume data forming and reconstructing unit operable to form volume data based on the ultrasound echo signals, the volume data forming and reconstructing unit being configured to determine a beat period of the moving object and reconstruct the volume data based on the beat period; a processor operable to form at least one reference image based on the reconstructed volume data and set a plurality of M-mode lines on the reference image, the processor being configured to form a plurality of M-mode images by extracting data corresponding to the M-mode lines from the reconstructed volume data; and a display unit to display the reference image, the M-mode lines and the M-mode images, one at a time, simultaneously or sequentially.
In accordance with another embodiment of the present invention, there is provided a method of forming an ultrasound image, including: a) transmitting ultrasound signals to a target object containing a periodically moving object and receiving ultrasound echo signals reflected from the target object; b) forming volume data based on the ultrasound echo signals; c) determining a beat period of the moving object and reconstructing the volume data based on the beat period; d) forming at least one reference image based on the reconstructed volume data; e) setting a plurality of M-mode lines on the reference image; f) forming a plurality of M-mode images by extracting data corresponding to the plurality of M-mode lines from the reconstructed volume data; and g) displaying the reference image, the M-mode lines and the M-mode images, one at a time, simultaneously or sequentially.
Any reference in this specification to “one embodiment,” “an embodiment,” “example embodiment,” etc. means that a particular feature, structure or characteristic described in connection with the embodiment is included in at least one embodiment of the present invention. The appearances of such phrases in various places in the specification are not necessarily all referring to the same embodiment. Further, when a particular feature, structure or characteristic is described in connection with any embodiment, it is submitted that it is within the purview of one skilled in the art to effect such feature, structure or characteristic in connection with other ones of the embodiments.
Although embodiments have been described with reference to a number of illustrative embodiments thereof, it should be understood that numerous other modifications and embodiments can be devised by those skilled in the art that will fall within the spirit and scope of the principles of this disclosure. More particularly, numerous variations and modifications are possible in the component parts and/or arrangements of the subject combination arrangement within the scope of the disclosure, the drawings and the appended claims. In addition to variations and modifications in the component parts and/or arrangements, alternative uses will also be apparent to those skilled in the art.
Number | Date | Country | Kind |
---|---|---|---|
10-2007-0022982 | Mar 2007 | KR | national |
The present application is a Continuation Application of U.S. application Ser. No. 12/044,292, filed Mar. 7, 2008, which claims priority from Korean Patent Application No. 10-2007-0022982 filed on Mar. 8, 2007, the entire subject matter of which is incorporated herein by reference.
Number | Name | Date | Kind |
---|---|---|---|
5515856 | Olstad et al. | May 1996 | A |
5570430 | Sheehan et al. | Oct 1996 | A |
6002738 | Cabral et al. | Dec 1999 | A |
6196715 | Nambu et al. | Mar 2001 | B1 |
6464642 | Kawagishi | Oct 2002 | B1 |
8103066 | Kim et al. | Jan 2012 | B2 |
20020045826 | Powers et al. | Apr 2002 | A1 |
20040111028 | Abe et al. | Jun 2004 | A1 |
20040127798 | Dala-Krishna et al. | Jul 2004 | A1 |
20050049503 | Schoisswohl et al. | Mar 2005 | A1 |
20050245822 | Dala-Krishna et al. | Nov 2005 | A1 |
20050288589 | Houle et al. | Dec 2005 | A1 |
20070167809 | Dala-Krishna | Jul 2007 | A1 |
20080221450 | Kim et al. | Sep 2008 | A1 |
Number | Date | Country |
---|---|---|
1 757 955 | Feb 2007 | EP |
2001-046372 | Feb 2001 | JP |
2004-195253 | Jul 2004 | JP |
2005-074225 | Mar 2005 | JP |
2002-44563 | Jun 2002 | KR |
2008-0001059 | Jan 2008 | KR |
2008-0029189 | Apr 2008 | KR |
WO-0217298 | Feb 2002 | WO |
Entry |
---|
Japanese Office Action with English Translation issued in Japanese Application No. 2008-058386 Feb. 19, 2013. |
Japanese Notice of Allowance with English Translation issued in Japanese Applicaiton No. 10-2007-0022982 mailed Apr. 26, 2013. |
European Office Action issued in European Patent Application No. 08004218.7 dated Oct. 5, 2012. |
Extended European Search Report issued Jan. 25, 2012, in Patent Application No. 08004218.7. |
Number | Date | Country | |
---|---|---|---|
20130123633 A1 | May 2013 | US |
Number | Date | Country | |
---|---|---|---|
Parent | 12044292 | Mar 2008 | US |
Child | 13692811 | US |