The present invention relates to a technique for imaging the interior of an object to be inspected by using ultrasonic waves.
As an ultrasonic apparatus for imaging the interior of an object (specimen) to be inspected by using ultrasonic waves, there has been known an ultrasonic diagnostic apparatus for use in medical diagnosis, for example. In the ultrasonic apparatus, an ultrasonic probe is used which includes a plurality of ultrasonic transducers having the function of transmitting and receiving ultrasonic waves. When an ultrasonic beam formed in combination of a plurality of ultrasonic waves is transmitted from the ultrasonic probe to the specimen, the ultrasonic beam is reflected in a region of different acoustic impedance (i.e., a boundary of a tissue) in the interior of the specimen. The appearance in the interior of the specimen can be reproduced on a screen by receiving an ultrasonic wave echo generated in this manner and constructing an image based on the intensity or magnitude of the ultrasonic wave echo.
In such an ultrasonic image, it has conventionally been attempted to extract a contour (boundary) of the tissue in an accurate manner. This is because it is possible to make use of the contour thus extracted for three-dimensional image processing or diagnosis such as distinction of benignancy and malignancy of tumor or the like.
As a related art, Japanese patent application laid-open No. H07 (1995)-194597 describes a method of using threshold processing as a method of automatically extracting the outline or contour of a desired specimen region. A luminance value of an ultrasonic image is searched for along a received sound wave ray, and when a predetermined number or more of luminance values, each equal to or higher than a threshold, have been continuously searched, processing with a predetermined threshold or extraction of a boundary position is performed on the pixels on the received sound wave ray. In addition, as another related art, there is a method that is disclosed in Japanese patent application laid-open No. 2004-181240.
In case where an operator (inspector) such as an inspecting engineer, etc., performs image diagnosis by using an ultrasonic diagnostic apparatus, it is the general use of the apparatus that the operator applies the search unit to a diagnostic region of the specimen while looking at the ultrasonic image, and moves the position and the angle of the search unit so as to find an internal organ in the form of an object to be inspected. In the ultrasonic image at that time, the position and the shape of the object change dynamically. In order to obtain accurate contour information from such a time-varying or dynamic image in real time, it is necessary to execute boundary extraction processing for each frame.
However, the conventional boundary extraction technique involves a problem that it is difficult to achieve such real-time processing. For example, the technique of the first patent document is to extract the outline or contour of an object to be inspected by performing threshold processing on entire sound ray data in an exhaustive manner by comparing the sound ray data with a threshold value and determining a boundary position. In such a technique, the amount of calculation becomes huge (though it depends on the processing power of the apparatus), processing of all the frames in real time is not practical. Therefore, to apply such a conventional technique to dynamic image processing could not help reducing the frame rate of the dynamic image.
The present invention has been made in view of the above-mentioned circumstances, and has for its object to provide a technique that enables an accurate contour (boundary) to be extracted in real time from an ultrasonic wave dynamic image in motion.
In order to achieve the above object, the present invention adopts the following construction.
The present invention provides an ultrasonic apparatus comprising: an ultrasonic probe that transmits ultrasonic waves to an interior of an object to be inspected, and receives reflection waves thereof; a receiving unit that outputs received signals based on the reflection waves received by the ultrasonic probe; an image generation unit that produces ultrasonic images from the received signals; a boundary extraction unit that extracts boundaries between media appearing in each of the ultrasonic images based on the intensity of each of the received signals; and a display unit; wherein the boundary extraction unit performs boundary extraction processing on individual time series ultrasonic images sequentially generated, and wherein the boundary extraction unit sets a target region in a part of an ultrasonic image being processed so as to include boundaries extracted in an ultrasonic image preceding the ultrasonic image being processed, and performs boundary extraction processing in the ultrasonic image being processed by using received signals corresponding to reflection waves reflected at an inner side of the target region thus set.
The present invention provides a control method for an ultrasonic apparatus which includes an ultrasonic probe that transmits ultrasonic waves to an interior of an object to be inspected, and receives reflection waves thereof, a receiving unit that outputs received signals based on the reflection waves received by the ultrasonic probe, an image generation unit that generates ultrasonic images from the received signals, a boundary extraction unit that extracts boundaries between media appearing in each of the ultrasonic images based on the intensity of each of the received signals, and a display unit, the control method for an ultrasonic apparatus comprising: a step of sequentially generating time series ultrasonic images from the received signals; and a step of sequentially extracting boundaries with respect to the ultrasonic images thus produced; wherein the step of extracting the boundaries comprises: a step of setting a target region in a part of an ultrasonic image being processed so as to include a boundary extracted in an ultrasonic image preceding the an ultrasonic image being processed; and a step of performing boundary extraction processing in the ultrasonic image being processed by using received signals corresponding to reflection waves reflected at an inner side of the target region thus set.
According to the present invention, an accurate contour (boundary) can be extracted in real time from an ultrasonic wave dynamic image in motion. Accordingly for example, it is possible to dynamically extract and observe a boundary of a diagnostic region while moving an ultrasonic probe.
Further features of the present invention will become apparent from the following description of exemplary embodiments with reference to the attached drawings.
Hereinafter, preferred embodiments of the present invention will be described in detail by way of example while referring to the accompanying drawings. Here, note that although a medical ultrasonic diagnostic apparatus is shown herein as one example of an ultrasonic apparatus, the present invention is preferably applicable to a variety of kinds of ultrasonic inspection apparatuses in which objects other than a living body are made the objects to be inspected.
As illustrated in
(Ultrasonic Probe)
The ultrasonic probe 10 is used so as to be placed in contact with a specimen, so that it transmits and receives ultrasonic beams toward and from the specimen. The ultrasonic probe 10 is provided with a plurality of ultrasonic transducers (ultrasonic vibrators). An ultrasonic transducer is an element that transmits an ultrasonic beam based on a drive signal applied thereto, receives an ultrasonic wave echo (reflection wave) and outputs an electric signal corresponding to the intensity of reflection thereof. These ultrasonic transducers are arranged in a one-dimensional or two-dimensional manner thereby to form a transducer array.
The ultrasonic transducers are each composed of a transducer which has electrodes formed at opposite ends of a material (piezoelectric material) having piezoelectricity. As such a piezoelectric material, there are used, for example, piezoelectric ceramic represented by PZT (Pb (lead) zirconate titanate), polymer piezoelectric element represented by PVDF (polyvinylidene difluoride), and so on. The piezoelectric material is caused to expand and contract when a pulsed electric signal or a continuous wave electric signal is sent to the electrodes of such a transducer thereby to apply a voltage thereto. In accordance with the expansion and contraction, a pulse-shaped ultrasonic wave or a continuous-wave ultrasonic wave is generated from each transducer, so that an ultrasonic beam is formed by the combination of these ultrasonic waves. In addition, the individual transducers are caused to expand and contract to generate electric signals, respectively, by receiving the transmitted ultrasonic waves. These electric signals are output as detection signals for the corresponding ultrasonic waves.
Alternatively, a plurality of kinds of elements of different transducing schemes can be used as the ultrasonic transducers. For example, the above-mentioned transducers are used as elements for transmitting ultrasonic waves, and ultrasonic transducers of photodetection type are used as elements for receiving ultrasonic waves. The ultrasonic transducer of photodetection type is one that makes detection by converting an ultrasonic beam into an optical signal, and is composed of, for example, a Fabry-Perot resonator or a Fiber Bragg grating.
(Drive Unit)
The transmitting unit 13 is a circuit that supplies a drive signal to the respective ultrasonic transducers so as to transmit an ultrasonic wave from the ultrasonic probe 10. The transmitting unit 13 is composed of a plurality of drive circuits corresponding to the individual ultrasonic transducers, respectively.
The receiving unit 14 is a circuit that processes the ultrasonic waves (reflection waves) received by the ultrasonic probe 10. The receiving unit 14 is also composed of a plurality of receiving circuits corresponding to the individual ultrasonic transducers, respectively. The receiving circuits apply analog amplification processing to the detection signals output from the ultrasonic transducers by the use of preamplifiers and TGC (time gain compensation) amplifiers, respectively. The levels of the detection signals are adjusted to the input signal levels of the A/D converters, respectively, by the analog amplification processing. The analog signals output from the TGC amplifiers are converted into detected data in the form of digital signals by means of the A/D converters. A plurality of pieces of detected data (received signals) corresponding to the individual ultrasonic transducers, respectively, are output from the receiving unit 14.
(Other Construction of the Apparatus)
The memory 19 includes a plurality of line memories corresponding to a plurality of the receiving circuits, respectively, and stores the detected data output from the individual receiving circuits in a time series manner.
The phase matching calculation unit 18 performs calculation processing, i.e., reception focus processing so as to adjust the phase of the detected data. The phase matching calculation unit 18 provides delays corresponding to the focal position to the plurality of pieces of detected data stored in the memory 19, respectively, and thereafter adds them to one another. As a result, sound ray data representing ultrasonic wave information along desired scanning lines is generated. The phase matching calculation unit 18 is constituted by a shift register delay line, a digital minute delay machine, a CPU (central processing unit) with software, or any combination of these.
The input operation unit 11 is used when an operator inputs instructions and information to the ultrasonic diagnostic apparatus. The input operation unit 11 includes a keyboard, an adjustment knob, and a pointing device such as a mouse, etc.
The system control unit 12 is constituted by a processor and software, and controls respective parts of the ultrasonic diagnostic apparatus based on the instructions and information input from the input operation unit 11.
(Ultrasonic B Mode Image)
The image processing unit 15 generates synthetic image data in which a boundary image is overlapped on a region of B mode image, based on the B mode image data generated by the B mode image data generation unit 22 and the boundary image data generated by the boundary image data generation unit 24. The region of the B mode image in which the boundary image is overlapped can be automatically decided by the image processing unit 15, or can be manually designated by the operator with the use of the input operation unit 11.
The image data storage unit 17 stores the synthetic image data thus generated. In addition, the image processing unit 15 generates image data for screen display by applying predetermined image processing including scan conversion, gradation processing, etc., to the synthetic image data. The display unit 16 includes a display unit such as a CRT, an LCD, etc., and an ultrasonic image is displayed based on the image data to which the image processing has been applied by the image processing unit 15.
(Boundary Extraction Processing)
Next, reference will be made to a processing flow of the principle and operation of the boundary extraction in this embodiment. However, the processing to be described herein is merely one specific example, and the scope of the present invention should not be limited to this.
In general, it is difficult to accurately extract only a target boundary line (contour) from an ultrasonic image. In addition, as stated above, if boundary detection processing is applied to all the sound ray data in the image in an exhaustive manner, the amount of data to be calculated becomes huge, and hence real-time processing thereof also becomes difficult. Accordingly, in this embodiment, the above-mentioned problem is solved as follows. That is, (1) after a boundary line at the first time (an initial boundary line) is decided by using the teaching or instruction of the operator, (2) the processing of searching and tracking the boundary line is performed on a target region in the form of a nearby region including the boundary line.
Now, reference will be made to the flow of the boundary extraction processing by using the flow charts of
As shown in
(Detection of Initial Boundary Line)
As illustrated in
The tissue boundary marking method according to method 1 is a technique that the operator teaches or instructs the position of the boundary line, as illustrated in
The ROI setting method according to method 2 is a technique in which the operator teaches or instructs, as an ROI (area of interest), a region where a boundary line exists, as illustrated in
After the search regions have thus been fixedly set, the boundary extraction unit 2 acquires the received signals (sound ray data) of a current frame from the phase matching calculation unit 18 (S205), and detects boundary lines only from those received signals which correspond to the search regions (S206). As a result, the boundary lines can be detected in a shorter period of time than when boundary detection processing is executed over the entire regions of the received signals. Moreover, since the regions where the boundaries exist are taught, false detection of the boundaries can be reduced and the initial boundary lines can be decided in an accurate manner.
The detection processing of the initial boundary lines by means of the boundary extraction unit 2 as referred to above corresponds to an initial boundary setting unit in the present invention that serves to set the initial boundaries for the first ultrasonic image in the time series ultrasonic images. The time series ultrasonic images means a group of temporally continuous ultrasonic images that have been sequentially generated at a predetermined period (frame rate). When the operator moves the ultrasonic probe, an ultrasonic image is sequentially generated at each position of the ultrasonic probe in the object to be inspected. Here, note that it is desirable to fix the position of the ultrasonic probe 10 so as to prevent the boundary positions from changing during the initial boundary line detection processing.
(Tracking of Boundary Lines)
When the initial boundary lines are decided as stated above, the control flow shifts to the boundary line tracking processing (S300). Here, note that after the tracking processing has been started, it is possible to observe the specimen while moving the position and the angle of the ultrasonic probe 10. Thus, the time series ultrasonic images (ultrasonic wave dynamic images) are sequentially generated at the predetermined frame rate, and the extraction of the boundaries is sequentially performed on the ultrasonic images of each frame by means of a method that will be described below.
As illustrated in
Subsequently, the boundary extraction unit 2 acquires the received signals of the current frame (frame being processed) from the phase matching calculation unit 18 (S302). The example of an image of the current frame is illustrated in
Accordingly, the boundary extraction unit 2 executes the boundary line detection processing for only those received signals which correspond to the reflection waves reflected at an inner side of each of the margin regions (S303). As a result, the boundary lines can be detected in a extremely shorter period of time than when boundary detection processing is executed for the entire region of the received signals.
The processing in steps S301 through S303 is repeatedly executed every one frame. In the processing of the following frame, the margin regions 1′ and 2′ are again set (updated) in such a manner as to contain the boundary lines 1′ and 2′ extracted in the preceding frame, as illustrated in
The value of the size L of each margin region can be fixed, or can be changed, or can be caused to vary dynamically. It is desirable that the size (the value of L) and the position of each margin region be decided in consideration of the speed and the direction of movement of the search unit being driven by the operator (based on information of the movement between the positions of the ultrasonic probe). That is, when an operator causing the search unit to move at fast speed uses the search unit, the margin regions are increased by making the value of L larger. However, the larger the value of L, the larger the search regions become, so the processing time of the boundary detection accordingly increases. Thus, an upper limit should be set for the value of L. When the operator slowly moves the search unit, the search regions can be narrowed by decreasing the value of L. If the detection processing can be shortened, there will be a merit or advantage that high-quality movie (moving image) display becomes possible due to further improved frame rate. In addition, as for the setting of the size L of the margin regions, the operator can manually set the size L by initial setting. Or, the apparatus can also automatically set the size L for each frame by learning the movement operation condition of the search unit and estimating the amount of movement per frame. It is also desirable to estimate (predict) the direction of movement of each boundary line in an image from the history of the direction of movement of the search unit or the history of the tracking processing or the like, and to decide the position of each margin region based on the result of the estimation.
As described above, in this embodiment, by limiting the search range of a boundary line, an accurate contour (boundary) can be extracted in real time from an ultrasonic dynamic image in motion. Accordingly, for example, it is possible to dynamically extract and observe the boundary of a diagnostic region while moving an ultrasonic probe.
Next, reference will be made to an ultrasonic diagnostic apparatus according to a second embodiment of the present invention. The ultrasonic diagnostic apparatus of this second embodiment is different from that of the first embodiment in that it has a sound speed setting function to set the value of sound speed for each region delimited by a boundary. The other construction of this second embodiment is similar to that of the first embodiment, and hence in the following, those which are different from the first embodiment will be mainly described.
In a conventional ultrasonic diagnostic apparatus, a delay time in the electronic focus is calculated on the assumption that the speed of sound in a living body is a specific value (in general, 1,530 m/sec or 1,540 m/sec as specified in JIS). However, in actuality, the speed of sound is different according to the kind of tissues (media). In general, the speed of sound is about 3,000 m/sec in bone, about 1,590 m/sec in muscle, and about 1,470 m/sec in fat.
When an object to be inspected has regions in which the speed of sound is different in this manner, the arrival points in time of the individual received signals do not coincide with one another even if the individual delay times decided on the assumption that the speed of sound is uniform are given to the individual received signals, respectively. Accordingly, even if all these individual received signals are added together, a focused signal is not obtained, thus resulting in a blurred tomographic image. The larger the difference between the actual speed of sound in each tissue and a set reference speed of sound (1,530 m/sec), the larger the amount of focal shift becomes. In addition, the larger the layer thickness of each tissue, the larger the above-mentioned amount of focal shift becomes.
For example, in case where a brain is inspected through a transcranial skull, or where a liver is inspected, or where a thyroid is inspected, an actually focused position shifts to a short distance direction from a focusing position (the position of focusing when assuming that a living body is an ultrasonic wave transmission medium of a uniform speed of sound having a sound speed of 1,530 m/sec). In addition, in case where a mammary gland is inspected, an actually focused position shifts to a long distance direction from the focusing position. Specifically, when acoustic diagnosis of a liver in a abdomen is performed, a fat layer of a sound speed of about 1,470 m/sec exists in the vicinity of a body surface, and a muscle layer of a sound speed of about 1,540 m/sec exists under the fat layer, and further, a liver of a sound speed of about 1,540 m/sec similarly exists under the muscle layer. The thickness of the fat layer varies depending on person, so individual delay amounts for the respective received signals can not be uniformly corrected. In addition, the fat layer is sometimes deposited in the muscle or the liver.
Here, note that the values of the speeds of sound are used not only for the determination of delay times in the received focus but also for the generation of an ultrasonic image, various measurements on the ultrasonic image and so on. When there is a difference between the actual speed of sound in each tissue and the set reference speed of sound, a distortion is generated in the ultrasonic image, and the error of measurements obtained from the ultrasonic image becomes large, so it is undesirable.
In order to solve such a problem, the ultrasonic diagnostic apparatus of this embodiment is provided with a sound speed setting function to set an appropriate value of the speed of sound corresponding to the acoustic characteristic of a tissue in each of the regions delimited by boundaries.
(Sound Speed Setting Processing)
As shown in
Then, an operator selects and sets a tissue name in each of the regions delimited by boundaries by using the input operation unit 11 (S402).
Subsequently, the values of the speeds of sound in the individual regions are decided in accordance with the tissue names thus set, respectively (S403).
Thereafter, the values of the speeds of sound in the individual regions are passed from the system control unit 12 to the respective blocks such as the phase matching calculation unit 18, the image processing unit 15 and so on, so that they are reflected in the processing of an ultrasonic image (S404). Specifically, the phase matching calculation unit 18 calculates (corrects) the delay times of the individual ultrasonic transducers by using the values of the speeds of sound in the individual regions, respectively. As a result, the shift or deviation in position of the electronic focus is improved, thereby suppressing the blurring or defocusing of the image as well as the reduction of the signal level. Further, the image processing unit 15 corrects the distortion of the ultrasonic image by using the values of the speeds of sound in the individual regions. By adopting appropriate values of the speeds of sound in the individual regions, respectively, the degradation of image quality due to the non-uniformity of the speeds of sound in the living body can be suitably corrected in this manner.
The technique of this embodiment is effective for the diagnosis of an object to be inspected in which there exist a lot of tissues of different speeds of sound, which frequently appears in ordinary diagnosis. The technique of this embodiment can also improve the image quality degradation and the image distortion of an ultrasonic image in such a case, and decrease measurement errors on the image.
While the present invention has been described with reference to exemplary embodiments, it is to be understood that the invention is not limited to the disclosed exemplary embodiments. The scope of the following claims is to be accorded the broadest interpretation so as to encompass all such modifications and equivalent structures and functions.
This application claims the benefit of Japanese Patent Application No. 2008-155105, filed on Jun. 13, 2008, which is hereby incorporated by reference here in its entirety. This application also claims the benefit of Japanese Patent Application No. 2009-089092, filed on Apr. 1, 2009, which is hereby incorporated by reference here in its entirety.
Number | Date | Country | Kind |
---|---|---|---|
2008-155105 | Jun 2008 | JP | national |
2009-089092 | Apr 2009 | JP | national |
Filing Document | Filing Date | Country | Kind | 371c Date |
---|---|---|---|---|
PCT/JP2009/060972 | 6/6/2009 | WO | 00 | 12/8/2010 |