The present application claims priority under 35 U.S.C. § 119 to Japanese Patent Application No. 2022-144569, filed on Sep. 12, 2022. The above application is hereby expressly incorporated by reference, in its entirety, into the present application.
The present invention relates to an ultrasound diagnostic apparatus and a control method for an ultrasound diagnostic apparatus for setting a region of interest in an ultrasound image.
Conventionally, an ultrasound image representing a tomogram of an inside of a subject under examination has been acquired using a so-called ultrasound diagnostic apparatus, and an examination for the subject under examination has been performed by a user such as a doctor based on the acquired ultrasound image. In order for the user to smoothly perform such an examination for the subject under examination, there is known a technique for automatically detecting or measuring an object such as an organ of the subject under examination shown in an ultrasound image. In this case, a so-called region of interest may be set in the ultrasound image in order to limit a range in which processing such as automatic detection or measurement is performed and to smoothly perform the processing. For example, WO2019/039028A discloses that a rectangular region of interest is set in an ultrasound image in order to limit a range in which a detection target is detected.
Meanwhile, in a case where a user such as a doctor confirms a detection target shown in an ultrasound image and performs a diagnosis, a region of interest including the detection target in the ultrasound image may be displayed on a monitor such that the detection target can be easily confirmed. Usually, the region of interest is often displayed with a closed rectangular frame line.
In addition, in a case where the detection target is a feces, a cyst, or the like present inside the rectum, it is known that in order to perform an accurate diagnosis, it is necessary to confirm not only the presence of the detection target but also whether or not there is a so-called posterior acoustic shadow in a region located at a deeper part than the detection target, whether or not a so-called posterior echo is enhanced, or the like. Therefore, in a case where the region of interest is displayed with the closed rectangular frame line, it may be difficult for the user to confirm the region located at the deeper part than the detection target in the ultrasound image, which may make it difficult to easily perform an accurate diagnosis.
The present invention has been made in order to solve such a conventional problem, and an object of the present invention is to provide an ultrasound diagnostic apparatus and a control method for an ultrasound diagnostic apparatus that enable a user to easily and accurately perform a diagnosis.
According to the following configuration, the above object can be achieved.
According to the present invention, there is provided an ultrasound diagnostic apparatus comprising: a monitor; a detection target detection unit configured to detect a detection target captured in an ultrasound image; a region-of-interest setting unit configured to set, on the ultrasound image, a region of interest including the detection target detected by the detection target detection unit; and a region-of-interest suggestion line display unit configured to display, on the monitor, a region-of-interest suggestion line consisting of only a part of a contour line of the region of interest set by the region-of-interest setting unit. Therefore, the user can easily and accurately perform a diagnosis.
Hereinafter, embodiments of the present invention will be described with reference to the accompanying drawings.
The description of configuration requirements to be described below is made based on a representative embodiment of the present invention, but the present invention is not limited to such an embodiment.
In the present specification, a numerical range represented by “to” means a range including numerical values described before and after “to” as a lower limit value and an upper limit value, respectively.
In the present specification, “same” and “identical” include an error range generally allowed in the technical field.
The ultrasound probe 1 includes a transducer array 11. A transmission/reception circuit 12 is connected to the transducer array 11.
The apparatus main body 2 includes an image generation unit 21 connected to the transmission/reception circuit 12 of the ultrasound probe 1. A display controller 22 and a monitor 23 are sequentially connected to the image generation unit 21. In addition, a detection target detection unit 24, a region-of-interest setting unit 25, and a region-of-interest suggestion line display unit 26 are sequentially connected to the image generation unit 21. The region-of-interest suggestion line display unit 26 is connected to the display controller 22. In addition, a main body controller 27 is connected to the transmission/reception circuit 12, the image generation unit 21, the display controller 22, the detection target detection unit 24, the region-of-interest setting unit 25, and the region-of-interest suggestion line display unit 26. An input device 28 is connected to the main body controller 27.
In addition, the transmission/reception circuit 12 and the image generation unit 21 constitute an image acquisition unit 31. Further, the image generation unit 21, the display controller 22, the detection target detection unit 24, the region-of-interest setting unit 25, the region-of-interest suggestion line display unit 26, and the main body controller 27 constitute a processor 32 for the apparatus main body 2.
The transducer array 11 of the ultrasound probe 1 includes a plurality of ultrasound transducers one-dimensionally or two-dimensionally arranged. Each of these ultrasound transducers transmits an ultrasound wave in accordance with a drive signal supplied from the transmission/reception circuit 12 and receives an ultrasound echo from a subject under examination to output a signal based on the ultrasound echo. For example, each ultrasound transducer is composed of a piezoelectric material consisting of piezoelectric ceramic represented by lead zirconate titanate (PZT), a polymer piezoelectric element represented by poly vinylidene di fluoride (PVDF), piezoelectric single crystal represented by lead magnesium niobate-lead titanate (PMN-PT), or the like, and electrodes formed at both ends of the piezoelectric material.
Under the control of the main body controller 27, the transmission/reception circuit 12 transmits the ultrasound wave from the transducer array 11 and generates a sound ray signal based on a reception signal acquired by the transducer array 11. As shown in
The pulsar 41 includes, for example, a plurality of pulse generators, and the pulsar 41 adjusts an amount of delay of each of drive signals and supplies the drive signals to the plurality of ultrasound transducers such that ultrasound waves transmitted from the plurality of ultrasound transducers of the transducer array 11 form an ultrasound beam based on a transmission delay pattern selected according to a control signal from the main body controller 27. In this way, in a case where a pulsed or continuous-wave voltage is applied to the electrodes of the ultrasound transducer of the transducer array 11, the piezoelectric material expands and contracts to generate pulsed or continuous-wave ultrasound wave from each of the ultrasound transducers, whereby an ultrasound beam is formed from the combined wave of these ultrasound waves.
The transmitted ultrasound beam is reflected in, for example, a target such as a site of the subject under examination and propagates toward the transducer array 11 of the ultrasound probe 1. The ultrasound echo propagating toward the transducer array 11 in this way is received by each of the ultrasound transducers constituting the transducer array 11. In this case, each of the ultrasound transducers constituting the transducer array 11 receives the propagating ultrasound echo to expand and contract to generate a reception signal, which is an electrical signal, and outputs these reception signals to the amplification section 42.
The amplification section 42 amplifies the signal input from each of the ultrasound transducers constituting the transducer array 11 and transmits the amplified signal to the AD conversion section 43. The AD conversion section 43 converts the signal transmitted from the amplification section 42 into digital reception data. The beam former 44 performs so-called reception focus processing by applying and adding a delay to each reception data received from the AD conversion section 43. By this reception focus processing, each reception data converted by the AD conversion section 43 is phase-added, and a sound ray signal in which the focus of the ultrasound echo is narrowed down is acquired.
As shown in
The signal processing section 45 generates a B-mode image signal, which is tomographic image information regarding tissues inside the subject under examination, by performing, on the sound ray signal received from the transmission/reception circuit 12, correction of the attenuation due to the distance according to the depth of the reflection position of the ultrasound wave using a sound speed value set by the main body controller 27 and then performing envelope detection processing.
The DSC 46 converts (raster-converts) the B-mode image signal generated by the signal processing section 45 into an image signal according to a normal television signal scanning method.
The image processing section 47 performs various types of necessary image processing such as gradation processing on the B-mode image signal input from the DSC 46 and then sends the B-mode image signal to the display controller 22 and the detection target detection unit 24. Hereinafter, the B-mode image signal that has been subjected to image processing by the image processing section 47 is referred to as an ultrasound image.
Under the control of the main body controller 27, the display controller 22 performs predetermined processing on the ultrasound image or the like generated by the image generation unit 21 and displays the ultrasound image or the like on the monitor 23.
The monitor 23 performs various kinds of display under the control of the display controller 22. The monitor 23 can include a display device such as a liquid crystal display (LCD), or an organic electroluminescence (EL) display, for example.
The detection target detection unit 24 analyzes the ultrasound image generated by the image generation unit 21 to detect the detection target captured in the ultrasound image. The detection target detection unit 24 stores, for example, a plurality of template images for each of a plurality of detection targets and can detect the detection target by searching within the ultrasound image according to a so-called template matching method using the plurality of template images. In addition, the detection target detection unit 24 includes, for example, a machine learning model that has learned a large number of ultrasound images showing the plurality of detection targets, respectively, and can also use this machine learning model to detect the detection target shown in the ultrasound image.
For example, as shown in
Instead of outputting the contour line C of the detection target A as the detection result, the detection target detection unit 24 can also output a rectangular image region B including the detection target A as the detection result, as shown in
For example, as shown in
In a case where the detection target detection unit 24 outputs the contour line C of the detection target A, the region-of-interest setting unit 25 sets, for example, a rectangular region that includes the contour line C and that circumscribes the contour line C, and enlarges the rectangular region by a magnification of at least 1 time and less than 2 times, for example, by a magnification of 1.2 times, while fixing the position of the center of gravity of the rectangular region, whereby the region of interest R can be set.
In addition, in a case where the detection target detection unit 24 outputs the image region B including the detection target A instead of outputting the contour line C of the detection target A, the region-of-interest setting unit 25 can set the image region B as the region of interest R.
For example, as shown in
For example, as shown in
Meanwhile, depending on the type of the detection target A, it may be necessary to confirm a so-called posterior echo in order to perform the diagnosis related to the detection target A. It is known that, for example, in a case of performing a diagnosis related to a feces present inside the rectum of the subject under examination, it is necessary to confirm the posterior echo of the feces to determine whether or not there is a so-called posterior acoustic shadow in a region located at the deeper part than the feces. The posterior acoustic shadow refers to a low brightness region located at the deeper part than the detection target A such as a feces in the ultrasound image U, which is caused by the ultrasound wave propagating from a body surface side of the subject under examination being unable to pass through the detection target A. The posterior acoustic shadow is often generated in the ultrasound image U in which the hard feces is captured, and is often confirmed in order to determine the property of the feces, that is, the hardness of the feces.
In the embodiment of the present invention, since the region-of-interest suggestion line L to be displayed on the monitor 23 by the region-of-interest suggestion line display unit 26 is composed of, for example, a line consisting of only a part of the contour line Q and excluding a portion of the contour line Q of the region of interest R, which is a portion located at the deeper part than the detection target A, the user such as a doctor can easily and accurately perform the diagnosis related to the detection target A by clearly confirming the posterior echo of the detection target A such as the posterior acoustic shadow.
In addition to the feces, examples of the detection target A for which the posterior echo needs to be confirmed include a cyst. In general, it is known that the posterior echo may be enhanced in the ultrasound image U in which the cyst is captured. The enhancement of the posterior echo refers to a high brightness region located at the deeper part than the detection target Ain the ultrasound image U, where the attenuation of the ultrasound wave is small, such as a cyst. In this way, even in a case where the posterior echo of the detection target A is enhanced, the user can easily and accurately perform the diagnosis related to the detection target A by clearly confirming the enhancement of the posterior echo because the region-of-interest suggestion line L is composed of a line consisting of only a part of the contour line Q of the region of interest R.
Further, in the ultrasound image U in which a so-called B-line in the lung echo is captured, for example, displaying the region of interest R of the B-line with a closed frame line surrounding the generation portion of the B-line may make it difficult for the user to confirm the continuity of the B-line. In addition, displaying the region of interest R of the B-line with a closed frame line surrounding the entire B-line may make the display range of the frame line too wide, which makes it difficult for the user to confirm the ultrasound image U. As shown in
The main body controller 27 controls each unit of the apparatus main body 2 and the ultrasound probe 1 in accordance with a program recorded in advance, or the like.
The input device 28 accepts an input operation by an examiner and sends input information to the main body controller 27. The input device 28 is composed of, for example, a device for the examiner to perform an input operation, such as a keyboard, a mouse, a trackball, a touchpad, or a touch panel.
Although the processor 32 including the image generation unit 21, the display controller 22, the detection target detection unit 24, the region-of-interest setting unit 25, the region-of-interest suggestion line display unit 26, and the main body controller 27 may be composed of a central processing unit (CPU) and a control program for causing the CPU to perform various types of processing, the processor 32 may be composed of a field programmable gate array (FPGA), a digital signal processor (DSP), an application specific integrated circuit (ASIC), a graphics processing unit (GPU), or other integrated circuits (ICs), or may be composed of a combination thereof.
In addition, the image generation unit 21, the display controller 22, the detection target detection unit 24, the region-of-interest setting unit 25, the region-of-interest suggestion line display unit 26, and the main body controller 27 of the processor 32 can also be configured by being integrated partially or entirely into one CPU or the like.
Next, an example of an operation of the ultrasound diagnostic apparatus according to the embodiment will be described with reference to the flowchart of
First, in step S1, the ultrasound image U is acquired by the image acquisition unit 31. In this case, the transducer array 11 of the ultrasound probe 1 transmits the ultrasound beam into the subject under examination and receives the ultrasound echo from the inside of the subject under examination, whereby the reception signal is generated. The transmission/reception circuit 12 of the image acquisition unit 31 performs so-called reception focus processing on the reception signal to generate the sound ray signal, under the control of the main body controller 27. The sound ray signal generated by the transmission/reception circuit 12 is sent to the image generation unit 21. The image generation unit 21 generates the ultrasound image U using the sound ray signal sent from the transmission/reception circuit 12.
Next, in step S2, the detection target detection unit 24 analyzes the ultrasound image U acquired in step S1 to detect the detection target A shown in the ultrasound image U. In this case, the detection target detection unit 24 can detect the detection target A using a template matching method and can detect the detection target using a machine learning model that has learned in advance a large number of ultrasound images U showing the detection targets.
In step S3, the region-of-interest setting unit 25 sets, on the ultrasound image U, the region of interest R including the detection target A detected in step S2, for example, as shown in
Finally, in step S4, the region-of-interest suggestion line display unit 26 displays the region-of-interest suggestion line L consisting of only a part of the contour line Q of the region of interest R set in step S3 on the monitor 23, as shown in
In a case where the processing of step S4 is completed in this manner, the operation of the ultrasound diagnostic apparatus according to the flowchart of
As described above, with the ultrasound diagnostic apparatus according to the embodiment of the present invention, the detection target detection unit 24 detects the detection target A captured in the ultrasound image U, the region-of-interest setting unit 25 sets, on the ultrasound image U, the region of interest R including the detection target A, and the region-of-interest suggestion line display unit 26 displays the region-of-interest suggestion line L consisting of only a part of the contour line Q of the region of interest R on the monitor 23. Therefore, even in a case where images that are useful in the diagnosis of the subject under examination, such as the posterior acoustic shadow, the enhancement of the posterior echo, and the B-line, are generated, the user can easily and accurately diagnose the subject under examination by clearly confirming these images.
Although a case where the transmission/reception circuit 12 is provided in the ultrasound probe 1 has been described, the transmission/reception circuit 12 may be provided in the apparatus main body 2.
Further, although a case where the image generation unit 21 is provided in the apparatus main body 2 has been described, the image generation unit 21 may be provided in the ultrasound probe 1.
In addition, the apparatus main body 2 may be a so-called stationary type, a portable type that is easy to carry, or a so-called handheld type that is composed of, for example, a smartphone or a tablet type computer. As described above, the type of the device that constitutes the apparatus main body 2 is not particularly limited.
In addition, the apparatus main body 2 can also comprise an image memory (not shown) that stores the ultrasound image U generated by the image generation unit 21 for each examination. In this case, the processing of steps S2 to S4 in the flowchart of
In addition, the apparatus main body 2 can also comprise an image input unit (not shown) for inputting the ultrasound image U from an external device (not shown). In this case, the processing of steps S2 to S4 in the flowchart of
Further, a case where the region-of-interest suggestion line display unit 26 can display, as the region-of-interest suggestion line L, a line excluding a portion of the contour line Q of the region of interest R, which is a portion located at the deeper part than the detection target A, on the monitor 23 has been described, but the aspect of the region-of-interest suggestion line L is not particularly limited thereto.
For example, as shown in
In addition, in a case where the region of interest R has the shape of a quadrangle, for example, as shown in
Here, the quadrangle may be a quadrangle having corners with right angles at the positions of the four vertices, or a so-called rounded quadrangle having rounded corners with a certain curvature. For example, in a case where a plurality of detection targets A such as an empty rectum and a feces are set, a quadrangle having corners with right angles can be set as the region of interest R for the empty rectum, and a rounded quadrangle can be set as the region of interest R for the feces. In this case, for example, the region-of-interest suggestion line L consisting of four corners with right angles can be set for the empty rectum, and the region-of-interest suggestion line L consisting of four rounded corners can be set for the feces. As a result, the user can grasp the type of the detection target A for which the region of interest R is set by confirming the shape of the region-of-interest suggestion line L.
Further, a case where the region of interest R to be set by the region-of-interest setting unit 25 has a rectangular shape has been described, but the shape of the region of interest R is not limited to the rectangular shape and can be any shape, such as a circular shape and a polygonal shape.
For example, as shown in
In addition, the shape and size of the region of interest R can also be decided on, for example, based on an input operation of the user via the input device 28. In this case, the region-of-interest setting unit 25 can set, on the ultrasound image U, the region of interest R having at least one of the shape or the size decided on based on the input operation of the user via the input device 28.
Further, a case where the detection target detection unit 24 detects the detection target A by analyzing the ultrasound image U generated by the image generation unit 21 has been described, but the detection target detection unit 24 also can detect the detection target A by, for example, analyzing the B-mode image signal generated by the signal processing section 45. In this case, the region-of-interest setting unit 25 can set the region of interest R for the B-mode image signal generated by the signal processing section 45.
In a case where the B-mode image signal for which the region of interest R is set in this manner undergoes processing by the DSC 46 and the image processing section 47, the region of interest R set for the B-mode image signal is converted into a shape along the sound line as shown in
Number | Date | Country | Kind |
---|---|---|---|
2022-144569 | Sep 2022 | JP | national |