The present application claims priority under 35 U.S.C. § 119 to Japanese Patent Application No. 2019-128479 filed on Jul. 10, 2019. Each of the above application is hereby expressly incorporated by reference, in its entirety, into the present application.
The present invention relates to a measurement apparatus, an ultrasound diagnostic apparatus, a measurement method, and a measurement program.
An ultrasound diagnostic apparatus that acquires an ultrasound image of the inside of a subject by driving each of a plurality of ultrasound transducers inside the subject (for example, the body of a patient) to transmit and receive ultrasound waves is already known. An ultrasound diagnostic apparatus having a measurement function of measuring the size of tissue included in the ultrasound image (for example, see JP2005-334089A, JP2019-083960A, and JP2008-161220A) is known.
JP2005-334089A and JP2019-083960A disclose an ultrasound diagnostic apparatus that specifies a plurality of measurement points on an ultrasound image displayed on a display unit using an input apparatus such as keyboards and trackballs and measures a range specified by the plurality of measurement points.
JP2008-161220A discloses an ultrasound diagnostic apparatus that generates a brightness profile on a detection line by setting the detection line for an ultrasound image displayed on a display unit, sets two measurement points on the detection line on the basis of the brightness profile, and measures a composite thickness of the intima and media of a blood vessel on the basis of the two measurement points.
The measurement function in the ultrasound diagnostic apparatus is often performed while a subject is being tested. In order to specify a measurement range on the ultrasound image, it is necessary to set at least two measurement points. However, it is not easy to accurately specify the measurement range, in other words, to accurately specify a position of the measurement point within a limited time during the test.
In JP2005-334089A and JP2019-083960A, since the measurement is performed under the assumption that a measurement point specified by a manual operation is correct, the reliability of a measurement result can be reduced. JP2008-161220A determines a measurement range on the basis of the brightness profile on the detection line. However, in this method, since only the position of the detection line can be specified, the measurement of tissues different from the desired tissue can be performed. Also, depending on the state of the brightness profile, measurement of tissues different from the desired tissue can be performed.
The present invention has been accomplished in consideration of the above-described situation, and an object of the invention is to provide a measurement apparatus, an ultrasound diagnostic apparatus, a measurement method, and a measurement program that can set an intended measurement target range with high accuracy for an ultrasound image.
A measurement apparatus according to the aspect of the present invention comprises a correction support information generation unit that generates a first brightness profile on a first straight line passing through a first measurement point and a second measurement point specified for an ultrasound image generated by an ultrasound diagnostic apparatus and displayed on a display unit, and generates first correction support information for supporting correction of at least one position of the first measurement point or the second measurement point on the first straight line on the basis of the first brightness profile, and a measurement unit that displays the first correction support information on the display unit, and on the basis of instructions input in a state where the first correction support information is displayed on the display unit, determines one of the first measurement point or a first corrected measurement point corrected from the first measurement point based on the first correction support information as a first final measurement point, determines one of the second measurement point or a second corrected measurement point corrected from the second measurement point based on the first correction support information as a second final measurement point, and measures a size of a measurement range on the ultrasound image based on the first final measurement point and the second final measurement point.
An ultrasound diagnostic apparatus according to the aspect of the present invention comprises the measurement apparatus and an image processing unit that generates the ultrasound image on the basis of an output signal of an ultrasonic endoscope.
The measurement method according to the aspect of the present invention comprises a correction support information generation step of generating a first brightness profile on a first straight line passing through a first measurement point and a second measurement point specified for an ultrasound image generated by an ultrasound diagnostic apparatus and displayed on a display unit, and generating first correction support information for supporting correction of at least one position of the first measurement point or the second measurement point on the first straight line on the basis of the first brightness profile, and a measurement step of displaying the first correction support information on the display unit, and on the basis of instructions input in a state where the first correction support information is displayed on the display unit, determining one of the first measurement point or a first corrected measurement point corrected from the first measurement point based on the first correction support information as a first final measurement point, determining one of the second measurement point or a second corrected measurement point corrected from the second measurement point based on the first correction support information as a second final measurement point, and measuring a size of a measurement range on the ultrasound image based on the first final measurement point and the second final measurement point.
The measurement program according to the aspect of the present invention is a program for causing a computer to perform a correction support information generation step of generating a first brightness profile on a first straight line passing through a first measurement point and a second measurement point specified for an ultrasound image generated by an ultrasound diagnostic apparatus and displayed on a display unit, and generating first correction support information for supporting correction of at least one position of the first measurement point or the second measurement point on the first straight line on the basis of the first brightness profile, and a measurement step of displaying the first correction support information on the display unit, and on the basis of instructions input in a state where the first correction support information is displayed on the display unit, determining one of the first measurement point or a first corrected measurement point corrected from the first measurement point based on the first correction support information as a first final measurement point, determining one of the second measurement point or a second corrected measurement point corrected from the second measurement point based on the first correction support information as a second final measurement point, and measuring a size of a measurement range on the ultrasound image based on the first final measurement point and the second final measurement point.
According to the present invention, it is possible to provide a measurement apparatus, an ultrasound diagnostic apparatus, a measurement method, and a measurement program that can set a measurement target range intended for an ultrasound medical image with high accuracy.
Outline of Ultrasound Diagnostic Apparatus
An outline of an ultrasonic endoscope apparatus 10 which is an embodiment of an ultrasound diagnostic apparatus according to the embodiment of the present invention will be described with reference to
The ultrasonic endoscope apparatus 10 is used for observing the state of an observation target site in the body of a patient who is a subject (hereinafter, also referred to as an ultrasound diagnosis) using ultrasound waves. Here, the observation target site is a site that is difficult to test from the body surface side (outside) of the patient, such as the gall bladder or the pancreas. It is possible to perform the ultrasound diagnosis for the state of the observation target site and the presence or absence of abnormality via digestive tracts such as the esophagus, stomach, duodenum, small intestine, and large intestine, which are a body cavity of the patient, by using the ultrasonic endoscope apparatus 10.
As illustrated in
As illustrated in
The operator can acquire an endoscopic image of an inner wall of the body cavity of the patient and an ultrasound image of an observation target site by the function of the ultrasonic endoscope 12. The endoscopic image is an image obtained by imaging the inner wall of the body cavity of the patient by an optical method. The ultrasound image is an image obtained by receiving reflected waves (echo) of ultrasound waves transmitted from the body cavity of the patient toward an observation target site and imaging the received signal.
The ultrasonic processor apparatus 14 is connected to the ultrasonic endoscope 12 via a universal cord 26 and an ultrasonic connector 32a provided at an end part thereof. The ultrasonic processor apparatus 14 controls the ultrasound transducer unit 46 of the ultrasonic endoscope 12 to cause the ultrasound transducer unit 46 to transmit ultrasound waves. In addition, the ultrasonic processor apparatus 14 generates the ultrasound image by imaging the received signal in a case where the ultrasound transducer unit 46 receives the reflected waves (echo) of the ultrasound waves.
As illustrated in
As illustrated in
In the present embodiment, the ultrasonic processor apparatus 14 and the endoscopic processor apparatus 16 are configured by two apparatus (computers) separately provided. However, the present invention is not limited to this, and both the ultrasonic processor apparatus 14 and the endoscopic processor apparatus 16 may be configured by one apparatus.
The monitor 20 is connected to the ultrasonic processor apparatus 14 and the endoscopic processor apparatus 16, and displays an ultrasound image generated by the ultrasonic processor apparatus 14, an endoscopic image generated by the endoscopic processor apparatus 16, and the like. Regarding the display of the ultrasound image and the endoscopic image, either one of the images may be switched and displayed on the monitor 20, or both images may be displayed simultaneously. In addition, a configuration in which the display methods can be randomly selected and changed may be employed.
In the present embodiment, the ultrasound image and the endoscopic image are displayed on one monitor 20, but a monitor for displaying an ultrasound image and a monitor for displaying an endoscopic image may be separately provided. In addition, a display method other than the monitor 20, for example, a method in which an ultrasound image and an endoscopic image are displayed on a display of a personal terminal carried by an operator may be used.
The console 100 is an input apparatus provided for the operator to input necessary information for the ultrasound diagnosis or to instruct the ultrasonic processor apparatus 14 to start the ultrasound diagnosis, or the like. The console 100 is configured by, for example, a keyboard, a mouse, a trackball, a touch pad, a touch panel, or the like, or a combination thereof, and is connected to a system controller 152 of the ultrasonic processor apparatus 14 as illustrated in
Further, the operator can set various control parameters on the console 100 in a case of performing the ultrasound diagnosis. The control parameters include, for example, a selection result of a live mode and a freeze mode, a set value of a display depth (depth), and a selection result of an ultrasound image generation mode.
Here, the “live mode” is a mode in which ultrasound images (motion pictures) obtained at a predetermined frame rate are sequentially displayed (real-time display). The “freeze mode” is a mode in which an ultrasound image (still pictures) for one frame acquired in the past is read out from a cine memory (not illustrated) and displayed.
There is a plurality of ultrasound image generation modes that can be selected in the present embodiment, and specifically, a B (brightness) mode, a CF (color flow) mode, and a PW (pulse wave) mode. The B mode is a mode in which an amplitude of an ultrasound echo is converted into brightness and a tomographic image is displayed. The CF mode is a mode in which an average blood flow velocity, a flow fluctuation, a flow signal intensity, a flow power, or the like are mapped to various colors and displayed in the B mode image in an overlapping manner. The PW mode is a mode in which speed (for example, blood flow velocity) of an ultrasound echo source detected on the basis of transmission and reception of a pulse wave is displayed. The above-described ultrasound image generation mode is merely an example, and modes other than the three types of modes described above, for example, an A (Amplitude) mode, an M (Motion) mode, and the like may be further included.
Configuration of Ultrasonic Endoscope
The ultrasonic endoscope 12 has an insertion part 22 and an operation unit 24. The insertion part 22 comprises a distal end part 40, a bending part 42, and a flexible part 43 in order from the distal end side (free end side). An ultrasonic observation part 36 and an endoscopic observation part 38 are provided at the distal end part 40.
A balloon 37 that is expandable and contractible is attached to the distal end part 40 at a position covering the ultrasound transducer unit 46.
The bending part 42 is a part provided closer to the base end side (the side opposite to the side where the ultrasound transducer unit 46 is provided) than the distal end part 40 of the insertion part 22, and is freely bendable. The flexible part 43 is a part that connects the bending part 42 and the operation unit 24, has flexibility, and is provided in an elongated state.
As illustrated in
The operation unit 24 is provided with an air and water supply button 28a for opening or closing an air and water supply pipe line (not illustrated) extending from the water supply tank 21a, and a suction button 28b for opening or closing a suction pipe line (not illustrated) extending from the suction pump 21b.
The other end part of the universal cord 26 is provided with the ultrasonic connector 32a connected to the ultrasonic processor apparatus 14, the endoscopic connector 32b connected to the endoscopic processor apparatus 16, and the light source connector 32c connected to the light source apparatus 18. The ultrasonic endoscope 12 is attachably and detachably connected to the ultrasonic processor apparatus 14, the endoscopic processor apparatus 16, and the light source apparatus 18 via connectors 32a, 32b, and 32c, respectively.
Next, the ultrasonic observation part 36 among components of the ultrasonic endoscope 12 will be described.
Ultrasonic Observation Part
The ultrasonic observation part 36 is a part provided for acquiring an ultrasound image, and is disposed on the distal end side of the distal end part 40 of the insertion part 22. The ultrasonic observation part 36 comprises the ultrasound transducer unit 46 illustrated in
Each ultrasound transducer of the ultrasonic observation part 36 is supplied with a pulsed driving voltage from the ultrasonic processor apparatus 14 as an input signal. In a case where the driving voltage is applied to an electrode of the ultrasound transducer, a piezoelectric element expands and contracts, and the ultrasound transducer is driven (vibrated). As a result, pulsed ultrasound waves are output from the ultrasound transducer. In addition, in a case where reflected waves (echo) of the ultrasound waves or the like are received, each ultrasound transducer vibrates (drives) accordingly, and the piezoelectric element of each ultrasound transducer generates an electric signal. The electric signal is output from each ultrasound transducer toward the ultrasonic processor apparatus 14 as a received signal.
The ultrasound transducer unit 46 of the present embodiment has a convex type as described above. That is, in the present embodiment, the ultrasound waves are scanned in a scanning range along a curved surface, for example, in a range of about several tens mm from the center of curvature of the curved surface by sequentially driving the N ultrasound transducers included in the ultrasound transducer unit 46 by an electronic switch such as a multiplexer 140 described later.
Configuration of Ultrasonic Processor Apparatus
As illustrated in
The receiving circuit 142 and the transmitting circuit 144 are electrically connected to each ultrasound transducer of the ultrasonic endoscope 12 via the multiplexer 140. The multiplexer 140 selects one or more from N ultrasound transducers (N is a natural number of 2 or more) and opens the channel.
The transmitting circuit 144 is a circuit that supplies a driving voltage for transmitting ultrasound waves to the ultrasound transducer selected by the multiplexer 140 in order to transmit the ultrasound waves from the ultrasound transducer unit 46.
The receiving circuit 142 is a circuit that receives an electric signal output from the ultrasound transducer received the ultrasound waves (echo), that is, a received signal. In addition, the receiving circuit 142 amplifies the received signal received from the ultrasound transducer according to a control signal sent from the system controller 152, and delivers the amplified signal to the A/D converter 146. The A/D converter 146 is connected to the receiving circuit 142, converts the received signal received from the receiving circuit 142 from an analog signal to a digital signal, and outputs the converted digital signal to the image processing unit 148.
The image processing unit 148 generates an ultrasound image on the basis of the digital received signal output from the A/D converter 146. The ultrasound image generated by the image processing unit 148 is stored in the cine memory 156. In a case where an operation of reading out an ultrasound image is performed by the console 100, the image processing unit 148 reads out the ultrasound image specified from the cine memory 156 and transfers the image to a DSC 154.
The DSC 154 converts (raster-converts) a signal of the ultrasound image (including the image read out from the cine memory 156) generated by the image processing unit 148 into an image signal according to a normal television signal scanning method, performs various necessary image processing such as gradation processing on the image signal, and outputs the image signal to the monitor 20.
The system controller 152 controls each unit of the ultrasonic processor apparatus 14, and is connected to the receiving circuit 142, the transmitting circuit 144, the A/D converter 146, the image processing unit 148, and the measurement controller 158, to control the apparatus. The system controller 152 is connected to the console 100, and controls each unit of the ultrasonic processor apparatus 14 according to test information and control parameters input at the console 100 in a case where the subject is tested. Thereby, an ultrasound image according to the ultrasound image generation mode specified by the operator is acquired.
The measurement controller 158 measures the size (length, area, or the like) of a measurement range specified via the console 100 in the ultrasound image displayed on the monitor 20, and displays a measurement result on the monitor 20. At the time of specifying the measurement range, the measurement controller 158 also performs control to support this. The measurement controller 158 constitutes a measurement apparatus.
Each of the image processing unit 148, the system controller 152, and the measurement controller 158 includes various processors that execute programs to perform processing, a random access memory (RAM), and a read only memory (ROM).
The various processors in the embodiment of the present invention include a central processing unit (CPU) which is a general-purpose processor that executes programs to perform various processing, a programmable logic device (PLD) which is a processor whose a circuit configuration can be changed after manufacturing such as a field programmable gate array (FPGA), or a dedicated electric circuit which is a processor having a circuit configuration specifically designed to execute specific processing such as an application specific integrated circuit (ASIC). More specifically, the structures of the various processors are electric circuits in which circuit elements such as semiconductor elements are combined.
The system controller 152 may be configured with one of various processors, or configured with a combination of two or more processors of the same type or different types (for example, a combination of a plurality of FPGAs or a combination of a CPU and an FPGA).
The correction support information generation unit 158A generates a first brightness profile on a first straight line passing through a first measurement point and a second measurement point specified via the console 100 with respect to the ultrasound image displayed on the monitor 20 in the distance measurement mode, and generates first correction support information for supporting correction of a position of at least one of the first measurement point or the second measurement point on the first straight line, on the basis of the first brightness profile.
The correction support information generation unit 158A generates second correction support information in addition to the first correction support information in the area measurement mode. Specifically, the correction support information generation unit 158A generates a second brightness profile on a second straight line passing through a third measurement point and a fourth measurement point specified via the console 100 with respect to the ultrasound image displayed on the monitor 20 and orthogonal to the first straight line, and generates the above-described second correction support information for supporting correction of a position of at least one of the third measurement point or the fourth measurement point on the second straight line, on the basis of the second brightness profile.
The measurement unit 158B causes the monitor 20 to display the first correction support information generated by the correction support information generation unit 158A in the distance measurement mode. In this state, the measurement unit 158B measures a distance between two points (specifically, any one of the first measurement point or a first corrected measurement point corrected from the first measurement point based on the first correction support information displayed on the monitor 20 and any one of the second measurement point or a second corrected measurement point corrected from the second measurement point based on the first correction support information displayed on the monitor 20) determined via the console 100 on the ultrasound image displayed on the monitor 20, and displays the measurement result on the monitor 20.
The measurement unit 158B causes the monitor 20 to display the first correction support information and the second correction support information generated by the correction support information generation unit 158A in the area measurement mode. In this state, the measurement unit 158B measures the area of the elliptical range determined on the basis of the four points (specifically, any one of the first measurement point or a first corrected measurement point corrected from the first measurement point based on the first correction support information displayed on the monitor 20, any one of the second measurement point or a second corrected measurement point corrected from the second measurement point based on the first correction support information displayed on the monitor 20, any one of the third measurement point or a third corrected measurement point corrected from the third measurement point based on the second correction support information displayed on the monitor 20, and any one of the fourth measurement point or a fourth corrected measurement point corrected from the fourth measurement point based on the second correction support information displayed on the monitor 20) determined via the console 100 on the ultrasound image displayed on the monitor 20, and displays the measurement result on the monitor 20.
The measurement controller 158 operates in the distance measurement mode in a case where the measure button 103 illustrated in
Operation in Distance Measurement Mode
In a case where the operator operates the console 100 and gives an instruction to display an ultrasound image acquired in the B mode stored in the cine memory 156, the DSC 154 causes the monitor 20 to display the ultrasound image. In addition, the measurement controller 158 acquires the ultrasound image displayed on the monitor 20 by the DSC 154. Then, the measurement unit 158B displays a pointer P for specifying a measurement point at a random position on the ultrasound image being displayed on the monitor 20. The position of the pointer P displayed on the monitor 20 is changed by operating the touch pad 102. In a case where the set button 104 is pressed while the pointer P is at the random position, the measurement unit 158B receives an instruction to specify the position as a measurement point, causes the pointer P to be fixedly displayed on the position, and stores position information (coordinates) of the pointer P. Specifying the measurement point described here may be performed using an input apparatus other than the console 100. As such an input apparatus, for example, the operation unit 24 provided in the ultrasonic endoscope 12, a foot switch operated by a foot, an apparatus for inputting information by a line of sight, or an apparatus capable of inputting information by voice can be used.
As illustrated in
Operation for Generating Correction Support Information
In a case where two measurement points are specified as illustrated in
Next, the correction support information generation unit 158A performs smoothing to reduce noise of the analysis image. It is desirable that the correction support information generation unit 158A performs smoothing on the analysis image in a direction perpendicular to the first straight line L1. The correction support information generation unit 158A may perform smoothing using a two-dimensional filter (such as a bilateral filter) for storing image edges or another method. After smoothing, the correction support information generation unit 158A generates a brightness profile (first brightness profile) on the first straight line L1 in the analysis image.
The correction support information generation unit 158A detects a point (a first measurement candidate point Ax) on the first straight line L1 that is a correction candidate of the first measurement point A from a first range A1 on the basis of brightness change amount in the first range A1 including the first measurement point A in the first brightness profile illustrated in
The first range A1 is a range over the first measurement point A, and a center position of the range coincides with the position of the first measurement point A. The center position of the first range A1 does not need to coincide with the position of the first measurement point A.
The second range B1 is a range over the second measurement point B, and a center position of the range coincides with the position of the second measurement point B. The center position of the second range B1 does not need to coincide with the position of the second measurement point B.
Specific Example of Method for Detecting First Measurement Candidate Point Ax
The correction support information generation unit 158A calculates a brightness difference ΔY1 between each position of the first range A1 in the first brightness profile and an adjacent position in the direction from the first measurement point A toward the second measurement point B at each position, and in a case where there is a position where the brightness difference ΔY1 is equal to or more than a threshold value TH, determines the position as the first measurement candidate point Ax. In a case where there is a plurality of positions where the brightness difference ΔY1 is equal to or more than the threshold value TH, the correction support information generation unit 158A may determine a position at which the distance from the first measurement point A is minimum as the first measurement candidate point Ax.
In addition, in the case where there is the position where the brightness difference ΔY1 is equal to or more than the threshold value TH, the correction support information generation unit 158A calculates the reliability of the position on the basis of the distance from the first measurement point A of the position and the brightness difference ΔY1 between the position and the adjacent position. The reliability is determined to be higher as the brightness difference ΔY1 is larger and the distance from the first measurement point A is smaller. In the case where there are the plurality of positions where the brightness difference ΔY1 is equal to or more than the threshold value TH, the correction support information generation unit 158A may determine a position where the reliability is maximum, as the first measurement candidate point Ax, instead of the distance from the first measurement point A.
The correction support information generation unit 158A calculates an average brightness between the first measurement point A and the second measurement point B in the first brightness profile, or an average brightness near an intermediate position between the first measurement point A and the second measurement point B. Then, in the case where there is the position where the brightness difference ΔY1 is equal to or more than the threshold value TH, it is preferable that the correction support information generation unit 158A does not determine the brightness value of the adjacent position on the side opposite (left side in the example of
The correction support information generation unit 158A detects the first measurement candidate point Ax for the first range A1 as described above. In the case where the first measurement candidate point Ax is detected, the correction support information generation unit 158A stores position information (coordinates) of the first measurement candidate point Ax and the reliability calculated for the first measurement candidate point Ax.
Specific Example of Method for Detecting Second Measurement Candidate Point Bx
The correction support information generation unit 158A calculates a brightness difference ΔY2 between each position of the second range B1 in the first brightness profile and an adjacent position in the direction from the first measurement point A toward the second measurement point B at each position, and in a case where there is a position where the brightness difference ΔY2 is equal to or more than a threshold value TH, determines the position as the second measurement candidate point Bx. In a case where there is a plurality of positions where the brightness difference ΔY2 is equal to or more than the threshold value TH, the correction support information generation unit 158A may determine a position at which the distance from the second measurement point B is minimum as the second measurement candidate point Bx.
In addition, in the case where there is the position where the brightness difference ΔY2 is equal to or more than the threshold value TH, the correction support information generation unit 158A calculates the reliability of the position on the basis of the distance from the second measurement point B of the position and the brightness difference ΔY2 between the position and the adjacent position. The reliability is determined to be higher as the brightness difference ΔY2 is larger and the distance from the second measurement point B is smaller. In the case where there are the plurality of positions where the brightness difference ΔY2 is equal to or more than the threshold value TH, the correction support information generation unit 158A may determine a position where the reliability is maximum, as the second measurement candidate point Bx, instead of the distance from the second measurement point B.
The correction support information generation unit 158A calculates the above-described average brightness. Then, in the case where there is the position where the brightness difference ΔY2 is equal to or more than the threshold value TH, it is preferable that the correction support information generation unit 158A does not determine the brightness value of the adjacent position on the side opposite (right side in the example of
The correction support information generation unit 158A detects the second measurement candidate point Bx for the second range B1 as described above. In the case where the second measurement candidate point Bx is detected, the correction support information generation unit 158A stores position information (coordinates) of the second measurement candidate point Bx and the reliability calculated for the second measurement candidate point Bx.
In the example of
In a case where at least one of the first measurement candidate point Ax or the second measurement candidate point Bx is detected by the correction support information generation unit 158A, the measurement unit 158B displays the measurement candidate point on the monitor 20 on the basis of position information of the detected measurement candidate point. In addition, the measurement unit 158B measures a distance between one of the first measurement point A or the first measurement candidate point Ax and one of the second measurement point B or the second measurement candidate point Bx, and superimposes and displays the measurement result and the reliability of the first measurement candidate point Ax or the second measurement candidate point Bx on the ultrasound image G of the monitor 20 in an overlapping manner.
In the example of
In a case where both the first measurement candidate point Ax and the second measurement candidate point Bx is detected by the correction support information generation unit 158A, the measurement unit 158B displays the measurement candidate point on the monitor 20 on the basis of position information of the detected measurement candidate point. In addition, the measurement unit 158B measures the distance between the second measurement candidate point Bx and the first measurement candidate point Ax, and displays the measurement result, the reliability of the second measurement candidate point Bx, and the reliability of the first measurement candidate point Ax on the ultrasound image G of the monitor 20 in an overlapping manner.
On the screen illustrated in
In a case where the reliability of the first measurement candidate point Ax and the second measurement candidate point Bx is displayed as illustrated in
In a case where the screen as illustrated in
In addition, in a case where the set button 104 is pressed by the operator while the pointer P (A), the pointer P (B), the pointer P (Ax), and the pointer P (Bx) are displayed as illustrated in
In the state where the pointers P (A), P (B), P (Ax), and P (Bx) are displayed as illustrated in
In the case of setting the first final measurement point and the second final measurement point, the measurement unit 158B displays the pointer P indicating these and the straight line L1a connecting them on the ultrasound image G in an overlapping manner, and further displays a measurement result of a distance between them on the ultrasound image G in an overlapping manner.
Effect of Distance Measurement Mode of Ultrasonic Endoscope Apparatus 10
According to the ultrasonic endoscope apparatus 10, information indicating at least one position of a first measurement candidate point that is a correction candidate for a first measurement point or a second measurement candidate point that is a correction candidate for a second measurement point is generated and displayed on the monitor 20 as the first correction support information for supporting correction of the position of at least one of the first measurement point or the second measurement point on the ultrasound image specified by the operator. For example, even in a case where the operator specifies the first measurement point and the second measurement point with a margin outside a range suspected of a lesion site, a measurement candidate point is displayed near an edge position in the range. For this reason, even in a case of using an interface such as the touch pad 102 that requires time for detailed position specification, it is possible to accurately specify the desired range and measure the size of the range without spending time. Accordingly, the measurement range can be accurately specified within a limited time during the test, and the test efficiency and the reliability of the measurement result can be improved.
Further, according to the ultrasonic endoscope apparatus 10, the reliability of the measurement candidate point is displayed on the monitor 20 together with the position of the measurement candidate point. It is possible to assist in determining whether or not to determine the measurement candidate point as the final measurement point, and to prevent a range largely deviating from the operator's intention from being determined as the measurement range by displaying the reliability.
In addition, according to the ultrasonic endoscope apparatus 10, as illustrated in
Further, according to the ultrasonic endoscope apparatus 10, the first range A1 is a range over the first measurement point A, and is preferably a bilaterally symmetrical range. In addition, the second range B1 is a range over the second measurement point B, and is preferably a bilaterally symmetrical range. Therefore, for example, compared to a case where the first range A1 is inside the first measurement point A and the second range B1 is inside the second measurement point B, the possibility that the measurement candidate point is detected can be increased, and the correction of the measurement point can be more strongly supported.
The size of each of the first range A1 and the second range B1 illustrated in
In addition, the size of each of the first range A1 and the second range B1 may be automatically changed according to an operating condition of the ultrasonic endoscope apparatus 10 (setting state of the ultrasound image generation mode), an observation target site (pancreas, gall bladder, or the like) by the ultrasonic endoscope apparatus 10, an attribute (medical history, age, and the like) of an observation target person by the ultrasonic endoscope apparatus 10, or a combination thereof. As described above, it is possible to detect an optimum measurement candidate point according to the situation, and to improve the reliability of the measurement result by making the size of each of the first range A1 and the second range B1 variable.
In the above description, the correction support information generation unit 158A detects the measurement candidate point by analyzing the first brightness profile. As a modification example, a learned model which sets at least the first measurement point, the second measurement point, and the first brightness profile as an input and outputs at least one of the first measurement candidate point or the second measurement candidate point may be prepared, and the measurement candidate point may be detected using the learned model.
For example, the learned model is added to the inside of the ultrasonic processor apparatus 14, and the correction support information generation unit 158A inputs the first measurement point, the second measurement point, and the first brightness profile to the learned model. In addition, in a case where one or both of the first measurement candidate point Ax and the second measurement candidate point Bx are output from the learned model, the correction support information generation unit 158A may acquire information on them and use the information on them as first correction support information.
The learned model described above may further learn not only the first measurement point, the second measurement point, and the first brightness profile but also an operating condition, an observation target site, and an attribute of an observation target person of the ultrasonic endoscope apparatus 10 at the time of acquiring the ultrasound image G in which the first measurement point and the second measurement point are specified. In addition, the learned model may be provided in the ultrasonic endoscope apparatus 10 and an external apparatus connected via a network.
First Modification Example of Operation in Distance Measurement Mode
In the above description, the correction support information generation unit 158A generates the position information of the first measurement candidate point Ax and the position information of the second measurement candidate point Bx as the first correction support information, and outputs them to the measurement unit 158B. The measurement unit 158B displays the position of the first measurement candidate point Ax and the position of the second measurement candidate point Bx on the ultrasound image G in an overlapping manner.
In the first modification example, the correction support information generation unit 158A generates, as first correction support information, a first brightness profile and information indicating a position of each of the first measurement point A, the second measurement point B, the first measurement candidate point Ax, and the second measurement candidate point Bx in the first brightness profile, and outputs them to the measurement unit 158B. Then, with the first brightness profile, the measurement unit 158B displays the position of the first measurement point A, the second measurement point B, the first measurement candidate point Ax, and the second measurement candidate point Bx on the first brightness profile on the ultrasound image G in an overlapping manner.
As illustrated in
In a case where two measurement points are specified as illustrated in
Then, by the same method as described above, the correction support information generation unit 158A generates the first brightness profile of the first straight line L1 using the analysis image, and detects the first measurement candidate point Ax and the second measurement candidate point Bx on the basis of the first brightness profile, the first measurement point A, and the second measurement point B. In addition, the correction support information generation unit 158A outputs information of the first brightness profile and information indicating the position of each of the first measurement point A, the second measurement point B, the first measurement candidate point Ax, and the second measurement candidate point Bx in the first brightness profile to the measurement unit 158B as the first correction support information.
In
In a case of receiving the first correction support information from the correction support information generation unit 158A, the measurement unit 158B displays the first correction support information on the ultrasound image G of the monitor 20 in an overlapping manner.
In a case where the position information of the first measurement candidate point Ax is not included in the first correction support information, the information of the position of the first measurement candidate point Ax is not displayed on the subsidiary screen G1 in
In a case where the screen as illustrated in
In a case where the set button 104 is pressed by the operator while the position information of the second measurement candidate point Bx is not included in the subsidiary screen G1 illustrated in
In addition, in a case where the set button 104 is pressed by the operator while the position information of the first measurement candidate point Ax is not included in the subsidiary screen G1 illustrated in
In addition, in a case where the set button 104 is pressed by the operator while the position information of the first measurement candidate point Ax and the second measurement candidate point Bx is not included in the subsidiary screen G1 illustrated in
In this way, in the case of setting the first final measurement point and the second final measurement point, the measurement unit 158B displays the pointer P indicating the position of them and the straight line L1a connecting them on the ultrasound image G in an overlapping manner, and further displays the measurement result of the distance between them on the ultrasound image G in an overlapping manner.
According to the operation of the above first modification example, it is possible to intuitively grasp where two measurement points specified by the operator and the measurement candidate point detected by apparatus are located on the first brightness profile by the subsidiary screen G1 illustrated in
Second Modification Example of Operation in Distance Measurement Mode
In the second modification example, the correction support information generation unit 158A generates, as first correction support information, a first brightness profile and information indicating a position of each of the first measurement point A and the second measurement point B in the first brightness profile, and outputs them to the measurement unit 158B. Then, with the first brightness profile, the measurement unit 158B displays the position of the first measurement point A and the second measurement point B on the first brightness profile on the ultrasound image G in an overlapping manner on the basis of the first correction support information. Further, in a case where a position other than the first measurement point A and the second measurement point B on the first brightness profile displayed on the monitor 20 is specified by operating the console 100, the position is set as a first correction candidate point Axx of the first measurement point A or a second correction candidate point Bxx of the second measurement point B.
As illustrated in
The correction support information generation unit 158A sets the first straight line L1 (a straight line consisting of the straight line L1a, the straight line L1b, and the straight line L1c) in the ultrasound image G, and extracts a predetermined range including the first straight line L1 as an analysis image. Then, the correction support information generation unit 158A generates the first brightness profile of the first straight line L1 using the analysis image in the same method as described above.
The correction support information generation unit 158A outputs information of the first brightness profile and information indicating the position of each of the first measurement point A and the second measurement point B in the first brightness profile to the measurement unit 158B as the first correction support information. The first brightness profile generated here is the same as that illustrated in
In a case of receiving the first correction support information from the correction support information generation unit 158A, the measurement unit 158B displays the first correction support information on the ultrasound image G of the monitor 20 in an overlapping manner.
In a case where the screen illustrated in
In a case where the set button 104 is pressed by the operator in the state illustrated in
In a case where the first final measurement point and the second final measurement point are set in this way, the measurement unit 158B deletes the subsidiary screen G2 from the ultrasound image G of the monitor 20, and further displays a pointer P (Ax) indicating the first final measurement point, a pointer P (Bx) indicating the second final measurement point, a straight line L1a connecting the first final measurement point and the second final measurement point, and a measurement result of the distance between the first and second final measurement points on the ultrasound image G in an overlapping manner, and switches the screen of the monitor 20 to, for example, the screen illustrated in
In a case where the delete button 105 is pressed by the operator in the state illustrated in
In addition, in a case where the state shifts from the state illustrated in
In addition, in a case where the state shifts from the state illustrated in
According to the operation of the above second modification example, it is possible to grasp a relationship between two measurement points specified by the operator and the first brightness profile by the subsidiary screen G2 illustrated in
Operation in Area Measurement Mode
In the area measurement mode, the console 100 can be operated on the ultrasound image G displayed on the monitor 20 to specify an elliptical range. Specifically, first, an operator operates the touch pad 102 as described above to specify the first measurement point A and the second measurement point B.
In a case of being specified, as illustrated in
In the state illustrated in
In the state where the four points are specified as illustrated in
In addition, the correction support information generation unit 158A generates second correction support information for supporting a correction of a position of at least one of the third measurement point C or the fourth measurement point D on a second straight line extending both ends of the straight line L2a outward by a predetermined amount. The content of the second correction support information and the method of generating the same are the same as those of the first correction support information, and thus description thereof will be omitted. A brightness profile of the second straight line constitutes a second brightness profile.
The measurement unit 158B displays the first correction support information and the second correction support information on the ultrasound image G of the monitor 20 in an overlapping manner. In
The measurement unit 158B further causes the screen illustrated in
In addition, in a case where the set button 104 is pressed by the operator while the pointer P (A), the pointer P (Bx), the pointer P (C), and the pointer P (Dx) are displayed as illustrated in
In this case, the second measurement candidate point Bx is a second corrected measurement point corrected from the second measurement point B on the basis of the first correction support information. Further, in this case, the fourth measurement candidate point Dx is a fourth corrected measurement point corrected from the fourth measurement point D on the basis of the second correction support information.
On the other hand, in a case where the delete button 105 is pressed by the operator in the state of
In a case where the set button 104 is pressed from the state illustrated in
As described above, according to the ultrasonic endoscope apparatus 10, in the area measurement mode, similarly to the distance measurement mode, correction support information for correcting the measurement point specified by the operator is generated and displayed on the monitor 20. Therefore, specifying the elliptical range can be performed quickly and accurately. Therefore, it is possible to improve the test efficiency and the reliability of the measurement result.
Modification Example of Operation in Area Measurement Mode
In the modification example, after four measurement points are specified in the ultrasound image G, first, the first correction support information is generated and displayed, and then, the first final measurement point and the second final measurement point are set according to the operation of the operator. Thereafter, the second correction support information is generated and displayed, and then, the third final measurement point and the fourth final measurement point are set according to the operation of the operator.
In a case where the set button 104 is pressed in the state illustrated in
In this state, the correction support information generation unit 158A sets the above-described second straight line L2 passing through the third measurement point C and the fourth measurement point D. In a state (a state in
Then, the correction support information generation unit 158A detects a third measurement candidate point Cx and a fourth measurement candidate point Dx at equal distances from the midpoint O on the second straight line L2b by the above-described method. For example, the correction support information generation unit 158A calculates a brightness difference ΔYc between each position and an adjacent position in a range AR2 including the third measurement point Ca (see
In a case where the third measurement candidate point Cx and the fourth measurement candidate point Dx at equal distances cannot be detected from the midpoint O on the second straight line L2b, the correction support information generation unit 158A does not cause the monitor 20 to display the third measurement candidate point Cx and the fourth measurement candidate point Dx.
In a case where the third measurement candidate point Cx and the fourth measurement candidate point Dx at equal distances can be detected from the midpoint O on the second straight line L2b, the correction support information generation unit 158A causes the monitor 20 to display pointers indicating the third measurement candidate point Cx and the fourth measurement candidate point Dx, as illustrated in
In a case where the set button 104 is pressed in the state illustrated in
According to the operation of the modification example of the area measurement mode, an elliptical range having the straight line connecting the two measurement points specified by the operator as the short axis or the long axis can be presented to the operator as a candidate of a measurement target range. For this reason, the ellipse CR2 that is the candidate of the measurement target range as illustrated in
Each functional block of the measurement controller 158 in the above embodiment and the modification example may be configured to be provided in a processor included in the endoscopic processor apparatus 16, and may be configured to be provided in a processor included in an external apparatus such as an external server that can be connected to the ultrasonic endoscope apparatus 10.
As described above, the following items are disclosed in the embodiment of the present invention.
(1) A measurement apparatus comprising a correction support information generation unit that generates a first brightness profile on a first straight line passing through a first measurement point and a second measurement point specified for an ultrasound image generated by an ultrasound diagnostic apparatus and displayed on a display unit, and generates first correction support information for supporting correction of at least one position of the first measurement point or the second measurement point on the first straight line on the basis of the first brightness profile, and a measurement unit that displays the first correction support information on the display unit, and on the basis of instructions input in a state where the first correction support information is displayed on the display unit, determines one of the first measurement point or a first corrected measurement point corrected from the first measurement point based on the first correction support information as a first final measurement point, determines one of the second measurement point or a second corrected measurement point corrected from the second measurement point based on the first correction support information as a second final measurement point, and measures a size of a measurement range on the ultrasound image based on the first final measurement point and the second final measurement point.
(2) The measurement apparatus described in (1), in which the correction support information generation unit generates the first correction support information on the basis of the first measurement point, the second measurement point, and the first brightness profile.
(3) The measurement apparatus described in (2), in which the correction support information generation unit detects a first measurement candidate point that is a correction candidate of the first measurement point from a first range including the first measurement point in the first brightness profile on the basis of a brightness change amount of the first range, detects a second measurement candidate point that is a correction candidate of the second measurement point from a second range including the second measurement point in the first brightness profile on the basis of a brightness change amount of the second range, and outputs information indicating a position of one or both of the first measurement candidate point and the second measurement candidate point as the first correction support information.
(4) The measurement apparatus described in (3), in which the correction support information generation unit determines first reliability of the first measurement candidate point on the basis of a difference between a brightness value at a position of the first measurement candidate point and a brightness value at a position adjacent to the position of the first measurement candidate point and a distance between the first measurement candidate point and the first measurement point, determines second reliability of the second measurement candidate point on the basis of a difference between a brightness value at a position of the second measurement candidate point and a brightness value at a position adjacent to the position of the second measurement candidate point and a distance between the second measurement candidate point and the second measurement point, and outputs information indicating the first reliability and the second reliability as the first correction support information.
(5) The measurement apparatus described in (3) or (4), in which the first range is a range over the first measurement point, and the second range is a range over the second measurement point.
(6) The measurement apparatus described in any one of (3) to (5), in which a size of each of the first range and the second range is changeable.
(7) The measurement apparatus described in (6), in which the size of each of the first range and the second range is changed according to an operating condition of the ultrasound diagnostic apparatus, an observation target site by the ultrasound diagnostic apparatus, an attribute of an observation target person by the ultrasound diagnostic apparatus, or a combination thereof.
(8) The measurement apparatus described in (2), in which the correction support information generation unit detects a first measurement candidate point that is a correction candidate of the first measurement point from a first range including the first measurement point in the first brightness profile on the basis of a brightness change amount of the first range, detects a second measurement candidate point that is a correction candidate of the second measurement point from a second range including the second measurement point in the first brightness profile on the basis of a brightness change amount of the second range, and outputs the first brightness profile and information indicating positions of the first measurement candidate point, the second measurement candidate point, the first measurement point, and the second measurement point in the first brightness profile, as the first correction support information.
(9) The measurement apparatus described in (2), in which the correction support information generation unit acquires a first measurement candidate point that is a correction candidate of the first measurement point and a second measurement candidate point that is a correction candidate of the second measurement point from a learned model by inputting at least the first measurement point, the second measurement point, or the first brightness profile to a learned model, and outputs information including one or both positions of the first measurement candidate point and the second measurement candidate point as the first correction support information, the learned model outputs the first measurement candidate point and the second measurement candidate point by inputting at least the first measurement point, the second measurement point, or the first brightness profile.
(10) The measurement apparatus described in (2), in which the correction support information generation unit outputs the first brightness profile and information indicating positions of the first measurement point and the second measurement point in the first brightness profile as the first correction support information, and in which in a case where the point that is different from the first measurement point and the second measurement point and closer to the first measurement point than the second measurement point is specified for the first brightness profile displayed on the display unit, the measurement unit sets the point as the first corrected measurement point and in a case where a point that is different from the first measurement point and the second measurement point and closer to the second measurement point than the first measurement point is specified, sets the point as the second corrected measurement point.
(11) The measurement apparatus described in any one of (1) to (10), in which the correction support information generation unit generates a second brightness profile on a second straight line passing through a third measurement point and a fourth measurement point specified for the ultrasound image and is orthogonal to the first straight line, and generates second correction support information for supporting correction of at least one position of the third measurement point or the fourth measurement point on the second straight line on the basis of the second brightness profile, and in which the measurement unit displays the second correction support information on the display unit, and on the basis of instructions input in a state where the second correction support information is displayed on the display unit, determines one of the third measurement point or a third corrected measurement point corrected from the third measurement point based on the second correction support information as a third final measurement point, determines one of the fourth measurement point or a fourth corrected measurement point corrected from the fourth measurement point based on the second correction support information as a fourth final measurement point, and measures an area of an elliptical measurement range passing through the first final measurement point, the second final measurement point, the third final measurement point, and the fourth final measurement point in the ultrasound image.
(12) The measurement apparatus described in (11), in which the correction support information generation unit detects a third measurement candidate point that is a correction candidate of the third measurement point from a third range including the third measurement point in the second brightness profile on the basis of a brightness change amount of the third range, detects a fourth measurement candidate point that is a correction candidate of the fourth measurement point from a fourth range including the fourth measurement point in the second brightness profile on the basis of a brightness change amount of the fourth range, and generates information including one or both positions of the third measurement candidate point and the fourth measurement candidate point as the second correction support information, and further in which, in a state where the second straight line intersects points other than a midpoint of a line segment connecting the first final measurement point and the second final measurement point, the correction support information generation unit detects the third measurement candidate point and the fourth measurement candidate point at equal distances from the midpoint by moving the second straight line, the third measurement point, and the fourth measurement point in parallel along the line segment to have a state where the second straight line intersects the midpoint.
(13) The ultrasound diagnostic apparatus comprising the measurement apparatus described in any one of (1) to (12), and an image processing unit that generates an ultrasound image based on an output signal of an ultrasonic endoscope.
(14) A measurement method comprising a correction support information generation step of generating a first brightness profile on a first straight line passing through a first measurement point and a second measurement point specified for an ultrasound image generated by an ultrasound diagnostic apparatus and displayed on a display unit, and generating first correction support information for supporting correction of at least one position of the first measurement point or the second measurement point on the first straight line on the basis of the first brightness profile, and a measurement step of displaying the first correction support information on the display unit, and on the basis of instructions input in a state where the first correction support information is displayed on the display unit, determining one of the first measurement point or a first corrected measurement point corrected from the first measurement point based on the first correction support information as a first final measurement point, determining one of the second measurement point or a second corrected measurement point corrected from the second measurement point based on the first correction support information as a second final measurement point, and measuring a size of a measurement range on the ultrasound image based on the first final measurement point and the second final measurement point.
(15) A non-transitory computer readable recording medium storing a measurement program that causes a computer to perform a correction support information generation step of generating a first brightness profile on a first straight line passing through a first measurement point and a second measurement point specified for an ultrasound image generated by an ultrasound diagnostic apparatus and displayed on a display unit, and generating first correction support information for supporting correction of at least one position of the first measurement point or the second measurement point on the first straight line on the basis of the first brightness profile, and a measurement step of displaying the first correction support information on the display unit, and on the basis of instructions input in a state where the first correction support information is displayed on the display unit, determining one of the first measurement point or a first corrected measurement point corrected from the first measurement point based on the first correction support information as a first final measurement point, determining one of the second measurement point or a second corrected measurement point corrected from the second measurement point based on the first correction support information as a second final measurement point, and measuring a size of a measurement range on the ultrasound image based on the first final measurement point and the second final measurement point.
Number | Date | Country | Kind |
---|---|---|---|
2019-128479 | Jul 2019 | JP | national |