Patent Grant
11134916
This application is the U.S. National Phase application under 35 U.S.C. § 371 of International Application No. PCT/EP2016/081629 filed on Dec. 19, 2016, which claims the benefit of PCT/CN2015/099880 filed Dec. 30, 2015 and EP Application Serial No. 16159416.3, filed Mar. 9, 2016. These applications are hereby incorporated by reference herein.
The invention relates to the field of ultrasound, in particular to a system and a method for sequentially performing a predetermined procedure for each of at least one region of interest.
Pneumothorax (PTX) is a common problem in various settings, for example, emergency care, respiratory care, interventional radiology, critical care and anaesthesia, etc. PTX represents the second most common injury after rib fracture in the domain of blunt chest trauma. Large PTXs may cause respiratory distress, and tension PTXs may cause cardiorespiratory failure. Rapid detection of PTX is important due to the life-threatening nature of these conditions.
At present, ultrasound is widely used for detection of pneumothorax (PTX). In accordance with a certain sequence defined by the clinical protocol, an ultrasound probe will be sequentially placed at various portions of the chest to detect the presence of PTX at each portion of the chest. Based on the obtained ultrasound data of each portion, the ultrasound system can analyze the ultrasound data to extract features of each portion to rule out or rule in PTX automatically. As shown in
There may be solutions which can partly solve the issue mentioned above. For example, assuming that the PTX determination on each portion will take at most time period T as shown in the upper part of
US2007/0078340 A1 discloses a method and system for providing an operational command signal to a workstation of an imaging system. The workstation is provided imaging data from a positionable transducer. The method and system convert at least one of a predetermined plurality of motion patterns impacted by an operator of the system to the transducer into the operational command signal. However, US2007/0078340 A1 provides solutions to use several motion patterns to discriminate between motion intended to initiate control changes and motion which occurs normally during scanning, and it fails to provide applicable solution to solve the above mentioned issue of PTX determination which involves multiple consecutive determination on human body.
US2014/0128739 A1 discloses an ultrasound imaging system and method includes performing a gesture with a probe and detecting the gesture based on data from a motion sensing system includes at least one sensor selected from the group of an accelerometer, a gyro sensor and a magnetic sensor. However, US2014/0128739 A1 provide a solution to solve the power-consumption issue of ultrasound system and is silent about the above mentioned issue of PTX determination.
Therefore, it would be advantageous to provide an improved ultrasound system and method for sequentially performing automatic detection on different portions of a subject.
According to a first aspect of the present invention, there is proposed an ultrasound system for sequentially performing a predetermined procedure for each of at least one region of interest, comprising:
an ultrasound probe configured to transmit a first ultrasound signal towards a region of interest and receive echo signals from the region of interest;
a motion sensor configured to detect a motion of the ultrasound probe and generate a motion signal for indicating the motion of the ultrasound probe; and
a processor configured to perform a predetermined procedure for a region of interest on the basis of the echo signals received from the region of interest if the motion signal indicates that the ultrasound probe is stationary.
The whole PTX determination process according to the clinical protocol may seem to be very complex due to the multiple determination processes on multiple portions of the chest. However, inventors of the present invention recognized that the operator will operate in a repeated stop-and-go mode (i.e. the operator will move the ultrasound probe to a portion of the subject, stop for a certain period on the portion and then go to the next portion) to transfer among different portions, because there is a predefined order according to the clinical protocol for all the operators to follow. The ultrasound probe will be placed on the subject by the operator without any movement, when the operator believes that the probe is ready for collecting ultrasound data for the ultrasound system to perform a predetermined procedure, such as PTX check. That is to say, the ultrasound probe will be stationary when it has been placed on the region of interest, such as a portion of the chest, by the operator and is ready for obtaining ultrasound data for check.
The motion sensor will monitor the motion of the ultrasound probe and provides motion signal indicating the motion of the probe. When the motion signal indicates that ultrasound probe is stationary, the processor will be triggered to perform a predetermined procedure, such as PTX check, on the region of interest immediately. There will be no extra time delay because the ultrasound system does not require the operator to do any extra operations to control the system to start the predetermined procedure. There is no need to place any extra devices on the region of interest, the whole system is easy to be implemented and cost effective. Furthermore, the accuracy of the solution will be good as long as the operator has been trained to follow the clinical protocol to sequentially perform the predetermined procedure for each of the at least one region of interest.
In an embodiment of the ultrasound system according to the present invention, the ultrasound probe is configured to start transmitting the first ultrasound signal if the motion signal indicates that the ultrasound probe is stationary. With this ultrasound system, the ultrasound probe is activated to start transmitting the first ultrasound signal when the ultrasound probe is detected to be stationary. The ultrasound probe is not activated when the ultrasound probe is detected to be not stationary, which saves energy and reduces ultrasound exposure.
In another embodiment of the ultrasound system according to the present invention, the ultrasound probe is configured to transmit a second ultrasound signal prior to transmitting the first ultrasound signal. This feature enables the ultrasound system to transmit the second ultrasound signal when the ultrasound probe is indicated to be not stationary. This feature allows the user access to ultrasound signals all the time. Consequently, the ultrasound signals are enabled to be visualized by the user all the time.
In an embodiment of the ultrasound system according to the present invention, the processor is further configured to generate an indication indicative of completion of the predetermined procedure. The processor enables to generate the indication timely after the predetermined procedure has been completed. The indicator indicating the condition enables providing information timely to the user. The user may move the ultrasound probe to the next region of interest in response to the indication of the indicator so as to minimize the required time spent at each region of interest.
In an embodiment of the ultrasound system according to the present invention, the ultrasound system further comprises a user interface configured to present the indication. This feature allows presenting the indication to the operator, so that the operator is aware of the completion of the predetermined procedure at the region of interest. For certain applications, the time required for performing the predetermined procedure may vary at different regions of interest. This feature allows presenting the user with timely information about the completion of the predetermined procedure at a region of interest. The user may move the ultrasound probe to the next region of interest in response to the indication so as to minimize the required time spent at each region of interest.
In an embodiment of the ultrasound system according to the present invention, the predetermined procedure for a region of interest comprises a procedure for extracting features of the region of interest from the echo signals received from the region of interest. This feature enables the ultrasound system to extract features of the region of interest automatically.
In an embodiment of the ultrasound system according to the present invention, the predetermined procedure for a region of interest comprises a procedure for detecting the presence of a pneumothorax on the basis of the echo signals received from the region of interest. This feature enables the ultrasound system to detect a pneumothorax in the region of interest automatically.
In an embodiment of the ultrasound system according to the present invention, the ultrasound system further comprises a reporting module, the processor is configured to deliver a result of the predetermined procedure for a region of interest, the reporting module is configured to identify a current region of interest of the at least one region of interest in accordance with a predetermined order of the at least one region of interest and record a result delivered by the processor as a result for the current region of interest, the at least one region of interest comprising a plurality of regions of interest. The feature applies for a plurality of regions of interest. In this way, the result of each region of interest can be recorded in sequence automatically and no extra action by the operator is required. When there are lots of regions to be checked for a certain operation, such as PTX check, the time for recording the check result of each region will be greatly reduced. The whole workflow is simple for the operator to operate, and the check result can be well recorded without any error as long as the operator does the check in the right order according to the clinical protocol.
In an embodiment of the ultrasound system according to the present invention, the ultrasound system further comprises the user interface configured to visualize the results recorded by the reporting module. This feature allows visualizing the results recorded to the user.
In an embodiment of the ultrasound system according to the present invention, the ultrasound system further comprises the user interface for receiving a user input for going back, and a go-back module configured to identify the current region of interest on the basis of the recorded results and the user input. In this way, the operator can control the check process if the operator finds something not good enough or wrong.
In an embodiment of the ultrasound system according to the present invention, the ultrasound system further comprises a position verification module configured to calculate a ratio between the size of the ultrasound acoustic shadow and the total area of a region of interest from the echo signals received from the region of interest and generate a position indicator by comparing the ratio with a predetermined threshold. Optionally, the position indicator provides information on whether the ultrasound probe is placed properly on this region of interest or needs to be placed on another region of interest.
In an embodiment of the ultrasound system according to the present invention, the motion detector is an accelerometer. With the accelerometer as the motion sensor, high accuracy measurements can be obtained.
According to a second aspect of the present invention, an ultrasound method is provided, comprising the steps of:
transmitting a first ultrasound signal towards a region of interest and receiving echo signals from the region of interest;
detecting a motion of an ultrasound probe and generating a motion signal for indicating the motion of the ultrasound probe; and
performing a predetermined procedure for a region of interest on the basis of the received echo signals received from the region of interest if the motion signal indicates that the ultrasound probe is stationary.
In an embodiment of the ultrasound method according to the present invention, the ultrasound method further comprises a step of starting to transmit the first ultrasound signals if the motion signal indicates that the ultrasound probe is stationary.
In an embodiment of the ultrasound system according to the present invention, the ultrasound system further comprises a step of transmitting a second ultrasound signal prior to transmitting the first ultrasound signal.
Detailed explanations and other aspects of the invention will be given below.
Particular aspects of the invention will now be explained with reference to the embodiments described hereinafter and considered in connection with the accompanying drawings, in which identical parts or sub-steps are designated in the same manner:
The present invention will be described with respect to particular embodiments and with reference to the drawings, but the invention is not limited thereto but only by the claims. The drawings described are only schematic and are non-limiting. In the drawings, the size of some of the elements may be exaggerated and not drawn to scale for illustrative purposes.
The ultrasound system 100 comprises an ultrasound probe 101 configured to transmit a first ultrasound signal SG1 towards a region of interest and receive echo signals from the region of interest. The ultrasound system 100 also comprises a motion sensor 102 configured to detect a motion of the ultrasound probe 101 and generate a motion signal MS for indicating the motion of the ultrasound probe 101. The ultrasound system 100 further comprises a processor 103 configured to perform a predetermined procedure for a region of interest on the basis of the echo signals received from the region of interest if the motion signal MS indicates that the ultrasound probe 101 is stationary.
The motion sensor 102 monitors the motion of the ultrasound probe 101 and generates a motion signal MS to indicate the motion of the ultrasound probe 101. For example, accelerometers are known devices to be used as the motion sensor 102. An accelerometer may be placed on the ultrasound probe 101 to measure acceleration data of the ultrasound probe 101. Thus, accurate real-time velocity of the accelerometer can be derived on the basis of the measured data. Hence, the motion status of the ultrasound probe 101 is derived accordingly.
Gyroscopes are also known devices. They are useful for measuring or maintaining orientation, and they may be used together with the accelerometer to determine motion in 6 dimensions. There are other known devices to detect motion, such as barometer, cameras, and GPS sensor, etc. The embodiments of the motion sensor 102 are not limited to those mentioned above.
Whether the ultrasound probe 101 is stationary can be determined in many ways.
In an embodiment, it may be determined that the ultrasound probe 101 is stationary if the ultrasound probe 101's velocity derived by the motion sensor 102 is less than the minimum value which can be measured by the motion sensor 102. The minimum value of the measured data depends on the motion sensor 102's accuracy. For example, a certain type of motion sensor can only measure velocity not less than 0.0005 cm/s.
In another embodiment, there will be a maximum velocity threshold for the ultrasound probe 101 to complete the predetermined procedure, and the maximum velocity threshold may be different for different types of detection. People skilled in ultrasound detection will think that the maximum velocity threshold is small enough for determining whether the ultrasound probe 101 is stationary. It may be determined that the ultrasound probe 101 is stationary if the ultrasound probe 101's velocity derived by the motion sensor 102 is below the maximum velocity threshold. The maximum velocity threshold may be equal or larger than the minimum value which can be measured by the motion sensor 102. For example, the maximum velocity threshold is 0.0009 cm/s when the motion sensor 102 can only measure velocity not less than 0.0005 cm/s.
The motion of the ultrasound probe 101 is monitored by the motion sensor 102. When the motion sensor 102 detects that the motion of the ultrasound probe 101 is stationary as described above, the motion sensor 102 generates a motion signal MS to indicate the stationary state of the ultrasound probe 101. Then, processor 103 starts to perform a predetermined procedure for a region of interest on the basis of the echo signals received from the region of interest immediately in response to the motion signal.
In an embodiment, an accelerometer is used to detect the motion of the ultrasound probe 101, and the motion signal MS is generated as illustrated in
As illustrated in
The first ultrasound signal SG1 and the second ultrasound signal SG2 are synchronized with the motion signal MS by using the same time reference system. The first ultrasound signal SG1 and the second ultrasound signal SG2 may comprise ultrasound data frames generated under many modes, such as B-mode, Doppler mode.
In another embodiment, the processor 103 is further configured to generate an indication IDA indicative of completion of the predetermined procedure.
As illustrated in
As illustrated in
The user interface 107 aims to present an indication IDA to the operator in order to guide the operator for the next step. For example, the operator is guided to move the ultrasound probe 101 to the next region of interest. The indication IDA presented by the user interface 107 may be visible or audible to the operator. One example is a light indicator, which uses different colours of the light to indicate different types of feedback signals. Another example is an icon on a display, which visualizes the statuses to represent different types of feedback signals. An alternative example is a voice reminder, which provides audio instructions to guide the operator based on the different types of feedback signals. The embodiments of the user interface 107 are not limited to the examples mentioned above.
In another embodiment of the system 100, the predetermined procedure for a region of interest comprises a procedure for extracting features of the region of interest from the echo signals received from the region of interest.
In another embodiment of the system 100, the predetermined procedure for a region of interest comprises a procedure for detecting the presence of a pneumothorax on the basis of the echo signals received from the region of interest.
Ultrasound imaging is widely used for pneumothorax (PTX) detection. Four features have been described for PTX detection: lung sliding, B-lines, lung pulse and lung point.
When the presence of none of lung sliding, lung pulse or B-line is detected, the step of detection of the presence of lung point S4 is to be further performed by means of the algorithm, as illustrated in
At different portions of the chest, the time required for PTX detection may be different. A portion of the chest where PTX is detected normally takes up more time than a PTX-free portion of the chest. The decision of ruling out PTX may be made quickly as long as a detection of one of the features is absent, for example, lung sliding, lung-pulse, or B-lines as illustrated in
As illustrated in
The operator sequentially place the ultrasound probe 101 on the plurality of regions of interest and the processor 103 sequentially performs the predetermined procedure for the plurality of regions of interest. The reporting module 103 will identify the current region of interest as the first region of the plurality regions of interest when the ultrasound system 100 starts checking a certain subject and it is the first time that the motion signal MS generated by the motion sensor 102 indicates that the ultrasound probe 101 is stationary. Similarly, the reporting module 103 will identify the current region of interest as the second region of the plurality regions of interest when it is the second time that the motion signal MS generated by the motion sensor 102 indicates that the ultrasound probe 101 is stationary. Similarly, the reporting module 103 will identify the current region of interest as the nth region of the plurality regions of interest when it is the nth time that the motion signal MS generated by the motion sensor 102 indicates that the ultrasound probe 101 is stationary. In this way, the sequence of each region of interest among the plurality of region of interest can be identified and then the corresponding result of each region of interest can be recorded in association with each region of interest.
As illustrated in
The results recorded by the reporting module 108 may be visualized on the user interface 107 directly. Alternatively, the results may be mapped on pre-acquired information and visualized together with the pre-acquired information. The pre-acquired information may be anatomy information of the plurality of regions of interest, such as CT images, MR images, or anatomy models of the plurality of regions of interest.
As illustrated in
The user interface 107 enables the user to give an input to go back, for example, when the user feels the operation is not done properly or the operation is not satisfactory for a region of interest, the user may give an input to go back, i.e., not record the result for the region of interest. Based on the user input to go back, the go-back module 105 identifies the current region of interest and records the results.
For example, in
In another embodiment, the ultrasound system 100 may further comprise a position verification module 110 configured to calculate a ratio between the size of the ultrasound acoustic shadow and the total area of a region of interest from the echo signals received from the region of interest and generate a position indicator by comparing the ratio with a predetermined threshold.
The embodiment is shown in
The ultrasound acoustic shadow is formed when ultrasound signals are blocked by a portion of the living being, for example, a bone or bony structure. For example, when the ultrasound probe 101 is placed on the chest, the ultrasound signals generated by the ultrasound probe 101 are not able to pass through ribs. The ratio between the size of the ultrasound acoustic shadow and the total area of a region of interest indicates whether the ultrasound probe 101 is placed on the correct position. The larger is the ratio, the better is the position for placing the ultrasound probe 101.
For example, there are dark areas under the ribs in acquired ultrasound images. Therefore, one embodiment is provided to calculate the ratio by using the acquired ultrasound images. In this embodiment, the ratio between the size of the ultrasound acoustic shadow and the total area of a region of interest is represented by the ratio between the area of the ultrasound acoustic shadow and the total area of the ultrasound image frame. The width of an ultrasound image frame is the width of the ultrasound probe 101, which can be measured directly. The depth of an ultrasound image frame is determined by the operator before the operation. Therefore, the total area of the ultrasound image frame is calculated by multiplying the width of the ultrasound image frame and the depth of the ultrasound image frame.
The area of the ultrasound acoustic shadow may be determined by applying a known image processing algorithm to the ultrasound image frame, for example, detecting the edge to identify the range of the ultrasound acoustic shadow and then calculate the area of the identified range.
The predetermined threshold is chosen in the range of [1/4-1/3] based on experimental results. A ratio smaller than the predetermined threshold indicates that the ultrasound probe 101 is placed at a proper position. A ratio larger than the predetermined threshold indicates that the ultrasound probe 101 is not placed at a proper position.
In another embodiment of the system 100, the motion sensor 102 is an accelerometer.
The accelerometer may be a 3-axis accelerometer, adapted to detect acceleration in any of three orthogonal directions. For example, a first axis of the accelerometer may be disposed in an x-direction, a second axis may be disposed in a y-direction, and a third axis may be disposed in a z-direction. By combining signals from each of the three axes, the accelerometer may be able to detect accelerations in any three-dimensional direction. By integrating accelerations occurring over a period of time, the processor may generate an accurate real-time velocity of the accelerometer on the basis of data from the accelerometer.
An ultrasound method 200 for sequentially performing a predetermined procedure for each of at least one region of interest, comprises a step of transmitting 201 a first ultrasound signal SG1 towards a region of interest and receiving echo signals from the region of interest. The ultrasound method 200 also comprises a step of detecting 202 a motion of an ultrasound probe 101 and generating a motion signal MS for indicating the motion of the ultrasound probe 101. The ultrasound method 200 also comprises a step of performing 203 a predetermined procedure for a region of interest on the basis of the echo signals received from the region of interest if the motion signal MS indicates that the ultrasound probe 101 is stationary.
In an embodiment, the ultrasound method 200 may further comprise a step of starting to transmit the first ultrasound signals SG1 if the motion signal MS indicates that the ultrasound probe 101 is stationary.
In an embodiment, the ultrasound method 200 may further comprise a step of transmitting a second ultrasound signals SG2 prior to transmitting the first ultrasound signal SG1.
While the invention has been illustrated and described in detail in the drawings and foregoing description, such illustration and description are to be considered illustrative or exemplary and not restrictive. The invention is not limited to the disclosed embodiments. Other variations to the disclosed embodiments can be understood and effected by those skilled in the art in practicing a claimed invention, from a study of the drawings, the disclosure, and the dependent claims.
In the claims, the word “comprising” does not exclude other elements or steps, and the indefinite article “a” or “an” does not exclude a plurality. A single processor or other unit may fulfill the functions of several items re-cited in the claims. The mere fact that certain measures are re-cited in mutually different dependent claims does not indicate that a combination of these measures cannot be used to advantage. Any reference signs in the claims should not be construed as limiting the scope.
| Number | Date | Country | Kind |
|---|---|---|---|
| 16159416 | Mar 2016 | EP | regional |
| Filing Document | Filing Date | Country | Kind |
|---|---|---|---|
| PCT/EP2016/081629 | 12/19/2016 | WO | 00 |
| Publishing Document | Publishing Date | Country | Kind |
|---|---|---|---|
| WO2017/114673 | 7/6/2017 | WO | A |
| Number | Name | Date | Kind |
|---|---|---|---|
| 5552645 | Weng | Sep 1996 | A |
| 10653388 | Xu | May 2020 | B2 |
| 20020026118 | Govari | Feb 2002 | A1 |
| 20050096539 | Leibig | May 2005 | A1 |
| 20070078340 | Wilcox et al. | Apr 2007 | A1 |
| 20100179428 | Pedersen | Jul 2010 | A1 |
| 20120108971 | Miyama | May 2012 | A1 |
| 20120179035 | Boudier | Jul 2012 | A1 |
| 20130053697 | Holl | Feb 2013 | A1 |
| 20130158408 | Tsuda et al. | Jun 2013 | A1 |
| 20130184584 | Berkey | Jul 2013 | A1 |
| 20130197370 | Burlina | Aug 2013 | A1 |
| 20140128739 | Sundaran et al. | May 2014 | A1 |
| 20140194742 | Sundaran et al. | Jul 2014 | A1 |
| 20140243671 | Holl | Aug 2014 | A1 |
| 20150002538 | Sohn et al. | Jan 2015 | A1 |
| 20150126869 | Kawabata | May 2015 | A1 |
| 20150146855 | Futamura | May 2015 | A1 |
| 20150164482 | Toji | Jun 2015 | A1 |
| 20150374344 | Koide | Dec 2015 | A1 |
| 20170091914 | Halmann | Mar 2017 | A1 |
| 20180344293 | Raju | Dec 2018 | A1 |
| 20190105013 | Wang | Apr 2019 | A1 |
| Number | Date | Country |
|---|---|---|
| 10125655 | Dec 2002 | DE |
| 2010057562 | Mar 2010 | JP |
| 2012050603 | Mar 2012 | JP |
| 2016087984 | Jun 2016 | WO |
| Entry |
|---|
| L. Gargani and G. Volpocelli, ‘How I do it: Lung ultrasound’, Cardiovascular Ultrasound, 2014, vol. 12:25 ( http://www.cardiovascularultrasound.com/content/12/1/25 ). |
| G. Volpicelli, et al., ‘International evidence-based recommendations for point-of-care lung ultrasound’, Intensive Care Med., 2012, vol. 38:577-591. |
| M. Mennicke, et. al., ‘Anatomical distribution of traumatic pneumothoraces on chest computed tomography: implications for ultrasound screening in the ED’, American Journal of emergency Medicine, 2012, vol. 30: 1025-1031. |
| S. Kiley, et. al., ‘Retrospective computed tomography mapping of intra-pleural air may demonstrate optimal window for ultrasound diagnosis of pneumothorax’, Journal of Intensive Care Medicine, 2014, vol. 29: 342-347. |
| T. Berlet, et. al., ‘Current practice of lung ultrasonography (LUS) in the diagnosis of pneumothorax: a survey of physician sonographers in Germany’, Critical Ultrasound Journal, 2014, vol. 6:16. (http://www.criticalultrasoundjoumal.com/content/6/1/16. |
| T. Berlet and R. Etter, ‘Favourable experience with M-Mode sonography in the diagnosis of pneumothorax in two patients with thoracic subcutaneous emphysema’, Case Report in Radiology, 2014, vol. 2014, Article ID 906127, 3 pages (http://dx.doi.org/10.1155/2014/906127 ). |
| BS. Ku, et. al., ‘Clinician-performed bedside ultrasound for the diagnosis of pneumothorax’, West Journal of Emergency Medicine, 2013, vol. 14(2):103-108. |
| K. Alraijhi et. al., ‘Test characteristics of ultrasonography for the detection of pneumothorax: A systematic review and Meta-analysis’, Chest , 2012, vol. 141(3): 703-709. |
| Number | Date | Country | |
|---|---|---|---|
| 20190150889 A1 | May 2019 | US |
