The present invention relates to ultrasound medical devices. More particularly, the invention relates to the correlation of ultrasound images with physical hand positioning.
Ultrasound is frequently used during various diagnostic procedures. In some countries the utrasound process in done in two stages: in the first stage the technician is responsible for acquisition of the images, and in the second stage the physician is responsible for the offline diagnosis. Ultrasound is often followed by a physical examination in which the physician touches and senses the relevant body part.
Currently, there is no existing tool that enables the physician to accurately know, by viewing in real time, the exact point he is touching in a body cavity, relative to the ultrasound view. Thus, for example, in gynecological physical examination, the physician relies on his sense of touch only, and cannot know where his hand is in real time, relative to the inner body organs that he may have seen before in the ultrasound. While sensing the kidney or liver, the physician can only assume that he remembers the ultrasound image he saw before and the previous location of the transducer.
In spite of the broad use of ultrasound in the art, there is no known solution to the specific problem described above. Various solutions have been suggested instead for the registration of imaging data in known medical procedures. For example: Mediguide developed sensors for intrabody positioning system for medical devices, designed for guide-wires, coronary catheterization devices, and the like (http://medgadget.com/search/mediguide). U.S. Patent Application No. 2011/0040175 deals with the real-time positioning (location and orientation) of surgical instruments during operation, with reference to ultrasound transducers. U.S. Pat. No. 7,824,328 teaches the positioning of endoscopes during operation. U.S. Pat. No. 7,662,113 teaches the tracking of fingers during physical examination for training purposes, without registration with imaging data and with no integration of the information with the ultrasound information.
Therefore a need exists for systems that will allow displaying the location of a physician's finger over imaging data during physical examination. It is therefore an object of the present invention to provide a method and system that will allow the physician to perceive in real time how the image he views on a screen correlates with the position of his hand or finger and the tactile information he derives from them.
The invention relates to an augmented ultrasound examination system, comprising:
In one embodiment of the invention said first position sensor comprises a plurality of sensors. In another embodiment of the invention said second position sensor comprises a plurality of sensors.
The augmented system of the invention may further comprise registration markers, either external or such that are suitable to be applied to a patient's body.
In another aspect the invention is directed to a method for generating augmented ultrasound examination system, comprising:
In the drawings:
Physicians are used to look at special displays (used in ultrasound apparatus) while carrying out examinations. A display that provides the physician with information about the relative position of their fingers to the object under examination is needed to improve the diagnostic accuracy.
The need for an augmented display is even higher when:
The invention provides a system that enables a physician to see the position of his fingers over an ultrasound display during physical examinations or other procedures. Positioning sensors are used, in addition to the ultrasound transducer and to the fingers of the physician during the physical examination, in order to enable the integrated display.
According to the invention the following is provided:
Referring now to
Looking now at
Although in the examples provided herein reference is made to magnetic positioning sensors, the specific type of sensors is only mentioned for the purpose of illustration and is not intended to limit the invention in any way. As will be easily appreciated by persons skilled in the art, any other suitable positioning sensor, such as, e.g., Wi-Fi or radio based positioning sensors, can be used, without exceeding the scope of the invention.
The invention permits to provide enhanced displaying capabilities, because of the augmented data made available to it. For the purpose of illustration
The positioning sensor must be coupled to the transducer in a way that the coupling is fixed so that the sensors measurement is not effected by the transducer's activity. For example, if sensors are employed, which use magnetic fields for calculations, with a transducer that uses a mechanical engine for 3D/4D acquisition, then the sensor must be located far from the engine so that the magnetic noise created by the engine will not affect the measurements. The system should be designed in such a way that will enable the location of the volume in the sensors coordinate system to be measured.
Positioning markers adjusted to patient are needed when there is a chance that the patient will move between the ultrasound and the physical examination. If the patient will not move (i.e., will not perform a movement that may affect the required accuracy of the physical examination), the positioning markers will not add information and therefore the operation can be performed without them. Yet, it is often useful to employ markers to verify that no movement is taking place.
Positioning markers should be applied to the patient in a way that repeating the registration process gives same results. There are mainly two types of markers:
It is usually desirable to use more markers than the minimum for verification of the registration. If the registration failed at any stage (manual or automatic), the physician must be notified. While using sensors with lower accuracy than required, the accuracy can be improved when using multiple sensors.
There is no change in the acquisition procedure of US/Doppler 2D/3D/4D data and the procedure can be performed with any US (ultrasound) device and transducers. The process may include acquisition of multiple 2D/3D/4D gray/Doppler data. The system will pose all data in the same coordinate system, thus enabling a location-based search of the data.
The physical examination can be applied in a place where the ultrasound was acquired or elsewhere. In both cases, the patient's position should not be changed in a way that may cause deformation of the relevant body part.
As explained above, the physician can use a one-finger sensor or a plurality of sensors. He may also have sensors on both hands. The sensors and/or the glove must not interfere with the physical examination or affect the physician's touching sense after short adaption period. The sensors can be wired together, or separately, to a central source or can use wireless communication to publish their positions.
The main use of a finger sensor is to display the position over the ultrasound information. The system can work well while showing the location of the sensors (rather than the finger tip) and leaving the physician to estimate the position correction in his head. However, using a simple calibration process will enable the system to display the exact position of the finger tips or the finger volume on screen.
There are many valid methods to apply such calibration. For example, touching a dedicated sensor or touching a marker with known position. Another simple calibration method (suitable only when both fingers have sensors) is meeting the thumb and the index finger, and dividing the distance by 2. The accuracy of this simple method is limited but may be good enough for many purposes.
It is recommended to repeat the calibration every time the physician wears the sensors, but when the required accuracy is limited, the calibration can be performed only on the first use by the physician.
The physician should select the intersection and/or display mode of the ultrasound in order for the process to be efficient, and in order for him to control it during the examination. The ultrasound display option can be the same as the existing display options of the ultrasound. In case of invasive physical examination (gynecology or other), the display may be according the finger location, enabling the physician to see the environment of the finger. In the case of multiple data of the same location, the user may select which data to display or multiple display option.
As will be apparent from the above description, the invention provides a tool and method, which enable the physician to “see” where he is sensing during the physical examination, relative to the ultrasound information. It enhances the physical examination with visual information from the ultrasound. The interactive ultrasound information can be stored along with the positioning information so that the physical examination can be repeated using the already stored ultrasound data. This permits to enhance the ultrasound capabilities in cases of a second opinion, and expert examination, follow-up examinations, and more.
All the above description and examples of use have been provided for the purpose of illustration and are not intended to limit the invention in any way. Many different systems and setups can be devised, using many different sensors and elements, all without exceeding the scope of the invention.