Patent Application
20170251988
The present invention relates to an ultrasound imaging apparatus for providing ultrasound images of a patient. The present invention further relates to an ultrasound imaging method for providing ultrasound images of a patient and a computer program comprising program code means for causing a computer to carry out steps of the method when said computer program is carried out on a computer.
In the field of medical imaging systems it is generally known to use catheters including ultrasound echo probes for providing an ultrasound view from a position within the patient's body, such as e.g. intracardiac echocardiography. A corresponding ultrasound catheter echo probe for providing intracardiac ultrasound images is e.g. known from U.S. Pat. No. 8,270,694 B2.
The ultrasound catheters including ultrasound echo probes are expensive and have to be introduced into the patient's body so that the examination is complicated, time consuming and probably risky for the patient. Since not all examinations of a patient require a catheter including an ultrasound echo probe, the use of these catheters can be omitted, however, an internal view within the patient's body from a catheter probe position may be helpful for the operator to analyze the ultrasound images and the compare the results with other ultrasound images.
US 2013 0223702 A1 discloses a surgical instrument navigation system that visually simulates a virtual volumetric scene of a body cavity of a patient from a point of view of a surgical instrument residing in the cavity of the patient, wherein the surgical instrument may be a steerable surgical catheter with a biopsy device and/or a surgical catheter with a side-exiting medical instrument.
It is therefore an object of the invention to provide an ultrasound imaging apparatus and an ultrasound imaging method which provides an internal view corresponding to a view from an ultrasound catheter probe position with low technical effort. According to one aspect an ultrasound imaging apparatus for providing ultrasound images of a patient is provided, comprising:
an ultrasound acquisition unit for acquiring ultrasound data of a patient's body in a field of view,
a position determining unit for determining a position within the patient's body, and
an ultrasound data transformation unit for transforming the ultrasound data in the filed of view on the basis of the determined position to transformed ultrasound data in a virtual field of view having a virtual viewing direction different from the viewing direction of the ultrasound acquisition unit,
wherein the position determining unit is adapted to determine the position and/or the virtual viewing direction of the virtual field of view on the basis of the ultrasound data or on the basis of X-ray images provided by an X-ray unit.
According to another aspect an ultrasound imaging method for providing ultrasound images of a patient is provided, comprising the steps of:
receiving ultrasound data of a patient's body in a field of view,
determining a position within the patient's body,
transforming the ultrasound data in the field of view on the basis of the determined position to transformed ultrasound data in a virtual field of view having a virtual viewing direction different from the viewing direction of the field of view, and
determining the position and/or the virtual viewing direction of the virtual field of view on the basis of the ultrasound data or on the basis of X-ray images provided by an X-ray unit.
According to another aspect a computer program is provided comprising program code means for causing a computer to carry out the steps of the method according to the invention when said computer program is carried out on the computer.
Preferred embodiments are defined in the dependent claims. It shall be understood that the claimed method has similar and/or identical preferred embodiments as the claimed device and as defined in the dependent claims.
The present invention is based on the idea to acquire ultrasound data of a patient by means of an ultrasound acquisition unit and to transform the ultrasound data in the field of view as captured to ultrasound data in a virtual field of view corresponding to a position within the patient's body determined by the position determining unit. The virtual field of a view has a virtual viewing direction as seen from the position within the patient's body determined by the position determining unit so that an internal view can be derived from the ultrasound data acquired by the ultrasound acquisition unit. Hence, the internal view within the patient's body can be provided without introducing a catheter into the patient's body including an ultrasound echo probe merely by transforming the ultrasound data from the real field of view of the ultrasound acquisition unit to the virtual field of view. Hence, the technical effort for providing ultrasound images from an internal view of the patient's body can be reduced.
In a preferred embodiment, the position is a position of a catheter probe within the patient's body determined by the position determining unit. In other words, the position determining unit is adapted to determine a position of a catheter probe within the patient's body as the position on the basis of which the virtual field of view is determined. This is a possibility to precisely determine a position of interest in the patient's body by means of a catheter, wherein the use of an expensive catheter ultrasound echo probe can be omitted.
In a preferred embodiment, the position determining unit is further adapted to determine an orientation of the catheter probe within the patient's body, wherein the virtual viewing direction is determined on the basis of the orientation of the catheter probe. This is a possibility to provide an ultrasound image in the virtual viewing direction corresponding to a viewing direction of the catheter probe without the need of a catheter having an ultrasound echo probe. Hence, the ultrasound images of an echo probe can be virtually simulated.
The position determining unit is adapted to determine the position and/or the virtual viewing direction of the virtual field of view on the basis of the ultrasound data. This is a possibility to identify anatomical features of the patient or a catheter probe within the patient's body in order to precisely determine the relevant position from which images in the virtual viewing direction are required.
The position determining unit is connected to the X-ray unit providing X-ray images of the patient's body, wherein the position determining unit is adapted to determine the position and/or the virtual viewing direction of the virtual field of view on the basis of the X-ray images. This is a possibility to further improve the determination of the position within the patient's body, since X-ray as a different analysis method is utilized. In a further preferred embodiment, the X-ray unit is used to determine the position and the orientation of the catheter probe. This is a possibility to determine the catheter probe with high precision.
In a further preferred embodiment, the virtual field of view is determined as a virtual viewing direction from the determined position. This is a possibility to simulate the acquisition of ultrasound images by a catheter ultrasound echo probe.
In a preferred embodiment, the position determining unit comprises a segmentation unit for segmenting the ultrasound data and for providing segmentation data, wherein the position and/or the virtual viewing direction of the field of view is determined on the basis of the segmentation data. This is a possibility to further improve the determination of the position within the patient's body, since the ultrasound data can be analyzed e.g. for anatomical features so that the position within the patient's body can be precisely determined within the anatomical context.
In a further preferred embodiment, the position determining unit is adapted to determine the virtual viewing direction on the basis of anatomical features identified in the segmentation data. This is a possibility to define the virtual viewing direction with respect to identified anatomical features and organs so that a predefined or a standard view of certain anatomical features can be automatically determined.
In a preferred embodiment, the position determining unit comprises an input device for determining the position and the direction of the virtual viewing direction on the basis of a user input. This is a possibility to flexibly determine the position and the direction of the virtual viewing directing by the user so that an arbitrary viewing direction can be selected.
In a preferred embodiment, the input device is adapted to determine the position in the ultrasound data received from the ultrasound acquisition unit. This is a possibility to improve the comfort for the user, since the position can be determined in the ultrasound images, e.g. by means of a mouse click or the like so that the position can be determined precisely with low technical effort.
In a preferred embodiment, the imaging apparatus comprises a display unit for displaying the transformed ultrasound data in the virtual viewing direction. This is a possibility to provide ultrasound images corresponding to the determined internal virtual viewing direction.
In a further preferred embodiment, the ultrasound acquisition unit is an external ultrasound acquisition unit located outside the patient's body or a catheter based ultrasound acquisition unit. This is a possibility to reduce the technical effort, since different ultrasound acquisition units can be utilized for acquiring the ultrasound data and the ultrasound data can be transformed in order to provide a corresponding ultrasound image in the virtual viewing direction from the position within the patient's body.
In a preferred embodiment, the ultrasound data comprises a plurality of voxels each including an ultrasound measurement value, wherein the transformation unit is adapted to transform the ultrasound measurement values of the voxels in the field of view to voxels of the virtual field of view. This is a possibility to transform the ultrasound data of the field of view with low technical effort to the transformed ultrasound data in the virtual field of view, since each voxel can be transformed to a voxel of the virtual field of view with e.g. by means of a transformation matrix.
As mentioned above, the position within the patient's body can be determined in order to define the virtual field of view in order to simulate the acquisition of ultrasound data by means of a catheter ultrasound echo probe. The position on the basis of which the virtual field of view is determined can be defined by determining a position of a real catheter probe within the patient's body, e.g. by means of a tracking unit or within the ultrasound image or an X-ray image, the position can be determined on the basis of the anatomical context in the patient's body by segmenting the ultrasound data and by determining organs within the patient's body on the basis of the segmentation data or by means of a combination of the catheter tracking and the anatomical context. In a further embodiment, the position within the patient's body can be determined by means of a manual user input so that the position can be defined flexibly as desired. This is in general a possibility to improve the ultrasound imaging analysis, since each view within the patient's body can be determined with low technical effort merely by transforming the acquired ultrasound data to a virtual field of view.
These and other aspects of the invention will be apparent from and elucidated with reference to the embodiment(s) described hereinafter. In the following drawings
The ultrasound imaging apparatus 10 comprises in general an image processing apparatus 18 for evaluating the ultrasound data received from the ultrasound acquisition unit 14 and for transforming the ultrasound data in the field of view 16 to a virtual field of view 20 as described in the following.
The ultrasound acquisition unit 14 may be an external ultrasound acquisition unit which is located entirely outside the patient's body or may be a catheter probe inserted into the patient's body, wherein the acquisition unit provides e.g. a transesophageal echocardiogram (TEE) or a transthoracic echocardiogram (TTE) as the ultrasound image.
The image processing apparatus 18 comprises an image evaluation unit 22 connected to the ultrasound acquisition unit 14 for evaluating the ultrasound data and for providing ultrasound image data from the volume or object of the patient which is analyzed by the ultrasound acquisition unit 14 in the field of view 16. The image processing apparatus 18 further comprises a position determining unit 24, which is adapted to determine a position 26 within the patient's body. The position determining unit 24 is further adapted to determine the virtual field of view 20 as a virtual cone from the determined position 26 in a virtual viewing direction 28. The position determining unit 24 is connected to the image evaluation unit 22 and receives the ultrasound data from the image evaluation unit 22 of the field of view 16 and determines the position 26 preferably within the field of view 26 of the ultrasound acquisition unit 14. The position determining unit 24 further determines the virtual field of view 20 on the basis of the position 26 and the virtual viewing direction 28 e.g. having a predefined or selectable viewing angle so that a volume within the virtual field of view 20 can be determined.
The image processing apparatus 18 further comprises a transformation unit 30 for transforming the ultrasound data in the field of view 16 to transformed ultrasound data in the virtual field of view. The transformed ultrasound data is provided to a display unit 32 for displaying the transformed ultrasound data in the virtual field of view 20.
The transformation unit 30 receives the ultrasound data as a 3D array of voxels each including an ultrasound measurement value and transforms the voxels of the field of view 16 to voxels of the virtual field of view 20 in the virtual viewing direction 28 so that the transformed ultrasound data can be provided and displayed on a display unit 32 as if the transformed ultrasound data would have been acquired by an ultrasound probe located at the position 26 and directed in the virtual viewing direction 28.
The position 26 within the patient's body and the virtual viewing direction 28 can be determined in different ways. The position 26 and the virtual viewing direction 28 may be determined as a position of a catheter introduced in the patient's body so that the virtual field of view 20 can be determined as if the transformed ultrasound data would have been acquired by means of the catheter ultrasound probe as described in the following. The position of the catheter may be determined by an electromagnetic tracking unit, by means of the ultrasound acquisition unit 14 or by means of an X-ray unit 34 which may be connected to the ultrasound imaging apparatus 10 and to the position determining unit 24 e.g. by means of pattern detection.
The ultrasound imaging apparatus 10 may further comprise a segmentation unit 36 connected to the image evaluation unit 22 and to the position determining unit 24, wherein the segmentation unit 24 provides segmentation data on the basis of the ultrasound data and determines anatomical features within the field of view 16. The position determining unit 24 can identify on the basis of the segmentation data different anatomical features and/or organs within the field of view 16 and determines the virtual field of view 20 on the basis of the segmentation data. This is a possibility to automatically define the virtual field of view 20 in the direction of a certain anatomical feature to be examined or which corresponds to a usual field of view of a catheter ultrasound probe during corresponding catheter examinations.
The ultrasound imaging apparatus 10 may further be connected to or may further comprise an input device 38 which is provided for a user input to determine the position 26 and/or the virtual viewing direction 28 in the patient's body so that the virtual field of view 20 can be individually determined by the user. The user may identify the position and the virtual viewing direction 28 within the ultrasound data or within the X-ray data or may determine the position on the basis of the segmentation data so that the virtual field of view 20 can be individually determined with high precision by the user.
In general, the ultrasound imaging apparatus 10 can provide the transformed ultrasound data in the virtual field of view 20 as if a catheter including an ultrasound echo probe would have been used and is located at the position 26, wherein the use of such a catheter probe can be omitted.
The position determining unit 24 determines the position of the catheter probe 14 by means of an electromagnetic tracking unit, by means of the X-ray device 34 or by means of the ultrasound acquisition unit 14 which provides the ultrasound data from the field of view 16, in which the catheter probe 40 is located. The position determining unit 24 is also adapted to determine an orientation of the catheter probe 40 within the patient's body 12 in order to determine the position 26 and the virtual viewing direction 28 on the basis of the position and orientation of the catheter probe 40. The transformation unit 30 transforms the ultrasound data of the ultrasound acquisition unit 14 in the field of view 16 to the virtual field of view 20 and displays the transformed ultrasound data at the display unit 32 so that an ultrasound image can be displayed as if the transformed ultrasound data would have been captured by means of the catheter probe 40.
A preferred application of the ultrasound imaging apparatus is the ultrasound examination of the heart of the patient 12. The ultrasound acquisition unit 14 may be an ultrasound probe disposed outside the patient's body e.g. attached to the skin of the thorax for acquiring the ultrasound data or may be an ultrasound catheter introduced into the patient's body 12 e.g. into the esophagus for acquiring the ultrasound data of the patient 12.
Hence, ultrasound images from an internal view within the patient's body can be provided without the use of a catheter having an ultrasound echo probe.
It shall be understood that the embodiments of
It shall be understood that the user input may be utilized for adjusting the position 26 and the viewing direction 28 determined on the basis of the position of the catheter probe 40 and on the basis of the segmentation data 44.
In one embodiment, the position determining unit 24 determines the position 26 as shown at 60 and the virtual viewing direction 28 as shown at 62 on the basis of the ultrasound data 42 or the X-ray data.
Alternatively, the position determining unit 24 determines the virtual position 26 on the basis of the ultrasound data and/or the X-ray data as shown at 64 and the virtual viewing direction 28 on the basis of the ultrasound data 42 and/or the X-ray data and additionally on the basis of the segmentation data 44 provided by the segmentation unit 36 as shown at 66.
In an alternative embodiment, the position determining unit 24 is adapted to determine the position 26 and the virtual viewing direction 28 merely on the basis of the segmentation data 44 provided by the segmentation unit 36 as shown at 68 and 70.
Alternatively, a user input is provided by means of the input device 38 as shown at 72 and the position determining unit 24 is adapted to determine the position 26 on the basis of the user input as shown at 74 and the virtual viewing direction on the basis of the user input as shown at 76.
The transformation unit 30 transforms the ultrasound data 42 in the field of view 16 to the transformed ultrasound data 46 in the virtual field of view 20 as shown at 78 and provides the transformed ultrasound data 46 to the display unit 32 for displaying the transformed ultrasound data 46 in the virtual field of view 20 as if the ultrasound data 46 would have been acquired from the position 26 within the patient's body 12. The transformed ultrasound data 46 is provided to the display unit 32 for displaying the transformed ultrasound data as shown at 80.
While the invention has been illustrated and described in detail in the drawings and foregoing description, such illustration and description are to be considered illustrative or exemplary and not restrictive; the invention is not limited to the disclosed embodiments. Other variations to the disclosed embodiments can be understood and effected by those skilled in the art in practicing the claimed invention, from a study of the drawings, the disclosure, and the appended claims.
In the claims, the word “comprising” does not exclude other elements or steps, and the indefinite article “a” or “an” does not exclude a plurality. A single element or other unit may fulfill the functions of several items recited in the claims. The mere fact that certain measures are recited in mutually different dependent claims does not indicate that a combination of these measures cannot be used to advantage.
A computer program may be stored/distributed on a suitable medium, such as an optical storage medium or a solid-state medium supplied together with or as part of other hardware, but may also be distributed in other forms, such as via the Internet or other wired or wireless telecommunication systems.
Any reference signs in the claims should not be construed as limiting the scope.
| Number | Date | Country | Kind |
|---|---|---|---|
| 14185262.4 | Sep 2014 | EP | regional |
| Filing Document | Filing Date | Country | Kind |
|---|---|---|---|
| PCT/EP2015/070806 | 9/11/2015 | WO | 00 |
