Patent Application
20120093378
The invention relates to a medical imaging apparatus for providing information about an object. The invention further relates to a method for providing information about an object.
Information about an object can be required, for example, for the diagnostics of diseases or during an intervention, such as a surgical intervention, to provide necessary or desired knowledge of the object, for example, in order to be able to perform further interventional steps. This knowledge can serve as a kind of feedback, for example in cases where the results of the intervention are difficult to detect, such as in cases where the object of interest is a patient, where medical intervention can be performed in such a way that the actual interventional process or even the result cannot be detected by the person performing the intervention. Medical imaging is therefore used in different applications. For example, the data these images are based upon can be derived by means of X-rays, MRI, Ultrasound, SPECT etc. Especially in minimally invasive procedures, the surgeon may thus be provided with the information necessary for performing the intervention. Furthermore, conventional X-ray imaging is used in endovascular interventional procedures as well as in percutaneous interventions. In order to provide soft tissue information, the so called soft tissue imaging, known as XperCT, is used. Further, percutaneous needle mediated interventions are widely used in a large variety of diseases where taking biopsies of tissue is used for tissue examination. For the definition of the needle trajectory as well as for image guided needle tracking, imaging modalities, such as X-ray, CT, MR etc. are used. With a needle integrated with optical fibers such as a photonic needle, it is possible to acquire optical spectroscopy data. Hence, the user is provided with two separate sources of information, for example X-ray images and optical information, displayed at two different places such as two monitors. For example, US 2007/0016028 A1 describes the use of several monitors of which one is a so-called navigation monitor displaying real time images in one window and real time EP signals in a further window. But it has been shown that the user, for example a physician, has difficulties conceiving all of the provided information. Especially during medical procedures that conventionally use X-ray information only, the presentation of additional information may hamper the normal work flow. Further, it has also been shown that due to an increasing number of parameters that can be displayed to provide information about the object of interest, for example the patient, the user sometimes experiences a fatigue that leads to a decrease in the user's performance and concentration during the intervention.
Hence, there may be a need to improve the preparation and the visual reception of information relating to an object during medical interventions.
The object is reached with a medical imaging apparatus and a method, according to the independent claims.
According to an exemplary embodiment of the information, a medical imaging apparatus for providing information about an object is provided that comprises an image acquisition device, an interventional device interventional device, a processing device and a display device. The image acquisition device is adapted to detect object data from at least one region of interest of an object and to provide the object data to a processing device. The interventional device interventional device is adapted to detect physiological parameters of the object depending on the position of a predetermined area of the interventional device interventional device in relation to the object and to provide the physiological parameters to the processing device. The processing device is adapted to transform at least a part of the object data into image data and to convert the physiological parameters into physiological data. The processing device is further adapted to modify at least one image parameter of the image data depending on the physiological data and to thereby transform the image data into modified life image data. The processing device is adapted to provide the modified life image data to the display device. The display device is adapted to display the modified life image.
The modification may comprise changing such parameters as contrast or brightness as well as color or saturation etc. The modification can be performed for the whole image data or for only selected areas or parts. The selection may be predetermined by the user and can relate to certain areas of the image and/or certain content of the image data which thus may be analyzed concerning the shown content.
The term “depending” means that a change in the physiological data, for example due to a movement of the interventional device or due to a change in the object's condition, leads to a change in the modified live image being displayed. The dependency may be defined as being directly coupled. The dependency may as well be ruled by a predetermined equation applied to the results of the physiological data detection.
This provides the advantage that the user, for example the physician, can proceed the intervention obtaining the additional information in a way that is not compromising the time he or she can spend on interpreting the image. In other words, the user is provided with additional information without requiring additional attention or influence on the concentration because the user only has to pay attention to one image instead of several images. A further advantage lies in the fact that by modifying the image data a loss of image content can be prevented. Simply said, the image data, in other words the image displayed, is not affected in a way that content is cut out or covered for example, by displaying the additional information.
Another advantage of the invention may be that additional information in form of the physiological data, can be provided to the user without the need of an extra display unit or separate window within a single display. In other words, the image data containing, for example, conventional information about the object, is not affected by the provision of the additional physiological data. By providing the additional data in form of the modified image the user can concentrate on the image provided on the display so that the reception of the content displayed is not interfered by the provision of the additional data. Thus, the additional information can be perceived by the user in a way which does not lead to fatigue or a decrease in concentration.
Since the additional information by the modified image relates to the object data derived by the interventional device, an interaction of the user in form of a change in the position of the device has the effect that the modified image is changing accordingly because the extraction of the physiological data and the modification is performed in real time, or at least in near real time.
Of course, the appearance of the additional information can be coded depending on the medical imaging methods used and according to the type of intervention applied to ensure a widespread use of the invention and to allow an easy perception of the information communicated to the user. For example, the selection of the type of additional data and its color or brightness or pattern should be performed depending on the physicians' needs.
One of the advantages of the invention is that the user can view the image data focusing on the content displayed on the display unit. Thus, the user can fully concentrate on the information shown on the display.
By providing the modified image to the user, the user is supported so that the process of making guidance decisions, which have to be made extremely quickly in order to avoid tissue damage, is relieved because the diffuse reflectance spectroscopy (DRS) information is presented in a concise and unobtrusive way that does not distract the physician too much from the original intervention.
But the present invention also provides the use of the potential perception or cognition that is so far unused. In the peripheral sub-zone of the user's area of view it is, for example, usually not possible to read or detect numbers or values but it is still possible to detect changes of brightness or color or patterns in this peripheral part of the field of view. Hence, in case the additional information is displayed by modifying the peripheral zone of the image, information or aspects can be communicated to the user by rather simple visual effects, for example a change of color or change of brightness representing determined data. In other words, the physiological data may be displayed in a rather simple way.
In an exemplary embodiment, a user interface to input data is provided in order to allow a determination of the kind of indicative data according to the user's needs.
For example, the physiological parameters may be an anatomical parameter.
In an exemplary embodiment, the physiological parameters are represented by optical information. For example, the optical information relates to color coding according to the field of intervention or examination respectively.
In a further exemplary embodiment, for certain conditions of the patient, thresholds can be pre-determined and monitored by the interventional device. Once a parameter reaches a critical value, that means once a threshold is reached, the modified image provides respective graphical information to the user.
In an exemplary embodiment, physiological parameters may be detected by the interventional device that are not provided by the detected object data.
This provides the advantage that the object data can be detected with a larger scale or lower resolution, whereas the interventional device provides a smaller scale that means a higher resolution or higher grade of details providing additional knowledge of the actual situation to the user.
For example, the apparatus may be adapted to determine the position of the interventional device depending on the physiological parameters.
For example, in case a certain physiological parameter is known from previous examination, the location of the interventional device in relation to the predetermined feature can be achieved by the physiological data.
For example, the apparatus is adapted to visualize the interventional device, for example in cases, where the interventional device is not visible in the detected object data, such as a glass needle under fluoroscopy. By obtaining information about the tissue at the needle's distal end, for example, it can be derived that the needle is in a certain type of tissue. Since certain tissue parameters can be identified for certain spatial relation to the structure visible on the fluoroscopy image, it is possible to know where or in which type of tissue the needle is at the moment.
The image acquisition device may be an imaging modality such as an X-ray imaging system, a computer tomography system (CT), magnetic resonance imaging modality (MR), ultrasound (US) or the like.
For example, the image acquisition device may be an X-ray apparatus acquiring fluoroscopic image.
According to another exemplary embodiment, the image data comprises a background and at least one parameter of at least a part of the background is modified in dependency of the physiological data.
For example, the background corresponds to the optical information representing the physiological parameter. Of course, several physiological parameters can be represented in such a way.
In an exemplary embodiment, the central part of the display comprises an image provided by the image acquisition device, such as an X-ray image with a background, for example a surrounding background, and the background changes in real time at each different position of the interventional device while the central part of the image is not effected. For example, the central part can have a circular form, whereas the background may be the rest of a square display.
According to another exemplary embodiment, the interventional device is shown in the modified life image with its trajectory and a graphical representation of the physiological data is shown along the trajectory of the interventional device.
For example, the graphical representation may be a colored marker, such as colored circles, for example with varying diameters to indicate intensity or other aspects of the physiological parameter. By providing the graphical representation along the trajectory of the interventional device, the user is provided with further information, namely the path within which the device has already been moved along. This may also indicate the direction for further movement of the interventional device.
According to another exemplary embodiment, the interventional device is shown in a modified life image and the color of the interventional device is modified depending on the detected physiological data.
This provides the advantage that the user is provided with additional information without meaning a cut-out or covering of image information.
For example, the interventional device is arranged to provide molecular information. For example, during a needle intervention the molecular information can inform the user about the molecular condition at the tip of the needle inserted by the user.
In another exemplary embodiment, the physiological data is obtained by non-optical methods.
In a further exemplary embodiment, the data may be based on measuring temperature and/or pH to provide additional information to the morphology data. For example, measuring temperature or pH can be useful to detect whether a site is reached where tissue is inflamed.
For example, the interventional device may be a biopsy needle, a canula, a trocar, a catheter or an endoscope.
Thus, the present invention is suitable for different applications or examination procedures respectively and can therefore be used in a wide range of different interventions.
According to a further exemplary embodiment, the interventional device is an optical needle with at least one integrated optical fiber adapted to acquire an optical spectrum to be translated into the physiological parameters.
For example, the translation may be achieved by spectroscopy.
In an exemplary embodiment, optical and non-optical methods are used in combination. This enables to provide sophisticated information to the surgeon for example.
According to a further exemplary embodiment, the interventional device is adapted to detect physiological parameters of the object, depending on the position of at least two different predetermined areas of the interventional device in relation to the object.
For example, the interventional device may be an optical needle and the needle may comprise more than two fibers such that spatial differences in the tissue to the left and right side, for instance, are detectable. This may be visualized on the display by different colors in the left and/or right part of the displayed image. One of the advantages is that a user is provided with differentiated information leading to an even better understanding of the situation within the object of interest.
According to a further exemplary embodiment, the contribution of blood, fat and water in the tissue at the predetermined location of the interventional device is converted into a color code and the color code is used for the modification of the image data.
Instead of or in addition to the parameters mentioned above, other parameters can be used for color coding as well.
The color code may be an RGB number, for example, blood may be represented by the color red, fat by the color green and water by the color blue.
For example, if the tissue content is measured on a scale from 0 to 1 for each of the selected parameters, this information can be converted into RGB numbers, using the following formula where R;G;B correspond respectively to red, green and blue (on a scale of 0 to 1):
R=([blood])/([blood]+[water]+[fat])
G=([fat])/([blood]+[water]+[fat])
B=([water])/([blood]+[water]+[fat])
where [X] corresponds to the contribution value of element X={blood; fat; water}.
For example, at a particular position, the contribution of blood, water and fat is respectively 0.8; 0.1; and 0.2. To convert this information into RGB numbers, the above-mentioned formula may be used. Thus, the RGB number is RGB=(0.8; 0.2; 0.1) which is a color close to red. In other words, the background 312 is displayed in a red color.
According to a further exemplary embodiment, the processing device is adapted to analyze the physiological data such that the approach of an important structure is determined and the image date is modified such that graphical instructional information is provided to the user.
For example, a first color may be used to indicate that the interventional device is not in danger of approaching the important structure, the color green for example. A second color may be used to indicate that the user must be careful in approaching the important structure, for example the color yellow. A third color may be used to indicate that the interventional device is very close to the important structure, for example by the color red. The important structure can be, for example, a vessel which the user does not want to perforate.
In another exemplary embodiment, different colors may correspond to different distances between, for example, chromophores and the probe, i.e. the needle directed by the user. For example, a first color could correspond to large distances when the probe is far from the target tissue and a second color could correspond to the case where the probe is within the target tissue.
According to a further exemplary embodiment, the interventional device may be adapted to acquire microscopic image data of the tissue in front of the needle, to detect the physiological data from the microscopic image data and the image data is modified with at least a part of the microscopic image data.
The acquisition may be performed, for example, by using a scanning fiber confocal scanner.
In an exemplary embodiment, the microscopic image data may be integrated into the modified image.
In a further exemplary embodiment, a combination of a photonic needle with X-ray provides the advantage that it is possible to combine macro-scale morphological information with micro-scale physiological or microscopic information. Hence, the image data can also be modified depending on the microscopic image.
For example, an interface unit is provided and adapted to control the display of the microscopic image data. This provides the advantage that the additional microscopic image data is only present in the image when the user actually wants to refer to the microscopic image data. Of course, the image displayed comprises the physiological parameters because the image has been modified.
The user interface may be, for example, a pedal, a mouse, a touch screen, a voice control device or the like adapted to enter a command.
In a further exemplary embodiment, the imaging apparatus comprises an X-ray imaging system with an X-ray image acquisition device comprising a source of X-ray radiation and an X-ray image detection module located opposite the source of X-ray radiation and a device provided to receive an object to be examined. Further, an interface unit is arranged to input information by the user. A control unit is connected to both the detection module and the radiation source and the interface unit as well as to the interventional device.
In another exemplary embodiment, the examination arrangement comprises an acoustic imaging system using ultrasound waves to generate images.
In a further exemplary embodiment, the examination arrangement comprises an MRI arrangement.
In a further exemplary embodiment, the examination arrangement comprises a SPECT arrangement.
According to a further aspect of the invention, a method for providing information about an object is provided that comprises the following steps. First, object data from at least one region of interest of an object is detected. Object parameters of the object are received from a device depending on the position of a predetermined location of the device in relation to the object. At least a part of the object data is transformed into image data. The object parameters are converted into second object data. At least one image parameter of the image data is modified depending on the second object data and thereby the image data is transformed into modified life image data. The modified life image is then displayed.
For example, the detection of the object data may be achieved with an image acquisition device such as the ones mentioned above. For example, the detection of the object parameters may be achieved with an interventional device. The parameters may comprise physiological parameters. For example, the object data and the object parameters may be provided to a processing device. For example, the modified life image data is provided to a display device and displayed on the display device.
For example, the image data may comprise a background, for example, surrounding a central part, and the step of modifying may include a step of modifying at least one parameter of at least a part of the background depending of the second object data.
Further, the interventional device may be an optical needle and the physiological data may be detected in form of optical data. The background may have a color that corresponds to the optical data.
In another exemplary embodiment of the present invention, a computer program or a computer program element is provided that is characterized by being adapted to execute the method steps of the method according to one of the preceding embodiments, on an appropriate system.
The computer program element might therefore be stored on a computer unit, which might also be part of an embodiment of the present invention. This computing unit may be adapted to perform or induce a performing of the steps of the method described above. Moreover, it may be adapted to operate the components of the above described apparatus. The computing unit can be adapted to operate automatically and/or to execute the orders of a user. A computer program may be loaded into a working memory of a data processor. The data processor may thus be equipped to carry out the method of the invention.
This exemplary embodiment of the invention covers both, a computer program that right from the beginning uses the invention and a computer program that by means of an up-date turns an existing program into a program that uses the invention.
Further on, the computer program element might be able to provide all necessary steps to fulfill the procedure of an exemplary embodiment of the method as described above.
According to a further exemplary embodiment of the present invention, a computer readable medium, such as a CD-ROM, is presented wherein the computer readable medium has a computer program element stored on it which computer program element is described by the preceding section.
However, the computer program may also be presented over a network like the world wide web and can be down loaded into the working memory of a data processor from such a network. According to a further exemplary embodiment of the present invention, a medium for making a computer program element available for downloading is provided, which computer program element is arranged to perform a method according to one of the previously described embodiments of the invention.
It has to be noted that embodiments of the invention are described with reference to different subject matters. In particular, some embodiments are described with reference to method type claims whereas other embodiments are described with reference to the device type claims. However, a person skilled in the art will gather from the above and the following description that, unless otherwise notified, in addition to any combination of features belonging to one type of subject matter also any combination between features relating to different subject matters is considered to be disclosed with this application. However, all features can be combined providing synergetic effects that are more than the simple summation of the features.
The aspect defined above and further aspects, features and advantages of the present invention can also be derived from the examples of embodiments to be described herein after and are explained with reference to examples of embodiments, but to which the invention is not limited. The invention will be described in more detail hereinafter with reference to the drawings.
The light detector 24 is adapted to transform the received light reflected by the tissue into electrical signals which are then provided to the processing device 26.
The image acquisition device 11 is adapted to detect object data from at least one region of interest of the object 18. For example, the X-ray radiation source 12 emits X-ray radiation towards the detector module 14. Thus, the detector module 14 provides the electrical signals to the processing device 26 from which, for example, a fluoroscopic image can be derived.
The interventional device 20 is adapted to detect physiological parameters of the object 18 depending on the position of a predetermined area 32, for example, the distal, i.e. the front tip of the needle, of the interventional device 20 in relation to the object 18 and to provide the physiological parameters to the processing device 26.
Within the processing device 26, at least a part of the object data provided by the image acquisition device 11 is transformed into image data and the physiological parameters provided by the interventional device 20 is converted into physiological data. Further, the processing device 26 is adapted to modify at least one image parameter of the image data depending on the physiological data, thereby transforming the image data into modified life image data. The processing device 26 provides a modified life data to a display device 28 which displays a modified life image 33.
In another example, not shown, the interventional device may be a biopsy needle, a canula, a trocar, a catheter or an endoscope.
In the following, the basic method steps according to an exemplary embodiment of the invention shall be described with reference to
In a modification step 128, at least one image parameter of the image data 122 is modified depending on the second object data 126. Thereby, the image data 122 is transformed into modified life image data 130. Further, the modified life image data 130 is displayed 132 as a modified life image 134 on the display 28.
For example, the detection 112 of the first object data 114 can be achieved by the image acquisition device 11. The detection of the object parameter 118 can be achieved with the interventional device 20, wherein the parameters 118 may comprise physiological parameters from the patient 18. The first object data 114 and the object parameters 118 are provided to the processing device 26 where the transformation step 120 and the conversion step 124 as well as the modification step 128 are performed.
By displaying 132 the modified life image 134, the user is provided with enhanced information such that, for example, image data is provided in form of image information, meanwhile additional information, namely information in relation with the at least one object parameter, for example physiological parameters, are also provided to the user. Since the modification 128 occurs in dependency from the second object data 126, that means depending on the object parameters 118 of the object 18, the displayed image 134 is constantly changing depending on a movement or change of location of the device, for example the interventional device 20, detecting the changing object parameters 118. In other words, even in case the first object data 114 is detected in a certain period, which means a respective stepwise change of the image, at least one image parameter of the image data is modified depending on the movement of the device 18. Of course, in a further exemplary embodiment the first object data 114 is detected constantly, too, thus providing life first object data.
It is noted that
From the diagram 210, for each position indicated on the horizontal axis 214 with the numbers 1, 2, 3, 4 and 5, the contribution of blood, fat and water can be converted into a color code, for example, an RGB number. For example, at position 2 on axis 214, the contribution of blood, water and fat is respectively 0.8; 0.1; and 0.2. To convert this information into RGB numbers, the following formula can be used where R;G;B correspond respectively to red, green and blue (on a scale of 0 to 1).
R=([blood])/([blood]+[water]+[fat])
G=([fat])/([blood]+[water]+[fat])
B=([water])/([blood]+[water]+[fat])
where [X] corresponds to the contribution value of element X={blood; fat; water}.
The thus derived physiological data can then be used to modify at least one image parameter of the image data depending on the physiological data. For example, the image data comprises a background 312 which is shown in
The background color will change in real time at each different needle position while the central part 314 of the screen containing the X-ray image is not affected. In this way, the physician can proceed with the needle intervention obtaining the optical information in a way that is not compromising the time he or she can spend on interpreting the X-ray image 314.
Another exemplary embodiment is shown in
Using the modified life image 134, providing the spectroscopic information in addition to the fluoroscopic image, it is for example possible to avoid puncturing blood vessels during an interventional procedure. It is also possible to confirm that a fatty structure is reached by the interventional device. That fatty structure indicates the fat layer that surrounds the region of interest such as the epidural space, e.g. the spinal cord.
This makes the subject matter of the present invention suitable for minimally invasive needle interventions such as low back pain interventions. The subject matter of the invention is also suitable for taking biopsies in the field of cancer diagnosis or in cases where a tissue characterization around the needle is required.
In a further exemplary embodiment shown in
Another exemplary embodiment is shown in
This provides the advantage that the user is provided with enhanced information indicating the expected type of tissue with respect to possible movement amendments of the interventional device 20. Of course this can be combined with the trajectory information described in relation with, for example,
Instead of showing the RGB content described in
By providing a modified image, it is generally possible to provide detailed information of the situation at, for example, the tip of the needle even though the fluoroscopic image may have such a resolution that it is not possible for the user to derive the information about the present situation with enough detailed information from the fluoroscopic image. In other words, a fluoroscopic image or another type of image, for example an ultrasound image, can be provided in a lower resolution representing morphological structures whereas the physiological parameter derived from the interventional device contribute to a much higher resolution providing microscopic information that is then represented in the modified image in order to improve the information supply of the user.
A further exemplary embodiment is shown in
In the embodiment shown in
For a better understanding,
While the invention has been illustrated and described in detail in the drawings and foregoing description, such illustration and description are to be considered illustrative or exemplary and not restrictive. The invention is not limited to the disclosed embodiments. Other variations to the disclosed embodiments can be understood and effected by those skilled in the art in practicing a claimed invention, from a study of the drawings, the disclosure, and the dependent claims.
In the claims, the word “comprising” does not exclude other elements or steps, and the indefinite article “a” or “an” does not exclude a plurality. A single processor or other unit may fulfill the functions of several items re-cited in the claims. The mere fact that certain measures are re-cited in mutually different dependent claims does not indicate that a combination of these measures cannot be used to advantage.
A computer program may be stored and/or distributed on a suitable medium, such as an optical storage medium or a solid state medium supplied together with or as part of other hardware, but may also be distributed in other forms, such as via the internet or other wired or wireless telecommunication systems.
Any reference signs in the claims should not be construed as limiting the scope.
| Number | Date | Country | Kind |
|---|---|---|---|
| 09164628.1 | Jul 2009 | EP | regional |
| Filing Document | Filing Date | Country | Kind | 371c Date |
|---|---|---|---|---|
| PCT/IB10/52955 | 6/29/2010 | WO | 00 | 1/6/2012 |
