The present application claims priority to German Patent Application No. 10 2008 062 650.3, filed Dec. 17, 2008, entitled “Surgical microscope for observing an infrared fluorescence and corresponding method,” the contents of which is hereby incorporated by reference in its entirety.
The invention relates to a surgical microscope for observing an infrared fluorescence and a microscopy method for observing an infrared fluorescence.
Fluorescent dyes are used in medical applications and biology for various purposes, such as visualizing particular types of tissue, tissue structures, tissue functions, tissue perfusion and other purposes. Herein, a fluorescent dye or a precursor of such fluorescent dye is applied to a tissue sample or a patient under examination. The dye or the precursor, respectively, accumulates in particular types of tissue and tissue structures of the tissue sample or the patient, respectively. The tissue may be illuminated with excitation light for exciting a fluorescence, and fluorescence light produced herein due to fluorescence occurring in the fluorescent dye may be detected so as to visualize particular tissue structures, types of tissue and tissue perfusion. A surgical microscope can be used to illuminate an object with excitation light and to detect fluorescence light.
A conventional surgical microscope comprises a first camera system for obtaining normal light images of an object, and a second camera system for obtaining fluorescence light images of the object.
One example of a fluorescent dye is indocyanine green (ICG) having a fluorescence spectrum in the range of infrared light.
The present invention has been accomplished taking the above technical problems into consideration.
It is an object of the present invention to provide a surgical microscope method allowing detection of fluorescence images.
It is a further object of the present invention to provide a microscopy method allowing detection of fluorescence images and normal light images.
According to embodiments, a camera system comprises an input port, a dichroic beam splitter and first, second and third camera chips, wherein the dichroic beam splitter is configured to direct red light received at the input port mainly towards the first camera chip via a first output port of the beam splitter, to direct green light received at the input port mainly towards the second camera chip via a second output port of the beam splitter, to direct blue light received at the input port mainly towards the third camera chip via a third output port of the beam splitter, and to direct infrared light received at the input port mainly only towards one of the first, second and third camera chips.
A conventional camera system including three chips for obtaining normal light images has a similar structure which is still different from the structure illustrated above. The conventional camera has a dichroic beam splitter configured to direct red, green and blue light to respective camera chips. The conventional camera further includes an infrared blocking filter to prevent detection of infrared light which is outside of the visible wavelength range. Properties of the dichroic beam splitter of the conventional camera are not defined with respect to infrared light.
However, in the embodiment described above, the properties of the dichroic beam splitter are defined such that the infrared light is supplied to merely one of the three camera chips. Compared to an embodiment, where infrared light is supplied to plural camera chips via the dichroic beam splitter, a comparatively good signal to noise ratio can be achieved by supplying the infrared light to merely one camera chip when detecting infrared light having a low intensity.
In the context of the present application, the definition that light of a particular wavelength is “mainly” supplied to one particular camera chip means that, in a situation where merely the light of the particular wavelength is supplied to the input port of the dichroic beam splitter, the particular camera chip detects an intensity which is substantially higher that an intensity of the particular wavelength detected by the other two camera chips together. For example, the intensity detected by the particular camera can be 1.8 times higher, or 2.5 or 3.0 times higher, than the sum of intensities detected by the two other cameras.
According to an embodiment, the dichroic beam splitter is configured such that the infrared light is mainly supplied to one of those camera chips to which the red light is not mainly supplied to. According to exemplary embodiments herein, the infrared light is mainly supplied to that camera chip to which also the green light is mainly supplied to. According to another exemplary embodiment, the infrared light is supplied to that camera chip to which also the blue light is supplied to.
In the context of the present application, blue light is light of a wavelength range from about 440 nm to about 490 nm, green light is light of a wavelength range from about 520 nm to about 570 nm, red light is light of a wavelength range from about 625 nm to about 740 nm, and infrared light is light of a wavelength range from about 800 nm to about 930 nm.
According to embodiments, surgical microscope comprises a first blocking filter which can be selectively disposed in an imaging beam path upstream of the dichroic beam splitter. The first blocking filter has a substantially higher transmittance for red, green and blue light than for infrared light. For example, the transmittance for red, green or blue light is ten times higher than the transmittance for infrared light. Infrared light is substantially blocked by the first blocking filter. In a first mode of operation, in which the first blocking filter is disposed in the beam path, the camera system is well suited to obtain normal light images, and in a second mode of operation, in which the first blocking filter is not disposed in the beam path, the camera system is suited to obtain infrared images.
According to embodiments, the camera system comprises a second blocking filter which can be selectively disposed in a beam path upstream of the dichroic beam splitter. The second blocking filter substantially blocks that light which is mainly supplied to that camera chip to which also the infrared light is supplied to.
In exemplary embodiments herein, the surgical microscope comprises an actuating system configured to position either the first blocking filter or the second blocking filter in the beam path. In the first mode of operation, in which the first blocking filter is positioned in the beam path, the camera system is capable to obtain normal light images, and in the second mode of operation, in which the first blocking filter is not disposed in the beam path, the camera system is capable to simultaneously obtain normal light images and infrared images.
According to embodiments, a surgical microscope comprises microscopy optics for optically imaging an object area onto at least one camera chip of a camera system to generate images of the object area, a display system to display the images to a user, and an illumination system to supply at least one illumination light beam to the object area. The camera system may be configured as illustrated above. The microscopy optics may be optics providing a variable magnification and/or a variable working distance. The microscopy optics may further provide a monoscopic or a stereoscopic beam path. The microscopy optics may further comprise one or more oculars into which a user may look in order to perceive an image of the object area. The display system displays images obtained by the camera system. The display system may comprise a cathode ray tube, an LCD display, an active matrix display and the like. The display system may be a head mounted display which can be attached to a head of a user. The display system may also be configured to display the images via oculars of the microscopy optics.
According to an embodiment, the microscope comprises a third blocking filter which can be selectively positioned in a beam path of an illumination beam. The third blocking filter blocks that light which is mainly supplied to that camera chip to which also the infrared light is supplied to. In an exemplary embodiment herein, there is provided an actuating system configured to position either the first blocking filter in the imaging beam path or the third blocking filter in the beam path of the illumination beam.
According to embodiments, a microscopy method comprises operating a surgical microscope in a first mode of operation and in a second mode of operation. In the first mode of operation, light comprising red, green and blue light is supplied to an object, and red, green and blue light emanating from the object is supplied to three camera chips, such that the three camera chips together may obtain a normal light image of the object. Herein, a filter blocking infrared light may be positioned in a beam path of the light, so as to prevent infrared light from being supplied to on one of the three camera chips, even if it is contained in light emanating from the object.
In the second mode of operation, light including light of a wavelength range from about 700 nm to about 790 nm is supplied to the object, and infrared light emanating from the object is mainly supplied to merely one of the three camera chips. If a filter blocking infrared light is positioned in the beam path in the first mode of operation, this filter is removed from the beam path in the second mode of operation.
According to exemplary embodiments, light with wavelengths greater than about 700 nm and smaller than about 805 nm is blocked upstream of the three camera chips in the second mode of operation.
According to exemplary embodiments, one of red light, green light and blue light is blocked upstream of the three camera chips in the second mode of operation.
According to further exemplary embodiments, at most two of red light, green light and blue light are supplied to the object in the second mode of operation.
According to an exemplary embodiment, a fluorescence of a fluorescent dye or a precursor of a fluorescent dye is observed in the second mode of operation. The fluorescent dye or precursor thereof may comprise indocyanine green (ICG).
According to a further exemplary embodiment, in the second mode of operation, infrared light emanating from the object is supplied to that camera chip to which the blue light or the green light is supplied to in the first mode of operation.
According to a further exemplary embodiment, the microscopy method is performed only in the second mode of operation.
According to a further exemplary embodiment, the red light, the green light and the blue light may be generated by a first light source, and light in a wavelength range from about 700 nm to about 805 nm may be generated by a second light source different from the first light source. The second light source may comprise an light emitting diode (LED) or a Laser diode. Thereby it is possible to adjust an intensity of the light supplied to the object from the first light source and independently of an intensity of light supplied to the object from the second light source, allowing for an adjustment of the relative intensities depending on circumstances.
In the following description, the present invention is explained in more detail with respect to special embodiments and in relation to the accompanying drawings, in which
In the exemplary embodiments described below, components similar in function and structure are indicated as far as possible by similar reference numerals.
A partially transmissive mirror 21 is disposed in the partial beam bundle 15 to branch off a part of the light of the beam bundle 15 to form beam 23 which is supplied to a camera system 25.
In the following, the camera system 25 is described in greater detail with reference to
In
As it is shown in
In a first mode of operation, which is shown in
The illumination system 51 comprises a light source 53, which can be, for example, a halogen lamp, a xenon lamp or some other suitable lamp. The illumination system 51 may further comprise a reflector 54 and a collimator 55 to shape a collimated beam 56 of light supplied to an end 61 of an optical fiber bundle 63 by one or more lenses 59 in order to couple light generated by light source 53 into the fiber bundle 63. The light is transmitted by the fiber bundle 63 to a vicinity of the objective lens 5, emanates from an end 65 of the fiber bundle 63 and is collimated by collimating optics 67 to form an illumination light beam 69 which is directed to the object 9 under examination.
The illumination system 51 further comprises a filter plate 71 including two filters 73 and 75 which are disposed adjacent to each other. The two filters 73 and 75 can be displaced by an actuator 77 along a direction indicated by the double arrow 79 in
The light emanating from the object 9 is detected by the camera system 25, wherein the camera chips 35, 36 and 37 detect red light, green light and blue light, respectively. Image signals generated by the camera chips 35, 36 and 37 are supplied to the controller 101 via lines 124. The controller 101 generates image data of a combined color image based on the supplied image signals. These image data can be displayed on a display.
The display may, for example, include a monitor 103 connected to the controller 101 to display a microscopic color image of the object 9. The display may, for example, include an LCD display 104 to generate a representation of the image. The representation is transmitted by optics 105 and superimposed with the beam path of the imaging optics 3 via a partially transmissive mirror 107, such that the user may see, by looking into the ocular 17, the image displayed on the display 104 in superposition with the optical image of the object 9 transmitted via the beam 15 from the objective lens 5 to the ocular 17.
A partially transmissive mirror 81 or a prism branches off a part of the light of the beam 14, which is then supplied to a second camera system 83 comprising a dichroic beam splitter 84 and three camera chips 85, 86 and 87, to which red light, green light and blue light is supplied to by the dichroic beam splitter 84. An infrared blocking filter 88 is permanently positioned in a beam path upstream of an input port of the dichroic beam splitter 84. Output signals of the camera chips 85, 86 and 87 are transmitted to the controller 101 via signal lines 89.
The display may include, for example, a head mounted display 113, which can be attached to a head of a user by an attachment band 111 or the like and comprises a display 114 for a right eye of the user and a display 115 for a left eye of the user. The head mounted display is connected to the controller 101 via a signal line 112. The controller 101 supplies the image data obtained by the camera system 25 to the display 114 and the controller 101 supplies the image data obtained by the camera system 83 to the display 115, such that the user can perceive a stereoscopical image of the object 9 via the display 113.
The user may instruct the controller 101 to change the mode of operation from the first mode of operation to the second mode of operation by a suitable command. The command can be supplied to the controller 101 via an input device, such as a button 121, a keyboard or a microphone receiving a corresponding voice signal, or some other input device and method.
Upon receipt of a signal indicating a desired change of the mode of operation, the controller 101 controls the actuator 45 via line 123 to remove the first blocking filter 27 from the beam 23. In the illustrated example, the first blocking filter blocks infrared light, and as the first blocking filter is removed from the beam in the second mode of operation, the camera system 25 can also obtain infrared images.
Further, the controller 101 controls the actuator 77 such that the second blocking filter 75 is positioned in the beam 23 and filter 73 is positioned outside of the beam 56. In the illustrated embodiment, the blocking filter 75 is a fluorescence excitation filter configured to allow merely such light to traverse the filter which is capable of exciting a fluorescence of a fluorescent dye or a precursor thereof chosen beforehand. Such excitation light is included in a frequency spectrum generated by the light source 53 and may traverse the filter 75 to be supplied to the object 9. The fluorescent dye or precursor thereof may, according to an example, comprise indocyanine green (ICG). Fluorescence light generated by the fluorescent dye comprises light of an infrared wavelength range and is imaged by the microscopy optics 3 onto the camera chips of the camera system 25. Since the filter 27, which is an infrared blocking filter in the illustrated example, is removed from the beam 23 in the second mode of operation, supply of infrared light to the camera system 25 is not prevented, and the camera system can detect a fluorescence image of the object 9, accordingly.
As explained above, the dichroic beam splitter 33 is configured to supply infrared light to merely the one camera chip 36, such that the camera chip 36 can detect the fluorescence image of the object 9. The detected fluorescence image may have relatively high signal-to-noise ratio, even if the generated infrared fluorescence light has low intensity.
The fluorescence image is transmitted to the controller 101 via lines 124 and may be displayed via the display 104 as a visual image, such that the user may perceive the infrared image as a visual image when viewed by the ocular 17. Likewise, the controller 101 may display the infrared image on the display 103 or on the displays 114, 115 of the head mounted display 113. The infrared image may be displayed as a greyscale image, wherein brighter grey values represent higher infrared intensities. For example, a maximum infrared intensity may be represented by the color white. It is also possible to display the infrared image inverted to this, wherein darker grey values represent higher infrared intensities.
A continuous line 151 in
A line 154 in
These transmission characteristics of the dichroic beam splitter 33 are very schematically illustrated by the lines 154, 155 and 156 in
In
In
In
Due to the presence of the filter 75 in the illumination beam path in the second mode of operation, green light is substantially not contained in the illumination light in the second mode of operation for detecting fluorescence. This gas a consequence, that green light is substantially not supplied to the camera chip 36. However, camera chip 36 may detect infrared light which is generated by the fluorescence, such that the controller 101 may obtain an infrared fluorescence image of the object by the camera system 25. The infrared image is mainly detected by the camera chip 36 which is arranged to also detect the green light.
In the above explained embodiment, the dichroic beam splitter 33 is configured to supply the infrared light to camera chip 36 to which the green light is also supplied to. However, it is also possible to modify the dichroic beam splitter 33 so as to supply the infrared light to the camera chip 37 to which the blue light is also supplied to. Consequently, the blue light is removed from either the beam path 23 upstream of the input port 31 of the dichroic beam splitter 33 or from the beam path upstream of the object 9.
In the illustrated example, the first blocking filter 27 is positioned in the beam 23 upstream of the input port 31 of the dichroic beam splitter 33 of the camera system 25. However, the first blocking filter can be omitted in other examples of the surgical microscope.
The surgical microscope illustrated in
The second blocking filter 28 is positioned in the beam 23 in the second mode of operation in which an infrared image is detected by the camera system 25. As illustrated above with reference to
In the embodiment illustrated with reference to
This camera system 25 can be used in two different modes of operation: In the first mode of operation, in which blocking filter 27 is disposed in the beam path upstream of the dichroic beam splitter 33, the camera system 25 detects the (complete) normal light image, wherein blocking filter 27 prevents infrared light from being supplied to camera chip 36. In the second mode of operation, in which the second blocking filter 28 is disposed in the beam path upstream of the dichroic beam splitter 33, the camera system 25 detects both the infrared image and the incomplete normal light image, wherein the second blocking filter 28 prevents green light from being supplied to the camera chip 36.
The surgical microscope 1 comprises a filter 76 connected to an actuator 78 which is controlled by the controller 101 via a signal line 122. The actuator 78 is configured to position the filter 76 under the control of controller 101 outside of the illumination beam 56 in the first mode of operation and in the illumination beam 56 in the second mode of operation. The filter 76 is a blocking filter configured to block green light and to not block red light, blue light and light suitable for exiting a fluorescence.
In the first mode of operation, the filter 76 is not positioned in the beam 56 such that white light is supplied to the object. The filter 27 is positioned in the beam path upstream of the camera system and prevents infrared light from detection by the camera chip 36. The three camera chips 35, 36 and 37 detect a (complete) normal light image of the object 9 in the first mode of operation, accordingly.
In the second mode of operation, the filter 76 is positioned in the beam 56, such that green light is not supplied to the object 9. In this mode of operation, green light does substantially not emerge from the object 9 and is substantially not contained in the light of beam 23 supplied to the camera system 29. Therefore, the camera chip 36 does substantially not receive any green light. The camera chip 36 may then detect the infrared image as illustrated above.
The camera system 83 which is used in the embodiments illustrated above with reference to
In the embodiments illustrated above, the camera chip receiving the green light image in the first mode of operation is also the camera chip receiving the infrared image in the second mode of operation. It is to be noted that also other camera chips, such as the camera chip receiving the blue light in the first mode of operation and the camera chip receiving the red light in the first mode of operation, may be arranged to also receive the infrared light in the second mode of operation wherein the camera chip receiving the green light in the first mode of operation does not receive the infrared light in the second mode of operation.
A further embodiment will be illustrated with reference to
According to this embodiment, the filter 75, which is positioned in the beam of the illumination system 51 in order to excite the fluorescence in the second mode of operation, has a transmission characteristic which is different from the transmission characteristic according to line 158 in
In the context of the embodiments described so far, it is further possible to combine several pixels, for example, 2, 4 or more pixels of the camera into groups and to accumulate the radiation intensities detected by the grouped pixels in order to obtain an intensity value of an image element of the detected image. Conventionally, such a procedure is called “pixel-binning” and serves to obtain a better signal to noise ratio in the entire image when merely low light intensities received by each individual pixel of the camera chip occur.
The embodiments described above may be further modified by exciting the fluorescent dye with a light source, for example, a light emitting diode (LED) or a laser diode, which is different from the light source generated by the normal illumination light. Therefore, relative intensities of fluorescent and non-fluorescent parts of tissue under examination may be controlled independently from each other and may be adjusted to the individual needs of the user.
While the present invention has been shown and described herein in what is believed to be the most practical and preferred embodiments, it is recognized that many alternatives, modifications, and variations will be apparent to those skilled in the art. Accordingly, the exemplary embodiments of the invention set forth herein are intended to be illustrative and not limiting in any way. Various changes may be made without departing from the spirit and scope of the present invention as defined in the following claims.
Number | Date | Country | Kind |
---|---|---|---|
10 2008 062 650 | Dec 2008 | DE | national |
Number | Name | Date | Kind |
---|---|---|---|
4045772 | Bouton et al. | Aug 1977 | A |
5507287 | Palcic et al. | Apr 1996 | A |
5590660 | MacAulay et al. | Jan 1997 | A |
5682038 | Hoffman | Oct 1997 | A |
5827190 | Palcic et al. | Oct 1998 | A |
6198147 | Connolly | Mar 2001 | B1 |
6899675 | Cline et al. | May 2005 | B2 |
7580185 | Haisch et al. | Aug 2009 | B2 |
7645971 | Gouch | Jan 2010 | B2 |
7720272 | Armogida | May 2010 | B2 |
20020103439 | Zeng et al. | Aug 2002 | A1 |
20040109231 | Haisch et al. | Jun 2004 | A1 |
20070077609 | Gambhir et al. | Apr 2007 | A1 |
20080251694 | Tanimoto et al. | Oct 2008 | A1 |
20090292168 | Farr | Nov 2009 | A1 |
20100182418 | Jess et al. | Jul 2010 | A1 |
Number | Date | Country |
---|---|---|
695 18 915 | Apr 2001 | DE |
696 23 523 | Jul 2003 | DE |
103 39 784 | Mar 2004 | DE |
102 51 151 | May 2004 | DE |
10 2005 005 253 | Nov 2005 | DE |
698 34 963 | Jan 2007 | DE |
10 2008 004 596 | Jun 2008 | DE |
0 820 104 | Jan 1998 | EP |
1 731 087 | Dec 2006 | EP |
1 403 675 | Jan 2007 | EP |
2 075 616 | Jan 2009 | EP |
2 254 417 | Jul 1992 | GB |
2004-520105 | Jul 2004 | JP |
WO 9418593 | Aug 1994 | WO |
9901749 | Jan 1999 | WO |
0250518 | Jun 2002 | WO |
WO 2005034747 | Apr 2005 | WO |
2007085496 | Aug 2007 | WO |
Entry |
---|
US 6,692,429, 02/2004, Imaizumi et al. (withdrawn) |
European Search Report and Search Opinion of EP Patent Application No. 09015577.1, mailed Mar. 17, 2010, 7 pages total. |
European Office Action issued in corresponding European Application No. 09 015 577.1 dated Jan. 7, 2013. |
Japanese Office Action in corresponding Japanese Application No. 2009-286310 mailed Oct. 8, 2013. |
Number | Date | Country | |
---|---|---|---|
20100182418 A1 | Jul 2010 | US |