(1) Field of the Invention
The present invention relates to a method and apparatus for the controlled actuation of a microscope, in general, and to controlled actuation of a laser scanning microscope having multiple light sources, in particular.
(2) Description of Related Art
Confocal microscopy is, among other things, the tool for defined controlled actuation of micro-objects. Based on that, numerous methods for examination and influencing of microscopic objects were proposed, thus, for instance, by Denk in U.S. Pat. No. 5,034,613, by Liu in U.S. Pat. No. 6,159,749, or by Karl Otto Greulich in “Micromanipulation by Light in Biology and Medicine” in 1999.
A combination comprising an image-forming point scanning or line scanning system and a “manipulator” system is increasingly finding more and more interest in the professional circles.
The interest in the observation and analysis of fast microscopic processes has brought forth new devices and methods (for example Carl Zeiss Line Scanner LSM 5 LIVE), which, in combination with the above mentioned methods of manipulation, lead to new insights. Thereby, the simultaneous microscopic observation of radiation-induced manipulation of the samples with spatial resolution by means of a suitable imaging system stands especially in the foreground (See for example U.S. Pat. No. 6,094,300 and DE 102004034987 A1). Therefore the modern microscopes attempt to offer as many flexible and optically equivalent decoupling and coupling ports as far as possible (See: DE 102004016433 A1).
The availability at the same time of at least two coupling ports for independent scan systems is thereby of special importance in order to avoid limitations in the temporal resolution due to the slowness of mechanical switching processes. Besides the tube interface, other coupling ports on the sides of the microscope stand are possible (preferably in the extended infinite space between the microscope objective and the tube lens; the so-called “sideports”) as well as on the rear side of the stand (typically optically modified incident light axis or transmitted light axis with suitable tube lens; the “rearports”) as well as on the bottom side (the “baseport”).
Thereby, arrangements with a common direction of the incident light (either reflected or transmitted light) or with a direction opposite to incident light (transmitted light and reflected light) are possible in principle. Apart from the viewpoint of the applicability, a common direction of incidence is frequently preferred from the device-technical viewpoint.
In that case, use of at least one element is necessary, which combines the beam paths of both devices in the space between the scanners of the scan systems that are to be operated simultaneously and the objective. Thereby, according to the state-of-the-art, a diverse variety of beam-combining elements are conceivable, such as, for example, the optomechanical components, like suitably coated beam combiner flat plates and beam combiner wedges, beam combiner cubes and polarization splitters. Conceivable are further beam combining acousto-optical modulators and deflectors.
In the following, reference is made in particular to DE 102004034987 A1, which is incorporated by reference herein as if reproduced in full and which forms a part of the subject matter of the present publication.
a shows schematically the design of a device system, which enables simultaneous operation of a manipulating and an imaging scan module in a microscope stand. The modules provided with a common actuation control system (control system, PC) and the laser or the laser modules are connected optically and controllably with both the scan modules.
In
In a preferred embodiment, the electronic actuation of the microscope stand and the coupled manipulation and the imaging module are suitably equipped using a real-time electronic control system with an integrated real-time computer for the processing of the high data rates. Thereby, such embodiments are conceivable in which the scan systems of the manipulations and the imaging modules coupled with the microscope stand can be actuated in synchronous or asynchronous manner. Thus simultaneous scan modes of both the modules are possible in which manipulation and imaging in the different regions of the sample (ROIs; “regions of interest” DE19829981 C2) with variable scanning rates takes place as in
Both for the manipulating system as well as for the imaging system, the useful spectral range can be extended, depending on the respective application, from the ultraviolet to the infrared spectral range. Manipulation wavelengths typically found in the applications are, for instance, 351, 355 and 364 nm (photo-uncaging), 405 nm (photoconversion, Kaede, Dronpa, PA-GFP), 488 and 532 nm (photobleaching, FRET, FRAP, FLIP) as well as 780-900 nm (multiphoton bleaching, for example MPFRAP, 2-photon uncaging; and direct multiphoton stimulation).
Since in many applications, both the manipulating as well as the imaging system employ the same laser wavelengths, it is reasonable to feed both the scan modules with a common laser source. In DE 102004034987 A1 different suitable arrangements for variably adjustable division of the beam between two independent scan modules are described:
The present invention relates to a method and apparatus for actuation control of a microscope, in particular of a Laser Scanning Microscope, in which, at least one first illumination light, preferably moving at least in one direction, as well as at least one second illumination light moving at least in one direction, illuminate a sample through a beam combiner. A detection of the light coming from the sample takes place. At least one part of the illumination light is generated through the splitting of the light from a common illuminating unit. A common control unit accomplishes a controlled splitting of the illumination light into the first and the second illumination lights. The intensity of the first illuminating light, as specified by a user or specified automatically, is assigned a higher priority (is prioritized) compared to the specified value for the second illumination light, and an adjustment for the second illumination light takes place until a maximum value is obtained, which is determined by the value specified for the first illumination light.
a is a schematic diagram of system which enables simultaneous operation of a manipulating and an imaging scan module in a microscope stand;
b is a schematic drawing of an inverse microscope stand;
c is a schematic diagram illustrating regions of interest and variable scanning rates;
a-7c are flow charts illustrating implementation of actuation control;
a-8c are schematic diagrams showing the derivation of a beam combiner design embodying the present invention;
In describing preferred embodiments of the present invention illustrated in the drawings, specific terminology is employed for the sake of clarity. However, the invention is not intended to be limited to the specific terminology so selected, and it is to be understood that each specific element includes all technical equivalents that operate in a similar manner to accomplish a similar purpose.
If the manipulating as well as imaging systems compete for the power of the laser line in such a manner that it is as high as possible in the simultaneous operation in this type of microscope system, it is an advantage if the power requirement of the imaging system has a higher priority compared to the manipulator module. In commercial laser scanning microscope systems with only one scan module, typically the laser power for the manipulation process and the subsequent imaging can in each case be adjusted through the operating interface of the control software. This takes place, for example, using the corresponding software slider. In contrast to that, in the methods for simultaneous, variably tunable division of a laser line between two independent scan systems, shown in
According to the invention, the beam-splitting ratio as well as the subsequent intensity modulation are so optimally adjusted that, on one hand, the laser power requirement of the imaging system is fulfilled (higher priority) and, on the other hand, the manipulating system also receives laser power that is as high as possible at the same time. This makes it necessary to provide a method for optimal management of the laser power that is as automatic as possible, in which the user of the device only needs to define the laser powers necessary for imaging and manipulation in the customary manner (as in LSM systems with only one scan module) and, against that, the control software takes care on its own of the optimal tuning of the components shown in
Implementation of this principle of the actuation control, shown in the flow charts in
This principle is explained as follows on the basis of the variable splitting of the beam by means of a rotatable λ/2-plate and intensity modulation of the two split partial beams by means of an AOM (acousto-optic modulator).
The AOMs correspond, for instance, to the attenuators in the beam paths to the manipulator or the line scanner shown in
The principle of the controlling actuation shown generally in
As already explained above, in most of the applications, the power for the light required by the imaging system has the first priority. The imaging system (for example the line scanner in
The software slider in the operating software represents (analogous to the software interface of “stand alone” LSM systems) the total power for the light demanded by the respective scan module (image forming as well as manipulating systems). Screenshots of a user interface for the user are shown in
P
ideal,Master
=R
λ/2
·T
AOM,Master
P
actual,Slave
=T
λ/2
·T
AOM,Slave
1≦Pactual,Master+Pactual,Slave
1≅Rλ/2+Tλ/2
whereby Rλ/2 and TAOM represent the part of the light reflected by the polarization beam splitter cube and the part of the light transmitted by the AOM. Thereby the designations “Master” and “Slave” stand for the “imaging” or the “manipulating” scan system. The “Master” part of the imaging system after the polarization beam splitter (Rλ/2) is obtained here from the angular position Θ of the λ/2-plate
R
λ/2=cos2(2θ)
In the present invention, the strategy for the control is so arranged as in
Pideal is the value specified by the user, on response yes to the comparison in the first box, it goes to the next query, on response no, the attenuator (AOM) of the master part must be adjusted.
In the next comparison, on no, the lambda half plate of the master system is adjusted, on yes, the attenuator (AOM) of the master system.
However, in the control, the power demanded by the manipulating system (“Slave”) comes to an expression as in
To illustrate the actuation control processes shown in
The examples 1)-5) follow successively one after the other, whereby the reaction without the manipulating system is described first (ref.
1) Imaging 100%, manipulation 0%, →Rλ/2=1, TAOM, Master=1, Tλ/2=0
2) Imaging 50%, manipulation 40%
Final result: Tλ/2/2=0.4→Rλ/2=0.6→TAOM, Master=0.83, TAOM, Slave=1.0
3) Imaging 50%, manipulation 70%
Final result: Tλ/2=0.5→Rλ/2=0.5→TAOM, Master=1.0, TAOM, Slave=1.0, PSlave=0.5 (instead of 0.7)
4) Imaging 10%, manipulation 40%
Final result: Tλ/2=0.5→Rλ/2=0.5 →TAOM, Master=0.2, TAOM, Slave=0.8, PSlave=0.4
5) Imaging 10%, manipulation 70%
Final result: Tλ/2=0.7→Rλ/2=0.3→TAOM, Master=0.33, TAOM, Slave=1.0
The generalized principle of the control shown in
Neutral combiners (for example T20/R80) can be employed universally as beam combiners for most diverse varieties of applications and, in addition to that, enable applications in a simple manner, in which the same laser wavelengths can be used in simultaneous operation, both of the imaging system as well as of the manipulation system (in particular photobleaching, FRET, FRAP, FLIP). On the other hand, neutral combiners often represent a compromise, especially when the same laser line is used simultaneously for the manipulation as well as for the imaging, between the branching ratio for the respective laser wavelength, on one hand, and maximizing the signal efficiency in the range of the detection wavelength, on the other hand. Therefore, this demands an optimal design for the beam combiner, which is explicitly optimized for simultaneous operation of a manipulating and an imaging system for the same laser wavelength.
It is evident from
a-8c elucidate the derivation of a beam combiner design, which is designed especially for simultaneous operation of a manipulating system and an imaging system with the same laser wavelength distributed with a variable ratio. In this way, a comparison is done with the ideal mirror (
b shows a microscope system, which enables simultaneous use of a manipulator arranged in the direction of transmission and an imaging system arranged in the direction of reflection. In use, the laser wavelength λ, split variably between the two scanning systems, is used both for the manipulation of the sample as well as for the fluorescence excitation, whereby the total laser power of the common source of light is again 1. In use, the superposition, accurate to the pixel, of the optical axes of the two scanning systems take place by means of a neutral beam splitter, which exhibits a constant reflectivity RNV<1 in the spectral range of interest. Thus, in the imaging, both the excitation light of wavelength λ as well as Stokes-shifted fluorescence signal of wavelength λFL is reduced in each case by factor RNV. The power requirement of the imaging “Master” system (See
P
NV,imag
=P
0,imag/(RNV)2.
The remaining laser power (1−PNV, imag) of the common source of light of wavelength λ is thus available to the manipulating “Slave” system according to the actuation control schema in
P
NV,mani,sample=(1−PNV,imag)*(1−RNV)
The optimal reflectivity RNV of the neutral beam combiner is obtained by maximizing the resulting manipulating laser power in the object plane PNV, mani, sample for the same fluorescence signal intensity as in the layout in
P0,imag=0.08 (8% excitation power for the embodiment 8a.) RNV=0.4939
PNV, mani, sample=0.3401
c now shows a beam combiner design optimized compared to such a neutral combiner. Let this beam combiner have reflectivity RSV<1 for the manipulation and fluorescence excitation wavelength λ, whereas let the reflectivity be RFL in the fluorescence wavelength range λFL, which is as nearly equal to 1 as possible. In the calculation of the power requirement of the imaging “Master” system, again let the losses appearing on the excitation and the emission side be taken into account, which are compensated by the correspondingly increased laser power Psv, imag of the imaging module. Thereby the laser power incident on the beam combiner is reduced by factor RSV, whereas the reverse fluorescence signal is reduced by factor RFL. Therefore, in order to detect the same fluorescence signal intensity as in
P
SV,imag
=P
0,imag/(RSV*RFL)
The remaining power (1−PSV,imag) of the common light source of wavelength λ is thus available to the “slave” manipulation system according to the actuation control principle shown in
P
SV,mani,sample=(1−PSV,imag)*(1−RSV)
The reflectivity RSV of the beam combiner for the excitation and manipulation wavelength λ is now to be so optimized that for a given fluorescence reflectivity RFL (in the ideal case as nearly equal to 1 as possible) and the same fluorescence signal intensity as in the embodiment 8a, a highest possible manipulation laser power PSV, mani, sample in the object plane is obtained. Analytically one obtains the optimum for:
[RSV]opt=(P0,imag/RFL)1/2
In
Po,imag=0.08 (8% excitation power for the embodiment 8a.), RFL=0.85 RSV=0.3068 and Psv, mani, sample=0.4805
For the same fluorescence signal intensity in the imaging system, one thus obtains, using this beam combiner, about 30% higher manipulation laser power in the sample—compared to the optimized neutral combiner of the embodiment 8b.
If in contrast to the devices shown in
To generalize, an optimized beam combiner design for the superposition of the optical axes of two independent scanning systems is required, in which both the modules are operated with at least one common laser wavelength λ. Thereby, at least one of the two scanning systems is designed as an imaging system and its power requirement is assigned higher priority compared to the other scanning system in such a manner that the detected fluorescence signal intensity is comparable with the corresponding “stand alone” system. For the wavelength(s) λ commonly used by both the systems, the branching ratio of this beam combiner is so selected that for a given fluorescence signal intensity, which would correspond to the typical intensity in a “stand alone” scanning system for free passage of the beam without a beam combiner, laser power that is as high as possible in the sample plane is obtained for one scanning system. Outside the common wavelength(s) λ used by the two scanning systems, the beam combiner is so designed that it is either only reflecting or transmitting as far as possible. The optimized spectral design of this beam combiner corresponds therefore to a “bad” bandpass filter in transmission or reflection.
In other words, as the control variables for the method according to the invention serve the grade of the reflectivity (Rsv, Rfl) or the transmission of the corresponding beam combiner for the excitation beam and fluorescence beam in the imaging system with respect to the proportion of the manipulation system or if specific power is given, the selection of a suitable beam combiner is optimized as the control variable.
In
Outside the bandpass range of 488 nm, the beam combiner is as reflecting as possible as in
The described invention relates in a general sense to any type of imaging and manipulating system. Besides the (confocal and partially confocal) point and line scanners, it can also be of relevance in particular in multifocal laser scanning systems (for example, those based on lens arrays, diode laser arrays, with any type of beam splitting arrangement) and spinning disk systems/Nipkow systems. Further, in the present invention, the sample can be scanned with a scanning method according to current state-of-the-art. Thereby, one of the following can be the underlying scanning principle of the device for the deflection of the beam in the imaging or the manipulating system:
However, since both the scanning systems must be independent of each other in the sense of this invention, a mechanical x- and y-adjustment of the sample is not admissible.
Besides the use of microscope systems with coherent light sources (lasers) and confocal or partially confocal scan modules, an advantageous application of the invention in analogous manner is conceivable also in the simultaneous manipulation of the sample and/or the imaging with the help of (structured) wide-field illumination systems with incoherent light sources.
Modifications and variations of the above-described embodiments of the present invention are possible, as appreciated by those skilled in the art in light of the above teachings. It is therefore to be understood that, within the scope of the appended claims and their equivalents, the invention may be practiced otherwise than as specifically described.
Number | Date | Country | Kind |
---|---|---|---|
10 2006 034 914.8 | Jul 2006 | DE | national |
The present patent application is a continuation of Application Ser. No. 11/783,290, filed Apr. 6, 2007, which is incorporated herein by reference in its entirety.
Number | Date | Country | |
---|---|---|---|
Parent | 11783290 | Apr 2007 | US |
Child | 12578202 | US |