The present application is a U.S. National Stage application of International PCT Application No. PCT/EP2011/001320 filed on Mar. 17, 2011 which claims priority benefit of German Application No. DE 10 2010 013 829.0 filed on Mar. 26, 2010, the contents of each are incorporated by reference in their entirety.
The invention relates to microscopy for optical examination, in particular in highly scattering media with limited depth of penetration, in particular biological samples.
The foregoing references are discussed in the text below.
Various methods are known to limit interference with the detection signal by sample scattering. One such method is Multiphoton microscopy (EP500717 B2). In this application pulsed laser beams are used to excite multiple photons. The lasers used are very expensive. There are application restrictions in this method. For example, these include the selection of dyes and high sample load.
Focal modulation microscopy (FMM) is another method to limit interference, as published, for example, in above references [1] and [2]:
In FMM, half of the excitation laser beam (in diameter) is phase modulated. This semi-lateral phase modulation results in intensity modulation in the focal volume when focused through the objective of a microscope. This intensity modulation can be detected after the confocal pinhole array, for example, by lock-in detection. The advantage of this method is that only the ballistic, i.e. unscattered, photons contribute to this modulation signal; multiply scattered photons in highly scattering media lose the fixed phase relationship. Accordingly, scattered photons do not contribute to the lock-in demodulated signal, which strongly reduces the scattered light background (both in excitation and detection) and increases the penetration depth of a confocal laser scanning microscope.
Hitherto, mechanical approaches have been used for phase modulating half the laser beam. In reference [1], the laser beam is directed onto a divided mirror, one half of which is moved relative to the other half using a piezo element.
In reference [2], half of the beam is guided through a glass plate that is located on a galvanometer seamier. The phase of the one beam half is modulated relative to the other by rotating this plate.
The basic problem of all mechanical approaches (other than adjustment, etc.) is the low modulation rate that is limited by the mechanical resonance frequency of the actuators used (5-20 kHz for references [1] and [2]). Since the lock-in detection method requires a minimum number of modulation periods per pixel dwell time (5-10 minimum), the image recording rate is severely limited.
It is an object of the invention to avoid the disadvantages of the prior art.
This object is achieved by the methods and microscopes according to the annexed claims.
Electro-Optical Modulator (EOM):
According to the invention, EOMs are used for particularly fast, non-mechanical phase modulation of at least a portion, preferably half, of the excitation beam.
A portion of the excitation beam may run via the EOM, or the EOM may be modulated in a section in which the excitation beam runs.
Of particular advantage, different beam sections or halves are modulated differently (anti-phase) by opposite-poled triggering of parts of an EOM or by several EOMs.
Electro-optical modulators utilize the Pockels effect in a birefringent crystal where the polarization or phase of the laser light is changed by applying a voltage. Depending on the type and size of the crystal, this process may be very fast (up to several 10 MHz).
The embodiments described below show how this can be favorably utilized for FMM microscopy: (a) EOM crystal with respective beam widening and collimated laser beam half illuminated (
A fundamental important advantage of all EOM-based solutions is the greatest possible modulation rate of several 10's of MHz.
The invention will be described in connection with the following annexed drawings.
a)-c) show top views of the EOM plane with the laser beam L shown hatched.
In accordance with references [1] and [2], the EOM is in the illumination beam path, in a widened (collimated) section of the beam.
The magnitude of the beam widening can be used to adjust the beam cross section to the crystal size.
In
In
In
This may be advantageous for preventing stray fields (EOMs require high voltages).
An embodiment with anti-phase polarization may be advantageous, for example, when the crystal should not be modified but crosstalk effects from one side to the other are avoided. Anti-phase control also doubles the stroke distance (distance of the opposing amplitudes) compared to single-phase control; for a desired phase difference (stroke), the crystal could also be shortened (shortened run length). The offset arrangement of the triggered regions of the EOM also allows an overlap of the two beam areas (beyond half).
It is interesting that anti-phase control is also an advantageous development of Chen [1]—a second piezo drive could be installed for the second beam half, wherein both piezo drives could be operated at opposite phases.
An effect of offset along the beam as shown in
Application of acousto-optical modulators (AOMs) in FMM:
According to the invention, acousto-optical modulators are used in order to modulate the excitation beam in interaction with a splitting together with elements that split the beam into several partial beam paths and with optical elements for partial phase modulation of the excitation beam and advantageously with actuators for setting the phase difference.
Acousto-optical modulators use the diffraction of the laser beam at a standing sound wave in a crystal for fast deflection or switching of a laser. This effect can be used as follows for fast phase modulation of half the laser beam if the deflection of the beam is used accordingly:
For example, the phase shift can be set by changing the optical path length using a piezo actuator at one of the deflecting mirrors and thus be adapted to different wavelengths.
AOMs do not switch as fast as EOMs (due to the speed of acoustic propagation in the crystal) but they are more cost-effective. At 1-10 MHz, the potential switching rates are still clearly higher than any rates that can be achieved using mechanical or electromechanical elements.
In
b) is similar to
Both parts of
A is an acousto-optical deflector that switches a beam at a frequency ω between two angular directions in which a through beam Sd and a deflected beam Sa run, wherein Sa is guided on a deflected route via mirrors m1, m2, m3.
The plate P in 2a) is a semicircular glass plate used to phase modulate half the full beam Sa of the deflected route on half, while the through beam is not phase modulated; the two beams are superimposed again at BC where they obtain a half modulated beam Sm. The absolute phase of the upper deflected beam can be set using a mirror mounted on a piezo actuator (PZT) (slow, DC). The AOM performs fast modulation by switching between the beam paths.
The piezo element PZT in
In 2b), no phase plate is provided in Sa but instead at BC there is a semicircular, reflective part and an open semicircle (half aperture plate); i.e., the reflective portion is effectively phase-shifted by the length difference of the beam paths (adjustable by the actuator PCT) and after BC, the beam Sm has two phase-shifted halves that are superimposed at the focus.
The modulation methods described herein can be used directly together with a fast lock-in amplifier for FMM microscopy as described in above cited references [1] and [2].
But they are also suitable for detection methods described below with reference to
These methods can also be used for multi-spot scanning electron microscopes if the modulator is placed in the pupil or a conjugated plane.
Embodiments in the detection part of an FMM arrangement:
Optical modulators are used, according to the invention, for demodulation in detection, or the operational principle of the detectors is used for demodulation.
The figure further shows optical modulators m1, m2, an element Ph for phasing, a filter F, a focus modulator FM, and a subtraction operator O−.
The laser L for fluorescence beam excitation is modulated at a frequency ω using a focus modulator (FM) as shown, for example, in
The fluorescence radiation of the sample (P) that is reflected from the dichroic (D) and now also modulated by ω is phase-sensitively detected by two detectors d1 and d2 via a 50/50 beam splitter (BS). Another modulator m may be inserted upstream of d1 and d2, respectively (m1, m2 in
The smoothed-out signals (filter F, e.g. integrator) are then subtracted from one another (operator O−).
The modulators m1, m2 may be optical modulators such as EOMs.
M1 is directly modulated and m2 is subjected to a phase shift using Ph; therefore, two partial signals that comprise a phase difference (delta phi) between one another are detected, mixed, and filtered using a low-pass filter; so optical demodulation with a set relative phase, ideally 90 degrees between the two detection components, is performed to subtract the states with an intact focus from the shifted states in which the focus is disturbed through destructive interference (—Operator). In this way, the out-of-focus background (scattered light) is subtracted from the signal from the focus on each pixel.
In
The detectors d1 and d2 can be switched on and off at the frequency ω (and set phase shift), for example.
The top portion of
In
In
In-phase subtraction of the two signals in accordance with
Optical modulation in the detection beam path:
According to the invention, beam switching by AOM is used for demodulation.
But here, switching between detectors d1 and d2 takes place, preferably by an AOM (A), similar to
Once again, and as shown and explained above, the in-focus and out-of-focus signals are subtracted and sent through a low-pass filter.
Since no beam splitter is used, there is no loss of half the signal intensity.
The phase difference can be set using Ph.
Wide-field microscope with background suppression
Surprisingly, and according to the invention, the individual foci of a foci distribution, produced, for example, by a spinning micro-lens disc or multi-spot generation as described in U.S. Pat. No. 6,028,306, which is made an integral part of the disclosure of this patent application, are subjected to an intensity modulation according to the FMM method, either jointly or by arranging a half-space phase mask according to the FMM method, especially as described above, in a pupil plane of the objective or by individually manipulating each partial beam using the FMM method, or by jointly manipulating a beam and subsequent splitting of said beam as described in DE 199 04 592 C2, U.S. Pat. No. 6,219,179.
The modulation and demodulation methods described above for a point-scanning system can be applied to a wide-field fluorescent image, for example, as described below.
A microscope setup as shown schematically in
b) shows an example of discrete demodulation with 4 partial images (from above reference [4]).
A spinning micro-lens disc such as in a Yokogawa wide-field scanning module (see above reference [3]) is brought into the vicinity of an intermediate image plane such that the foci of the micro-lenses are projected through the objective into the sample. Each of these foci now has to be intensity-modulated as described above or in references [1] and [2]. To achieve this, a modulator can be brought into the pupil of the illumination beam path as described above. The phase modulation that takes place there subjects all foci to a corresponding intensity modulation in the sample.
Wide-field detection must be performed in-phase to utilize the advantageous scattered light suppression of the method. This can be done using a trigger-ready image intensifier (such as in reference [6]): the latter can be switched very fast and acts as a fast gate that is modulated during the comparatively long image-taking time of the conventional CCD or CMOS camera downstream from it. If the modulator FM, image intensifier, and spinning micro-lens disc SML are synchronized accordingly, two images can be recorded sequentially, the first with intact foci (both excitation beam halves in-phase,
Placing the FM in the pupil means that all partial beams are present in the pupil at a different angle depending on their position; each point fills the pupil completely, and because half the pupil is modulated by the FM, each spot is half phase modulated and superseded in the sample.
The FM may also be an EOM, but also an element as described in prior art reference [1], [2].
c) shows the scanning pattern of a spinning micro-lens disc in reduced form: all pixels 1 are illuminated at the same time, then all pixels 2, etc. A complete image is provided with one rotation of the disc. For in-phase demodulation of the image, the disc rotation must be phase-coupled such that all pixels 1, 2, 3, 4 . . . have the same phase position. The modulation co must also be an integral multiple of the rotation frequency and pixel frequency of the disc. The frequency at which the intensifier is triggered on the other hand must be a multiple of the modulation frequency.
A typical spinning disc [3] can be operated at 125 rps or more, the (total number of micro-lenses/number of simultaneously illuminated lenses) ratio LB being 12, such that 12 images are scanned per revolution, which is an image rate of 1500 Hz. Assuming that 1000 lenses are scanned simultaneously and there are 500×500 camera pixels, there will be 250 pixel exposures per micro-lens and image, and at a 10 MHz modulation frequency of the half-beam modulator there will be 10 MHz/(1500 Hz*250)−26 modulation periods per pixel that can be scanned and integrated to obtain a measuring point for determining the phase position. An advantageous image rate of 375 Hz would then result for 4 phase points (as in
As an alternative to the image intensifier camera, a CMOS/CCD camera with integrated lock-in pixels can be used, such as in [4] & [5]. These cameras are usually used for time-of-flight based range finding in combination with modulated illumination but can also be used for demodulation in an arrangement as in
While the invention has been illustrated and described in connection with currently preferred embodiments shown and described in detail, it is not intended to be limited to the details shown since various modifications and structural changes may be made without departing in any way from the spirit of the present invention. The embodiments were chosen and described in order to best explain the principles of the invention and practical application to thereby enable a person skilled in the art to best utilize the invention and various embodiments with various modifications as are suited to the particular use contemplated.
Number | Date | Country | Kind |
---|---|---|---|
10 2010 013 829 | Mar 2010 | DE | national |
Filing Document | Filing Date | Country | Kind | 371c Date |
---|---|---|---|---|
PCT/EP2011/001320 | 3/17/2011 | WO | 00 | 9/25/2012 |
Publishing Document | Publishing Date | Country | Kind |
---|---|---|---|
WO2011/116901 | 9/29/2011 | WO | A |
Number | Name | Date | Kind |
---|---|---|---|
6028306 | Hayashi | Feb 2000 | A |
6219179 | Nielsen et al. | Apr 2001 | B1 |
6642504 | Cathey, Jr. | Nov 2003 | B2 |
7364296 | Miller et al. | Apr 2008 | B2 |
7400446 | Mikuriya et al. | Jul 2008 | B2 |
7738115 | Ocelic et al. | Jun 2010 | B2 |
8585587 | French et al. | Nov 2013 | B2 |
20100067103 | Sangu | Mar 2010 | A1 |
Number | Date | Country |
---|---|---|
199 04 592 | Mar 2001 | DE |
0 500 717 | Nov 2003 | EP |
2 163 935 | Mar 2010 | EP |
WO 2009008838 | Jan 2009 | WO |
Entry |
---|
Corle, T.R., et al.; “Electrooptic phase sensitive confocal scanning optical microscope”; Conference on Lasers and Electro Optics, Apr. 25-29, 1988; XP 000092275. |
Chen, N.G., et al.; “Real time focal modulation microscopy”; Proceedings of SPIE (2010); 7570:75700Q-1 to 75700Q-6. |
Chen, Nanguang, et al.; “Focal modulation microscopy”; Optics Express (2008); 16(23):18764-18769. |
Wong, Chee Howe, et al.; “Simple spatial phase modulator for focal modulation microscopy”; Applied Optics Jun. 2009; 48(17):3237-3242. |
Confocal Scanner Unit—Yokogawa Global; http://www.yokogawa.com. |
Dissertation R. Lange; Universitat Siegen (2000). |
SwissRanger SR4000 Overview; http://www.mesa-imaging.ch. |
Gated-Intensifier-Kamera:z.B tautec pico star; http://www.tautec.com/4709/4736.html. |
Gong, Wei, et al.; “Improved spatial resolution in fluorescence focal modulation microscopy”; Optics Letters 2009; 34(22): 3508-3510. |
English language translation of the International Preliminary Report on Patentability and Written Opinion of the International Searching Authority. |
Number | Date | Country | |
---|---|---|---|
20130020473 A1 | Jan 2013 | US |