The present invention relates to methods and arrangements for microscopic imaging with structured illumination. Increased spatial resolution is achieved by means of nonlinear interactions between samples, which is known from the prior art. By means of the method and the corresponding arrangements of this invention, this sample interaction is made use of for imaging in such a way that confocal imaging is possible with a resolution that goes beyond the diffraction boundary in all spatial directions with parallel data acquisition.
The prior art discloses various nonlinear sample interactions which can lead to enhanced spatial resolution when suitably implemented, specifically:
The basic idea behind the method of the invention is that the dye is either
a) brought to a non-fluorescing or slightly fluorescing state in a spatially limited region so that a subsequent excitation can lead to fluorescence only, or predominantly, in a limited region (second and third method), or
b) is de-excited in a spatially limited region following excitation so that fluorescence is carried out only from a limited region (first method).
In both cases, the intention is to achieve a fluorescing region which is smaller than that which can be achieved by diffraction-limited excitation.
The basic principle is illustrated in
Therefore, it is clear that a parallel data acquisition is needed in order to arrive at acceptable image compilation times. In this connection, it must be taken into consideration that confocal imaging is required in order to avoid a loss of contrast and reduced resolution enhancement due to extrafocal fluorescence. A possibility offered by the prior art for parallelizing is simultaneous excitation with a plurality of spots, each of whose fluorescence characteristics are modified by a doughnut-shaped illumination. However, the doughnut-shaped illumination must lead to a nonlinear sample interaction, i.e., a saturation, in order to achieve increased resolution. This means that a relatively large area around the individual spot interacts with this light distribution, which only allows a low density of the spot and, therefore, meager parallelization. Further, a confocal detection in a multi-spot arrangement of this kind is cumbersome in technical respects.
A method and an arrangement in which a high-resolution image is achieved directly (without image processing) with parallel data acquisition is described in the following. The extrafocal background can be eliminated by variable confocal detection. This method and arrangement prevent the above-mentioned disadvantages of the multi-spot arrangement according to the prior art. In particular, an optimal parallelization (maximum density of the simultaneously excited regions of the sample) and a relatively simple technical implementation are made possible by the invention.
The present inventions will be described in greater detail, using examples with reference to the annexed drawings, in which:
a) illustrates an achromatic color splitter which results from the pupil light distributions in
b) illustrates the achromatic color splitter located in the beam in a conjugate pupil plane;
a) shows the distribution without a mask (corresponds to excitation distribution);
b) shows the distribution with a mask according to
c) shows the distribution with a mask according to
d) shows incoherent overlapping results in the distribution shown;
a) is a graph illustrating intensity versus time showing switching on and off;
b) is a graph illustrating intensity versus time showing switching off;
a)-(c) illustrate adjustment gratings for masks;
a) illustrates an intensity structure; and
b) illustrates an axial structuring of the illumination light in the object plane.
An arrangement which meets the demands mentioned above is based on a line-shaped excitation and confocal detection by means of a line camera behind a slit diaphragm. By means of a suitable exposure pattern in combination with the nonlinear sample interaction, a de-excitation/depopulation/switching (always referred to hereinafter, by way of example, as switching) is realized in such a way that only a series of spots along a line can emit fluorescent light. The distance between these spots is at least as great as (but advantageously no greater than) the diffraction-limited resolution of the optical system. A possibility for generating an illumination of this kind (which is simultaneously also axially structured) consists in the diffraction of coherent light at a periodic structure and interference of the diffraction orders in the object plane, as is described in the application DE102004034962A1 which is hereby incorporated in the present disclosure. This results in diffraction-limited light distributions on the camera line which are separated from one another, impinge on corresponding pixels and are detected separately at the latter (see
A highly resolved image is now obtained by scanning the object along line (x) and perpendicular to line (y). This scanning can be carried out by moving the illumination distributions, e.g., by means of a galvanometer scanner and/or by moving the object. In the former case, the illumination beam and the detection beam must pass over the same beam deflection elements in order to obtain a stationary light distribution on the detector (descanned detection). In case the object is simply moved (object scanning), the light distributions are stationary in every case.
The information about the correlation of pixel to measurement point on the sample is derived in a definitive manner from the scanning movement and the corresponding optics. This will be described more exactly: the image field raster observed by the detector is determined by the imaging of the camera pixels on the sample. For example, 512 pixels are imaged on the sample in such a way that every pixel detects an image surface of 1.5-times the diffraction-limited resolution (for an objective with an NA of 1.4, this corresponds at a wavelength 488 nm to a field of 488 nm/(2*1.4)*1.5=260 nm edge length). Adjustment of the illumination pattern (switching light distribution) ensures that there is a unique correlation between the luminous spots in the sample and the camera pixels. By means of the relative movement of the object and illumination pattern, different sample points are imaged. For this purpose, the scanning movement and the detection of the spot size in the sample which is synchronized with the scanning movement must be adapted. Typically, scanning is carried out with one half of the spot diameter (Nyquist theorem). Thus when a fivefold increase in resolution (N=5) is achieved in the example given above by mean of the nonlinear sample interaction, a sample scanning must be carried out at a distance of 260 nm/(5*2)=26 nm. Therefore, N*2 scan/detection steps (10 in the example above) are needed to completely scan a line. Therefore, 512*2*N highly resolved data points are obtained from 512 pixels in x-direction (see
The discussion has so far been limited to one object plane. However, objects are always three-dimensional. This has several consequences. For one, aside from the fluorescence in the focus with increased resolution, fluorescence is also excited outside of the focus. This fluorescence interferes with the imaging described above and can make it impossible to correlate the pixels to high-resolution object points. A remedy is afforded by confocal detection which effectively suppresses extrafocal fluorescent light. In the case presently under consideration, this is realized by means of an (ideally) variable slit diaphragm in front of the camera parallel to the line. On the other hand, the three-dimensional point spread function (PSF) must be taken into consideration for imaging. This will depend upon the switching light distribution as well as on the excitation PSF and detection PSF. In axial direction, the PSF can correspond to the diffraction-limited PSF (structured switching light only in lateral direction).
In principle, all of the above considerations can also be applied to a two-dimensionally structured switching beam distribution and detection with an area detector. In this case, the excitation and the switching on which may possibly be necessary are carried out with (far-field) area illumination. An arrangement of this kind would have the advantage of increased parallelism (e.g., 5122 points could be exposed simultaneously), but also has the disadvantage of non-confocal detection. The occurrence of extrafocal fluorescence can pose a severe problem depending on the sample (particularly with thick, strongly dyed samples).
An option for the use of increased parallelism while simultaneously preserving a certain confocality of the imaging is to image a plurality of separate lines on the sample and to carry out detection by means of an area detector. When the lines on the area detector are sufficiently separated (e.g., by about 10 pixels), a confocal detection can be achieved by selectively reading out the pixels associated with the lines. The confocality can be adjusted by also taking into account adjacent pixels. For example, by reading out the two pixel rows adjacent to the line and summing the corresponding associated pixel elements, the effective “slit diaphragm” can be increased by a factor of 3 with a corresponding decrease in confocality. The same elements in the vicinity of the pupil as those shown in
Preferred Arrangement
A preferred arrangement uses a modified line-scanning system as shown in FIG. 7 and, for example, in DE 10257237A1 and EP1617271 A2 which are hereby incorporated in the present disclosure.
The modifications involve the following aspects:
The AchroGate achromatic color splitter is replaced by one permitting a structuring of the switching light in the object plane—this can be a suitable achromatic design or a dichroic beamsplitter.
The illumination unit is replaced by one which enables the required nonlinear sample interactions and the structuring of the switching light.
The illumination and the data acquisition are adapted in such a way that the exposure of the sample and the detection with the suitable sequence of switching/excitation/detection/switching on (see
The data evaluation is adapted so that a correlation of pixels to object points is carried out as shown schematically in
Structuring of the Switching Light
A preferred way to generate a lateral structuring is made possible by means of a phase mask according to
If an axial structuring of the switching light—as is shown schematically at the top of FIG. 5—is also desired, another partial beam of the switching light is modified with a phase mask according to
Masks 8b) and 8c) have a central region symmetric to the optical axis and to an axis perpendicular to the optical axis which produces a different phase delay of the passing light compared to the outer regions to the right and left sides. A phase delay of it of an outer portion of the line-shaped pupil illumination relative to an inner portion of the line-shaped pupil illumination is carried out. In theory, the optimal radius of the phase jump is 1/√{square root over (2)} of the pupil radius of the objective. In practice, a somewhat smaller radius is often optimal. A phase plate such as that shown in
a) shows an achromatic color splitter which results from the pupil light distributions in
The point pattern of intensity minima occurring in the focus in the sample caused by a corresponding nonlinear sample interaction is a point pattern of excitable regions (GSD/switching) or of regions in which there is still significant excitation (STED). These regions are appreciably smaller after suitable exposure optimized for the dye (wavelength, intensity, exposure time) than a diffraction-limited light distribution and therefore allow a scanning of the sample with increased resolution. The adjustment of the illumination is carried out based on knowledge of the dye and can be optimized at the device based on the resolution of test structures (e.g., beads). Since this point pattern must be imaged exactly on the pixels of the line camera, a variable optical system (zoom) which makes it possible to adapt the periods of the pattern to the periods of the detector elements is advantageously provided in the illumination beam path or detection beam path. The position of the imaged spots (i.e., their center of gravity) can be centered within the pixels by means of another element such as a tiltable, thick glass plate in the illumination beam path or detection beam path (see, e.g., DE 102004034960A1).
Excitation and Switching On
The excitation and switching on are carried out with diffraction-limited light distributions which are generated without a mask. In the preferred embodiment example, these are lines which have the most homogeneous possible intensity curve along the line and extend in a diffraction-limited manner perpendicular to the line.
The excitation is carried out either before the switching/de-excitation (STED) or after the dye has been switched off (GSD/switching) by the switching light in a structured manner. Only in the case of switching is it generally necessary to subsequently reverse the switching off by a switch-on laser, because the other processes spontaneously revert to the initial state of the dye (see also
The optimal parameters for excitation and switching on are determined beforehand from knowledge of the dye characteristics. For switching on, the aim is to reverse the switching off as completely as possible; optimized excitation and simultaneous detection of the emitted fluorescence signal is carried out by maximizing the signal-to-noise ratio. Different boundary conditions must be taken into account for the different interaction mechanisms:
Generally, not all light-emitting molecules in a sample take part in the nonlinear sample interaction (STED/switching/GSD). This leads to a background signal which is not subjected to the nonlinear beam shaping and accordingly limits the high resolution that can be achieved. In case of long-lived states (i.e., approximately >1 μs) as in GSD and switching, the magnitude of the background relative to the signal of the molecules participating in the nonlinear sample interaction can be gauged by a further recording before switching on again (switching) or before the spontaneous relaxation into the ground state (GSD). This is because the unstructured excitation (S2,
A suitable candidate for switching is the Dronpa protein (Habuchi et al., PNAS 102 (2005) 9511-9516). In this case, the switching off and the excitation are carried out with a wavelength in the range of about 450 nm to 520 nm. Switching on can be carried out in the range of 350 nm to 420 nm. This makes it possible to work, e.g., with the lines of the argon laser at 477 nm and 488 nm and to use a laser diode at 405 nm for switching on. The mutual switching on and off is shown in
STED and GSD (see the introductory part of the specification) can be realized by means of S1 and S2, STED can be realized by S2 followed by S1, and detection can be realized in S1, GSD by S1 followed by S2, and detection in S2. In S1, after the beam shaping (e.g., by means of a Powel lens) and after passing through a splitter DC in the zeroth diffraction order of a grating followed by the mask 7a) (phase jump), the two laterally limiting outer lines of the switching beam are generated in the sample and the structuring of the center line is generated by means of the +/− first diffraction order.
The mask 7b) or c) (after reflection at the splitter DC and separate beam path until after the mask 7c)) generates the limiting lines of the switching beam in axial direction by means of the phase jump described above.
Slightly different wavelengths (in this case, 488 nm, 477 nm) can be used for the beam paths through 7a) and 7c), but they must both lie within the range of the response behavior of the respective dye.
The integration of an illumination unit according to the invention in a line-scanning microscope is shown in
In order to achieve a flexible system for switching additional dyes (also simultaneously with Dronpa), additional lasers are connected and the design of the dichroic splitter DC is provided for a plurality of colors (or as a neutral splitter). Further, it may be necessary (depending upon the wavelength difference) to change masks (although simultaneous operation would not then be possible).
A simple adaptation consists in changing the grating constant so that the diffraction orders occur at the same location in the pupil. This can be achieved by a translation of a grating as is shown in
Also, when a wavelength is used, the use of different objectives, for example, creates the need for adjustment possibilities in the system. In this connection, a basic adaptation of the illumination to the different pupils of the objectives is carried out by means of the zoom system directly following the main color splitter (
Simulation of the Intensity Distribution for Dronpa
An embodiment example of the illumination is shown in
A light bundle which is adapted to a Powell lens and has a Gaussian intensity profile is provided by fiber coupling. The light bundle has two wavelengths, 477 nm and 488 nm. The Powell lens (divergence 30°) generates a line-shaped illumination with a homogeneous intensity distribution along the line in the focal plane of the following achromatic objective with a focal distance of 10 mm. This plane is conjugate to the object plane of the microscope. A first color splitter splits the two homogenized laser lines. A light path, advantageously that with 488 nm, has a line grating with 55 l/mm which generates the zeroth and ±first diffraction orders in a determined intensity ratio of 8:1. These laser lines are imaged by 2f-imaging with 150 mm focal distance onto a phase element which is located in a plane conjugate to the microscope pupil. The phase element is described in
While the invention has been illustrated and described in connection with currently preferred embodiments shown and described in detail, it is not intended to be limited to the details shown since various modifications and structural changes may be made without departing in any way from the spirit of the present invention. The embodiments were chosen and described in order to best explain the principles of the invention and practical application to thereby enable a person skilled in the art to best utilize the invention and various embodiments with various modifications as are suited to the particular use contemplated.
Number | Date | Country | Kind |
---|---|---|---|
10 2006 047 912 | Oct 2006 | DE | national |
The present application is a continuation of application Ser. No. 12/444,290 filed on Apr. 3, 2009, now abandoned which is a U.S. National Stage Application of International PCT Application No. PCT/EP2007/008556 filed on Oct. 2, 2007, which claims benefit of German Application No. DE 10 2006 047 912.2 filed on Oct. 6, 2006, the contents of each are incorporated by reference in their entirety.
Number | Name | Date | Kind |
---|---|---|---|
20010045523 | Baer | Nov 2001 | A1 |
20020141052 | Iketaki | Oct 2002 | A1 |
20040095576 | Wolleschensky | May 2004 | A1 |
Number | Date | Country |
---|---|---|
10 2004 034 962 | Feb 2006 | DE |
WO 2007009812 | Jan 2007 | WO |
Number | Date | Country | |
---|---|---|---|
20110215258 A1 | Sep 2011 | US |
Number | Date | Country | |
---|---|---|---|
Parent | 12444290 | US | |
Child | 13042137 | US |