1. Field of the Invention
The present invention is directed to a scanning light microscope with scanning and applications, which uses raster scanning or point scanning.
2. Related Art
Egner et al., J. Microsc. 2002, 206: 24-32 compare the efficiency and resolution of spinning-disk and multifocal multiphoton microscopes; depending on the specimen preparation, both systems would be useful.
Stephens and Allan, Science 2003, 300: 82-86 illustrate the advantages of different types of light- and confocal microscopy technologies for live cell imaging; despite the existence of various detection methods, most high-quality systems employ a single laser as the light source.
Knight et al., Am. J. Physiol. Cell Physiol. 2003, 284: C1083-1089 describe Ca2+ imaging involving light activation via a laser; the laser could also be used for imaging.
Denk, J. Nuerisc. Methods 1997, 72: 39-42 describe the use of pulsed mercury vapor lamps for in the release of pharmaceuticals; if a laser were used in this case, positionability and efficiency would be noticeably improved.
Wang and Augustine, Neuron, 1995, 15: 755-760 describe fast Ca2+ Imaging involving localized release of pharmaceuticals via laser light; the laser could also be used for imaging.
Quing et al., Appl. Opt. 2003, 42: 2987-2994 describe bacterial experiments with FCS in water; both the imaging and the FCS components could make use of the laser.
Bigelow et al., Opt. Lett. 2003, 28: 695-697 describe the examination of tumor cells with confocal fluorescence spectroscopy and fluorescence anisotropy; both the imaging and the spectroscopy components could make use of the laser.
McLellan et al., J. Neurosc. 2003, 23: 2212-2217 describe the use of in-vivo multiphoton microscopy to depict amyloidal plaques in Alzheimer animal models; the microscope arrays are customized for the animal models; using multiple arrays with a shared laser would increase the throughput considerably. Zipfel et al., Proc. Natl. Acad. Sci USA 2003, 100: 7075-7080 describe the investigation of autofluorescence in living tissue using multiphoton and SHG microscopy; due to customizations the microscope array is not very universal; use of a second array would increase the flexibility.
Pollard and Apps, Ann. N.Y. Acad. Sci. 2002, 971: 617-619 describe new technologies for the examination of exocytose and ion transport using TIRF microscopy; the imaging laser could also be used for TIRF excitation.
Ruckstuhl and Seeger, Appl. Opt. 2003, 42: 3277-3283 describe confocal and spectroscopic experiments upon nanoparticles and molecules using an innovative mirror objective during TIRF microscopy; due to the customized optics the array is not very universal; a second imaging array would increase flexibility.
Tsuboi et al., Biophys. J. 2002, 83: 172-183 describe the study of endocrine cells with laser microforce—and TIRF microscopy; the imaging laser could also be used for TIRF excitation.
All the cited experiments would clearly benefit from a combined system with a shared laser module, as cost, the ability to obtain reproducible results, and flexibility are all clearly optimized by comparison to single systems.
Use of two or more scan modules, in accordance with this invention, is especially sensible for the following method combinations:
In the given context, it is preferential or even absolutely necessary, respectively, to design the beam path of the laser module so that it is possible to achieve an infinitely variable partition of the beam among the illumination modules used. The use of a single laser module makes practical sense in that it reduces the amount of money spent on equipment, and thus effectively reduces costs.
The goal of the adjustable beam split design form is to guide individual wavelengths or wavelength ranges of the light source into different beam paths without influencing the remaining wavelengths, while simultaneously isolating the individual line selections and beam attenuation. This can occur in several ways:
1. Splitting of a light source into at least two separate beam paths by an optical element, during which the beam split ratio at optical element can be infinitely varied so as to flexibly accommodate the applicable operating requirements; whereby both beam paths would have to functionally support one of the method combinations 1-4, or alternatively, one beam is guided into a light trap into order to adjust the available laser strength to suit the applicable operating requirements.
a. with at least one fiber coupling
b. with at least one AOTF for laser line-selective beam attenuation
2. Splitting of a light source into two separate beam paths, in which splitting of the light source is accomplished using a polarizing beam splitter and a rotating lambda/2 plate or other element placed in front of it which allows for rotation of the polarization individually for each laser (e.g. liquid crystal, Pockels cell, Faraday rotator . . . ). As a result of what is in essence the infinitely variable orientation of the E-vector achieved via the lamba/2 plate (in some cases individually for each laser), the beam split ratio at the polarized beam splitter can essentially be infinitely varied for each laser, thereby enabling flexible accommodation to the applicable operating requirements.
a. with at least one fiber coupling
b. with at least one AOTF for laser line-selective beam attenuation
3. Splitting of a light source into two separate beam paths, in which the beam is split by a single or multiple dichroic beam splitters, whose reflection and/or transmission characteristics can be altered through manual or motor-assisted tilting.
Altering the angle (e.g. from 45° to 50°) intended to be used with a specific sample plane leads to a change in the spectral characteristics, because the path lengths within the plane system change accordingly (corresponding in principle to the Fabry Perot Interferometer). This in turn allows the shift range of constructive and/or destructive interference to be variably adjusted, thereby allowing the beam split ratio to be flexibly suited to the applicable operating requirements.
a. with at least one fiber coupling
b. with at least one AOTF for laser line-selective beam attenuation
4. Splitting of a light source into two separate beam paths, in which splitting of the beam path is accomplished by a single acoustooptical or other single diffractive element, and in which the efficiency of diffraction in a (+) or (−) order of magnitude in relation to the zeroed order of magnitude must be variably adjustable, thereby allowing the beam split ratio between the first order of magnitude and (+) or first order of magnitude to be flexibly suited to the applicable operating requirements.
a. with at least one fiber coupling
b. with at least one AOTF for laser line-selective beam attenuation
5. Splitting of a light source into two separate beam paths, in which a fast switchable mirror splits the beam. The switching frequency lie within the range of the image acquisition rate. Additionally, in order to influence the energy transported within the individual beam paths, a fast switchable beam attenuator, synchronized to the switching frequency for each laser, must be integrated via a liquid crystal filter.
6. Same as five, but the beam attenuation placed after the laser is accomplished by an acoustooptic or other diffractive component.
The advantage of variations 1-4 is that no parts need be moved during switching between the beam paths, which preserves the full dynamic performance capability of the array.
The following section describes an RT (real time) scanner with line scanning capability in greater detail, with reference to the drawings in
For a general description of a punctiform scan laser scanning microscope, reference is made to DE 19702753A1 (corresponding to U.S. Pat. No. 6,167,173), which description has been fully integrated into the current description.
The radiation source module 2 generates illuminating radiation appropriate to a laser scanning microscope, or more specifically, radiation which can induce fluorescence. Depending on the application in use, the radiation source module has a number of respective radiation sources available for it. In one illustrated design variation, two lasers 6 and 7 are envisioned in radiation source module 2, after each of which a light valve 8 and beam attenuator 9 are connected, and both of which couple their radiation into a lead optical fiber 11 at coupling point 10. The light valve 8 functions as a beam deflector and allows a beam shutdown to be effected without necessitating an actual shutoff of the lasers themselves in laser units 6 and/or 7. Light valve 8 is designed as an AOTF, for example, and effectively causes a beam shutdown by deflecting the laser beam into a light trap (unillustrated) before it is can couple into the lead optic fiber 11.
In the example illustration in
Using moveable collimation lenses 12 and 13, the radiation coupled into lead optic fiber 11 is guided together via beam combining mirrors 14, 15 and its beam profile subsequently transformed within a beam formation assembly.
Collimators 12 and 13 ensure that the radiation passing from radiation source module 2 to scan module 3 is collimated into an infinite beam path. In each case, respectively, this is best accomplished by a single lens, which assumes a focusing function by virtue of its being moved along the optical axis under the direction of a central control unit (not shown) and rendering adjustable the distance between collimators 12, 13 and the respective ends of the lead optic fibers.
The beam formation assembly, which will be explained in detail at a later point, generates a line-shaped beam from the rotationally symmetric, Gaussian-profiled laser beam, its form after encountering beam combining mirrors 14, 15. The resulting beam is no longer rotationally symmetric, and its cross-section is suitable for generating a rectangular illuminated field.
This illumination beam, alternatively described as line-shaped, acts as excitation radiation and is guided to scanner 18 via a main color splitter 17 and a zoom lens which has yet to be described. The main color splitter will also be detailed at a later point, here it is only noted that it functions to separate the sample radiation returning from microscope module 4 from the excitation radiation.
Scanner 18 guides the line-shaped beam on one or two axes, after which it is condensed onto a focus point through a scan objective 19 as well as a tube lens and an additional lens within microscope module 4. This focus point is located within a slide preparation and/or sample. The sample is illuminated with excitation radiation in a focal line, through which process optical imaging occurs.
The fluorescence radiation, excited in a line-shaped focus in this manner, travels via an objective, a tube lens belonging to microscope module 4 and scan objective 19 back to scanner 18, so that in reverse direction after scanner 18, a dormant beam exists. For this reason, in this connection it is said that scanner 18 “descans” the fluorescence radiation.
The main color splitter 17 allows fluorescence radiation to pass through as it occupies a different wavelength range than the excitation radiation. This enables it to be redirected into detector module 5 via a deflection mirror and subsequently analyzed. In the design variation in
Each spectral channel is equipped with a slit diaphragm 26, which enables realization of a confocal or partially confocal image of the sample, and whose size determines the depth of field used to detect the fluorescence radiation. The geometry of the slit diaphragm 26 therefore determines the section plane in the (thick) slide preparation from which the fluorescence radiation will be detected.
In addition, a barrier filter 27 is placed after slit diaphragm 26 in order to block undesirable excitation radiation which has managed to enter detector module 5. The radiation isolated in this manner, originating from a specific section plane, line-shaped and fanned out, is then analyzed by a suitable detector 28. The second spectral detection channel is designed analogously to the color channel already described, likewise including a slit diaphragm 26a, a barrier filter 27a, and a detector 28a.
A confocal slit diaphragm is used in detector module 5 only for the sake of example. A single point scanner could naturally be used as well. The slit diaphragms 26, 26a are then replaced by aperture diaphragms, and the beam formation assembly can be omitted. Finally, in this type of array all lenses are designed rotationally symmetric. In essence, this would naturally permit the use of any preferred type of multiple point scanning arrangement, such as point clouds or Nipkow disk concepts, could be used instead of single point scanning and detection. These types of arrays will be explained later with reference to
Following transformation, at profile level the resulting beam essentially illuminates a rectangular field, in which the intensity distribution along the longitudinal field axis is not Gaussian-shaped, but box-shaped instead.
The illumination array containing aspherical unit 38 can essentially function to create an evenly filled pupil between tube lens and objective. In this manner, the optical resolution of the objective can be fully exploited. This variant is therefore well-suited to a single-point or multipoint scanning microscope system, also e.g. a line-scanning system (in the latter it is supplemental to the axis upon which focusing onto or into the sample is accomplished).
The line-shaped conditioned excitation radiation, by way of example, is guided to the main color splitter 17. This is depicted in its preferable design form as a spectrally-neutral splitting mirror in accordance with DE 10257237 A1 (corresponding to U.S. Pat. No. 6,888,148), the published contents of which have been fully incorporated in the present description. The concept of “color splitter” therefore refers to splitting systems that operate non-spectrally. Instead of the spectrally independent color splitter described, a homogenous neutral splitter (e.g. 50/50, 70/30, 80/20 or other) or a dichroic splitter could be used. In order to ensure a range of choices with regard to potential applications, the main color splitter is preferably equipped with a mechanism that enables a simple change, for example through an appropriate beam splitting wheel containing single, interchangeable splitters.
A dichroic main color splitter is particularly useful in cases where coherent, in other words, directed radiation must be detected, e.g. reflection, Stokesian and/or anti Stokesian Raman spectroscopy, coherent Raman processes of a higher order of magnitude, general parametric non-linear optical processes, such as second harmonic generation, third harmonic generation, sum frequency generation, two- and multi-photon absorption and/or fluorescence. Several of these non-linear procedures from optical spectroscopy require the use of two or more laser beams collinearly layered upon one another. In this connection, the herein described beam combination of the radiation from several lasers is especially applicable. In general, dichroic beam splitters could have a wide variety of uses in fluorescence microscopy. In Raman microscopy, additional placement of holographic notch splitters or filters in front of the detectors in order to suppress whatever portion of Rayleigh stray radiation is present would be useful.
In the design form illustrated in
The cylindrical telescope 37 works together with the zoom lens 41, which is also motorized and is placed in front of the aspherical unit. In the design form depicted in
If a zoom factor smaller than 1.0 is desired, the cylindrical telescope 37 is automatically swung into the beam of optical radiation. When zoom lens 41 is shortened, this keeps the aperture filter 42 from being receiving inadequate illumination. The swinging cylindrical telescope 37 thus guarantees that also at zoom factors smaller than 1, i.e. independent of adjustments to zoom lens 41, an illumination line with a constant length is always present at the location of the objective pupil. This allows drops in laser performance within the illumination beam to be avoided, by comparison to a simple visual field zoom.
Because engagement of the cylindrical telescope 37 causes an abrupt and unavoidable jump in image brightness, the control unit is configured to appropriately adjust either the positioning rate of scanner 18 or an intensification factor of the detectors in detector module 5 upon engagement of the cylindrical telescope 37, in order to maintain a constant level of image brightness.
In addition to the motor-driven zoom lens 41 and the motor-activated cylindrical telescope 37, remote-controlled adjusting elements are also envisioned in detector module 5 of the laser scanning microscope. In order to compensate for chromatic difference of focus, for example, a circular lens 44 and a cylindrical lens 39 are envisioned in front of the slit diaphragm, in addition to a cylindrical lens 39 placed directly in front of detector 28, each of which, respectively, can be moved in an axial direction by a motor.
A correction assembly 40 is additionally envisioned for compensation purposes; a brief description follows.
Slit diaphragm 26, together with a circular lens 44 in front of it, the first cylindrical lens 39 also in front of it and the second cylindrical lens placed after it, forms a pinhole objective in detector arrangement 5, in which the pinhole is realized here by the slit diaphragm 26. In order to avoid undesirable detection of excitation radiation reflected inside the system, a further barrier filter 27 is connected in front of the second cylindrical lens 39. This filter possesses the spectral characteristics necessary to allow only the desired fluorescence radiation to reach detector 28, 28a.
Changing the color splitter 25 or the barrier filter 27 leads to a certain unavoidable amount of tilt or wedge error when these parts are re-engaged. The color splitter can create errors between the sample area and slit diaphragm 26, while barrier filter 27 can induce errors between slit diaphragm 26 and detector 28. In order to avoid the necessity of readjusting the position of slit diaphragm 26/detector 28, a parallel plane plate 40 is placed between circular lens 44 and slit diaphragm 26, i.e. within the imaging beam path between the sample and detector 28. The plate can be set to different tilt positions via instructions from by a control unit. To accomplish this, the plane-parallel plate 40 is adjustably attached using an appropriate mounting.
An example description of resonance scanners can be found in Pawley, Handbook of Biological Confocal Microscopy, Plenum Press, 1994, page 461 ff. If the scanner is directed to scan a specific field asymmetrically with respect to the optical axis—i.e. with respect to the resting position of the scanner mirror—an offset shift OF of the chosen region of interest is obtained in connection with the action of the zoom lens. Through the already-mentioned descanning action of scanner 18, as well as repeated passage through zoom lens 41, the selected region of interest within the detection beam path is canceled out as the beam travels back in the direction of the detector. This allows for selection of a very wide range of possible ROI areas within the sample. In addition, pictures can be taken of the different regions of interest selected, and these can then be combined into a high resolution image.
If one wishes to not only to shift the chosen region of interest not only one offset OF with relation to the optical axis, but to rotate it in addition, the applicable design form envisions placement of an Abbe-Konig prism in a pupil of the beam path between the main color splitter 17 and the sample, which is known to cause rotation of the image field. This also is canceled out in the reverse beam path moving in the direction of the detector. At this point, images with different offset shifts OF and different rotation angles can be acquired and finally combined in a high resolution image, through an algorithm, for example, as described in the publication, Gustafsson, M., “Doubling the lateral resolution of wide-field fluorescence microscopy using structured illumination,” in “Three-dimensional and multidimensional microscopy: Image acquisition processing VII,” Proceedings of SPIE, Vol. 3919 (2000), p. 141-150.
In a departure from the design of
Zoom lens 41 conforms to the design previously mentioned, although scanner 18 is naturally rendered unnecessary by the Nipkow disk 64. The scanner could be envisioned nonetheless should selection of a region of interest be undertaken in accordance with
A multipoint scanning array which is described in U.S. Pat. No. 6,028,306 represents another possible design form. The published details of the above patent have been fully taken into account here. In this case as well, a detector 28 with localized resolution is envisioned. The sample is then illuminated by a multi-point light source, realized by means of a beam expander with a microlens array placed after it. The characteristics of the illumination of a multi-aperture plate which results are such that a multipoint light source can be said to be effectively realized. In the set of diagrams to follow, the following elements and terminology are depicted and used (reference is also made to the explanation in EP977069A1 (corresponding to U.S. Pat. No. 6,462,345))
Lasers 1-4 and/or A-G as light sources
Deflection mirror US for deflection of the laser beam
Light flap or shutter V as light closure
rotating λ/2 plate
PT pole splitter for pole splitting
LF optic fibers for light transport
fiber coupling port for fiber coupling
attenuator A (AOTF or AOM preferred)
MD monitoring diode for radiation detection
PMT 1-3 detectors for wavelength-sensitive radiation detection
T-PMT detector for detection of transmitted radiation
Pinholes PH 1-4
DBS 1-3 color splitter
Pinhole lenses for focusing at the pinhole
MDB main color splitter
EF 1-3 emission filter
Collimators for wavelength-dependent adjustments
Scanner
Scan optical system or scan lens
Ocular
Tube lens
Beam combiner
Non-descanned detector between objective and scanner
Objective
Sample
Condenser
HBO white light source
HAL halogen lamp for throughput illumination
telescopic lens
zoom lens
beam formation apparatus for generation of an illumination line
cylindrical telescope
cylindrical lens
gap
detector for line capture with slit diaphragms
SS faster switching mirror
Four lasers 1-4 with varying wavelengths are represented in
Depending on the respective orientation of their polarization planes, the laser beams are fully or only partially transmitted or reflected (laser 4 is not combined here with other lasers, but is instead guided directly to the polarizing splitter) and are guided in the direction of the optical fibers via selective beam attenuators (AOTF). One of the fixed ½ plates in the transmission (VIS)/reflection (V) light paths sets the correct polarization plane for the AOTF.
Coupling ports for optical fibers are envisioned in different microscope arrays, and are described in further detail toward the end. The polarizing beam splitting cube has only two settings. Transmitted light is always polarized parallel to the mounting plate, while reflected light is always polarized perpendicular to the mounting plate. If the lambda/2 plate is located in front of a laser with its optical axis at an angle of less than 22.5° with respect to the laser polarization (linearly polarized and perpendicular to the mounting plate), the polarization plane is rotated 45°. In other words, the polarizing beam splitter functions as a 50/50 splitter. Different angles generate different split ratios, e.g. lambda/2 plate under 45° means a 90° rotation of the polarization plane and theoretically 100% reflection at the polarizing beam splitter cube. This further implies that the AOTF in the reflection path (at the pole splitter) always sees perpendicularly polarized light, ensuring that the AOTF is used correctly. For the transmission path, a permanent 90° rotation of the polarization plane is necessary in order to comply with the requirement that “AOTF entry polarization perpendicular to mounting plate”. Decoupling of the lambda/2 plates takes place through the polarization splitting cube.
An RT scanning microscope and a scanning manipulator are given here by way of example, with which varying wavelengths can be divided in different ways.
This takes place infinitely through appropriate electronically coordinated rotation of the individual lamda/2 plates.
This allows for a highly variable operating setup, and also one involving operation of multiple independent observation and/or manipulation systems.
The first diffracted order of magnitude of the AOTF, the actual working beam, is collinear for the entire defined spectral area (e.g. 450-700 nm). The zeroed order of magnitude is split by the prismatic effect of the crystal. This configuration is therefore only useful for a specific wavelength (must be specified). Configurations which might compensate for the splitting of the first order of magnitude (second prism with reversed dispersion, correspondingly modified AOTF crystal) are naturally conceivable.
The intensity within the branches of various orders of magnitude is adjustable depending on the wavelength; an applied control current regulates the diffracted intensity of the first order, the remainder stays in the zeroed order).
The beams of the zeroed and first orders can enter different observation and/or manipulation systems.
In single branch, here of the first order of magnitude, an additional AOTF2 could be envisioned, through which yet another splitting could be accomplished.
In a similar fashion,
The light from the lasers B-D is condensed, as in
Coupling into the illumination beam path of lasers E-G takes place, for example, via a fast SS switchable mirror, which alternately enables opening up of or coupling into the beam path.
The switchable mirror can also take the form of a wheel that alternatively exposes reflecting and transmitting sections.
A permanent beam splitter for effecting beam combination is equally plausible.
At this coupling point, light from lasers B-D can also adjustably combined with the light from lasers E-G, traveling via an optical fiber to an LSM 510, for example.
A manipulation system, consisting of a light source module and a manipulator model, is coupled in by means of a beam combiner.
Via the manipulator scanner, specific areas of the sample could be subjected to targeted bleaching, for example, or physiological reactions induced, while image acquisition could occur in simultaneously or in alternating fashion using the LSM 510.
Within the light source module of the manipulator, a λ/2 plate is envisioned—placed after laser A for example—working together with a polarized beam splitter cube which adjustably partitions the light from laser A, as described above, into the manipulation beam path and the LSM 510 beam path, respectively, via optical fibers.
For this purpose, a separate coupling point is envisioned at the LSM, at which the various coupled beams are themselves coupled via (internal) mirrors and beam splitters. In this way, laser A can be used by both systems.
In
In this way, light from lasers B-G, in addition to the light from laser A, enters adjustably into both beam paths.
Here, through use of λ/2 plates and pole splitters, a shared light source module is envisioned in which an adjustable allocation within the systems can again be accomplished.
Thus, light from lasers A-D is available to both systems, which would mean a considerable simplification and cost-savings.
An additional light source E could be envisioned as an option, by way of example, only for the manipulator, as its wavelengths are not required in the RT scanner.
In
A variety of laser modules, B-D, A, G-E are envisioned, each of which, as described above, can be adjusted upon demand to be available to both systems. In
A shared light source module is effective for both systems, as described above.
A pole splitter located in the common beam path serves to again partition the light into the different illumination modules 1 and 2, to different scanner configurations for image acquisition and/or manipulation, whereby the light portions and intensities which reach the individual illumination modules can be controlled according to individual preference. This control is again exercised by means of λ/2 plates and the beam attenuator (AOTF) placed within the now separate beam paths.
The invention herein described represents a significant expansion of the possible applications of fast confocal microscopes. The significance of a development of this type can inferred from the standard literature of cell biology and the descriptions it contains of fast cellular and subcellular processes, as well as from the methods used for investigation of a multitude of dyes. See, for example:
Products, 10th Edition, Molecular Probes Inc. and Molecular Probes Europe BV.
The invention is of particular significance for the following processes and procedures:
Development of Organisms
The invention described is suitable, among other things, for the investigation of developmental processes which are above all characterized by dynamic processes ranging in duration from a tenth of a second to a number of hours. Potential applications at the cell group and whole organism level of are given here, for example:
This is particularly relevant with respect to the following points:
Transport Processes within Cells
The invention described is excellently suited for the examination of transport processes within cells, as it requires resolution of extremely small, motile structures, e.g. proteins, having very high speeds. In capture the dynamics of complex transport processes, applications such as FRAP with ROI bleaching are often employed. Examples for these kinds of studies are described here, e.g.:
Molecular Reciprocal Processes
The invention described is particularly suited to the depiction of molecular and other subcellular reciprocal processes. In these cases, very small, high-velocity structures (within the range of hundredths of a second) must be imaged. In order to resolve the spatial position which the molecule must occupy in order for the reciprocal process to take place, indirect technologies e.g. FRET with ROI-bleaching can also be used. Example applications are described here, e.g.:
Signal Transfer Between Cells
The invention described is extremely well-suited to the investigation of signal transferal processes, which take place for the most part with extreme rapidity. These mainly neurophysiological processes place the highest possible demands on time-dependent resolution, because the activities, which are mediated by ions, occur in a time frame ranging from hundredths to less than a few thousandths of a second. Example applications of investigations upon the muscular and nervous system are described here, e.g.:
Number | Date | Country | Kind |
---|---|---|---|
10 2004 034 987.8 | Jul 2004 | DE | national |
The present patent application is a continuation of application Ser. No. 10/967,316, filed Oct. 19, 2004, which is incorporated herein by reference in its entirety.
Number | Date | Country | |
---|---|---|---|
Parent | 10967316 | Oct 2004 | US |
Child | 11987219 | US |