The invention relates in general to microscopy, and specifically to wide-field interferometric microsopy.
The interferometric Photo-Activated Localization Microscopy (iPALM) technique can be regarded as a refinement of the conventional (non-interferometric) PALM technique, whereby the former augments the latter with the ability to perform resolution/image reconstruction axially as well as laterally. The augmentation can be understood in several ways, as discussed below.
In PALM, lateral super-resolution is achieved by sequentially exciting spatially sparse subsets of objects (photoactivatable fluorophores) in a specimen, causing temporal separation of fluorescence emission from these different subsets. The resolvability of objects within each of these sparse subsets is greater than if the whole specimen were to be imaged in one go. In essence, the resolution-limiting diffraction effects that one would expect if one were to attempt to simultaneously image a dense set of objects are circumvented by instead regarding the set as a cumulative collective of sparse subsets, which are sequentially imaged. The photoactivatable fluorophores are caused to fluoresce in a two-step process, whereby in a preliminary step, a so-called “activating wavelength” (or “activation wavelength”) is used to promote the fluorophore from a non-emissive to an emissive state; and in a subsequent step, a so-called “exciting wavelength” (or “excitation wavelength”) is used to cause radiative “relaxation” of the activated fluorophore (fluorescence excitation).
In iPALM, the lateral (XY) super-resolution achieved in PALM is taken a step further, by introducing a mechanism that will also allow fine axial/depth (Z) resolution. This is achieved by imaging the (fluorophores in the) specimen through a pair of oppositely disposed projection systems (objective lenses, optical columns), whose output beams are fed into an optical combining element (specifically, a three-phase beam splitter), where they optically interfere. The resulting interference fringe pattern will be (very) sensitive to the axial (depth) position of the object (fluorophore) being imaged, since this will influence the relative path lengths of the interfering beams. By using a detector arrangement comprising multiple detectors (e.g. CCDs) to selectively look at phase-separated outputs from the combining element, one can effectively (mathematically) “translate” a given fringe pattern into a deduced axial object position; in iPALM, three distinct outputs from the combining element (mutually phase-shifted by 120°) are observed using three different detectors (cameras), whereby the relative intensities of the outputs observed by these cameras will change in a predictable manner as a function of axial fluorophore position.
Although iPALM is a useful technique, it does suffer from drawbacks. More specifically, it relies on a relatively complicated optical/detection architecture. In particular the employed three-phase beam splitter is an expensive and fragile component that is difficult to manufacture. Its performance is sensitive to temperature fluctuations and mechanical vibrations, and it has a relatively long settling time after being disturbed. Moreover, it is difficult to optically align/adjust. The employed three-phase beam splitter is also difficult to mechanically scale up in size, e.g. to match cameras with a larger field of view (without vignetting). Limiting factors in this regard include tolerances on the planar optics of the beam splitter, and coherence characteristics of the fluorescence light. The detection set-up requires the use of three detectors/cameras, which increases bulk/decreases available space, and increases expense.
One should note the distinction between a wide-field microscope—which can be regarded as employing a planar imaging wave—and, for example, a point scanning microscope (German: “Rastermikroscop”), which uses an imaging beam that is focused to a point, and is thus (necessarily) scanned over an object to be imaged. The present invention relates to the former (wide field).
It is an object of the invention to address these issues. In particular, it is an object of the invention to provide an alternative depth-resolved localization microscopy technique that utilizes a radically different illumination/detection configuration. More specifically, it is an object of the invention that does not require use of a three-phase beam splitter.
Like reference numerals refer to corresponding parts throughout the several views of the drawings.
The above described deficiencies may be addressed by a microscope as disclosed herein. In some embodiments, an illuminator comprises an optical cavity that is configured to produce a standing wave of input radiation at an analysis location, and a detector arrangement includes two interferometric detection branches.
To illustrate, (i) the standing wave alluded to here may be produced using the “activating” input light or the “exciting” input light, and will extend in a direction along the (local) optical axis at the analysis location, and (ii) this standing wave produces a (sinusoidal) modulation of the input radiation that illuminates the specimen, and it has a phase that can be tuned, e.g. by adjusting the “length” of the optical cavity in which it is generated. Further, aspect (ii) can be exploited to provide an alternative for (at least) one of the three 120-degree-phase-shifted beams used in the conventional iPALM detection set-up. For example, since three detection beams are thus rendered unnecessary, one no longer needs to use a troublesome three-phase beam splitter and associated trio of cameras—instead, one can suffice with a regular two-way beam splitter, which is much cheaper, less fragile, and more easily manufactured (and scaled to larger sizes). Moreover, (iv) the spatially modulated intensity distribution in the standing wave admits innovative ways of activating/exciting the fluorophores in the specimen, which can serve as a basis for new effects and advantages.
Note that the invention is distinguished from detector arrangements that use only one detector (branch/channel), e.g. as set forth in US 2005/0006597 A1 and EP 0 491 289 A1. In such set-ups, although one can observe an interferometric image, one cannot meaningfully interpret detected intensities; for example, one does not know if an above-average intensity value is due to constructive interference effects, or instead due to a fluorophore with a relatively high emission rate, or to a combination of both. Using more than one channel allows examination of intensity ratios, thus mitigating this problem. And further distinguished from detector arrangements that use three detectors (branches/channels), e.g. as described above/below, and as set forth in US 2006/0291043 A1 (in which it should be noted that no interferometric imaging is done: the three employed cameras are only used to detect different wavelengths).
There are various ways in which to realize/configure an illuminator of the type disclosed herein. In an embodiment, the illuminator comprises a beam splitter to produce a pair of coherent beams from a single source (e.g. a laser), a pair of reflectors to direct each of said pair of coherent beams through a respective one of the employed pair of projection systems, where the optical cavity comprises the beam splitter and the pair of reflectors. An example of such a set-up is depicted in
In an alternative embodiment to that set forth in the previous paragraph, the illuminator comprises a laser located at a first side of said analysis location to direct an input beam along a common optical axis of said pair of projection systems and through said specimen in a first direction, a movable mirror, located at a second, opposite side of said analysis location and arranged normal to said common optical axis, to reflect said input beam back upon itself and through said specimen in a second, opposite direction. An example of such a set-up is depicted in
In a refinement of the set-up described in the previous paragraph, the illuminator can optionally comprise an optical diode or 50:50 plate beam splitter (for example) provided between said laser and said movable mirror. Such an embodiment serves to mitigate feedback effects in the lasing cavity.
In the single-insertion embodiments just discussed, adjusting the axial position of the movable mirror (along the local optical axis) allows the phase of the standing wave (at the analysis location) to be modified. A similar effect can be achieved in the preceding “dual-insertion” embodiment by, for example incorporating an adjustable optical retarder element in the path of at least one of the two input beams (as shown in
As already stated above, the standing wave utilized in the present invention may be generated using light from the activating light source (e.g. a laser with a wavelength of 405 nm) or the exciting light source (e.g. a laser with a wavelength of 488 nm, 561 nm, 639 nm or 750 nm). Such aspects relate to the illumination architecture of the inventive microscope. In addition to illumination optics, the invention is also concerned with the detection optics of the microscope. In that regard, an embodiment of the invention is characterized in that the employed optical combining element (OCE) comprises a two-way beam-splitter (as already alluded to above). This can be used in conjunction with a detector arrangement comprising two cameras, which look at two mutually phase-shifted outputs from the (OCE), see
As already set forth above, the present invention uses an innovative illumination set up, which correspondingly allows an innovative detection set-up to be employed. In a further aspect of the present invention, said standing wave is produced using said first type of radiation, and said selected fluorophores are activated in a depth region of the specimen proximal to a local maximum of said standing wave. Such a scenario exploits the fact that a standing wave generated in the illuminator according to the invention will intrinsically have localized maxima and minima extending axially through the specimen, and that this effect can be exploited to activate fluorophores in a depth region that is relatively thin relative to a period of the standing wave.
In a particular aspect of the invention, a wavefront modifying means may be used to produce astigmatism in light entering the optical combining element. To this end, one could, for example, employ a cylindrical lens or mirror, or introduce a (cylindrical) stress into a planar mirror (such as a folding mirror), in at least one or both of the dual detection branches of the microscope. Introducing astigmatism (more generally: wavefront modification that varies in polarity as a function of axial position) in this manner causes an associated Point Spread Function (PSF) to demonstrate ellipticity “oscillations” as a function of Z—changing from elongate along Y, to circular, to elongate along X, etc. Observing the form of this PSF at a given axial position can then be used to help determine a Z-value for that position—more specifically, it acts as a check on the “sign” of a Z-coordinate of known amplitude.
The beam 1 encounters a two-way beam splitter 3, which divides the beam 1 into a pair of coherent light beams 5a, 5b, respectively located in two different “branches” or “arms” that originate from a beam-splitting surface 3′ in item 3. The beams 5a, 5b subsequently impinge on a respective pair of reflectors (e.g. mirrors) 7a, 7b, which divert the beams 5a, 5b onto (or approximately onto) a common optical axis O of co-linear projection systems P1, P2; in this way, diverted beam 5a traverses analysis area A along O through P1, whereas diverted beam 5b traverses analysis area A along O through P2, and these two diverted beams produce a (longitudinal/axial) standing wave at location A (and elsewhere in the path/optical cavity A, 7a, 3, 7b, A). As schematically illustrated in
Also symbolically/generically shown are optics 9, 11, which, for example, serve to focus/collimate the beams 5a, 5b. Moreover, as here depicted, an adjustable retarding element R is located in one of abovementioned “branches”, thus allowing the phase of the generated standing wave 31 to be adjusted. As an alternative or supplement to this, one could also shift (at least) one of the reflectors 7a, 7b—e.g. shift reflector 7a as shown by the arrow symbol beside it.
In
Optionally present in
As already set forth above, illumination of (a collection of fluorophores in) specimen S—using suitably chosen activation and excitation wavelengths—will cause (certain of) those fluorophores to emit fluorescence light, which is (partially) collected by projection systems P1, P2. Using canted dichroic mirrors (reflectors) 23, 25 (positioned on axis 0), light collected by P1 and P2 is respectively directed as beams B1, B2 into (a respective pair of input faces of) Optical Combining Element (OCE) C—which, in the current invention, can be a (relatively simple) two-phase beam splitter (combiner) rather than a (more complicated) three-phase beam splitter (combiner); within OCE C, the beams B1 and B2 optically interfere and produce an interference pattern (not depicted). A detector arrangement D—which here comprises two detectors Da, Db—is used to examine this interference pattern, by simultaneously looking at it along two different (mutually phase-shifted) “channels”: see
Referring now to
Iin1=(EB1+EB2)2 Iin2=(EB1−EB2)2.
The emission beam path of the cavity produces a phase shift of π between Iin1 and Iin2. The fluorescence wavelength in this particular instance is 530 nm, and the associated period of the intensity signals Iin1(Z) and Iin2(Z) is thus 530 nm/4=132.5 nm; however, these particular values are not limiting upon the current discussion. In a corresponding fashion,
Qin =(Iin1−Iin2)/(Iin1+Iin2).
(a) In conventional iPALM, the underlying problem is addressed by using three detection channels, which are mutually phase-shifted by 120°/240°; as a result, if the Normalized Differential Intensity (NDI) for a given Z-value and a given pair of channels lands in a dud zone, then one can instead use the NDI based on a different pair of channels, which (for the same Z-value) will (necessarily) lie outside a dud zone.
(b) In contrast, the present invention does not need to rely on such a third channel, and instead solves the problem of dud zones in a completely different manner. In this regard, reference is made to
Iin1, Iin2 at a first standing wave phase value Δφ;
Iin1′, Iin2′ at a second standing wave phase value δ+Δφ,
whereby the Quantum Efficiency (emission brightness) of the observed fluorescing fluorophore(s) should not (significantly) change during the measurement process (so that an observed intensity change can be validly attributed to a standing wave phase shift rather than a change in intrinsic brightness of the fluorophore(s)); this will typically imply an exposure time of the order of about 1-100 ms, for example. From these measurements, the Z-position of an observed portion (fluorescing fluorophore(s)) of the specimen can be determined. This can be done by “fitting” the measured intensity values to reference Q-versus-Z graphs obtained in a (previously performed) calibration session in which intensity signals from a test specimen (such as a gold nanoparticle) are registered as the test specimen is deliberately moved along Z.
With reference to the elucidation already given above regarding
This problem can be addressed using a technique that is also exploited in iPALM. If the wavefront of the fluorescence light reaching the OCE C is deliberately deformed so as to introduce astigmatism—e.g. by deliberately mechanically stressing one/preferably both of the folding mirrors 23, 25 in
The basic mathematical analysis of the interference pattern in a microscope according to the current invention is similar to that pertaining to iPALM. For more information in this regard, reference is (for example) made to the mathematical discussion in U.S. Pat. No. 7,924,432, which is incorporated herein by reference for all purposes.
Number | Date | Country | Kind |
---|---|---|---|
15190749 | Oct 2015 | EP | regional |
This application is a continuation of U.S. application Ser. No. 15/246,512, filed Aug. 24, 2016, issued as U.S. Pat. No. 9,885,660 on Feb. 6, 2018, and claims priority to European application number 15190749.0, filed Oct. 21, 2015, which is incorporated herein for all purposes.
Number | Name | Date | Kind |
---|---|---|---|
RE38307 | Gustafsson et al. | Nov 2003 | E |
7463344 | Wolleschensky et al. | Dec 2008 | B2 |
7583436 | Rygiel | Sep 2009 | B2 |
7599069 | Toussaint et al. | Oct 2009 | B2 |
7924432 | Hess et al. | Apr 2011 | B2 |
8237835 | Muller | Aug 2012 | B1 |
9885660 | Daum | Feb 2018 | B2 |
20050006597 | Wolleschensky et al. | Jan 2005 | A1 |
20060098188 | Buijsse et al. | May 2006 | A1 |
20060291043 | Bewersdorf et al. | Dec 2006 | A1 |
20080007248 | Zyss et al. | Jan 2008 | A1 |
20080158551 | Hess | Jul 2008 | A1 |
20090263002 | Cremer et al. | Oct 2009 | A1 |
20120002031 | Pertsinidis et al. | Jan 2012 | A1 |
20120193530 | Parker et al. | Aug 2012 | A1 |
20140160265 | Voegele et al. | Jun 2014 | A1 |
20140231644 | Botman et al. | Aug 2014 | A1 |
20140293015 | Hess | Oct 2014 | A1 |
20140333750 | Zhuang | Nov 2014 | A1 |
20150002632 | Kalkbrenner | Jan 2015 | A1 |
20150014552 | Nagatomi | Jan 2015 | A1 |
20150028205 | Botman et al. | Jan 2015 | A1 |
20160003740 | Tao | Jan 2016 | A1 |
Number | Date | Country |
---|---|---|
0491289 | Apr 1996 | EP |
Entry |
---|
“Fluorophore”, Wikipedia, Retrieved from the Internet Nov. 7, 2016, https://en.wikipedia.org/wiki/Fluorophore, 10 pages. |
“Super Resolution Microscopy”, Wikipedia, Retrieved from the Internet Nov. 4, 2016, https://en.wikipedia.org/wiki/Super-resolution_microscopy, 15 pages. |
Aquino, Daniel et al., “Two-color nanoscopy of three-dimensional vols. By 4Pi detection of stochastically switched fluorophores”. Nature Methods, vol. 8. No. 4., Apr. 1, 2011. pp. 353-359. XP055260855. GB ISSN: 1548-7091. DOI: 10.1038/nmeth.1583. |
Hell, Stefan W. et al., “Enhancing the Axial Resolution in Far-field Light Microscopy: Two-photon 4Pi Confocal Fluorescence Microscopy,” J.Modern Optics (1994), vol. 41 No. 4) pp. 675-681. |
Lippincott-Schwartz, J., et al. “Photoactivatable fluorescent proteins for diffraction limited and super-resolution imaging”, Trends Cell Biology, Nov. 2009, pp. 555-565, vol. 19 Issue 11, Elsevier. |
Raymo, F. “Photoactivatable Fluorophores”, ISRN Physical Chemistry, Aug. 16, 2012, vol. 2012, Article ID 619251, 16 pages. |
Shao, L., et al. “I5S: Wide-Field Light Microscopy with 100-nm-Scale Resolution in Three Dimensions”, Biophysical Journal, Jan. 6, 2009, pp. 4971-4983, vol. 94 Issue 12. |
Shtengel, G., et al. “Interferometric fluorescent super-resolution microscopy resolves 3D cellular ultrastructure”, PNAS, Feb. 6, 2009, pp. 3125-3130, vol. 106 No. 09. |
Unknown, “Super Resolution Microscopy,” Retrieved from the Internet Nov. 7, 2016; http://www.mechanobio.info/topics/methods/super-resolution-microscopy-intro; 11 pages. |
Number | Date | Country | |
---|---|---|---|
20180195962 A1 | Jul 2018 | US |
Number | Date | Country | |
---|---|---|---|
Parent | 15246512 | Aug 2016 | US |
Child | 15880945 | US |