This invention relates generally to microscopy, and, more particularly, to an imaging interferometric microscope.
Optical microscopy is among the oldest applications of optical science and remains one of the most widely used optical technologies. In spite of impressive results obtained by fluorescent microscopy in exceeding the classical diffraction limit, non-fluorescent transmission/reflection microscopy remains an important field of modern research. However, using traditional illumination schemes, resolution is limited to ˜K1λ/NA where λ is the source wavelength and NA is the numerical aperture (sine of the half-acceptance angle) of the imaging objective lens. The “constant” K1 depends on both the details of the image and on the illumination scheme. For example, K1 can be between 0.25 and 1. Hence, traditional approaches to improve resolution are either to use shorter wavelengths and/or to use larger numerical-aperture lenses. For biological samples, however, the wavelength is constrained to the visible spectral range because ultraviolet photons can damage samples. In many practical cases, even for inorganic samples, the wavelength is limited to the deep ultraviolet (for example 193 nm) since transmissive optical materials become difficult at shorter wavelengths (fused quartz has a cutoff at ˜185 nm). Furthermore, a disadvantage of using a high-NA lens is the resulting short depth-of-field (an essential feature of achieving high resolution in a single image; typically the depth-of-field scales as K2λ/NA2 where K2 is a second “constant” of order unity). The depth-of-field decreases rapidly as the NA is increased to increase the resolution. In addition, the field of view (the area over which the resolution is achieved) and the working distance (the distance from the final lens surface to the object plane) are reduced for higher-NA optical systems. These latter two issues can be surmounted by more complex objective lenses, with an increase in the cost of manufacturing. These tradeoffs are well known and are discussed in many microscopy overviews.
Synthetic aperture approaches, such as, for example, imaging interferometric microscopy (IIM), extend the collected spatial frequencies to improve the image. IIM, with both illumination and collection in a transmission medium (usually air), uses a low-NA objective and yet provides a resolution approximately a factor of two better than that available even with a high-NA objective using conventional coherent or incoherent illumination. A major advantage is that the depth-of-field, field-of-view and working distance associated with the low-NA system are retained, but the final composite image has a resolution at the linear system limit imposed by the transmission medium (≧λ4n where λ is the wavelength in free space and n is the index of refraction of the transmission medium), and significantly better than that accessible with even a high NA lens using conventional (coherent or incoherent) illumination approaches.
An exemplary IIM with two offset partial images, one each in orthogonal spatial directions can result in an increased resolution by three times using about 0.4-NA objective and 633-nm He—Ne laser. Furthermore, IIM requires building an interferometric system around the objective lens which is an issue for wide-spread adoption of this approach, and in particular towards its adoption to the existing microscopes. In the prior art, this interferometer required additional optics to relay the pupil plane of the collection objective to convenient location; this is straightforward but required significant additional optics. Hence, there is a need for a new approach that does not require a large change to the imaging optical system that comprises the objective lens and subsequent optical components.
The prior art imaging interferometric microscopy was able to image maximum spatial frequency of 2π/λ e.g. to the linear system's limit of the air (transmission medium between the object and the lens). The ultimate linear system limit is 2πn/λ, which reflects the use of an immersion medium of refractive index n. Even though materials with refractive indices of up to about 5 are known at some optical wavelengths, the highest numerical aperture available for the immersion microscopy is about 1.4, limited by the refractive index of the glass used to make the lens, by the refractive indices available for the index matching fluids, and the well known difficulties of making aberration corrected optics of high NA. Hence, there is a need for a new approach that can achieve this linear system limit without requiring index-matching fluids or high NA lenses.
As is well-known, using off-axis illumination provides enhanced resolution over that available with either of the standard illumination schemes discussed above, but there is some distortion of the image associated with the resultant non-constant transfer function for different regions of frequency space. This non-uniform frequency-space coverage can be addressed with appropriate pupil plane filters and by combining partial images corresponding to different parts of frequency space, as has been previously demonstrated in the case of imaging interferometric lithography
In implementations, a method for microscopy is disclosed that includes providing a plane-parallel optical element operable to be positionable adjacent to an object, wherein the plane-parallel optical element is characterized by a homogeneous refractive index (npp) and a thickness (tpp), such that a distance of separation between the plane-parallel optical element and the object is within about a wavelength of illumination light incident upon the object; providing a first optical system disposed to provide a substantially coherent illumination of the object, wherein the illumination light is characterized by a wavelength λ, a radius of curvature, a center position, and a field-of-view and disposed at one of a plurality of incident wave vectors from about 0 to about 2πnpp/λ with respect to a surface normal of the plane-parallel optical element and at a plurality of azimuth angles spanning about 0 to 2π; providing a second optical system including one or more optical components defining an optical axis which is disposed on a side of the plane parallel optical element, the second optical system including a first set of optical media characterized by indices of refraction and thicknesses in which light scattered by the object propagates to the first optical component of the second optical system, an effective numerical aperture (NApp) of the combined one or more optical components of the second optical system, a focal plane of the optical system conjugate with a image plane of an optical image recording device, and a field-of-view in the focal plane, wherein the optical axis of the second optical system is disposed at one of a plurality of angles between 0 and π/2−NApp with respect to the surface normal of the plane-parallel optical element, the field-of-view of the second optical system is located at a center offset from the center position of the illumination provided by the first optical system, and wherein the one or more optical components of the second optical system are operable to collect at least a portion of the illumination scattered by the object; and providing a third optical system disposed in an optical path of the first optical system to provide interferometric reintroduction of a portion of the coherent illumination as a reference beam into the third optical system, wherein each of an amplitude, a phase, a radius of curvature, a path length, and an angle of incidence of the reference beam is adjustable such that a reference illumination suitable for interfering with the portion of the illumination scattered by the object and collected by the second optical system is present at an image plane of the second optical system; recording a sub-image of the object at an image plane of the second optical system using the image recording device, wherein the sub-image is formed as a result of interference between the scattering resulting from the coherent illumination of the object and the reference beam; adjusting the first, the second, and the third optical systems to collect a plurality of sub-images corresponding to a plurality of regions of the object spatial frequency space; and combining the plurality of sub-images into a composite image to provide an image of the object. The subscript “pp” is used to denote the plane-parallel optical element.
In implementations, the second optical system can further comprise one or more gratings on an outward facing surface of the plane parallel optical element, away from the object, the grating being in a far field region of the scattering of the illumination by the object, wherein each grating is characterized by a position, including a center position and a spatial extent, a period, and a grating profile and wherein each grating is operable to decouple a subset of the coherent radiation scattered by the object at angles that are beyond the NApp of the second optical system into the first optical medium of the second optical system at angles smaller than ±sin−1(NApp) of the second optical system.
In implementations, the method can further comprise translating the center offset of the field of view of the second optical system, relative to the center of the field-of-view of the first optical system, to collect subsets of the illumination scattered from the object.
In implementations, the translation of the center offset of the field-of-view of the second optical system can be within an extent of a single grating for which a width of the spatial extent of the grating is greater than the field-of-view of the second optical system, thereby affecting an increased field-of-view of the second optical system.
In implementations, the translation of the center offset of the field-of-view of the second optical system can be larger than a width of a first grating of the one or more gratings, resulting in the field-of-view of the second optical system being positioned over a second grating of the one or more gratings with a different pitch from the first grating, thereby accessing a different subset of the scattered waves from the object.
In implementations, the plane-parallel optical element can be arranged to be physically coupled, and therefore provide, at least a portion of the mechanical support of the object.
In implementations, the plane-parallel optical element can be a superstrate that is arranged to be held or positionable to within about an illumination wavelength of the object.
In implementations, the one or more sub-images can be recorded with the optical axis of the second optical system on the same side of the plane parallel optical element as the object and at an angle between 0 and π/2−NApp relative to the normal of the plane-parallel optical element and the center of field-of-view of the second optical system is positioned over the center of the field-of-view of the first optical system.
In implementations, the one or more sub-images can be recorded with the optical axis of the second optical system on a side of the plane parallel optical element opposite the object, normal to the plane-parallel optical element, and the field-of-view of the second optical system is positioned over one of the one or more gratings, thereby collecting and recording additional spatial frequencies of the illumination scattered by the object.
In implementations, the method can further comprise manipulating each of the sub-images to correct for distortions and alterations introduced by the combinations of the first, the second, and the third optical systems.
In implementations, the providing a third optical system can further comprise collecting a portion of the coherent illumination by splitting the coherent illumination using a beam splitter disposed in an optical path of the first optical system; and interferometrically reintroducing the portion of the coherent illumination as a reference beam after an exit aperture of a collection lens of the second optical system, wherein the reintroduction is at one of a position, an amplitude, a phase, a radius of curvature, a path length, and an angle of incidence such that either a correct sub-image or an aliased sub-image with reduced spatial frequencies is produced.
In implementations, the providing a third optical system can further comprise collecting a portion of the coherent illumination by splitting the coherent illumination using a beam splitter disposed in an optical path of the first optical system; and interferometrically reintroducing the portion of the coherent illumination as a reference beam using a second beam combining device before the entrance aperture of a collection lens of the second optical system, wherein the reintroduction is at an angle less than the acceptance angle of the collection lens of the second optical system, wherein the second beam combining device is selected from the group consisting of: a beamsplitter, a grating coupler, and a waveguide filter.
In implementations, an apparatus for microscopy is disclosed that can comprise a plane parallel optical element, characterized by a homogeneous refractive index (npp) and a thickness (tpp), a mechanical mechanism arranged to support an object, such that a separation between the plane parallel optical element and the object is within about a wavelength of an illumination light with which the object is illuminated; a first optical system operable to provide a substantially coherent illumination of the object, the illumination characterized by a wavelength λ, a radius of curvature, a center position, and a field-of-view and disposed at one of a plurality of incident wave vectors from about 0 to about 2πnpp/λ, with respect to a surface normal of the substrate and at a plurality of azimuth angles spanning about 0 to 2π; a second optical system; including one or more optical components defining an optical axis operable to be positioned on a side of the plane parallel optical element, the second optical system including a first set of optical media characterized by indices of refraction and thicknesses in which light scattered by the object propagates from the object, a numerical aperture (NApp) of the combined one or more optical components of the second optical system, a focal plane of the object conjugate with an image plane of an image recording device, and a field-of-view in the focal plane; wherein the optical axis of the second optical system can be disposed at one of a plurality of angles between about 0 and about π/2−NApp with respect to the plane parallel optical element surface normal; the field-of-view of the second optical system is located at a center offset from the center position of the illumination provided by the first optical system, and wherein the one or more optical components are operable to collect at least a portion of the illumination scattered by the object; a third optical system operable to be positioned in an optical path of the first optical system to provide interferometric reintroduction of a portion of the coherent illumination as a reference beam into the third optical system, wherein each of an amplitude, a phase, a radius of curvature, a path length, and an angle of incidence of the reference beam is adjustable such that a reference illumination suitable for interfering with the portion of the illumination scattered by the object and collected by the second optical system is present at an image plane of the second optical system; an image recording device operable to record a sub-image of the object at an image plane of the second optical system, wherein the sub-image is formed as a result of interference between the scattering resulting from the coherent illumination of the object and the reference beam; an adjustment mechanism operable to configure the first, the second, and the third optical systems to collect a plurality of sub-images corresponding to a plurality of regions of the object spatial frequency space; and a signal processing device operable to combine the plurality of sub-images into a composite image to provide an image of the object.
In implementations, the second optical system can further comprise one or more gratings on an surface of the plane-parallel optical element opposite the object, the interface being in a far field region of the scattering of the illumination by the object, wherein each grating is characterized by a position, including a center position and a spatial extent, a period, and a grating profile and wherein each grating is operable to decouple a subset of the coherent radiation scattered by the object at angles that are beyond the NApp of the second optical system into the first optical medium of the second optical system at angles smaller than ±sin−1(NApp) of the second optical system.
In implementations, the apparatus can further comprise one or more optical, mechanical, or both optical and mechanical elements operable to translate the center offset of the field of view of the second optical system, relative to the center of the field-of-view of the first optical system, to collect subsets of the illumination scattered from the object.
In implementations, the translation of the center offset of the field-of-view of the second optical system can be within an extent of a single grating for which a width of the spatial extent is greater than the field-of-view of the second optical system, thereby affecting an increased field-of-view of the second optical system.
In implementations, the extent of the translation of the center offset of the field-of-view of the second optical system can be larger than a width of a first grating of the one or more gratings, resulting in the field-of-view of the second optical system being positioned over a second grating of the one or more gratings with a different pitch from the first grating, thereby accessing a different subset of the scattered waves from the object.
In implementations, any, or combinations of, the first, the second, or the third optical systems can be arranged such that one or more sub-images are recorded with the optical axis of the second optical system on a side of the plane-parallel optical element away from the side facing the object and at an angle between about 0 and about π/2−NApp relative to the normal of the plane-parallel optical element and the center of field-of-view of the second optical system is positioned over the center of the field-of-view of the first optical system.
In implementations, the sub-images depend on both the illumination system, for example, the first and the third optical systems, and collection systems, for example, the second optical system. The third optical system can also provide a spatial frequency offset. In implementations, all three optical systems are needed to correctly interpret the sub-image.
In implementation, the second optical system can be arranged such that one or more sub-images are recorded with the optical axis of the second optical system on the outward facing side of the plane-parallel optical element, normal to the plane-parallel optical element, and the field-of-view of the second optical system is positioned over one of the one or more gratings, thereby collecting and recording additional spatial frequencies of the illumination scattered by the object.
In implementation, the apparatus can further comprise one or more electrical, optical, or both electrical and optical element operable to manipulate each of the sub-images to correct for distortions and alterations introduced by the combinations of the first, the second, and the third optical systems.
In implementations, the third optical system can further include one or more optical elements operable to collect a portion of the coherent illumination by splitting the coherent illumination using a beam splitter disposed in an optical path of the first optical system; and one or more optical elements operable to interferometrically reintroduce the portion of the coherent illumination as a reference beam after an exit aperture of a collection lens of the second optical system, wherein the reintroduction is at one of a position, an amplitude, a phase, a radius of curvature, a path length, and an angle of incidence such that either a correct sub-image or an aliased sub-image with reduced spatial frequencies is produced.
In implementations, the third optical system can further include one or more optical elements operable to collect a portion of the coherent illumination by splitting the coherent illumination using a beam splitter disposed in an optical path of the first optical system; and one or more optical elements operable to interferometrically reintroduce the portion of the coherent illumination as the reference beam using one or more optical components before the entrance aperture of a collection lens of the second optical system, wherein the reintroduction is at an angle less than the entrance aperture of the collection lens of the second optical system, wherein the one or more optical components that are operable to reintroduce the reference beam are selected from the group consisting of: a beamsplitter, a grating coupler, and a waveguide filter.
In accordance with various embodiments, an apparatus for coherent anti-Stokes Raman (CARS) microscopy is disclosed. The apparatus can comprises an object plane on which is disposed a first surface of a planar substrate, wherein the substrate is characterized by a homogeneous refractive index and a surface normal, wherein the substrate is arranged to support an object; a first optical system disposed to provide an illumination of the object plane, the illumination characterized by two substantially coincident coherent beams with wavelengths λ1 and λ2 and corresponding angular frequencies ω1 and ω2 with ω1>ω2, a radius of curvature, and disposed at one of a plurality of incident wave vectors from about 0 to about 2πnsub/λ1 with respect to the surface normal of the substrate and at a plurality of azimuth angles spanning about 0 to about 2π; a second optical system having an optical axis disposed at one of a plurality of center wave vectors from about 0 to about 2πnsub/λ1 with respect to the surface normal of the substrate, wherein the second optical system is characterized by a numerical aperture and is responsive to optical signals at frequencies greater than ω1; a third optical system disposed between the first optical system and an entrance aperture of a first optical element of the second optical system to provide interferometric reintroduction of the illumination as a reference beam at an angular frequency of 2ω1−ω2 into the second optical system, wherein each of an amplitude, a phase, a radius of curvature and an angle of incidence of the reference beam is arranged to be adjusted such that a corrected reference wave is present at an image plane of the second optical system; an electronic image device disposed at the image plane of the second optical system and operable to respond linearly to a local optical intensity and transfer a local optical intensity map across the image plane as a sub-image to a signal processor device in electronic form; one or more devices operable to adjust the first, the second, and the third optical systems to collect sub-images for different pairs of the pluralities of incident illumination wave vectors from the first optical system and collection angles from the second optical system so as to sequentially obtain a plurality of sub-images corresponding to a plurality of regions of spatial frequency space, wherein the signal processor device is operable to sequentially receive the electronic form of the sub-images and manipulate the sub-images to correct for distortions and alterations introduced by the optical configuration, store, and combine the plurality of sub-images corresponding to the plurality of regions of spatial frequency space to create a composite image. In some aspects, the substrate can be air.
In some aspects, the third optical system can further comprise a first beamsplitter disposed in an optical path of the first optical system before the object to collect a portion of the coherent illumination; and one or more optics disposed between the first optical system and an entrance aperture of a first optical element of the second optical system, wherein the optics comprises a nonresonant nonlinear material configured to generate anti-Stokes four-wave mixing frequency 2ω1−ω2 and exclude the frequencies ω1 and ω2 and to interferometrically reintroduce a portion of the anti-Stokes illumination as the reference beam into the second optical system in a position after an exit aperture of a collection lens of the second optical system, wherein the reintroduction is at one of a position corresponding to a position a zero-order beam would have had if it had been transmitted through an appropriate higher numeric aperture lens of the second optical system or an aliased position to reduce pixel requirements of the electronic image device, wherein the signal processor is operable to compensate for spatial frequency aliasing.
In some aspects, the third optical system can further comprise a first beamsplitter disposed in an optical path of the first optical system to collect a portion of the coherent illumination; one or more transfer optics disposed between the first optical system and an entrance aperture of a first optical element of the second optical system, wherein the optics comprises a nonresonant nonlinear material configured to generate anti-Stokes four-wave mixing frequency 2ω1−ω2 and exclude the frequencies ω1 and ω2; and a second beamsplitter disposed between the object and an entrance aperture of a collection lens of the second optical system to reintroduce the portion of the anti-Stokes coherent illumination as the reference beam into the second optical system at an angle less than an entrance angular aperture of the second optical system.
In some aspects, the third optical system can further comprise a first beamsplitter disposed in an optical path of the first optical system to collect a portion of the coherent illumination; one or more transfer optics disposed between the first optical system and the second optical system, wherein the optics comprises a nonresonant nonlinear material configured to generate anti-Stokes four-wave mixing frequency 2ω1−ω2 and exclude the frequencies ω1 and ω2; and at least one of a grating or a grating on a waveguide disposed between the object and an entrance aperture of a first optical element of the second optical system to reintroduce a portion of the anti-Stokes coherent illumination as the reference beam into the second optical system at an angle less than an entrance angular aperture of the second optical system.
In some aspects, the third optical system can further comprise a first beamsplitter disposed in an optical path of the first optical system to collect a portion of the coherent illumination; one or more transfer optics, wherein the optics comprises a nonresonant nonlinear material configured to generate anti-Stokes four-wave mixing frequency 2ω1−ω2 and exclude the frequencies ω1 and ω2; an optical element operable to direct a portion of the anti-Stokes coherent illumination as the reference beam to illuminate the object at an angle corresponding to less than an entrance angular aperture of the second optical system; and a dynamic physical block disposed in a back pupil plane of the second optical system to alternately block and unblock a portion of a pupil aperture corresponding to the position of the reference beam in the aperture.
In some aspects, the third optical system can further comprise a first beamsplitter disposed in an optical path of the first optical system to collect a portion of the coherent illumination; one or more transfer optics, wherein the optics comprises a nonresonant nonlinear material configured to generate anti-Stokes four-wave mixing frequency 2ω1−ω2 and exclude the frequencies ω1 and ω2; an optical element operable to direct the portion of the anti-Stokes coherent illumination as the reference beam to illuminate the object at an angle corresponding to less than an entrance angular aperture of the second optical system; and a guided-mode resonance filter disposed between the object and a collection lens of the second optical system to sequentially block and unblock the transmission of the reference beam.
In some aspects, the apparatus can further comprise at least one known reference object to cover a part of an image field.
In some aspects, the first, the second, and the third optical systems are arranged in at least one of a transmission configuration or a reflection configuration.
In some aspects, the plurality of incident wave vectors of the first optical system can comprise wave vectors<2π/λ1, wherein the wave vectors are accessed by illumination of the substrate at polar angles between 0 and π/2.
In some aspects, the plurality of incident wave vectors of the first optical system can comprise wave vectors between 2π/λ1 and 2πnsub/λ1, wherein the wave vectors are accessed by evanescent wave illumination of the object through the substrate of refractive index nsub.
In some aspects, the plurality of center wave vectors of the second optical system can comprise only center wave vectors<2π/λ1, wherein the center wave vectors are accessed by an optical system above the object plane of the substrate.
In some aspects, the plurality of center wave vectors of the second optical system can comprise center wave vectors between 2π/λ1 and 2πnsub/λ1, wherein the center wave vectors greater than 2π/λ1 are accessed through the plane parallel optical element and the second optical system comprises a plurality of gratings on a side of the plane parallel optical element opposite the object plane, wherein each grating is characterized by a position, a pitch, and a grating profile.
In accordance with some aspects of the present disclosure, a method for coherent anti-Stokes Raman (CARS) microscopy is disclosed. The method can comprise providing an object atop an object plane disposed upon a plane-parallel optical element, wherein the plane parallel optical element is characterized by a homogeneous refractive index (npp) and a surface normal; providing a first optical system disposed to provide an illumination of the object plane, the illumination characterized by two substantially coincident coherent beams with wavelengths λ1 and λ2 and corresponding angular frequencies ω1 and ω2 with ω1>ω2, a radius of curvature, and disposed at one of a plurality of incident wave vectors from about 0 to about 2πnpp/λ1 with respect to the surface normal of the substrate and at a plurality of azimuth angles spanning 0 to about 2π; providing a second optical system having an optical axis disposed at one of a plurality of center wave vectors from about 0 to about 2πnpp/λ1 with respect to the surface normal, wherein the second optical system is characterized by a numerical aperture and is responsive to optical signals at frequencies greater than ω1; providing a third optical system disposed between the first optical system and an entrance aperture of a first optical element of the second optical system to provide interferometric reintroduction of a reference illumination as a reference beam at a frequency of 2ω1−ω2, into the second optical system, wherein each of an amplitude, a phase, a radius of curvature and an angle of incidence of the reference is operable to be adjusted such that a corrected reference wave is present at an image plane of the second optical system; recording a sub-image of the object at an object plane using an electronic image device disposed at the image plane of the second optical system that responds linearly to a local optical intensity and transfers a local optical intensity map across the image plane as a sub-image to a signal processor in electronic form, wherein the sub-image is formed as a result of interference between the scattering resulting from the coherent illumination of the object and the reference beam; providing one or more devices operable to adjust the first, the second, and the third optical systems to sequentially collect sub-images for different pairs of the pluralities of illumination wave vectors from the first optical system and collection angles from the second optical system so as to sequentially obtain a plurality of sub-images corresponding to a plurality of regions of spatial frequency space; providing a signal processor device operable to sequentially receive the electronic form of the sub-images and manipulate the sub-images to correct for distortions and alterations introduced by the optical configuration, to store and combine the plurality of sub-images corresponding to the plurality of regions of spatial frequency space into a composite image.
In some aspects, the method can further comprise tuning a frequency difference ω1−ω2 of the two substantially coplanar and spatially coherent plane waves through Raman resonances of one or more materials in the object.
In some aspects, the plane parallel optical element can be replaced by an air path from the object to the first optical element of the second optical system.
In some aspects, the method can include providing a third optical system further comprising collecting a portion of the coherent illumination using a first beamsplitter disposed in an optical path of the first optical system; and interferometrically reintroducing using one or more optics disposed between the first optical system and an entrance aperture of a first optical element of the second optical system a coherent anti-Stokes 2ω1−ω2 reference beam and excluding the frequencies ω1 and ω2 into the second optical system in a position after an exit aperture of a collection lens, wherein the reintroduction is at one of a position corresponding to a position a zero-order beam would have had if it had been transmitted through an appropriate numeric aperture lens of the second optical system or an aliased position to reduce pixel requirements of the electronic image device, wherein the signal processor is adjusted to compensate for this spatial frequency aliasing.
In some aspects, the method can include providing a third optical system further comprising providing a first beamsplitter in an optical path of the first optical system to collect a portion of the coherent illumination; using one or more transfer optics disposed between the first optical system and the second optical system, wherein the optics comprises a nonresonant nonlinear material configured to generate anti-Stokes four-wave mixing frequency 2ω1−ω2 and exclude the frequencies ω1 and ω2; and interferometrically injecting an anti-Stokes reference beam using a second beamsplitter disposed between the object and a collection lens of the second optical system at an angle less than an entrance angular aperture of the second optical system.
In some aspects, the method can include providing the third optical system further comprising providing a first beamsplitter in an optical path of the first optical system to collect a portion of the coherent illumination; providing one or more transfer optics disposed between the first optical system and the second optical system, wherein the optics comprises a nonresonant nonlinear material configured to generate anti-Stokes four-wave mixing frequency 2ω1−ω2 and exclude the frequencies ω1 and ω2; and using at least one of a grating or a grating on a waveguide disposed between the object and a collection lens of the second optical system to reintroduce the portion of the anti-Stokes coherent illumination as the reference beam into the second optical system at an angle less than an entrance angular aperture of the second collection optical system.
In some aspects, the method can include providing the third optical system further comprising providing a first beamsplitter in an optical path of the first optical system to collect a portion of the coherent illumination; using one or more transfer optics, wherein the optics comprises a nonresonant nonlinear material configured to generate anti-Stokes four-wave mixing frequency 2ω1−ω2 and exclude the frequencies ω1 and ω2 to direct the portion of the anti-Stokes coherent illumination as the reference beam to illuminate the object at an angle corresponding to less than an entrance angular aperture of the second optical system; and providing a dynamic physical block disposed in a back pupil plane of the second optical system to alternately block and unblock a portion of a pupil aperture corresponding to a position of the reference beam in the aperture.
In some aspects, the method can include providing the third optical system further comprising providing a first beamsplitter in an optical path of the first optical system to collect a portion of the coherent illumination; providing one or more transfer optics, wherein the optics comprises a nonresonant nonlinear material configured to generate anti-Stokes four-wave mixing frequency 2ω1−ω2 and exclude the frequencies ω1 and ω2; directing the portion of the anti-Stokes coherent illumination as the reference beam to illuminate the object at an angle corresponding to less than an entrance angular aperture of the second optical system; and providing a guided-mode resonance filter between the object and a collection lens of the second optical system to sequentially block and unblock transmission of the reference beam.
In some aspects, the method can include providing at least one known reference object to cover a part of an image field.
In some aspects, the first, the second, and the third optical systems can be arranged in at least one of a transmission configuration or a reflection configuration.
In some aspects, the plurality of incident wave vectors of the first optical system can comprise only wave vectors<2π/λ1, wherein the wave vectors are accessed by illumination of the plane parallel optical element at polar angles between 0 and π/2.
In some aspects, the plurality of incident wave vectors of the first optical system can comprise wave vectors between 2π/λ1 and 2πnpp/λ1, wherein the wave vectors are accessed by evanescent wave illumination of the object through the plane parallel optical element.
In some aspects, the plurality of center wave vectors of the second optical system can comprise only center wave vectors<2π/λ1, wherein the center wave vectors are accessed by an optical system above the object plane of the plane parallel optical element.
In some aspects, the plurality of center wave vectors of the second optical system can comprise center wave vectors between 2π/λ1 and 2πnpp/λ1, wherein the center wave vectors greater than 2π/λ1 are accessed through the plane parallel optical element and the second optical system comprises a plurality of gratings on the side of the planar plane parallel optical element opposite the object plane, wherein each grating is characterized by a position, a pitch, and a grating profile.
In some aspects, the method can further comprise one or more processes of subtracting dark field images, subtracting of background images, shifting of spatial frequencies in accordance with an optical configuration, and eliminating one or more overlapping coverage of frequency space.
In some aspects, the method can further comprise selecting regions of spatial frequency space to provide the image of the object in the object plane.
Additional objects and advantages of the invention will be set forth in part in the description which follows, and in part will be obvious from the description, or may be learned by practice of the invention. The objects and advantages of the invention will be realized and attained by means of the elements and combinations particularly pointed out in the appended claims.
It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the invention, as claimed.
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate several embodiments of the invention and together with the description, serve to explain the principles of the invention.
Reference will now be made in detail to the present embodiments, examples of which are illustrated in the accompanying drawings. Wherever possible, the same reference numbers will be used throughout the drawings to refer to the same or like parts.
Notwithstanding that the numerical ranges and parameters setting forth the broad scope of the invention are approximations, the numerical values set forth in the specific examples are reported as precisely as possible. Any numerical value, however, inherently contains certain errors necessarily resulting from the standard deviation found in their respective testing measurements. Moreover, all ranges disclosed herein are to be understood to encompass any and all sub-ranges subsumed therein. For example, a range of “less than 10” can include any and all sub-ranges between (and including) the minimum value of zero and the maximum value of 10, that is, any and all sub-ranges having a minimum value of equal to or greater than zero and a maximum value of equal to or less than 10, e.g., 1 to 5. In certain cases, the numerical values as stated for the parameter can take on negative values. In this case, the example value of range stated as “less that 10” can assume negative values, e.g. −1, −2, −3, −10, −20, −30, etc.
An object of the present teachings is to reduce or eliminate the requirement of the prior art for optical access to between the back of the objective lens and the image plane of the second optical system. This access is required for injecting the reference beam 109 in the prior art (
In certain embodiments apparatus 200 for an exemplary structured illumination approach to IIM can also include at least one known reference object to cover a small part of the image field.
According to various embodiments, there is a method for structural imaging interferometric microscopy. The method can include providing an object 220 disposed over a planar substrate 225, wherein the substrate 225 is characterized by a homogeneous refractive index (nsub) and a surface normal 226 and providing a first optical system to illuminate the object 220 with substantially coherent illumination 210, the illumination characterized by a wavelength λ and a radius of curvature and disposed at one of a plurality of incident wave vectors from about 0 to about 2π/λ with respect to a surface normal of the substrate and at a multiplicity of azimuth angles spanning from about 0 to about 2π. The method can also include providing a second optical system 230 disposed to collect portions of the illumination scattered from the object plane 222, the second optical system 230 having an optical axis 236 disposed at one of a plurality of center wave vectors from about 0 to about 2π/λ with respect to the substrate 225 surface normal 226 and at the azimuth angle corresponding to the illumination of the first optical system, wherein the second optical system 230 is disposed such that the object 220 is substantially at the object plane 222 of the second optical system 230 which is characterized by a numerical aperture (NA). The method can further include providing a third optical system disposed between the optical path of the first optical system and an entrance aperture of the second optical system to provide interferometric reintroduction of a portion of the coherent illumination (reference beam) 210′ into the second optical system, wherein each of an amplitude, a phase, a radius of curvature and an angle of incidence of the reference can be adjusted such that a corrected reference wave is present at the image plane of the second optical system, wherein the corrected reference beam 210′ and the illumination beam 210 are within the temporal coherence length of the source. The method can also include recording a sub-image of the object 220 at an object plane 222 using an electronic image device 228, wherein the sub-image is formed as a result of interference between the scattering resulting from the coherent illumination of the object 220 and the reference beam 210′. The method can also include adjusting the first, the second, and the third optical systems to sequentially collect a plurality of sub-images corresponding to a plurality of regions of spatial frequency space, manipulating each of the plurality of sub-images using a signal processor to correct for distortions and alterations introduced by the optical configuration, and combining the plurality of sub-images into a composite image to provide a substantially faithful image of the object 220. In various embodiments, the method can further include one or more processes of subtraction of dark field images, subtraction of background images, shifting of spatial frequencies in accordance with the optical configuration, and elimination of one or more overlapping coverages of the frequency space wherein the elimination operations can be performed either in the optical systems or in the signal processing. In some embodiments, the method can also include selecting the regions of spatial frequency space to provide a more or less faithful image of the object 220 in the object plane 222. One of ordinary skill in the art would know that the regions of frequency space that are important vary depending on the object. For example for a Manhattan geometry pattern, there is less need to gather spectral information on the diagonals. See, for example, Neumann et al. in Optics Express, Vol. 16, No. 10, 2008 pp 6785-6793 which describes a structural illumination for the extension of imaging interferometric microscopy, the disclosure of which is incorporated by reference herein in its entirety.
To mathematically explain the structured illumination approach to IIM, first a simple mathematical description of a conventional coherent illumination microscopy image will be described and then the mathematical description will be extended to the prior art IIM experiment and finally to the structured illumination approach.
The total transmission through an arbitrary object (assumed to be periodic on large scale to allow Fourier sums rather than Fourier integrals) and illuminated by a plane wave at normal incidence can be given by:
where ωx, ωy are the discrete spatial frequency increments of the Fourier summation; x and y are orthogonal spatial coordinates;
with n the refractive index of the transmission medium (1 for air); R is the set of integers, for which (|yk,l|)2>0, that is the range of integers for which the diffracted beams are within the bandpass of the transmission medium and are propagating in the z-direction, away from the object. Note that this representation is a scalar approximation that is appropriate as long as the angles do not get too large, and it is assumed below that all beams are polarized in the same direction. A more rigorous treatment is straightforward, but mathematically gets more complex and obscures the physical insight in these simpler equations.
The transmission through the optical system adds a filter factor:
The transmission function of the objective lens is a simple bandpass function:
and the final image intensity can be obtained by taking the square modulus of equation 2, viz:
Each of the three lines in this result has a simple physical interpretation. The top line is a constant independent of spatial coordinates, equal to the average intensity of the pattern. This ensures that the intensity is always positive as physically required. The second line represents the imaging terms that are retained. Finally the third line is the cross-correlation of the diffracted beams with themselves equivalent to the dark field image that would be obtained if the zero-order diffraction (transmission) was blocked at the back pupil plane. The imaging terms are band-limited to transverse spatial frequencies of (2π/λ)NA; the dark field terms extend out to (4π/λ)NA and are typically weaker in intensity than the imaging terms since for an object with thickness<<λ, |A0,0| is larger than any of the diffracted terms. In all of the summations the summation indices extend over all terms in R except for the zero-order term which has been explicitly separated out. Equation 4 gives the intensity over all space beyond the objective lens. The image is obtained in the back image plane (z=0) where the exponentials in γz vanish. The focusing information is contained in these exponential terms and its characteristic length, the depth-of-field, depends on the NA, as is well known. A Fourier optics perspective provides additional insight into the three terms. The DC term (top line) is a δ-function at the origin. The image terms fill a circle of radius 2πNA/λ as a result of the band-limited transmission function. Finally, the dark-field image contains frequencies up to 4πNA/λ as a result of the interference of the various diffracted orders.
It is well-known that additional, higher spatial frequency, information can be accessed with off-axis illumination.
The result is that higher spatial frequency information is transmitted through the lens, but only a dark field image is recorded in a traditional coherent illumination microscopy configuration (without the reference beam 109). This is solved in IIM by introducing an auxiliary optical system 135, an interferometer that reinjects the zero-order transmission on the low-NA side of the lens to reset the spatial frequencies. In practice it is simpler to reintroduce the zero-order transmission as an appropriately mode matched point source in the back pupil plane without actually using the transmitted beam which is often blocked by the objective lens mount. Effectively, the interferometer results in a modified filter transfer function where the zero-order is transmitted even though it is outside the lens NA. The amplitude, the phase, and the offset position in the back focal plane of the objective have to be controlled to provide a correct sub-image. These are often set by using a nearby, known reference object along with the object of interest.
It is straightforward to extend the mathematical treatment to the off-axis illumination case. Equation 2 can be modified to:
where ωoff=2π sin(θoff)/λ is the frequency offset arising from the off-axis illumination at angle θoff (assumed in the x-direction), the primes on the γs indicate that the propagation directions take into account the offset illumination, and the prime on the A0,0 refers to the re-injected 0-order.
Taking the square of equation 5 can provide the intensity on the imaging camera:
where the three terms on separate lines correspond to (top) a constant term, (middle) the imaging terms and (bottom) the dark field image. Subtracting out the dark field terms (by taking an image with the interferometer blocked so that only the third term survives) provides a sub-image that accurately captures the spatial frequency components that are transmitted through the optical system. Note that the imaging terms (middle line) are at the correct frequencies and that the offset illumination angle has cancelled out of the expression except for the filter transmission functions.
Changing both the illumination angle (and the angle of reintroduction) and the azimuthal angle changes the offset allowing recording of a different region of frequency space. Specifically, for Manhattan geometry (x,y oriented patterns) a second offset exposure to capture the high spatial frequencies in the y-direction, that is with the substrate rotated by π/2, can be used. Additional spatial frequency terms can be captured with large illumination angles.
Referring back to the
where the series with coefficients Ak,j are due to the first offset beam (210) and the second series with the coefficients Bp,q are due to the second offset beam (210′) and squaring while taking advantage of the fact that without the interferometer the A0,0 beam 209 is not transmitted to the objective image plane while the B0,0 beam 209′ is transmitted through the lens 230 gives:
The first three terms in the upper bracket, labeled [I], in equation 8 are the result of the off-axis illumination at the edge of the pupil. This image can be measured independently by blocking the extreme off axis beam and subtracted from the result. The term labeled [II] is the desired information, the image terms beating against a zero-order beam; because the zero-order beam is not at the correct angle to reset the frequencies to match the object frequencies (adjusted for magnification) there is a shift between the observed and the actual image plane frequencies {exp[i(ωNA−ωoff)x]} that will need to be fixed computationally (e.g. one is measuring the Fourier components at an intermediate frequency as detailed above). [III] is the dark field from the extreme off-axis illumination. Finally the last term, [IV] is the cross-correlated dark field from the two illumination beams.
To remove the unwanted terms in equation 8, five strategies can be used. However, these are not intended to be all-inclusive and other possibilities may exist. These are illustrated schematically in
Similarly, results using dynamic (adjustable on/off) physical block presented in
The embodiments discussed so far provide spatial frequency coverage up to 2λ(sin(θill)+NA)/λ≦2π(1+NA)/λ; that is the maximum illumination angle offset can be set close to 90° (providing the “1”) and the maximum angle collected by the objective lens corresponds to sin−1(NA). As was previously disclosed in relation to the interferometric implementation of IIM, additional spatial frequencies are available by tilting the object plane relative to the objective lens axis. This allows collection of spatial frequencies up to 4π/ζ, independent of the lens NA. The cost is a more complex signal processing requirement since the tilted object plane results in a nonlinear mapping of spatial frequencies from the object plane to the laboratory image that must be corrected to achieve a good image. This mapping has been discussed previously. The additional frequency space (and hence smaller image features) are available in the structured illumination embodiments of IIM disclosed herein.
Immersion microscopy is well known to provide higher spatial frequencies by a factor of the refractive index of the immersion medium, n, thereby extending the spatial frequency range to as high as 2n/λ. Again the advantages of immersion are directly applicable to structured illumination IIM.
Traditionally immersion microcoscopy has been practiced in reflection with a liquid medium on top of the object, or in transmission where advantage is taken of the high refractive index of the substrate (nsub) as well as that of a liquid on top of the object. An intermediate possibility is to use the refractive index of the substrate without an immersion fluid. In this case the spatial frequency range is extended to 2π(nsub+NA)λ.
In some embodiments, the third optical system can further include a first beamsplitter disposed in the optical path of the first optical system before the object to collect a portion of the coherent illumination and one or more optics disposed between the first optical system and the second optical system 1230 are prisms 1262 within first optical system used to inject into substrate at angles beyond total internal reflection to interferometrically reintroduce the portion of the coherent illumination as a reference beam into the second optical system 1230 in a position after the exit aperture of a collection (objective) lens, wherein the reintroduction is at one of a position corresponding to a position a zero-order beam would have had if it had been transmitted through a higher NA lens of the second optical system 1230 or an aliased position to reduce pixel requirements of the electronic image device, wherein the signal processor is adjusted to compensate for this spatial frequency aliasing (the same concept as the local oscillator frequency introduced earlier). In other embodiments, the third optical system of the apparatus 1200 can include one of the configurations shown in
In certain embodiments apparatus 1200 for microscopy with an IIM arrangement with illumination by evanescent waves extending from a substrate can also include at least one known reference object to cover a small part of the image field.
According to various embodiments, there is a method for microscopy by evanescent illumination through a substrate. The method can include providing an object 1220 disposed on a surface of a planar substrate 1225 characterized by a homogeneous refractive index (nsub) and a surface normal 1226 and providing a first optical system disposed to provide an evanescent wave illumination of the object plane 1222 by providing a substantially coherent illumination of the object plane 1222, the illumination characterized by a wavelength λ and a radius of curvature and disposed at one of a plurality of incident wave vectors from about 2π/λ to about 2πnsub/λ with respect to a surface normal of the substrate and at a multiplicity of azimuth angles spanning 0 to 2π, wherein the plurality of incident wave vectors correspond to angles beyond a total internal reflection angle θc of the substrate. The method can further include providing a second optical system 1230 having an optical axis 1236 disposed at one of a plurality of center wave vectors from about 0 to about 2π/λ with respect to the normal to the plane parallel optical element, wherein the second optical system 1230 is characterized by a numerical aperture (NA). The method can also include providing a third optical system disposed in an optical path of the first optical system to provide interferometric reintroduction of a portion of the coherent plane wave illumination (reference beam) into the second optical system 1230, wherein the amplitude, phase, and position of the reintroduced illumination wave in the image plane of the second optical system 1230 can be adjusted. The method can further include recording a sub-image of the object 1220 at an object plane 1222 using an electronic image device, wherein the sub-image is formed as a result of interference of the scattering from the coherent plane wave illumination of the object and the reference beam; adjusting the first, the second, and the third optical systems to sequentially collect a plurality of sub-images corresponding to a plurality of regions of spatial frequency space; manipulating each of the plurality of sub-images using a signal processor to correct for distortions and alterations introduced by the optical configuration; and combining the plurality of sub-images into a composite image to provide a substantially faithful image of the object. In various embodiments, the method can further include one or more processes of subtraction of dark field images, subtraction of background images, shifting of spatial frequencies in accordance with the optical configuration, and elimination of one or more overlapping coverages of the frequency space wherein the elimination operations can be performed either in the optical systems or in the signal processing. In some embodiments, the method can also include selection of the regions of spatial frequency space to provide a more or less faithful image of the object in the object plane. Neumann et al. in Optics Express, Vol. 16, No. 25, 2008 pp 20477-20483 describes an evanescent wave illumination for further extending the resolution limit of imaging interferometric microscopy to λ\2(nsub+1), the disclosure of which is incorporated herein by reference in its entirety.
In various embodiments, the step of providing an object 1220 disposed on a surface of a planar substrate 1225 can include providing a cladding layer surrounding the object 1220 and the object 1220 disposed over the substrate 1225. The extent of excitation region due to evanescent wave illumination, normal to the interface is given by an exponential decay function with a 1/e length of λ/2π√{square root over (npp2 sin2 θ−nclad2)}, where nsub is the refractive index of the substrate and nclad is the refractive index of the superstrate or cladding material surrounding the object 1220. The spatial localization can provide benefit, for example in TIRF (total internal reflection fluorescence) the localization is much larger than can be achieved with a simple focus or even with confocal microscopy. In other cases, this decay length can be a restriction, for example, in lithography studies where there might be multiple layers of material (bottom AR coating and photoresist for example) and the structural variation between these layers is of interest. Hence, the addition of a cladding layer surrounding the object can allow some degree of tuning of the decay length, and thereby control the signal to noise ratio.
Evanescent illumination can be combined with structural illumination eliminating the need for access to the back focal plane. This moves the interferometer to the front of the objective lens and makes IIM readily adaptable to existing microscopes. Structural illumination is roughly equivalent to recording the spectral information at an intermediate frequency; additional computation is required to reset the frequencies. But this frequency shifting can reduce the camera pixel size and count requirements. Evanescent wave illumination can be used to extend the resolution of IIM to λ/2(n+1). Furthermore, IIM provides an important advantage over conventional immersion microscopy techniques. Since only a relatively small region of frequency space (˜NA/λ) is recorded in each sub-image, the aberration requirements on the objective lens are dramatically reduced. Hence, a simple set of prisms or gratings can be used to extract, and conventional air-based lenses to capture, the information. As is always the case, there is a trade-off between the number of sub-images and the NA of the objective lens.
There are diffracted beams corresponding to even larger spatial frequencies (smaller features) scattered back into the substrate at angles larger than the critical angle. These beams are totally internally reflected and are not accessible.
In various embodiments, the grating 1864 profile can have an impact on the extraction efficiency. In some embodiments, the grating 1864 can have a sinusoidal profile. A sinusoidal grating has components in its Fourier transform only at ±1/d. In other embodiments, the grating 1864 can have a rectangular profile. A rectangular grating has many more Fourier components that can lead to coupling of additional scattered image plane waves across the interface. For equal line: space grating, the second order Fourier coefficient (@±2/d) vanishes, although for sufficiently deep gratings, comparable to the wavelength, additional coupling terms can arise. The third order terms (@±3/d) are always present for rectangular grating profiles. This can give rise to multiple coupling orders which can lead to artifacts in the sub-images. In some arrangements, this is not an issue because of the spatial separation of the scattered spatial frequency information at the bottom of the substrate (as can be seen in
Alternative collection schemes can include using one or more prisms 1974, as shown in
In certain embodiments apparatus 1800 for microscopy can also include at least one known reference object to cover a small part of the image field.
According to various embodiments, there is a method for microscopy by illumination through a substrate. The method can include providing an object 1820 disposed over a first side of a planar substrate 1825, the substrate characterized by a homogeneous refractive index (nsub) and a surface normal 1826 such that the object 1820 is separated from the substrate 1825 by a distance of no more than about ≦λ. The method can also include providing at least one grating 1864 on the side of the substrate 1825 opposite the object plane 1822, each grating 1864 characterized by a position, a period, a depth, and a grating profile, wherein each of the gratings 1864 can further scatter reflected waves resulting from the coherent illumination of the object into propagating waves in the medium below the substrate. The method can further include providing a first optical system disposed to provide a substantially coherent illumination of the object plane, the illumination characterized by a wavelength λ and a radius of curvature and disposed at one of a plurality of incident wave vectors from about 0 to about 2πnsub/λ with respect to a surface normal of the substrate and at a plurality of azimuth angles spanning from about 0 to about 2π. The method can also include providing a second optical system 1830 having an optical axis 1836 disposed at one of a plurality of center wave vectors from about 0 to about 2π/λ with respect to the surface normal 1826, wherein the second optical system 1830 includes at least one grating 1864 on the second side of the substrate 1825 and is characterized by a numerical aperture (NA). The method can further include providing a third optical system disposed in an optical path of the first optical system to provide interferometric reintroduction of a portion of the coherent illumination (reference beam) into the second optical system 1830, wherein each of an amplitude, a phase, a radius of curvature and an angle of incidence of the reference is adjusted as required such that a corrected reference wave is present at the image plane of the second optical system 1830. The method can also include providing an electronic image device disposed at an image plane of the second optical system 1830 that responds linearly to the local optical intensity and transfers the local optical intensity map across the image plane (a sub-image) to a signal processor device in electronic form, providing a signal processor that receives the electronic form of the sub-image, manipulating each of the plurality of sub-images using the signal processor to correct for distortions and alterations introduced by the optical configuration, and combining the plurality of sub-images into a composite image to provide a substantially faithful image of the object. In various embodiments, the method can further include one or more processes of subtraction of dark field images, subtraction of background images, shifting of spatial frequencies in accordance with the optical configuration, and elimination of one or more overlapping coverages of the frequency space wherein the elimination operations can be performed either in the optical systems or in the signal processing. In some embodiments, the method can also include selecting regions of spatial frequency space to provide a more or less faithful image of the object in the object plane.
For various IIM configurations shown in
Tiling of Frequency Space
In general, the spatial frequency location of the information corresponding to a specific angle of illumination (including illumination through the substrate) and angle of collection (θ) corresponds to
In the above equation, (n) in the first term is adjusted as appropriate, for example, for illumination in air, npp=1 while for illumination (evanescent) through a substrate, n=nsub=1.5 for glass. In keeping with the notation established above, θscattered is the angle in the substrate and so the factor nsub is appropriate; a grating can be used to shift the spatial frequencies into the air propagation bandpass as necessary.
Both angles as well as the pitch of any gratings can provide some flexibility in the tiling of frequency space, i.e. in choosing the regions of frequency images into a complete image. The maximum spatial frequency, kmax=2πfmax=2π(2nsub/λ) is obtained when both angles are close to 90°. Since a half pitch can be resolved, this leads to an Abbe resolution limit of λ/4nsub. The optimum strategy is pattern dependent, for example, for Manhattan geometry structures with edges confined to a rectangular grid, often found in integrated circuits, it is important to capture the frequency information along the axes and of less consequence to capture the information away from the axes where the Fourier transform of the pattern has lower spectral intensity. In the examples shown in
It should be noted that the tiling with circular regions is not a requirement, but is convenient as a result of the symmetry of optical lenses. In some cases, a square aperture, which can be provided either optically or electronically during the sub-image manipulations, can prove advantageous. In particular, a square aperture can be configured to provide more robust coverage at the boundaries between sub-images (e.g. two squares can match along the line, while two circles can only touch at a point). The tilings in
For arbitrary images, where a-priori information on likely orientations and spatial frequency content is not available, for example biological specimens, additional sub-images can be used in order to get a more complete coverage of spatial frequency space. An example of covering most of spatial frequency space is given in
The number of sub-images can be reduced by increasing the objective NA. As can be seen in
In implementations, immersion advantages of IIM can be realized if the object is in close proximity to a solid-immersion medium with illumination and collection through a plane-parallel optical element and coupling this radiation to air by one or more gratings on the medium surface opposite the object. The plane-parallel optical element differs from the substrate, as discussed above, in at least one manner, which is that the substrate functions, at least in part, to support the object. The plane-parallel optical element, as discussed further below, is of such a size and thickness that it cannot alone function to support the object. In implementations, a mechanical coupler can be used to support the object and optically couple the object with the plane-parallel plate. The plane-parallel optical element can be characterized by a homogeneous refractive index (npp) and a thickness (tpp), such that a distance of separation between the plane-parallel optical element and the object can be within a wavelength of the light used to illuminate the object.
In implementations, the plane-parallel optical element can include high index of refraction materials to function as a solid-immersion medium. When used in IIMM, the plane-parallel optical element can have a thickness (tpp) of about a fraction of the illumination wavelength, which allows use of strongly absorbing materials. By way of a non-limiting example, the wavelength can be chosen to be shorter than the band gap of the immersion material to take advantage of the increasing refractive index within an absorption band. In such an example, both the shorter wavelength and the larger index can extend the resolution will beyond those conventionally available with other known linear system microscopy implementations, even within the same λ/4npp linear-systems frequency-space limit, where npp is the refractive index of the plane parallel optical element.
IIMIIM can be adapted for solid-immersion in a variety of ways. For example, a high-index plane-parallel optical element can be placed very close to the object (within range of the evanescent fields). The plane-parallel optical element can be a multilayer structure or a confined liquid and can be at least partially transparent at the IIMIIM wavelength. Experiments conducted by the inventors have shown a resolution<λ/5 for IIMIIM of high contrast for chrome-on-glass objects on plane-parallel optical element composed of glass by illumination through the evanescent fields of the plane-parallel optical element and conventional collection in air (including off-axis contributions). For compactness, this configuration is referred to below as half-immersion (e.g. the illumination takes advantage of the higher wave vectors in the plane-parallel optical element, but the collection is limited to scattered wave vectors that propagate in air). For this configuration, the limiting optical resolution, in the Abbe sense of the smallest available half-pitch (HP) in the optical response, is λ/[2(npp+1)].
The resolution can be further extended by collection of the back-scattered light that propagates within the plane-parallel optical element beyond the angle for total internal reflection. This scattering corresponds to larger wave numbers and therefore to information on smaller details of the sample. A grating can be used on the back side of the plane-parallel optical element, opposite the side or surface facing the object or sample being imaged, to extract this scattered information, making it accessible to the optical collection system. There are spatial-frequency-dependent distortions associated with the spreading of the information as it propagates across the plane-parallel optical element and extends spatially beyond the field of view of the collection system, and phase aberrations associated this extended propagation, which require a mechanism or protocol for transforming the image from the laboratory frame to the image frame for combination with other sub-images. This mechanism or protocol can be used to compensate for frequency and/or phase discrepancies that can result from the optical configuration. The linear systems limit is a resolution of λ/4npp; resolution very close to this limit can be achieved in many cases, however with interrelated requirements on the field-of-view, the numerical aperture, and the thickness and refractive index of the plane-parallel optical element.
As discussed herein, the relationship between these parameters and the number of required sub-images are quantified and the transformation procedure for sub-images for deep sub-wavelength cases with full immersion, including single and multiple backside sub-images is discussed. The techniques described herein can use one or more gratings displaced from the object by the thickness of the plane-parallel optical element to extract waves propagating in the plane-parallel optical element beyond the angle for total internal reflection and make them available for collection in free space.
In a non-immersion IIMIIM optical arrangement, the result is the capture of a sub-image consisting of a separate region of frequency space in each sub-image. In air, the maximum angle of illumination can approach 90°, but is smaller in the plane-parallel optical element as a result of refraction at the air-plane-parallel optical element interface. By coupling into internal modes of the plane-parallel optical element, grazing incidence in the plane-parallel optical element can be achieved, increasing the resolution. IIMIIM relies on recording and combining sub-images to produce a final image that covers all of the essential, object dependent, parts of frequency space.
Using only a modest NA=0.4 lens at λ=633 nm and an object coupled to a plane-parallel optical element with refractive index npp, a half-immersion imaging resolution technique with evanescent wave illumination is disclosed to a maximum spatial frequency of (npp+NA)/λ with the objective normal to the plane-parallel optical element (e.g. un-tilted objective; 170 nm features on a glass plane-parallel optical element with npp=1.5) and up to (npp+1)/λ with a tilted objective (150 nm features of arbitrary structures, while the theoretical limit of grating HP resolution is 126 nm). A grating coupler can be added to the side of the plane-parallel optical element opposite the object to collect the spatial frequency information between (npp+NA)/λ and (npp+1)/λ as well as extending the spatial frequency coverage towards 2npp/λ. Phase and amplitude matching of the sub-images can be achieved electronically using a reference object containing spatial frequencies within each recorded sub-image.
The illumination and collection configurations for half-immersion and full-immersion are shown in
The corresponding frequency space coverages achievable using the apparatus configurations of
In each of the arrangements shown in
IIM requires reintroducing a coherent zero-order reference at the image plane (e.g. constructing an interferometer around the objective lens) to record the amplitude and phase of the spectral frequencies in the sub-images. The intensity, angle and phase of the reference beam have to be chosen to match all sub-images to the on-axis image. A reference object is used to cover a small part of the FOV in order to determine the correct amplitude ratio, frequency shift and phase. These offset frequencies can then corrected in the image processing before the sub-images are combined.
In the description that follows, elements including ray tracing (looking at the propagation of scattered rays corresponding to specific spatial frequencies) and Fourier optics (based on “infinite” plane wave propagation) are both presented. To bring these two concepts together, “wave packets” will be considered with center spatial frequencies that correspond to the direction of propagation and with a spatial extent that corresponds to the field-of-view, which is assumed to be much larger than the individual scattering objects within the field, but much smaller than the diameter of the lens. This corresponds to a broadening in the pupil plane and Fourier planes from the delta functions associated with plane waves to diffraction patterns corresponding to the finite field of view.
In embodiments, additional scattered information can be collected at spatial frequencies beyond (npp+NA)/λ by collection from the back side of the plane-parallel optical element using one or more gratings to redirect this information into an objective lens.
If this frequency equals the maximum available from half immersion without a tilted objective, (npp+NA)/λ, then:
This takes a scattered wave in the plane-parallel optical element corresponding to
k
α
=k
0NA=nppk0 sin α1=nppk0 sin sin−1(NA/npp)┘ (10)
into a wave propagating in air at an angle −sin−1 (NA). Here, k0≡2π/λ. Note that provided NA>0.33, higher diffraction orders from the grating are outside the NA of the collection optics and do not interfere with the image; an NA=0.4 is considered in the modeling. Over the range of spatial frequencies collected in each sub-image the diffraction efficiencies are roughly constant, thus allowing intensity compensation by sub-image matching procedures. This technique tends to be free of the complications connected with multiple diffraction orders from gratings encountered by other approaches. In embodiments, the gratings can provide extraction of information out of the immersion media but not diffraction of near-field high-spatial frequency components directly from the object. There can be variations in diffraction efficiency as the various higher order beams, in both the plane-parallel optical element and in air, switch from evanescent to propagating waves. These can be dealt with empirically by adjusting the amplitudes of the relevant portions of each sub-image independently, either by physically restricting the collection NA appropriately, or by separately addressing the regions of the sub-image electronically.
Progressively higher spatial frequency components impinge on the grating at larger horizontal displacements from the object and are diffracted into increasing angles, until the scattered beam at a displacement of b+F from the object centerline is diffracted at to an angle of +θ in air. The distance F corresponds to the FOV of the objective lens, which can be taken as focused on the grating surface, or to the width of the grating if it is smaller than the FOV.
Provided θ≦sin−1(NA), the entire spread of scattered light incident on the grating is collected by the objective lens. From the geometry of
and the corresponding minimum half pitch is:
The upper expression (Eq. 11) is valid when the full NA of the objective lens is filled by the diffracted beams from the grating, e.g. the grating width F, and the optical FOV and NA are such that θ≧sin−1(NA). If the angular spread is restricted by the field of view, or equivalently by the width of the grating, the lower expression (Eq. 12) pertains. An additional constraint is that 3NA<npp, since only spatial frequencies that can propagate in the plane-parallel optical element can be collected. The limiting behavior of HPmin is readily evaluated from this expression. For small NA where the full angular width of the lens is filled, the upper expression (Eq. 11) applies. For all interesting cases, NA/npp<<1; that is the lens NA is much less than the refractive index of the immersion medium. For large fields of view or thin plane-parallel optical elements, F/t>>NA/npp,
Thus, HPmin is always larger than the optics linear systems limit. The upper limit in Eq. 13 takes over before this result; thus the NA of the lens is filled in just a single sub-image. Additional gratings at smaller pitches of λ/2(i+1)NA [i=1, 2, 3, . . . ] allow access to higher spatial frequency components of the image up to the linear systems limit of λ/4n. In the opposite limit, NA/npp<<1 and F/t<<NA/npp,
The resolution is always somewhat improved over the starting point of half-immersion with the collection system optical axis normal to the object plane. In this case the linear systems limit of λ/4npp can be approached with a synthetic FOV, e.g. multiple sub-images with the collection optical system displaced to collect the higher spatial frequencies that are lost by the limited FOV with the same grating, and again, with multiple gratings (synthetic aperture), it is possible to extend the resolution close to the λ/4npp limit, as long as signal/noise ratio is sufficient to enable sub-image reconstruction into a full image.
Resolution (HP) restrictions as a function of plane-parallel optical element refractive index for NA=0.4, 0.8, 1.2, fixed field of view (F=32 μm) and plane-parallel optical element thickness (t=50 μm) obtained from Eq. 13 are shown in
Exemplary combination of restrictions induced by plane-parallel optical element properties and synthetic aperture (multiple of NA=0.4) for a fixed field of view (F=32 μm) with varying plane-parallel optical element thickness are shown in
It can be inferred from
Initial experiment were conducted using a 1-mm thick glass plane-parallel optical element optically coupled to a second 1-mm thick microscope slide with a metal decoupling grating of period 560 nm. Thus the total thickness (object to grating) is 2 mm. The results showed the possibility of resolution of a periodic structure. The image consists of a repeated pattern of several parallel lines with a spacing of 240 nm within a trapezoidal envelope. The pattern is repeated at a spacing of 3.6 μm in both directions. A SEM image is shown in
The distortion of the image as a result of the propagation in the and depends on the optical path in the plane-parallel optical element, e.g. on the plane-parallel optical element refractive index and thickness. The optical configuration was shown in
The marginal ray inclined at the angle α2 to the normal in the plane-parallel optical element and an angle θ in air after scattering by the grating is described by:
Then the path lengths in the plane-parallel optical element are:
and the phase difference between the arbitrary ray and the central ray is
The rays in
Simulation of the impact of this phase distortion on the image with nested-L structure and a delimited grating with CD=120 nm (
Without shifting the objective lens, the loss of information is equivalent to the reduction of captured range of frequencies (NApp<NA) for a single sub-image, which is a function of the FOV. To evaluate this degradation of the image bandwidth in a single image, consider again
On the other hand the marginal angles for a particular NAsub??????sub or pp can be written as function of an angle sin αc of the center frequency, corresponding to the chosen HPc.
sin α2=sin ζc+NApp (20)
and
sin ζ1=sin αc−NApp, (21)
where, for an illumination angle sin β:
Combining Eqs. 19-21 gives an implicit relation for the optical system parameters
This dependence shown in
allows us to define NApp of each sub-image and to estimate the number of sub-images which are necessary to cover the of the available spatial frequency space (along a specific direction).
It can be seen from
Examples of images shown in
For an additional perspective on the ability to restore these images, the restored images with different HP were compared with the filtered high frequency images using a mean square error (MSE) metric. A simple ten-line grating pattern was chosen for MSE analyses (inside of the square 3210 of
These calculations were carried out from the theoretical limit λ/4npp=0.106 μm to the half immersion limit λ/(npp+1)=0.126 μm (λ=633 nm, nsub=1.5). The MSE drops as image becomes resolvable. As expected, the distortion (expansion of the frequency content across the detection plane) of image features is lower in thinner films which allows higher resolution with a smaller FOV.
The same models were used for plane-parallel optical elements with different refractive indices in order to evaluate possible resolvable HP with MSE=3% for plane-parallel optical element thicknesses of 1-, 5-, and 10-μm. The results are summarized in
The modeling of image reconstruction represented in
The present techniques of the IIM configuration, as discussed above, with a slab of high refractive index material can be used as an effective solid-immersion medium to enhance the resolution up to the linear systems resolution limit of λ/4npp. Phase distortions of high frequency sub-images are inherent in the geometry of beam propagation in the immersion slab, requiring a phase restoration procedure. The resolution in this configuration depends not only on the objective NA and FOV, but also on the captured part of the spectral information which is also a function of immersion slab refractive index and thickness. The criteria for evaluation of the ultimate HP limits for different immersion slab parameters and system field of view have been provided. The estimation shows that the minimum thickness of the immersion slab and the maximum field-of-view of the optical system should be chosen to achieve the highest resolution with the smallest number of sub-images.
Embodiments of the present disclosure allow a regime for IIM not achievable with conventional approaches. Using very thin plane-parallel optical elements (or overlayers) and thereby restricting the propagation distance, higher absorption can be tolerated, allowing the use of shorter wavelengths. Then the resolution can be improved by two factors: the shorter wavelength; and the higher index of refraction within an absorption band. The present approaches provide resolutions that are not available to solid immersion microscopy approaches as a result of the need for a thick high-index solid immersion lens.
Table I provides calculated resolutions for several microscopy techniques and compares their practical resolution achievements for different 2 with a silicon immersion plane-parallel optical element.
Annular illumination using the ˜2× resolution advantage of off-axis illumination can be combined with immersion techniques (current results are with liquid immersion and an NA=1.3). However this requires alignment between two specialized high NA, small FOV objectives which is a challenging task. Even ignoring the fact that usually there is a tradeoff between the FOV and the NA, such objectives cannot use materials with significant losses, as a result of the required macroscopic optical thicknesses.
Solid immersion lenses (SIL) provide a relatively cost-effective solution for increasing NA by a combination of standard objective with section of high index refraction sphere as solid immersion media. This method has shown good resolution (to 145 nm using a Si SIL at 1.2 μm) but again can only be used with relatively long wavelengths since the sphere section (which in practice is close to a hemisphere) requires essentially lossless materials. To the contrary, IIM can provide up to few tens of nanometers resolution with immersion media such as silicon at visible (red to green) wavelengths while retaining the full field of view, large working distance, depth of field, and low-cost of low NA objectives.
Other materials coupled with wavelengths in proximity to a material band-gap in combination with our method can also provide excellent results. Some possible wavelength/material combinations to explore are shown in Table II.
Thus IIM can be very useful for imaging small features using thin immersion slab with high nsub where resolution approaches that of a SEM with a simple inexpensive technique that is applicable in a range of environments including air and water.
Imaging interferometric microscopy techniques as described above are sensitive to the optical refractive index variation of the object materials and does not contain any material specific information. Imaging interferometric microscopy can be applied to get material and chemical information using coherent anti-Stokes Raman scattering (CARS) spectroscopic microscopy. An apparatus for coherent anti-Stokes Raman (CARS) microscopy can include any suitable optical arrangement as shown in
In various embodiments, the third optical system of the apparatus for CARS microscopy can include a first beamsplitter disposed in the optical path of the first optical system before the object plane 122, 222, 1222, 1822, 2425 to collect a portion of the coherent illumination and one or more optics disposed between the first optical system and the second optical system 130, 230, 530, 1230, 1830, 2420A-C wherein the optics includes a nonresonant nonlinear material configured to generate the anti-Stokes four-wave mixing frequency 2ω1−ω2 and exclude the fundamental frequencies (ω1 and ω2), and to interferometrically reintroduce the portion of the anti-Stokes coherent illumination as a reference beam into the second optical system 130, 230, 530, 1230, 1830, 2420A-C in a position after the exit aperture of a collection (objective) lens, wherein the reintroduction is at one of a position corresponding to a position a zero-order beam would have had if it had been transmitted through an appropriate higher NA lens of the second optical system 130, 230, 530, 1230, 1830, 2420A-C as shown in
In various embodiments, the third optical system of the apparatus for CARS microscopy can include one of the third optical system configurations shown in
In other embodiments, the apparatus for CARS microscopy can include a third optical system 500D in a configuration shown in
In other embodiments, the apparatus for CARS microscopy can include a third optical system 500A in a configuration shown in
In various embodiments, the apparatus for CARS microscopy can include a third optical system 500C in a configuration shown in
In certain embodiments, the apparatus for CARS microscopy can also include at least one known reference object to cover a small part of the image field. In some embodiments, the first, the second, and the third optical systems can be arranged in a transmission configuration.
In other embodiments, the first, the second, and the third optical systems can be arranged in a reflection configuration. In some embodiments, the plurality of incident wave vectors of the first optical system can include wave vectors less than about 2π/λ1 wherein these wave vectors are accessed by illumination of the substrate at polar angles between 0 and π/2. In other embodiments, the plurality of incident wave vectors of the first optical system can include wave vectors between about 2π/λ1 and about 2πnsub/λ1 or 2πnpp/λ1, wherein these wave vectors are accessed by evanescent wave illumination of the object through the substrate. Furthermore, the apparatus for CARS microscopy can use any of the arrangements shown in
In some other embodiments, the plurality of center wave vectors of the second optical system 130, 230, 530, 1230, 1830, 2420A-C can include only center wave vectors less than about 2π/λ1, wherein these center wave vectors are accessed by an optical system above the object plane of the substrate 125, 225, 1225, 1825 or plane-parallel optical element 2405. In certain embodiments, the plurality of center wave vectors of the second optical system 130, 230, 530, 1230, 1830, 2420A-C can include center wave vectors between 2π/λ1 and 2πnsub/λ1 or 2πnpp/λ1, wherein the center wave vectors greater than 2π/λ1 are accessed through the substrate 125, 225, 1225, 1825 or plane-parallel optical element 2405 and the second optical system 130, 230, 530, 1230, 1830, 2420A-C can include one or more gratings on the side of the planar substrate 125, 225, 1225, 1825 or one or more gratings 2415 on the side of the plane-parallel optical element 2405 opposite the object plane 122, 222, 1222, 1822, 2425 wherein each grating is characterized by a position, a pitch, and a grating profile.
According to various embodiments, there is a method for coherent anti-Stokes Raman (CARS) microscopy. The method for CARS microscopy can include providing an object 120, 220, 1220, 1820, 2410 disposed over a planar substrate 125, 225, 1225, 1825 or plane-parallel optical element 2405, wherein the substrate 125, 225, 1225, 1825 is characterized by a homogeneous refractive index (nsub) and a surface normal and wherein the plane-parallel optical element 2405 is characterized by a homogeneous refractive index (npp) and a surface normal and providing a first optical system disposed to provide a illumination of the object plane 122, 222, 1222, 1822, 2425 the illumination characterized by two substantially coincident coherent beams with wavelengths λ1 and λ2 and corresponding angular frequencies ω1 and ω2 with ω1>ω2, a radius of curvature, and disposed at one of a plurality of incident wave vectors from about 0 to about 2λnsub/λ1 or 2πnpp/λ1 with respect to a surface normal 126, 226, 1226, 1826, 2406 of the substrate 125, 225, 1225, 1825 or plane-parallel optical element 2405 and at a multiplicity of azimuth angles spanning 0 to 2π. The method can also include providing a second optical system (collection) 130, 230, 1230, 1830, 2420A-C having an optical axis 136, 236, 1236, 1836, 2406 disposed at one of a plurality of center wave vectors from about 0 to about 2πnsub/λ1 or 2πnpp/λ1 with respect to the surface normal 125, 225, 1225, 1825, 2406 wherein the second optical system 130, 230, 1230, 1830, 2420A-C is characterized by a numerical aperture (NA) and is responsive primarily to optical signals at frequencies greater than ω1 and providing a third optical system disposed in an optical path of the first optical system to provide interferometric reintroduction of a reference illumination (reference beam) at a frequency of 2ω1−ω2, into the second optical system 130, 230, 1230, 1830, 2420A-C wherein each of an amplitude, a phase, a radius of curvature and an angle of incidence of the reference is adjusted as required such that a corrected reference wave is present at the image plane of the second optical system 130, 230, 1230, 1830, 2420A-C. The method can further include providing an electronic image device disposed at an image plane of the second optical system 130, 230, 1230, 1830, 2420A-C that responds linearly to the local optical intensity and transfers the local optical intensity map across the image plane (a sub-image) to a signal processor device in electronic form, providing a signal processor that receives the electronic form of the sub-image, manipulating the sub-image using the signal processor to correct for distortions and alteration introduced by the optical configuration, providing an electronic device to sequentially collect, store and combine a plurality of sub-images corresponding to a plurality of regions of spatial frequency space to create a composite image, wherein the plurality of sub-images are formed as a result of adjustments to the first, the second, and the third optical systems, and combining the plurality of sub-images into a composite image to provide a substantially faithful image of the object 120, 220,1220, 1820, 2410.
According to various embodiments, the method can further include one or more processes of subtraction of dark field images, subtraction of background images, shifting of spatial frequencies in accordance with the optical configuration, and elimination of one or more overlapping coverages of the frequency space wherein the elimination operations can be performed either in the optical systems or in the signal processing. In some embodiments, the method can further include selecting regions of spatial frequency space to provide a more or less faithful image of the object 120, 220, 1220, 1820, 2410 in the object plane 122, 222, 1222, 1822, 2425.
While the invention has been illustrated with respect to one or more implementations, alterations and/or modifications can be made to the illustrated examples without departing from the spirit and scope of the appended claims. In addition, while a particular feature of the invention may have been disclosed with respect to only one of several implementations, such feature may be combined with one or more other features of the other implementations as may be desired and advantageous for any given or particular function. Furthermore, to the extent that the terms “including”, “includes”, “having”, “has”, “with”, or variants thereof are used in either the detailed description and the claims, such terms are intended to be inclusive in a manner similar to the term “comprising.” As used herein, the term “one or more of” with respect to a listing of items such as, for example, A and B, means A alone, B alone, or A and B. As used herein, the symbol “n” or “nsub” will mean the index of refraction of the substrate when used in context to the substrate, unless otherwise expressly noted. For example, nclad represents the index of refraction of a cladding.
Other embodiments of the invention will be apparent to those skilled in the art from consideration of the specification and practice of the invention disclosed herein. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the invention being indicated by the following claims.
This application is a continuation-in-part to U.S. patent application Ser. No. 13/345,267 filed on Jan. 6, 2012, which is a divisional of U.S. patent application Ser. No. 12/347,619 filed Dec. 31, 2008 and claims priority from U.S. Provisional Patent Application Ser. Nos. 61/017,985, filed Dec. 31, 2007; 61/089,669, filed Aug. 18, 2008; and 61/115,246, filed Nov. 17, 2008, which are hereby incorporated by reference in their entirety.
This invention was made with government support under Contract Nos. HR0011-05-1-0006 awarded by the Defense Advanced Research Projects Agency and FA9550-06-1-0001 awarded by the Air Force Office of Scientific Research. The government has certain rights in the invention.
Number | Date | Country | |
---|---|---|---|
61115246 | Nov 2008 | US | |
61089669 | Aug 2008 | US | |
61017985 | Dec 2007 | US |
Number | Date | Country | |
---|---|---|---|
Parent | 12347619 | Dec 2008 | US |
Child | 13345267 | US |
Number | Date | Country | |
---|---|---|---|
Parent | 13345267 | Jan 2012 | US |
Child | 13629598 | US |