The present invention relates to apparatus and methods for enhancing image contrast in label-free imaging of substantially transparent specimens.
Unlabeled cells and tissues are transparent under visible light and, as such, can be approximated as phase objects, with a transmission function of the form t(x, y)≅A exp[iφ(x, y)]. That is to say that an intensity image, as rendered by a bright field microscope, loses the phase information and yields negligible contrast, since the intensity is the square modulus of the amplitude, which is to say that it is independent of φ(x, y). Much of light microscopy's four-century history has been shaped by the quest to develop new contrast mechanisms. Generating exogenous contrast requires designing new chemical compounds (e.g., dyes, fluorophores, nanoparticles) that bind to particular structures of interest and also absorb, emit, or scatter light significantly, basically converting the structure from a phase to an amplitude object.
On the other hand, intrinsic contrast methods exploit the light-tissue interaction in such a way as to couple the information carried by the phase into the final intensity image. These techniques do not aim to provide quantitative information about the optical thickness of the specimen. Instead, they provide non-invasive, label-free access to microscopic structures of cells and tissues, without the restrictions associated with exogenous contrast agents. While a number of methods utilizing intrinsic contrast have been proposed in recent years, the most commonly used label-free methods are phase contrast (PC) microscopy and differential interference contrast (DIC) microscopy, both of which have played major roles in biological investigations over the course of several decades.
A drawback of the forgoing methods is that each suffers from optical artifacts: halos in the case of PC, and directional shadows, in the case of DIC. In particular, DIC provides an intensity image that is related to the gradient of the field. Thus, using birefringent optics, two identical replicas of the image field, slightly shifted transversely, are produced at the observation plane,
In Eq. 1, I is the image intensity, φ the phase of the object, δx is the transverse shift between the two images, α is a controllable phase shift between the two fields, and the phase shift between the two fields, δφ, is proportional to the one-dimensional gradient of the phase φ,
DIC derives its power in revealing fine details in the specimen by virtue of the fact that adjusting α to a value of −π/2, transforms the cosine in Eq. 1 into a sine, which, in the limit of small values of δφ, becomes proportional to the one-dimensional gradient of the phase, since sin [δφx(x, y)]≅δφx(x, y). Insofar as DIC is highly sensitive to edges, it renders beautiful images of fibrous structures, for example. However, its limitation comes from the fact that the first order derivative changes sign rapidly across an edge, thereby generating spurious bright and dark regions (“shadowing”) along the direction of the gradient.
Use of grating as a diffractive optical element (DOE) for filtering at the back focal plane of an objective of a bright field microscope has been demonstrated by McIntyre et al., Differential interference contrast imaging using a spatial light modulator, Opt. Lett., vol. 34, pp. 2988-90 (2009) by taking the two first-order diffracted field, shifted, by two different distances, from the DC field, due to two different grating periods.
Spatial Light Interference Microscopy (SLIM) is a modality that provides quantitative phase imaging (QPI), distinguishing it as a technique with respect to PC and DIC, both of which provide only qualitative phase images of phase objects. SLIM is described, for example, in US Published Patent Application 2009/0290156 (to Popescu et al.) and by Wang et al., Spatial Light Interference Microscopy (SLIM), Opt. Exp., 19, pp. 1016-26 (2011), both of which are incorporated herein by reference. SLIM acquires an image of the quantitative phase delay of the optical path through the specimen albeit at the price in time and computation of successively interposing known phase delays with respect to a reference beam. Wang et al., Label-free intracellular transport measured by spatial light interference microscopy, J. Biomed. Opt., 16, 026019 (2011), incorporated herein by reference, describes benefits of applying a Laplace derivative operator to the digital data derived from the SLIM imaging technique, in particular, a highlighting of detail without introducing gradient artifacts at edges.
A method for highlighting fine detail in phase images without incurring the spurious shadowing that arises in DIC, and without the temporal delay and computational overhead of SLIM, would thus be highly desirable.
In accordance with embodiments of the invention, apparatuses and methods are provided for enhancing image contrast in an image of a phase object. In one embodiment, a phase derivative module is provided that has a first lens for creating, in a Fourier plane, a field corresponding to a 2D spatial Fourier transform in a spatial frequency domain of an image field of a sample. The phase derivative module also has an amplitude mask disposed in the Fourier plane that is characterized by a transmission amplitude such that a subsequent Fourier transform of the transmitted field results in a function of the image field of the sample having a term proportional to a power of a derivative of the phase image field. A second lens transforms the transmitted field back to an image domain at a focal plane of a detector array.
In other embodiments of the invention, the amplitude mask may be a sine function in one direction of the spatial frequency domain, or may be radially symmetric and proportional to radius in the spatial frequency domain.
In a further embodiment of the invention, the amplitude mask may be substantially parabolic as a function of radius with respect to a central axis, thereby constituting a Laplace field module.
In yet a further embodiment, the amplitude mask may be linear as a function of radius with respect to a central axis, thereby constituting a gradient field module. In a further embodiment yet, the amplitude mask may be a one-dimensional sinusoidal function, thereby constituting another version of a gradient field module.
More particularly, the amplitude mask may be generated by a spatial light modulator.
In an alternate embodiment of the present invention, a phase derivative microscope is provided that has a source of an illuminating beam for illuminating a specimen, an objective lens for collecting light from the source transmitted through the specimen and forming an image at an output port, and a phase derivative module for transforming the image and for filtering a transform of the image.
In accordance with another aspect of the present invention, a method is provided for enhancing image contrast in an image of a phase object, wherein the method has steps of
In other embodiments of the invention, the step of forming the transmission image may include illuminating the phase object with substantially spatially coherent illumination. Applying an amplitude filter may be performed by means of a spatial light modulator. The amplitude filter may be sinusoidal along a direction in the spatial frequency domain, or substantially proportional to radius in the spatial frequency domain, or a substantially parabolic function of radius in the spatial frequency domain.
The foregoing features of the invention will be more readily understood by reference to the following detailed description, taken with reference to the accompanying drawings, in which:
The term “image” shall refer to any multidimensional representation, whether in tangible or otherwise perceptible form, or otherwise, whereby a value of some characteristic (amplitude, phase, etc.) is associated with each of a plurality of locations corresponding to dimensional coordinates of an object in physical space, though not necessarily mapped one-to-one thereon. Thus, for example, the graphic display of the spatial distribution of some field, either scalar or vectorial, such as brightness or color, constitutes an image. So, also, does an array of numbers, such as a 3D holographic dataset, in a computer memory or holographic medium. Similarly, “imaging” refers to the rendering of a stated physical characteristic in terms of one or more images.
As used herein, “label-free” refers to a method of imaging a substantially transparent sample that does not require introduction of materials, such as fluorophores or contrast agents that are extrinsic to the imaged sample.
The terms “object,” “sample,” and “specimen” shall refer, interchangeably, to a tangible, non-transitory physical object capable of being rendered as an image.
The term “differential phase method” shall refer to any imaging method in which the intensity of an image is a function (typically linear) of the gradient of an optical phase, without regard for the mechanism by which this effect is achieved.
The term “high numerical aperture” shall characterize an optical element of numerical aperture (NA) exceeding 0.1, such that approximations based on NA<<1 are inapplicable.
The term “substantially high spatial coherence” as applied to a beam of light shall denote a condition of coherence wherein if two slits were to be placed within the beam in a plane transverse to the beam propagation axis, at least one interference null would result in the far field where the intensity is no greater than 10% of the peak intensity of the beam.
The term “broadband” as applied to a source of irradiation shall refer to a source for which Δk/k0 is at least 10%, with k0 denoting the central wavenumber of the spectrum illuminating the sample, while Δk denotes the range of illuminating wavenumbers. It is to be understood that, within the scope of the present invention, the wavelength of the source may be swept in time, and that concurrent broadband illumination and post-dispersion detection is employed in preferred embodiments of the invention.
In accordance with embodiments of the present invention, novel differential phase methods are provided that conserve the benefits of DIC, rendering high contrast images of transparent specimens, while, at the same time, reducing or eliminating the presence of shadows that typically arise across edges along the direction of the gradient. The novel differential phase methods described herein comprise a class of methods for rendering an image at the focal plane of a detector in which at least a component of the field incident on a detector is proportional to a derivative of the phase of the field transmitted through the sample.
One such method, which may be referred to as “gradient field microscopy” (GFM), is based on spatial filtering of light at the back focal plane of the objective. Like DIC, GFM provides the first-order derivative of the phase, however GFM overcomes two notable limitations of conventional DIC, namely the directional shadow artifact and the inapplicability of DIC to birefringent samples. The former obstacle is overcome by measuring the gradient amplitude (intensity) rather than one of its components, while the second former obstacle is overcome by using spatial light modulation without polarizing optics to achieve interference between two shifted replicas of the image field. A further method referred to as Laplace field microscopy (LFM) will also be described.
The general class of phase derivative microscopy techniques taught in the present invention is initially described with reference to
White light from a source 104, such as a halogen lamp, is spatially filtered by a spatial filter such as pinhole 106 to achieve substantially high spatial coherence (as defined above). The subsequently collimated field 108 is used for illuminating a specimen 110 in transmission. Light transmitted through the specimen is collected by an objective 112 and an image of the specimen is formed at the output port 121 via a tube lens TL. The GFM module 120 consists of a 4f imaging system, an optical configuration described, for example, by Goodman, Introduction to Fourier Optics, (3d ed., 2004), at page 232, where the entire book is incorporated herein by reference. GFM module 120 contains an amplitude mask 130, 131, 132 (shown in
Amplitude mask 130, 131, 132 is an amplitude filter that modifies the amplitude of a field transmitted through the mask such that a subsequent Fourier transform of the transmitted field results in a function of the image field of the sample having a term proportional to a power of a derivative of the phase image field. Amplitude mask 130 is disposed at Fourier plane 124, and may be conveniently implemented by an amplitude-only spatial light modulator (SLM), such as a liquid crystal SLM. In one embodiment of the present invention, a liquid crystal SLM obtained from an Epson Powerlite S5 projector was employed, characterized by a contrast ratio of 400/1 and a pixel size of 13 μm.
Even though the illumination is preferably broadband, the autocorrelation of the field may be characterized by a well-defined modulation (mean) frequency, with respect to which the Fourier transform is well defined.
In certain embodiments of the invention, modulation patterns may be applied to amplitude mask 130, 131, 132 as shown in
In the foregoing Eq. (3), α, kx,y, and U(x,y) are the inverse period of the sine modulation, spatial frequencies in x and y direction, and the scattered field at the image plane of microscope 102, respectively. Therefore, for a purely phase object (of unit amplitude), U(x, y)=exp[iφ(x, y)], the first order derivative of the phase q(x,y) is obtained at the image plane 126 along with some additive DC component.
In Eq. (4), I(x,y) and φ(x,y) represent the measured intensity at the detector and the phase of the scattered field, respectively. As shown in Eq. (4), this sine-modulation GFM gives the identical result as the regular DIC. Note that, unlike in DIC, where birefringent prisms are used to generate the two interfering beams, GFM operates without polarization optics. Thus, the GFM module 120 can be used with a regular bright field microscope 102, without the need for specialized optics.
Use of a sinusoidal mask 130 as shown in
Referring now to
where I is the intensity measured by CCD 128 at image plane 126. The advantage of this linear modulation is that there is no directional shadow artifact that occurs in DIC due to the rapidly changing sign of the derivative. However, in Eq. (3), the derivative image obtained from this linear modulation assumes that the field is rotationally symmetric. The image may be degraded for specimens without such symmetry. Thus, in practice, one can chose between the two complementary methods (sine- and linear-GFM) according to the properties of the sample, or combine multiple modes of GFM to obtain the full vector gradient of the phase of the sample, e.g. combining two sine-GFM images with shifts in different directions.
Referring now to
The SLM pixel size (p=13 μm) limits the resolution in k-space, δk, and, thus, the field of view at the image plane over which the modulation produced by one SLM pixel is uniform. In one embodiment of the invention, δk=k0p/f, where p is the pixel size, k0=2π/λ is the wavenumber characterizing the mean frequency of the illumination, and f=150 mm is the focal length of lens L2. While the corresponding field of view in the image plane is of the order of 2π/δk˜6.25 mm, high contrast images were successfully obtained over the entire CCD, which is larger, 13 mm on the side.
Lens L2 Fourier transforms the field back to the image domain, such that at the focal plane of detector 128 (where detector 128 may be a charge-coupled device (CCD) or other detector) the field is:
U
i(x,y)=αℑ[(kx2+ky2)Ũ(kx,ky)]=−α∇2U(x,y) (3)
Thus, for phase objects (i.e., U(x,y)≅A exp[iφ(x,y)]), under the Born approximation, the intensity image reveals directly the first and second order derivatives of the phase itself. Thus, the intensity distribution I(x,y)=|Ui(x,y)|2 recorded at the CCD detector plane, is thus proportional to:
The foregoing equation establishes that LFM reveals high contrast images from entirely transparent (phase) structures.
As one example of the capability of LFM, 3-μm polystyrene beads immersed in oil were first imaged under bright field illumination (a shown in
LFM can be used to study unstained tissues sections.
An important feature of LFM is that the rate of image acquisition is limited only by the camera frame rate. Thus, LFM is well suited for studying highly dynamic specimen such as cells. A particularly advantageous application of the apparatus and methods described herein lies in studying dynamics using certain derivatives of the spatial phase distribution rather than the quantitative phase image itself. It has been shown by Popescu, Quantitative phase imaging of cells and tissues, Chap. 15, (McGraw-Hill, New York, 2011), incorporated herein by reference, that since the optical pathlength contains information about both thickness and refractive index of the specimen, quantitative phase imaging is capable of investigating both out-of-plane cell membrane fluctuations (using the thickness component) and in plane intracellular transport (using the refractive index component).
The data analysis is based on the dispersion relation that connects the temporal and spatial frequencies of the fluctuations. This relation is obtained directly from the differential equations that govern the motions (e.g., the diffusion equation in the case of Brownian particle transport). This means that, for studying dynamics, the phase shift need not be known quantitatively; rather, one of its derivatives is sufficient. For example, the spatial power spectrum of the pathlength fluctuations can be obtained from the power spectrum of the Laplacian, by simply multiplying with k2. LFM and similar approaches advantageously allow for novel investigations of dynamic systems, while bringing great simplifications in the optical setup.
Further description of embodiments of the invention may be found in Kim, et al., Gradient field microscopy of unstained specimens, Opt. Exp., vol. 20, pp. 6737-45 (2012), which is incorporated herein by reference.
Because of its fast acquisition speed, GFM is suitable for studying live cells.
In preferred embodiments of the present invention, the disclosed methods for phase derivative microscopy may be implemented as a computer program product for use with a computer system. Such implementations may include a series of computer instructions fixed either on a tangible medium, such as a computer readable medium (e.g., a diskette, CD-ROM, ROM, or fixed disk) or transmittable to a computer system, via a modem or other interface device, such as a communications adapter connected to a network over a medium. The medium may be either a tangible medium (e.g., optical or analog communications lines) or a medium implemented with wireless techniques (e.g., microwave, infrared or other transmission techniques). The series of computer instructions embodies all or part of the functionality previously described herein with respect to the system. Those skilled in the art should appreciate that such computer instructions can be written in a number of programming languages for use with many computer architectures or operating systems. Furthermore, such instructions may be stored in any memory device, such as semiconductor, magnetic, optical or other memory devices, and may be transmitted using any communications technology, such as optical, infrared, microwave, or other transmission technologies. It is expected that such a computer program product may be distributed as a removable medium with accompanying printed or electronic documentation (e.g., shrink wrapped software), preloaded with a computer system (e.g., on system ROM or fixed disk), or distributed from a server or electronic bulletin board over the network (e.g., the Internet or World Wide Web). Of course, some embodiments of the invention may be implemented as a combination of both software (e.g., a computer program product) and hardware. Still other embodiments of the invention are implemented as entirely hardware, or entirely software (e.g., a computer program product).
The embodiments of the invention described above are intended to be merely exemplary; numerous variations and modifications will be apparent to those skilled in the art. All such variations and modifications are intended to be within the scope of the present invention as defined in any appended claims.
The present application claims priority of U.S. Provisional Patent Application Ser. No. 61/705,377, filed Sep. 25, 2012, and incorporated herein by reference.
This invention was made with government support under Grants CBET 08-46660 Career, and CBET 1040462 MRI, awarded by the National Science Foundation, and R21 CA147967-01, awarded by the National Cancer Institute. The Government has certain rights in the invention.
Number | Date | Country | |
---|---|---|---|
61705377 | Sep 2012 | US |