The present disclosure relates to microscopy systems, and specifically to holographic color optical microscopy.
Microscopy is a useful tool for imaging of a wide variety of samples, structural features, and objects that cannot be resolved by the unaided human eye. Different microscopy techniques are often employed for imaging of different targets. For example, fluorescent microscopy is often used to image biological samples and tissues, while scanning electron microscopy is often used to image nanoscale features and particles. Many microscopy techniques provide intense excitation radiation to the target to be imaged, which may compromise the function of biological tissues, cause photobleaching of samples, or otherwise degrade the structural integrity or electrical properties of the target. In some instances low intensity microscopy may be used to image sensitive samples and materials, but low intensity techniques require long image capture times, which are not feasible for imaging biological processes, fabrication processes (e.g., atomic layer deposition, or another fabrication to be monitored), or any changes of a sample in real time.
Light sheet microscopy is a high speed, low excitation intensity, 3D imaging technique. During light sheet microscopy, a plane of a material is illuminated using a sheet of light, and a microscope objective is configured to view the plane from an orthogonal direction as compared to the illumination. While light sheet microscopy provides advantages over other known microscopy techniques, excitation light sheets disperse rapidly in refractive tissue, which limits the penetration depth of a target or sample material. A reduced penetration depth is undesirable for many imaging applications including in live cell imaging in which the low excitation intensities of light sheets provide a major advantage, but in which the substrate can be strongly refractive. Further, a reduced penetration depth results in a loss of three-dimensional imaging information, which results in low contrast images of three-dimensional objects and the inability to resolve fine three-dimensional features. Further, if three-dimensional imaging is needed, additional mechanical components and optics may be required to obtain multiple images to generate an adequate three-dimensional image.
One light sheet microscopy approach, known as Lattice Light-Sheet Microscopy (LLSM), uses a convergent lattice of Bessel beams to generate the light sheet. In LLSM the excitation is confined to a plane defined by a lattice of intersecting Bessel beams that self-reinforce as they project through a target. A reflected beam is then viewed orthogonally as compared to the propagation of the excitation, allowing low excitation intensity illumination of planes to be viewed rapidly in sequence with little photobleaching or interacting with the target. The self-reinforcing nature of the Bessel beams increases the penetration depth as compared to other light sheet microscopy techniques. Nevertheless, LLSM is still limited to an imaging depth of approximately 100 μm in live tissue due to optical distortions. Attempts at improving the penetration depth have employed additional optics that has increased the penetration depth to around 200 μm. However, the required additions are technically challenging and require very expensive equipment. Further, imaging capabilities using LLS are limited when moving bulky detection objectives and not practical for many applications (e.g., biological and tissue imaging) because motors and translation stages have limited ranges of motion, and the target may not withstand the motion of the moving objective and optics. Additionally, the deeper penetration depths allow for dispersion and distortion of the lattice to compound with greater distortion due to the penetration of the target. While advances in microscopy techniques have allowed for the imaging of a wide-variety of targets, current methods still suffer from multiple drawbacks such as requiring complex optical setups, high intensity excitation radiation, long image acquisition times, and expensive equipment, among others.
This Summary is provided to introduce a selection of concepts in a simplified form that are further described below in the Detailed Description. This Summary is not intended to identify key features or essential features of the claimed subject matter, nor is it intended to be used to limit the scope of the claimed subject matter.
In one aspect, there is a method for performing holographic microscopy. The method includes providing, to a modulator, radiation having a (i) phase, (ii) amplitude, and (iii) Poynting vector, modulating, by the modulator, the phase of the radiation to generate a plurality of beams, and detecting, at a detection plane of a detector module, the plurality of beams. The method further includes generating, by the detector module, a signal indicative of an interference pattern of the plurality of beams, and generating, by a processor, a holographic image from the signal indicative of the interference pattern.
In embodiments, the modulator is a spatial light modulator. In some embodiments, the radiation includes incoherent radiation. Further, in embodiments, the plurality of beams includes two beams have a phase offset of 0°, 90°, 180°, or 270° from each other. In embodiments, the method further includes collecting, by a microscope objective positioned at a first distance from the sample, the radiation from a sample and altering, by an actuator, the distance between the microscope objective and the sample from the first distance to a second distance, wherein the second distance is a different distance than the first distance; and collecting, by the microscope objective positioned at the second distance, the radiation from the sample.
In another aspect, there is a microscopy system including a source of radiation configured to provide radiation, the radiation having a (i) phase, (ii) amplitude, and (iii) Poynting vector, the Poynting vector having a direction indicative of a direction of propagation of the radiation. A modulator, disposed along the direction of the Poynting vector, is configured to modulate a phase of the radiation to generate a plurality of beams. A detector module, disposed along the direction of the Poynting vector, is configured to detect, at a detector plane of the detector module, the plurality of beams, and is further configured to generate a signal indicative of an interference pattern of the plurality of beams. A processor is communicatively coupled to the detector module, and is further configured to receive the signal indicative of the interference pattern, and to generate a holographic image from the signal.
Advantages will become apparent to those skilled in the art from the following description of the preferred embodiments, which have been shown and described by way of illustration. As will be realized, the present embodiments may be capable of other and different embodiments, and their details are capable of modification in various respects. Accordingly, the drawings and description are to be regarded as illustrative in nature and not as restrictive.
An incoherent holographic microscopy detection method and associated system are disclosed. The microscopy technique employs incoherent holographic microscopy lattice light-sheet (IHLLS) imaging to generate three-dimensional images of a target. The method employs Fresnel incoherent correlation holography to generate the three-dimensional images. The incoherent imaging disclosed utilizes a scanning geometry with two imaging planes, reduces optical design and hardware complexity, and overall system cost as compared to other microscopy techniques. Further, the disclosed system and method allows for the generation of amplitude and phase three-dimensional images using numerical processing by digital holography.
Digital holography is a powerful three-dimensional (3D) imaging tool. In digital holography the 3D image of a sample volume is formed from determining and analyzing a complex-amplitude distribution of radiation. Most common digital holography techniques use coherent light, such as lasers, to illuminate a sample or target to image the target. The use of coherent light introduces noise from speckle and spurious interference, which limits the imaging resolution and contrast. Further, coherent light sources often provide high intensity excitation radiation which may damage, or otherwise be unsuitable, for imaging of certain materials (e.g., biological samples, tissues, electrically active materials, etc.). The incoherent holographic imaging described herein employs spatially incoherent light (e.g., fluorescent light, black body radiation, etc.) to form holograms and produce images with improved spatial resolution than conventional microscopy techniques.
The incoherent holography method and system disclosed utilizes a modified dual-lens Fresnel incoherent correlation holography technique to produce a complex hologram and to provide a reconstruction distance needed for the reconstruction of the hologram. As described herein, the IHLLS system exhibits a significant contrast improvement over other imaging techniques for imaging of beads and neuronal structures within a biological test sample, as well as quantitative phase imaging. The IHLLS also demonstrates improved transverse imaging resolutions as compared to traditional lattice light-sheet technique.
The disclosed system and method enable the generation of 3D holographic images without requiring the movement of any of a sample stage or detection microscope objective, which simplifies the system setup and reduces the need for mechanical components and controls. Further, by moving only galvanometric mirrors, the described system provides increased resolution and image accuracy as compared to known glass-optics LLS schemes. While not requiring the movement of system components, it may be desirable to perform a deeper volumetric reconstruction for a holographic image, and as such, the described IHLLS may include mechanical components. IHLLS allows for holographic volume reconstruction from fewer position displacements than other holography 3D imaging techniques reducing volume image acquisition time. For example, the described system may reconstruct a holographic image using 9 spatial positions of an objective, whereas traditional methods would require nearly 300 positions for the same objective. Capturing and reconstructing images at multiple objective positions may also improve axial resolution to achieve better localization of ample points and improve axial resolution of images. The optical and mechanical design of the described IHLLS system expands the applicability of lattice light-sheet systems and could open entirely new imaging modalities in all light sheet imaging instruments. The incoherent holography configuration described could be added as an accessory, or as an add-on feature, to any imaging system that uses Bessel or Gaussian beams for scanning and imaging.
Use of a single wavelength band excitation radiation is described for IHLLS, and further, incoherent color holography lattice light-sheet (ICHLLS) using multiple wavelengths of excitation radiation is also described. While a two color (i.e., two wavelength) ICHLLS is demonstrated, the systems described herein are readily scalable to image using four or more colors of radiation. The multi-color technique uses self-interference properties of fluorescence emitted from a sample. Multiple (e.g., two, three or four, as needed) interference patterns are generated at different phase shifts to create Fresnel holograms of a three-dimensional (3D) sample. To implement the multi-color technique, a spatial light modulator (SLM) must be modified to actively control dual diffractive lenses at two colors, while providing phase-shifts to each color sequentially. One or more galvonometric actuators are physically coupled to an LLS to shift a position of the LLS, and therefore change the probing location in the z-direction (i.e., along axis of optical propagation) of the sample. Each phase-shifted image for each lens is repeated at each individual galvonometric scanning level. The described ICHLLS technique enables faster 3D phase and amplitude imaging without moving either a sample stage or detection objective. Additionally, the ICHLLS disclosed herein enables extended imaging fields-of-vies (FOVs) of 208×208 mm2 or greater, at extended imaging depths.
The detector 104 is disposed along a propagation direction of the plurality of beams 110 (e.g., along one or more Poynting vectors of a beam of the plurality of beams), with the detector 104 configured to detect the interference pattern of the overlapped beams. The detector 104 may include one or more of a CMOS detector, a charge-coupled device (CCD), one or more photodiodes or photodiode arrays, a photovoltaic detector, a photomultiplier tube, a metal-oxide-semiconductor (MOS) capacitor, or an infrared sensor. The detector 104 is configured to generate a signal indicative of the detected interference pattern, and to provide the generated signal to a processor 120 for performing hologram generation, hologram reconstruction in amplitude and phase, and image processing. Further, the processor 120 may be configured to perform any required processing, calculations, or functions described herein to generate a holographic image.
In embodiments, the holographic microscopy apparatus 100 may include additional optical elements for performing wavelength filtering, polarization filtering, reflection, magnification, lensing, beam splitting, amplitude modulation, phase modulation, or for performing another optical process. In the embodiment illustrated in
The holographic microscopy apparatus 100 may further include a third lens 114a and a fourth lens 114b configured to operate together as a telescope to magnify the plurality of beams 110. In embodiments, it may be desirable to increase or decrease the size of one or more beams of the plurality of beams 110 according to the size of a detection area of the detector module 104, and/or the size of the active area of the modulator 102. The detector module 104 may include one or more sensors that have defined detection areas for detecting one or more of the beams of the plurality of beams 110, and/or for detecting interference between beams of the plurality of beams 110. To prevent loss of radiation 107, it may be desirable to for the third and fourth lenses 114a and 114b to magnify one or more beams of the plurality of beams 110 to a transverse size that is equal to, or smaller than an overall detection area of the detector module 102 (i.e., the combined detection area of the one or more sensors of the detection module 104). While the third and fourth lenses 114a and 114b are described herein as magnifying the plurality of beams 110, other elements may be employed to magnify the plurality of beams 110. For example, a mirror, spatial light modulator, telescope, objective, or other magnifying element may be used to magnify the plurality of beams 110.
The holographic microscopy apparatus 100 may include a wavelength filter 117 disposed along a direction of the Poynting vector of the radiation 107 configured to filter out wavelengths of the radiation 107. In embodiments, the wavelength filter 117 may include one or more of a low-pass filter, high-pass filter, notch filter, bandpass filter, or another type of wavelength filter. The holographic microscopy apparatus 100 may further include a polarizer 118 disposed along a direction of the Poynting vector of the radiation 107 configured to filter out polarizations of the radiation 107. In embodiments, the polarizer 118 may include one or more polarizers configured to transmit, or filter out, horizontally polarized radiation, vertically polarized radiation, diagonally polarized radiation, circularly polarized radiation, elliptically polarized radiation, or a superposition of polarizations. The polarizer 118 may include a polarizer configured to transmit radiation having a polarization parallel to an active axis of the modulator 102. The wavelength filter 117 and the polarizer 118, may provide filtering and polarizing of the radiation to increase a signal-to-noise (SNR) ratio of the radiation 107, to further improve an SNR of the signal generated by the detector module 104. The apparatus 100 may further include mirrors 115 for directing the radiation 107 and the plurality of beams 110 throughout the apparatus 104 as required. Further, in embodiments, the holographic microscopy apparatus may include one or more spatial filters, amplitude modulators, phase modulators, mirrors, wavelength filters, beam splitters, diffractive elements, prisms, lenses, refractive elements, or other optical elements. In addition to modulating the radiation 107 to form the plurality of beams 110, the modulator 102 may additionally be configured to modulate the radiation 107 to correct for aberrations and distortions due to other optical elements of the apparatus 100. For example, the modulator 107 may provide phase corrections due to imperfections of lens surfaces, imperfections of mirror surfaces, index of refraction inconsistencies, debris, or another optical aberration. Additionally, the modulator 107 may be configured to provide a phase to the radiation 107 to correct for phase errors due to the modulator 102 itself.
The holographic microscopy apparatus 100 may be configured to be an addition to, or add-on to, another imaging system. For example, as illustrated in
The method 200 further includes detecting the plurality of beams 110 (block 206). The detector module 104 is configured to detect one or more of the plurality of beams, or to detect an interference pattern of two or more beams of the plurality of beams 110. The detector module 104 generates a signal indicative of the detected plurality of beams, and/or the detected interference pattern (block 208). The detector module 104 provides the signal to the processor 120 and the processor 120 generates a holographic image from the signal (block 210). The processor 120 may perform one or more machine executable instructions that cause the processor to perform one or more signal processing techniques, image processing techniques, optical analyses, transformations, or other processes for generating the holographic image. The generated holographic image may be presented to a user via a user interface, stored in a memory, provided to another storage device, provided to another system, and/or further processed.
To provide maximum interference of the first and second beams 310a and 310b at the detector 304, it may be desirable for the first and second beams 310a and 310b to have as much transverse overlap as possible at the detector 304. For example, as shown in
To generate a holographic image as described in the IHLLS method and system described herein, a hologram must be obtained from the interference pattern of multiple beams at the detector 304. For example, using the illustrations of
where Q is the quadratic phase function
Q(b)=exp[(iπλ−1(x2+y2)], EQ. 2
θ is the phase shift of the SLM, fd1 is the focal length of a first diffractive lens, and fd2 is the focal length of a second diffractive lens. The first and second diffractive lenses are superimposed on the modulator 302, and the first lens generates the first beam 310a and having a focus at the first focal plane 330a, and the second lens and C1=C2=0.5 are constants. Therefore, employing the optical system and method of
To demonstrate the described IHLLS, a holographic apparatus according to the apparatus 100 of
To demonstrate IHLLS imaging, an SLM was employed as the modulator 102 and the radiation 107 had a wavelength of 520 nm. The SLM was a phase SLM (Meadowlark; 1920×1152 pixels), that was recalibrated to phase shift the radiation 107 to form two beams as the plurality of beams 110. The SLM was configured to apply a full range of 0 to 27 phase shift over its working range of 256 gray levels.
The detector module 104 was a CMOS ORCA camera and various components of the apparatus 100 and the LLS 150 were controlled by a Labview platform (National Instruments). A custom diffraction method was developed using MATLAB (Mathworks, Inc.), and the complex hologram was propagated and reconstructed at a focal plane using the custom diffraction method.
Performance of the holographic microscopy apparatus 100 was compared to conventional LLS imaging by superimposing two different lens configurations onto the active surface of the SLM, (i) a single lens was superimposed on the SLM was to generate one beam from the radiation 107, and (ii) two diffractive lenses were superimposed on the SLM to generate two beams as the plurality of beams 110. The single lens configuration is referred to herein as IHLLS 1L, and the two diffractive lens configuration is referred to herein as IHLLS 2L.
Optical simulations of IHLLS were performed in two steps. First, the distances between each sequential optical component and the focal length of fSLM of a diffractive lens superimposed on the SLM, were calculated to match the transversal pixel magnification of 62.5 for both conventional LLS and IHLLS 1L (
As previously discussed, to achieve high diffraction efficiency, and therefore high a contrast interference pattern at the detector 304, the first and second beams 310a and 310b formed by the SLM must overlap at a detection plane of the detector module 310. To determine the various distances between, and optical parameters of, the elements of the ILSSM system 300, the OpticsSetup optical design software was used. Keeping all the distances d1 to d7 constant, and superimposing two diffractive lenses onto the SLM, a multi-configuration optical system was determined having the transverse height of the two beams equal in size at the camera plane (e.g., at the detector 304). It was determined that, to provide a maximal overlap of the two beams at the detector 304, the first focal plane 330a should be at a focal distance of fd1=220 mm from the SLM, and the second focal plane 330b should be at a focal distance of fd2=2356 mm from the SLM. As previously mentioned, the various distances of the first and second focal planes 330a and 330b are approximate values, and in practice, they may be tuned by ±0.5 to ±5 mm, or more, depending on tolerances and imperfections of optical parameters of other elements of the system.
An IHLLS 2L imaging system was built according to the setups of
The two measurements described above, using the conventional LLS and IHLLS 1L imaging systems, were repeated to image the 200 nm fluorescent beads. For both the conventional LLS and the IHLLS 1L systems, the 200 nm beads were imaged with a transverse scanning area of 208×208 μm2, a galvanometer displacement of Δzgalvo=80 μm, by increments of δzLLS=0.16 μm. For conventional LLS, the scanning area is typically limited to about 54×54 μm2, with some operating up to 78×78 μm2. Therefore, multiple 54×54 μm2 images were obtained in a mosaic-fashion by moving the sample, to form a single image at a given z-galvonometer position. This multiple image mosaicing requires substantially longer acquisition time and images registration for an LLS system than the disclosed IHLLS 1L, and the IHLLS 2L, systems.
In the measurements of the fluorescent beads, the IHLLS 1L system has an increased transverse scanning area and shorter imaging times than conventional LLS. One reason for these improvements is the larger potential scanning area of the IHLLS 1L system as compared to the conventional LLS system. It was also determined from
The IHLLS 2L system was also used to image the 500 nm and 200 nm fluorescent beads. The measurements performed by the IHLLS 2L system also translated the z-gavlonometer according to the total galvanometer translation, and displacement intervals as was used for the conventional LLS and IHLLS 1L measurements. The two beam wavefronts interfered at the detector 304 and created Fresnel holograms captured by the detector 304. The modulator 302 was configured to provide multiple sets of beams with each set having two beams with a different phase offset. Each set of two beams was generated by the modulator 302 at a different time than other sets of beams to generate a time-series of four different sets of beam pairs. Each set of beam pairs had a phase offset of either 0°, 90°, 180°, or 270° (i.e., phases of 0, π/2, π, and 3π2). An image was captured at each of the four phase offsets at each position of the z-galvonometer. Therefore, each image plane in the z direction of the image target included four images, with each image capturing the interference pattern generated by a corresponding phase offset of the generated beams. The four images, for a given galvanometer position, were used to determine a complex amplitude of the wavefronts at the detector 304 according to the equation
U(u,v)=A(u,v)exp(iϕ(u,v))=¼{(IH(u,v,0)−IH(u,v,π)+i(IH(u,v,π/2)−IH(u,v,3π/2)} EQ. 3
where A(u, v) is an amplitude profile of the image, each term IH is an hologram image intensity for one of the four phase images, and ϕ(u, v) is the phase profile of the image according to
The disclosed system and method for performing IHLLS may be useful for imaging of sensitive materials such as biological samples and tissues. For example, imaging of neuronal cells may provide the foundation for understanding many diseases in the human brain. Understanding and analyzing the physiological behavior of the neuronal cells requires the ability to observe cell structure and dynamics quantitatively to cellular and subcellular levels. The described IHLLS imaging system and method provides a noninvasive contrast imaging technique that uses low intensity radiation, which preserves the integrity of the cell. Further, neuronal cells are 3D structures that extend throughout tissue in all directions and many conventional microscopy methods are unable to resolve the cellular structures into 3D images. Conventional approaches are unable to image in the millisecond temporal range at multiple depths simultaneously. The disclosed IHLLS system allows for the 3D holographic imaging of neurons and other cells at imaging speeds capable of capturing physiological responses and cellular dynamics.
As an example, neuronal cells could respond electrically to chemical and electrical inputs. The electrical response could rapidly spread throughout the neuronal cell structure. The electrical response rapidly spreads throughout the neuronal cell structure. The electrical activity in the neuronal cell causes a change in the refractive index of the cell, which, can be imaged over time by the disclosed IHLLS imaging techniques. To demonstrate the observation of cellular behavior, an IHLLS system was constructed to image biological samples.
Quantitative phase cell imaging was performed using an IHLLS 2L system according to the description of the IHLLS 2L system above. The target to be imaged was a lamprey spinal cord ventral horn neuron with dendrites that were sufficiently large to cover the whole detector FOV of 208×208 μm2. Images of the target neuron were obtained using the conventional LLS system, the IHLLS 1L system, and the IHLLS 2L system.
In implementations, multiple wavelengths of radiation may be used for performing IHLLS, referred to herein as multi-wavelength IHLLS, or ICHLLS. Imaging of a sample using multiple wavelengths of light allows for multiple types of tissues, fluorophores, or proteins to be probed and observed simultaneously, or nearly simultaneously. For example, one wavelength of radiation may be used to probe the pH level of a sample, while another wavelength of radiation is used to image calcium to determine changes in calcium levels to correlate the pH level of the sample with calcium levels. Additionally, for biological samples, imaging samples with multiple wavelengths of radiation allows for imaging of physical structures with one wavelength while simultaneously imaging and probing one or more biological processes. Therefore, physical structural changes can be monitored and correlated with chemical and biological processes occurring in the sample.
As previously described with reference to
A multi-wavelength bandpass filter (BPF) 1017 is disposed along a direction of the Poynting vector of the first and second radiation 1053a and 1053b configured to filter out undesirable wavelengths of the first and/or second radiation 1053a and 1053b. The multi-wavelength BPF 1017 may be a single BPF element having multiple transmission peaks, the multi-wavelength BPF 1017 may include multiple BPF elements that are switched into, and out of, the propagation path of the first and second radiation 1053a and 1053b. For example, the multi-wavelength BPF 1017 may include multiple BPFs disposed around a rotary wheel with the rotary wheel positioning a BPF in the propagation path of the first and/or second radiation 1053a and 1053b. The multi-wavelength BPF 1017 transmits center wavelengths of light corresponding to the presence of the first or second radiation 1053a and 1053b. For example, in the embodiment where the multi-wavelength BPF 1017 is a rotary wheel with multiple BPFs, the multi-wavelength BPF 1017 may have a rotation speed corresponding to a pulse width and pulse train timing of pulses of first and second radiation 1053a and 1053b provided by the radiation source 1052. As such, the multi-wavelength BPF 1017 is synchronized to the output of the radiation source 1052 to transmit first or second wavelengths of radiation corresponding to the first and second radiations 1053a and 1053b.
The multi-wavelength BPF 1017 may include more than two BPFs, or have more than two transmission peaks, corresponding to the number of excitation radiation center wavelengths provided by the radiation source 1052. In any embodiment, the multi-wavelength BPF 1017 has bandpass widths wide enough to transmit enough radiation to image the sample 106, and bandpass widths narrow enough to preserve the coherence of the first and second radiation 1053a and 1053b. Automation of the multi-wavelength BPF 1017 and synchronizing the multi-wavelength BPF 1017 transmission with the radiation source 1052 allows for the system to provide images of the sample 106 at various wavelengths of radiation without having to retune the system or change any elements of the system manually. The multi-wavelength BPF 1017 further enables the real time synchronous imaging and probing of multiple physical, biological, or chemical structures and processes using multiple wavelengths of radiation.
The polarizer 118 is configured to filter out polarizations of the first and second radiation 1053a and 1053b to further preserve the coherence of the radiation. The wavelength filter 117 and the polarizer 118, may provide filtering and polarizing of the radiation to increase a SNR ratio of the first and/or second radiation 1053a and 1053b.
The SLM 1002 is configured to superimpose a plurality of lenses on an active area of the modulator. Each lens of the plurality of lenses has a focal length dependent on a corresponding wavelength of radiation, to generate a plurality of beams and to focus each of the wavelengths of radiation to a same focal distance for imaging. For example, the SLM 1002 modulates the first radiation 1053a or second radiation 1053b to generate a plurality of beams 1100 from the respective first or second radiation 1053a and 1053b. The plurality of beams 1100 of the first and second radiation 1053a and 1053b is illustrated in
The third lens 114a and fourth lens 114b are configured to operate together as a telescope to magnify the plurality of beams 1100. In embodiments, it may be desirable to increase or decrease the size of one or more beams of the plurality of beams 1100 according to the size of a detection area of the detector module 104, and/or the size of the active area of the SLM 1002. The detector module 104 may include one or more sensors that have defined detection areas for detecting one or more of the beams of the plurality of beams 1100 at the wavelengths of the first and second radiation 1053a and 1053b, and/or for detecting interference between beams of the plurality of beams 1100. Mirrors 115 may be implemented to guide the first radiation 1053a, second radiation 1053b, and plurality of beams 1100 between various elements of the apparatus 1000.
The detector 104 is disposed along a propagation direction of the plurality of beams 1100 (e.g., along one or more Poynting vectors of a beam of the plurality of beams), with the detector 104 configured to detect the interference pattern of the overlapped beams. The detector 104 may include one or more of a CMOS detector, a charge-coupled device (CCD), one or more photodiodes or photodiode arrays, a photovoltaic detector, a photomultiplier tube, a metal-oxide-semiconductor (MOS) capacitor, or an infrared sensor capable of detecting wavelengths of the first and second radiation 1053a and 1053b. The detector 104 is configured to generate a signal indicative of the detected interference pattern, and to provide the generated signal to the processor 120 for performing hologram generation, hologram reconstruction in amplitude and phase, and image processing. Further, the processor 120 may be configured to perform any required processing, calculations, or functions described herein to generate a holographic image. The processor 120 may generate independent image frames corresponding to independent pulses of radiation provided by the radiation source 1052 for imaging the sample 106. For example, the processor 120 may generate a first image frame corresponding to an image of the sample taken by detecting the first radiation 1053a, and the processor 120 may generate a second image from probing the sample 106 with the second radiation 1053b. The processor 120 may generate a plurality of image frames corresponding to pulses in a radiation pulse train provided by the radiation source 1052. The apparatus 1000 may generate images at rates of hundreds or thousands of frames per second depending on the exposure amounts required to collect adequate radiation for generating images. The apparatus 100 may perform imaging with exposure times on the order of 100 ms, or tens of milliseconds, and it is envisioned that shorter exposure times may be achievable using more sensitive camera technologies. As such, biological and chemical processes that occur at time scales on the order of milliseconds and tens of milliseconds may be resolved.
As described herein, the multi-wavelength BPF 1017 and the SLM 1002 may be synchronized to the radiation source 1052 to perform functions for automated multi-wavelength IHLLS. In embodiments, a controller 1120 may be in communication with the radiation source 1052 to control the radiation source 1052. For example, the controller 1120 may control a radiation source 1052 to cause the radiation source 1052 to provide radiation having a specified wavelength, at pulses having a specific pulse width. The controller 1052 may cause the radiation source to provide radiation in pulse trains with pulses having different radiation wavelengths. The controller 1120 may control the multi-wavelength BPF 1017 to transmit radiation according to the pulse train, or wavelength of radiation provided by the radiation source 1052. Additionally, the controller 1120 may control the SLM 1002 to superimpose one or more diffractive lenses for generating the plurality of beams 1100 depending on the pulse train timing and wavelength of radiation provided by the radiation source 1052.
The method 1200 includes determining amplitude and phase modulation profiles of a first superimposable Fresnel lens from the first focal length (block 1206) and determining phase and amplitude parameters of a second superimposable Fresnel lens from the second focal length (block 1208). To determine the optical phase and amplitude modulations of the first and second Fresnel lenses, the processor 120 may run a script or code such as Matlab or Python script. The method 1200 further includes generating a plurality of phase shifted lens profiles for the first and second Fresnel lenses (block 1210). The phase shifted profiles are then provided to the SLM 1002 to superimpose either the first or second diffractive Fresnel lens onto the SLM 1002 (block 1212) as described previously for IHLLS, and in EQs. 1-4.
The method 1250 further includes determining first and second superimposable diffractive Fresnel lens profiles respectively having the first and second focal lengths for the first radiation (block 1256). The first and second Fresnel lens profiles having amplitude and phase profiles that focus the first radiation at the first and second focal lengths respectively. Third and fourth diffractive Fresnel lens profiles respectively having the first and second focal lengths for the second radiation (block 1258). The third and fourth Fresnel lens profiles having amplitude and phase profiles that focus the second radiation at the first and second focal lengths respectively. It should be understood that the third and fourth Fresnel lens profiles have different focal lengths than the first and second Fresnel lens profiles due to the difference in wavelengths of the first and second radiation. The method 1200 further includes generating a plurality of phase shifted lens profiles for the first, second, third, and fourth Fresnel lenses (block 1260). The phase shifted profiles are then provided to the SLM 1002 to superimpose one of the first, second, third, or fourth diffractive Fresnel lens onto the SLM 1002 (block 1262).
A multi-wavelength IHLLS system, also referred to as an ICHLLS system, was built according to
The two-color ICHLLS system is driven by similar physical principals as the single wavelength IHLLS system, as described with reference to
Combined with multicolor incoherent holographic imaging, the ICHLLS can provide rapid 3D validation of exogenous and endogenous subtle cellular differences that fluoresce at different wavelengths. Fluorophores can be attached to different markers of cell structure as desired to observe different chemical, structural, and biological changes and processes. As an example
The use of IHLLS 2L, as described herein, enables the possibility of measuring changes in cell membrane potential with imaging resolution across the complex 3D structure of the neuron. Organelle and protein movement within cells changes the local refractive index which can be observed in real time on a time scale of seconds, hours, or days at an exposure time and laser intensity two times the amount of conventional LLS. Therefore, IHLLS 2L allows for the observation and detection of movements related to structural changes, axonal transport, and vesicle recycling. The use of IHLLS to detect and image electrical or structural changes of phase opens many new possibilities in imaging of neuronal and cellular activity. While measuring the biological function of neuronal tissues is one example, the IHLLS methods and system disclosed may be used in a number of industries and applications for measuring samples that require low illumination intensities and fast image capture times to observe behaviors of the sample, without damaging or affecting the sample. For example, the disclose IHLLS method and system may be beneficial for measuring chemical reactions, weakly bonded materials, electrically active materials, refractive index changes, The optical and mechanical design of the IHLLS system expands the applicability of the LLS, and other microscopy systems, and could open entirely new imaging modalities in all light sheet imaging instruments. The incoherent configuration could be added as an accessory or as an add-on feature to any existing system that provides galvanometer mirror beam scanning (e.g., Bessel and/or Gaussian beams.)
The following list of aspects reflects a variety of the embodiments explicitly contemplated by the present disclosure. Those of ordinary skill in the art will readily appreciate that the aspects below are neither limiting of the embodiments disclosed herein, nor exhaustive of all of the embodiments conceivable from the disclosure above, but are instead meant to be exemplary in nature.
1. A microscopy system comprising: a source of radiation configured to provide radiation, the radiation having a (i) phase, (ii) amplitude), and (iii) Poynting vector, the Poynting vector having a direction indicative of a direction of propagation of the radiation; a modulator disposed along the direction of the Poynting vector, the modulator configured to modulate a phase of the radiation to generate a plurality of beams; a detector module disposed along the direction of the Poynting vector, the detector module configured to detect, at a detector plane of the detector module, the plurality of beams, the detector module further configured to generate a signal indicative of an interference pattern of the plurality of beams; and a processor communicative coupled to the detector module, the processor configured to receive the signal indicative of the interference pattern, and further configured to generate a holographic image from the signal.
2. A microscopy system according to aspect 1, wherein the modulator comprises a spatial light modulator (SLM).
3. A microscopy system according to either aspect 1 or 2, wherein the plurality of beams comprises two beams having a phase offset from each other of 0°, 90°, 180°, or 270°.
4. A microscopy system according to any of aspects 1 to 3, wherein the radiation comprises a Bessel beam.
5. A microscopy system according to any of aspects 1 to 4, wherein the modulator is further configured to modulate the phase of the radiation to correct for aberrations and phase distortions of the radiation due to optical elements.
6. A microscopy system according to any of aspects 1 to 5, wherein to modulate the phase of the radiation to generate a plurality of beams, the modulator is configured to: modulate the radiation to form a time-series of four beam pairs, wherein each beam pair of the time-series of four beam pairs includes two spatiotemporally overlapped beams, with the first beam pair having a phase offset of 0°, the second beam pair having a phase offset of 90°, the third beam pair having a phase offset of 180°, and the fourth beam pair having a phase offset of 270°.
7. A microscopy system according to any of aspects 1 to 6, wherein to generate a holographic image, the processor is further configured to: determine, from the signal indicative of the interference pattern, a complex amplitude of the interference pattern of the plurality of beams; reconstruct three-dimensional information from the complex amplitude of the interference pattern; and generate a holographic image from the three-dimensional information.
8. A microscopy system according to any of aspects 1 to 7, wherein the radiation comprises incoherent radiation.
9. A microscopy system according to any of aspects 1 to 8, further comprising a first magnification element disposed before the modulator along the direction of the Poynting vector, the first magnification element configured to magnify the radiation according to an active area of the modulator.
10. A microscopy system according to aspect 9, wherein the first magnification element comprises one of a lens, a mirror, a spatial light modulator, a telescope, or an objective.
11. A microscopy system according to any of aspects 1 to 10, further comprising a second magnification element disposed after the modulator along the direction of the Poynting vector, the second magnification element configured to magnify the plurality of beams according to a detection area of the detector module.
12. A microscopy system according to aspect 11, wherein the second magnification element comprises one of a lens, a mirror, a spatial light modulator, a telescope, or an objective.
13. A microscopy system according to any of aspects 1 to 12, further comprising a wavelength filter disposed along the direction of the Poynting vector, the wavelength filter configured to filter the radiation to attenuate a band of wavelengths of the radiation.
14. A microscopy system according to any of aspects 1 to 13, further comprising a polarizer disposed along the direction of the Poynting vector, the polarizer configured to polarize the radiation to filter out polarizations of the radiation.
15. A microscopy system according to any of aspects 1 to 14, further comprising, a radiation source configured to provide radiation to a sample, to perform imaging of the sample; and a microscope objective positioned at a first distance from the sample, the microscope objective configured to collect the radiation from the sample, the microscope objective further being operatively coupled to the modulator to provide the radiation to the modulator.
16. A microscopy system according to aspect 15, further comprising: an actuator physically coupled to the microscope objective, the actuator configured to alter the distance between the microscope objective and the sample;
17. A microscopy system according to aspect 16, wherein the actuator is a galvanometer configured to alter the position of the microscope objective.
18. A microscopy system according to any of aspects 1 to 17, wherein the modulator is configured to modulate the radiation according to two diffractive lenses superimposed on an active area of the modulator.
19. A microscopy system according to any of aspects 1 to 18, wherein the radiation source is a light sheet microscope.
20. An apparatus comprising: a light sheet microscope configured to provide radiation to the apparatus of any one of aspects 1 to 18.
21. A method for performing holographic microscopy, the method comprising:
providing, to a modulator, radiation having a (i) phase, (ii) amplitude), and (iii) Poynting vector; modulating, by the modulator, the phase of the radiation to generate a plurality of beams; detecting, at a detection plane of a detector module, the plurality of beams; generating, by the detector module, a signal indicative of an interference pattern of the plurality of beams; and generating, by a processor, a holographic image from the signal indicative of the interference pattern.
22. A method according to aspect 21, wherein the modulator comprises a spatial light modulator (SLM).
23. A method according to either aspect 21 or 22, wherein the plurality of beams comprises two beams having a phase offset from each other of 0°, 90°, 180°, or 270°.
24. A method according to any of aspects 21 to 23, wherein the radiation comprises a Bessel beam.
25. A method according to any of aspects 21 to 24, wherein the modulator is further configured to modulate the phase of the radiation to correct for aberrations and phase distortions of the radiation due to optical elements.
26. A method according to any of aspects 21 to 25, wherein modulating the radiation to generate a plurality of beams comprises: modulating the radiation to form a time-series of four beam pairs, wherein each beam pair of the time-series of four beam pairs includes two spatiotemporally overlapped beams, with the first beam pair having a phase offset of 0°, the second beam pair having a phase offset of 90°, the third beam pair having a phase offset of 180°, and the fourth beam pair having a phase offset of 270°.
27. A method according to any of aspects 21 to 26, wherein to generate a holographic image, the method further comprises: determining, by the processor, and from the signal indicative of the interference pattern, a complex amplitude of the interference pattern of the plurality of beams; reconstructing, by the processor, three-dimensional information from the complex amplitude of the interference pattern; and generating, by the processor, a holographic image from the three-dimensional information.
28. A method according to any of aspects 1 to 27, wherein the radiation comprises incoherent radiation.
29. A method according to any of aspects 21 to 28, further comprising magnifying, before receiving the radiation at the modulator, the radiation according to an active area of the modulator.
30. A method according to aspect 29, wherein magnifying the radiation according to an active area of the modulator is performed by one of a lens, a mirror, a spatial light modulator, a telescope, or an objective.
31. A method according to any of aspects 21 to 30, further comprising magnifying, after modulating the phase of the radiation, the plurality of beams according to an active detection area of the detector module.
32. A method according to aspect 31, wherein magnifying the plurality of beams according to an active detection area of the detector module is performed by one of a lens, a mirror, a spatial light modulator, a telescope, or an objective.
33. A method according to any of aspects 21 to 32, further comprising filtering, by a wavelength filter, the radiation to attenuate a band of wavelengths of the radiation.
34. A method according to any of aspects 21 to 33, further comprising polarizing, by a polarizer, the radiation to filter out polarizations of the radiation.
35. A method according to any of aspects 21 to 34, further comprising, before receiving the radiation by the modulator, providing the radiation to a sample, to perform imaging of the sample.
36. A method according to 35, further comprising: collecting, by a microscope objective positioned at a first distance from the sample, the radiation from the sample; altering, by an actuator, the distance between the microscope objective and the sample from the first distance to a second distance, wherein the second distance is a different distance than the first distance; and collecting, by the microscope objective positioned at the second distance, the radiation from the sample.
37. A method according to aspect 36, wherein the actuator is a galvanometer configured to alter the position of the microscope objective.
38. A method according to any of aspects 21 to 37, wherein modulating the phase of the radiation comprises modulating the phase of the radiation according to two diffractive lenses superimposed on an active area of the modulator.
This application is a continuation-in-part of International Patent Application No. PCT/US2021/017102, filed on Feb. 8, 2021, and claims the benefit of priority of U.S. Provisional Application 62/971,081 filed on Feb. 6, 2020, each of which is incorporated by reference herein in its entirety and for all purposes.
This invention was made with government support under grant number R21 DC017292 awarded by The National Institutes of Health (NIH). The government has certain rights in this invention.
Number | Date | Country | |
---|---|---|---|
62971081 | Feb 2020 | US |
Number | Date | Country | |
---|---|---|---|
Parent | PCT/US2021/017102 | Feb 2021 | US |
Child | 17883325 | US |