Tiling light sheet selective plane illumination microscopy (TLS-SPIM) improves the 3D imaging ability of SPIM by using a real-time optimized tiling light sheet. However, the imaging speed decreases, and size of the raw image data increases proportionally to the number of tiling positions in TLS-SPIM. The decreased imaging speed and the increased raw data size could cause significant problems when TLS-SPIM is used to image large specimens at high spatial resolution. An exemplary aspect solves this problem. Discontinuous light sheets created by scanning coaxial beam arrays synchronized with camera exposures are used for 3D imaging to decrease the number of tiling positions required at each image plane without sacrificing the spatial resolution. One exemplary aspect investigates the performance of the method via numerical simulation and discuss the details thereof.
A general overview of TLS-SPIM can be found in “Method and apparatus for tiling light sheet selective plane illumination microscopy with real-time optimized light sheet,” filed Feb. 23, 2015, as WO 2016/138003A1, which is incorporated herein by reference in its entirety.
Descriptions of exemplary SPIM microscopy can be found in US 2015/0286042A1, WO 2014/005682A2, and WO 2013/053454A1 which are also incorporated herein by reference in their entirety.
The 3D imaging ability of selective plane illumination microscopy (SPIM), i.e. light sheet microscopy, relies on the intensity profile of the light sheet used for 3D imaging. The thickness, light confinement ability, and size of the light sheet determine the axial resolution, optical sectioning ability, and field of view (FOV) of SPIM respectively. [1,2] In order to improve the 3D imaging ability of SPIM on large specimens, tremendous efforts have been spent to optimize the light sheet intensity profile in the above aspects with one objective being the confining of the excitation light near the detection focal plane over a long distance as much as possible. [3-7]
Unfortunately, a fundamental trade-off exists among the above properties of a light sheet due to the diffraction of light. The excitation light is always less confined as the light sheet size increases, which makes it extremely difficult to image large specimens at high spatial resolution and signal-to-noise ratio (SNR) using SPIM. Methods other than optimizing the light sheet intensity profile were developed to solve the problem [8-13]. Among these methods, an effective approach is to quickly move the light sheet axially within the image plane during imaging, so that high spatial resolution and good optical sectioning ability can be maintained in a much larger FOV compared to the size of the light sheet itself [14-19]. Tiling light sheet selective plane illumination microscopy (TLS-SPIM) is a method using this strategy to improve the 3D imaging ability of SPIM on large specimens. [18,19]
In TLS-SPIM, a large field of view (FOV) is imaged by tiling a short but thin light sheet at multiple positions within the detection focal plane and taking a camera exposure at each light sheet tiling position. It has been demonstrated that TLS-SPIM is capable of imaging large multicellular specimens of different sizes, ranging from live embryonic specimens to cleared tissue specimens, at high spatial resolution. In addition, TLS-SPIM allows the optimization of the tiling light sheet intensity profile and the tiling position in milliseconds, so that the 3D imaging ability of the microscope can be optimized in real-time based on the biological specimen and process being imaged.
Despite the improved 3D imaging ability of TLS-SPIM, the additional camera exposures required in the light sheet tiling process cause major problems. The imaging speed decreases, and the size of the raw image data increases proportionally to the number of tiling positions, i.e., the number of camera exposures required per image plane. Although these problems are less of an issue when the number of tiling positions or sample size is small, it could be truly troubling when a large specimen needs to be imaged by TLS-SPIM at a high spatial resolution, which requires a large number of tiling positions per image plane.
For example, when TLS-SPIM is used to image a cleared tissue specimen of dozens of cubic millimeters at micron level spatial resolution, the total imaging time could be extended by a few hours or more compared to a conventional non-tiling condition, despite the improved spatial resolution. Meanwhile, hundreds of gigabytes, even several terabytes, of additional raw image data are created by the additional camera exposures, and must be collected, which produces a heavy burden to the often-limited data collection bandwidth and the data storage space.
One exemplary aspect presents a method to address at least the above problems of TLS-SPIM. Discontinuous tiling light sheets, created by scanning coaxial beam arrays that are synchronized with the rolling shutter of the detection sCMOS camera (Details of exemplary sCMOS technology can be found at https://and/or.oxinst.com/learning/view/article/scmos-technology-what-is-scmos, which is also incorporated herein by reference in its entirety.), are used in TLS-SPIM to image a large FOV, by which the imaging speed of TLS-SPIM can be increased, and the raw image data size can be decreased proportionally to the number of the coaxial beams contained in the coaxial beam array. The primary feature of discontinuous light sheets is that they have multiple foci, or multiple regions of ideal sheet thickness. Here, one exemplary aspect presents the method and evaluates its performance via numerical simulations.
For a more complete understanding of the present disclosure and its advantages, reference is now made to the following description taken in conjunction with the accompanying drawings, in which like reference numerals represent like parts:
In order to increase the imaging speed of TLS-SPIM and produce less raw image data, the number of tiling positions and camera exposures must be decreased to image the same FOV. In other words, a larger effective area must be imaged at each light sheet tiling position with each camera exposure. Thus, the tiling light sheet must be enlarged along the light propagation direction. Meanwhile, the thickness and light confinement ability of the light sheet must remain the same to ensure that the same spatial resolution and optical sectioning ability can be maintained.
Using a “non-diffracting” light sheet, such as the Bessel light sheet or Lattice light sheet, is a possible solution to address the problem. However, the excitation light is still less confined by a “non-diffracting” light sheet when its size increases, which reduces the optical sectioning ability of SPIM significantly.
Therefore, one exemplary aspect presents a different approach to solve the problem. Instead of using a conventional light sheet with a continuous intensity profile, multiple light sheets that are separated far enough in the light propagation direction are used and tiled simultaneously for 3D imaging in TLS-SPIM. It can also be considered as using a discontinuous light sheet with multiple waists instead of a single continuous waist (
An exemplary aspect investigates the optical designs to conduct the above operations in TLS-SPIM. In the TLS-SPIM microscope reported previously, either one or two binary SLMs are used to generate and tile light sheets of different dimensions for 3D imaging. Although the light sheet tiling process can also be realized by other optical devices, such as a focal variable lens, digital mirror device (DMD), deformable mirror, or a mechanical scanning device, the binary SLM has signification advantages compared to others due to its fast response speed, accurate phase modulation ability, control flexibility, robustness and the lack of mechanical movement. The only major disadvantage of the binary SLM is perhaps a relative low laser power efficiency caused by the undesired diffraction orders generated by the device, which can be easily solved by using a high power laser source. Thus, an exemplary embodiment operates with optical designs using binary SLMs to implement discontinuous light sheets in TLS-SPIM.
A discontinuous light sheet can be obtained by scanning a coaxial beam array, and the effective size of such a discontinuous light sheet is proportional to the number of coaxial beams contained in the beam array. A coaxial beam array can be created easily by adding a DOE (Diffractive Optical Element) element into the previous TLS-SPIM system at a plane conjugated to the rear pupil of the excitation objective, and the binary SLM can be used as a focal variable device to tile the coaxial beam array, so as to the discontinuous light sheet.
However, a DOE element can only generate a coaxial beam array with a fixed beam number and period, which reduces the flexibility of TLS-SPIM significantly. In addition, a DOE element usually works differently for different excitation wavelengths, which makes it difficult to maintain the same imaging quality for different excitation wavelengths. Therefore, an exemplary aspect introduces solutions to generate coaxial beam arrays using the binary SLM used in TLS-SPIM, so that the microscope can generate coaxial beam arrays of different beam numbers and periods for different excitation wavelengths, tile the beam array, and switch between different beam arrays quickly to optimize the imaging performance.
Methods of generating coaxial beam arrays using binary optical devices have been studied extensively. A method that is modified from the designing of Dammann gratings was developed in our research to generate binary phase maps for the binary SLM to create coaxial beam arrays of different dimensions [20]. As shown in
Next, the coherent beam array needs to be tiled along the light propagation direction to image the entire FOV. As discussed above, there are two ways to perform the light sheet tiling process. One is to tile the same coaxial beam array at different positions in the same way as that in regular TLS-SPIM. It can be achieved by superimposing a tilted spherical phase to the circular Dammann grating used to generate the coaxial beam array and resetting the phase values to 0 and π (
Instead of tiling the same light sheet, another way to image the entire FOV in TLS-SPIM is to use multiple discontinuous light sheets with different waist positions, that compensate each other. For example, a FOV can be imaged by using three discontinuous light sheets, which are created by scanning a five-beam coaxial beam array, and two, four-beam arrays, respectively (
Nevertheless, the excitation coaxial beam array needs to be scanned to create a virtual discontinuous light sheet at each tiling position, while the crosstalk between different beams of a coaxial beam array causes a problem when the beam array is scanned to create a discontinuous light sheet. The off-focus light of the beam array adds up together during the beam scanning process and introduces additional off-focus excitation at the waist positions of the discontinuous light sheet, which is the same as what happens in a “non-diffracting” light sheet. Obviously, the additional off-focus excitation reduces the optical sectioning capability of the microscope. As shown
A series of images are taken with each image corresponding to a specific discontinuous beam pattern. The part of each image where the beam has a tight waist is then kept while the rest of the image is digitally removed. Because the beam waists are swept across the field, the kept part of each image will be several discontinuous slits. These several kept parts of each image are combined to form a complete image. Effectively this is a digital slit in the direction of the beam.
In light sheet microscopy, the off-focus fluorescence background produced by a virtual light sheet created by a scanning beam can be suppressed by using a sCMOS camera for fluorescence detection and operating the sCMOS camera in the light sheet readout mode [21,22]. In the light sheet readout mode of a sCMOS camera, the exposure and readout of each pixel row is synchronized with the scanning coaxial beam array, which results in a slit confocal detection effect rather than the wide field detection in normal light sheet microscopy, so that the majority of the fluorescence background created by the off-focus excitation light is rejected by the camera. Obviously, the off-focus fluorescence background created by discontinuous light sheets can be rejected much easier because the confocal slit detection is more effective in rejecting the fluorescence background that is further away from the detection focal plane.
Next, we studied the effectiveness of the confocal slit detection in rejecting the off-focus fluorescence background created by discontinuous light sheets with different detection numerical apertures (NA) and the confocal slit widths.
An exemplary aspect is therefore directed toward a method to increase the imaging speed and decrease the raw data size of TLS-SPIM. Discontinuous lights sheets created by scanning coaxial beam arrays synchronized with the camera exposure are used for 3D imaging. We studied the method and evaluated its performance via numerical simulations. We showed that the implementation of discontinuous light sheets together with the confocal slit detection mode in TLS-SPIM allow the same FOV being imaged with less light sheet tiling positions, i.e., camera exposures, while maintain the same spatial resolution and optical sectioning ability. The new method can improve the imaging speed and reduce the image data size by several times, which could bring significant benefits when TLS-SPIM is used to image large specimens at high spatial resolution.
In
Exemplary aspects are directed toward:
A selective plane illumination microscopy (SPIM) device that uses a discontinuous light sheet, in which the intensity profile of the illumination beam along the direction of the illumination beam is not continuous consisting of:
a SPIM imaging system,
a modified SPIM illumination beam that is discontinuous.
Any of the above aspects in which the illumination beam has more than one beam waists that provide more than one useful sheets along the direction of the illumination beam.
Any of the above aspects in which the beam waists are generated using Bessel beams.
Any of the above aspects in which the more than one beam waists are generated using a spatial light modulator (SLM).
Any of the above aspects in which the more than one beam waists are generated using a phase plate.
Any of the above aspects in which the microscope can also perform tiling light sheet selective plane illumination microscopy (TLS-SPIM).
Any of the above aspects in which TLS-SPIM is performed by adding an additional SLM to the illumination path.
Any of the above aspects in which TLS-SPIM is performed by using a variable optic.
Any of the above aspects in which the device can tile a light sheet at discrete positions to image regions of interest in the same image plane in TLS-SPIM.
Any of the above aspects in which the microscope uses different discontinuous light sheets that compensate each other in TLS-SPIM.
Any of the above aspects in which the detection path has a slit or slits to confine the detected signal to the beam waists of the illumination beam. As the beam waists are moved, said slits move with said beam waists.
Any of the above aspects in which the means for generating the slit(s) is digitally done by processing the raw images.
Any of the above aspects in which the means for generating the slit(s) is done by selectively reading the pixels of the detection device.
Any of the above aspects in which the detection path has a slit or slits to confine the detected signal to the scanned beam. As the beam is scanned across the field, said slit or slits move with the scanned beam.
Any of the above aspectsin which the means for generating the slit(s) is digitally done by processing the raw images.
Any of the above aspectsin which the means for generating the slit(s) is done by selectively reading the pixels of the detection device.
Any of the above aspectsin which an additional slit or slits is added to the detection path to confine the detected signal to the scanned beam.
The exemplary techniques illustrated herein are not limited to the specifically illustrated embodiments but can also be utilized with the other exemplary embodiments and each described feature is individually and separately claimable.
Additionally, the systems, methods and protocols can be implemented to improve one or more of a microscope optionally in conjunction with a special purpose computer, a programmed microprocessor or microcontroller and peripheral integrated circuit element(s), an ASIC or other integrated circuit, a digital signal processor, a hard-wired electronic or logic circuit such as discrete element circuit, a programmable logic device such as PLD, PLA, FPGA, PAL, a microscope or microscope system, any comparable means, or the like. In general, any device capable of implementing a state machine that is in turn capable of implementing the methodology illustrated herein can benefit from the various methods, protocols and techniques according to the disclosure provided herein.
Examples of the processors as described herein may include, but are not limited to, at least one of Qualcomm® Snapdragon® 800 and 801, Qualcomm® Snapdragon® 610 and 615 with 4G LTE Integration and 64-bit computing, Apple® A7 processor with 64-bit architecture, Apple® M7 motion coprocessors, Samsung® Exynos® series, the Intel® Core™ family of processors, the Intel® Xeon® family of processors, the Intel® Atom™ family of processors, the Intel Itanium® family of processors, Intel® Core® i5-4670K and i7-4770K 22 nm Haswell, Intel® Core® i5-3570K 22 nm Ivy Bridge, the AMD® FX™ family of processors, AMD® FX-4300, FX-6300, and FX-8350 32 nm Vishera, AMD® Kaveri processors, Texas Instruments® Jacinto C6000™ automotive infotainment processors, Texas Instruments® OMAP™ automotive-grade mobile processors, ARM® Cortex™-M processors, ARM® Cortex-A and ARM1926EJ-S™ processors, Broadcom® AirForce BCM4704/BCM4703 wireless networking processors, the AR7100 Wireless Network Processing Unit, other industry-equivalent processors, and may perform computational functions using any known or future-developed standard, instruction set, libraries, and/or architecture.
Furthermore, the disclosed methods may be readily implemented in software using object or object-oriented software development environments that provide portable source code that can be used on a variety of computer, microscope, imaging or workstation platforms. Alternatively, the disclosed system may be implemented partially or fully in hardware using standard logic circuits or VLSI design. Whether software or hardware is used to implement the systems in accordance with the embodiments is dependent on the speed and/or efficiency requirements of the system, the particular function, and the particular software or hardware systems or microprocessor or microcomputer systems being utilized. The systems, methods and protocols illustrated herein can be readily implemented in hardware and/or software using any known or later developed systems or structures, devices and/or software by those of ordinary skill in the applicable art from the functional description provided herein and with a general basic knowledge of the computer and imaging arts.
Moreover, the disclosed methods may be readily implemented in software and/or firmware that can be stored on a storage medium to improve the performance of: a programmed general-purpose computer with the cooperation of a controller and memory, a special purpose computer, a microprocessor, imaging system, microscopy imaging system, or the like. In these instances, the systems and methods can be implemented as program embedded on personal computer such as an applet, JAVA™ or CGI script, as a resource residing on a server or computer workstation, as a routine embedded in a dedicated imaging system or system component, or the like. The system can also be implemented by physically incorporating the system and/or method into a software and/or hardware system, such as the hardware and software systems of an imaging system or microscope system.
Furthermore, the disclosed control methods may be readily implemented in software using object or object-oriented software development environments that provide portable source code that can be used on a variety of computer or workstation platforms. Alternatively, the disclosed control methods may be implemented partially or fully in hardware using standard logic circuits or VLSI design. Whether software or hardware is used to implement the systems in accordance with this invention is dependent on the speed and/or efficiency requirements of the system, the particular function, and the particular software or hardware systems or microprocessor or microcomputer systems being utilized.
It is therefore apparent that there has been provided, in accordance with various embodiments an improvement to selective plane illumination microscopy. While aspects have been described in conjunction with a number of embodiments, it is evident that many alternatives, modifications and variations would be or are apparent to those of ordinary skill in the applicable arts. Accordingly, it is intended to embrace all such alternatives, modifications, equivalents and variations that are within the spirit and scope of this disclosure.
This application claims the benefit of and priority under 35 U.S.C. § 119(e) to U.S. Patent Application No. 62/629,405, filed Feb. 12, 2018, entitled “TILING LIGHT SHEET SELECTIVE PLANE ILLUMINATION MICROSCOPY USING DISCONTINUOUS LIGHT SHEETS,” which is incorporated herein by reference in its entirety. This application is also related to U.S. application Ser. No. 15/015,494, filed Feb. 4, 2016, entitled “ILLUMINATOR FOR MULTI-FOCUS CONFOCAL IMAGING AND OPTIMIZED FILLING OF A SPATIAL LIGHT MODULATOR FOR MICROSCOPY,” and U.S. Pat. No. 9,952,418, issued Apr. 24, 2018, entitled MULTI-CHANNEL SIMULTANEOUS PHOTOSIMULATION,” both of which are incorporated herein in their entirety.
Number | Date | Country | |
---|---|---|---|
62629405 | Feb 2018 | US |