Patent Application
20240377625
The invention relates to a confocal microscopy apparatus and to a confocal microscopy method for imaging a sample under investigation by chromatic confocal microscopy. Applications of the invention are available in confocal microscopy, in particular in imaging of biological, medical samples or industrial samples.
In the present specification, reference is made to the following prior art illustrating the technical background of the invention
It is generally known that the visualization of the cellular and subcellular structures within biological tissue improves understanding and identifying the very nature of these entities. In many cases, cellular level, three-dimensional imaging is required, e.g. for early disease diagnosis. Basically three-dimensional imaging can be obtained by tomographic techniques, like ultrasound imaging, magnetic resonance imaging, computer tomography, optical coherence tomography, confocal microscopy [1], and chromatic confocal microscopy [2]. Ultrasound is one of the most commonly used diagnostic technique in biomedical imaging, and it has an axial resolution of around 100s of μm, and a lateral resolution of submillimeter scales. Magnetic resonance tomography is applied in the medical field as well, wherein the field of view of the magnetic resonance tomography is a couple of centimeters and axial resolution is a couple of millimeters. Medical imaging with X-ray computed tomography has a lateral resolution of about 50 microns and axial resolution of around 1 mm. Thus, despite of extensive use in the clinic for tomographic purposes, these imaging techniques suffer from low resolution and therefore have not been a candidate for cellular and subcellular level studies. Optical coherence tomography (OCT) provides three-dimensional information of a sample based on low-coherence interferometry of light with axial and lateral resolution of a few μm. Even though OCT can achieve cellular level lateral resolution, it is maintained in the focal plane only, and as one moves above or below the focus, the resolution drops significantly.
Confocal microscopy has been the technique of choice for cellular and subcellular tomography with lateral resolution better than 1 μm ([3] to [6]). Standard confocal microscopy is a point scanning method, and one would need to scan X, Y, and Z-axis to acquire the complete tomographic information, which decreases the scanning time significantly [7]. Spinning disc confocal microscopy [6] has increased the scanning speed to a level such that up to 1000 frames can be acquired in less than a second. However, such systems are still very bulky and only used as benchtop imaging systems. Depth imaging can be obtained with standard confocal microscopy by scanning in Z direction only.
This limitation is met by chromatic confocal microscopy ([2], [8] to [20], [24]) which uses the chromatic dispersion property of light, allowing to extend the imaging range (range of imaging in depth direction) with a comparable lateral resolution of that of confocal microscopy. Chromatic confocal microscopy has been achieved using chromatic dispersion of refractive and diffractive optical elements and specially fabricated metalenses [13].
A maximum imaging range of 250 μm has been achieved with conventional chromatic confocal microscopy, using chromatic aberration of multiple achromatic and diffractive lenses where an average lateral resolution of around 1 μm is maintained within the imaging range [20]. This imaging range is insufficient for plural applications, wherein in particular in biological and medical imaging, there is an interest in increasing the imaging range.
Generally, the resolution in confocal microscopy can be improved by using a high numerical aperture (NA) lens but this comes at the expense of a reduced imaging range. A higher imaging range can be achieved by using a lower NA objective, but then the lateral resolution is compromised. Therefore, current advancements in this direction suffer from the trade-off between the imaging range and the resolution. For surface profiling, which is one of the main applications of the chromatic confocal microscopy ([10], [17], [21]), multi-lens commercial systems are available with an imaging range of the order of few centimeters, but with poor lateral resolution.
Thus, there is still a need for a tomographic technique that has a superior lateral and axial resolution, like in confocal microscopy, and a large imaging range, like in chromatic confocal microscopy, in particular to visualize cellular and subcellular structures in biological samples.
The objective of the invention is to provide an improved confocal microscopy apparatus and an improved confocal microscopy method for imaging a sample by chromatic confocal microscopy, wherein disadvantages of conventional techniques are avoided. In particular, chromatic confocal microscopy is to be enabled with improved lateral and/or axial resolution, in particular with sub-μm resolution, as it is known from conventional confocal microscopy, but with an increased imaging range, in particular from some 100 μm to few centimeters.
These objectives are correspondingly solved by a confocal microscopy apparatus and a confocal microscopy method comprising the features of the independent claims, respectively. Preferred embodiments and applications of the invention arise from the dependent claims.
According to first general aspect of the invention, the above objective is solved by a confocal microscopy apparatus (in particular chromatic confocal microscope), being configured for imaging a sample under investigation by chromatic confocal microscopy. The confocal microscopy apparatus comprises an illumination source device being arranged for creating illumination light having an illumination spectrum covering a plurality of illumination wavelengths, a focusing device including at least one focusing lens being configured for focusing the illumination light along an imaging axis into a plurality of wavelength-dependent focal planes in an axial imaging range of a sample to be investigated, wherein the at least one focusing lens is further arranged for collecting scattering light created in the focal planes of the sample, and a detector device being arranged for spectrally resolved detecting of the scattering light. According to the invention, the at least one focusing lens is made of a dispersive focusing lens material with an Abbe number equal to or below 8. The dispersive focusing lens material is the material of the at least one focusing lens, wherein this material is at least partially transparent, transparency e. g. at least 50% in the wavelength range of interest.
According to second general aspect of the invention, the above objective is solved by a confocal microscopy method for imaging a sample to be investigated by chromatic confocal microscopy, comprising the steps of creating illumination light having an illumination spectrum covering a plurality of illumination wavelengths, focusing the illumination light with at least one focusing lens along an imaging axis into a plurality of wavelength-dependent focal planes in an axial imaging range of the sample, collecting scattering light with the at least one focusing lens, wherein the scattering light is created in the focal planes of the sample, and spectrally resolved detecting of the scattering light. According to the invention, the at least one focusing lens is made of a dispersive focusing lens material with an Abbe number equal to or below 8. Preferably, the confocal microscopy method or an embodiment thereof is executed using the confocal microscopy apparatus according to the first general aspect of the invention or an embodiment thereof.
Advantageously, the inventors have found that the imaging range in depth direction, i. e. along the imaging axis, can be substantially increased by employing a material with low Abbe number for providing the at least one focusing lens. The at least one focusing lens being made of a material with the Abbe number below 10 allows to focus each of different wavelength components of a light source, e. g. a supercontinuum light source, at a different axial position in an extended imaging range. The term “Abbe number” refers to a dimensionless quantity characterizing the optical dispersive properties of optical materials, in particular characterizing how much the refractive index changes with the wavelength of light. For example, the Abbe number can be defined with (ne−1)/(nF′−nC′) by referring to the refractive index of the lens material at spectral Fraunhofer lines e(λ=546,074 nm), F′(λ=479,9914 nm) and C′(λ=643,8469 nm).
Furthermore, the inventors have found that materials with an Abbe number below 10, in particular 8 or lower, e. g. down to 5 or even 4 are available, which are sufficiently transmissive in the visible to NIR spectral range and which are suitable for creating the at least one focusing lens for confocal microscopy. Employing a focusing lens made of a material with the Abbe number below 10 is in contrast to employing conventional lenses based on materials such as fused silica and quartz for the visible-NIR range, which have an excellent optical quality and high transmission of about 90%, but a high an Abbe number of around 50. Materials with low Abbe number are rarely used for the visible or IR wavelengths because of the low transmission thereof, which is around 50% for the 550 nm and 60% for the 600 nm and above. However, the inventors have found that despite of the low transmission in the visible and NIR range, materials with low Abbe number, like e. g. ZnSe, are suitable for chromatic confocal tomography because of their high chromatic dispersion. The inventors have utilized the chromatic dispersion property of e. g. a single ZnSe lens (50.8 mm focal length) to realize a confocal microscopy apparatus with an imaging range of 1.8 cm with an average lateral resolution of e. g. 2.46 μm where the imaging points are equally spaced in distance along the imaging axis.
The confocal microscopy apparatus design not only allows to use the commercially available or specially manufactured lenses with low Abbe number, but also the fact that only a single lens can be employed for 3D imaging, making the system very attractive for all, in particular commercial and/or scientific, e.g. biological applications.
According to a preferred embodiment of the invention, the illumination spectrum of the illumination source device and the focusing lens material of the at least one focusing lens are selected such that the imaging range including the focal planes is at least 10 μm and/or at most 10 cm. For example, the inventive chromatic confocal microscopy apparatus has an imaging range of e. g. up to 1.8 cm or even more, while keeping an average lateral resolution of e. g. down to 2.46 μm or even less.
According to further preferred embodiment of the invention, the at least one focusing lens is made of zinc selenide (ZnSe). Advantageously, the inventors have found, that this material has an exceptionally high chromatic dispersion property, with an Abbe number of 8 and simultaneously excellent optical properties. As a further advantage, ZnSe lenses are commercially available. The invention is not restricted to this material, but other materials with the Abbe number below 10 can be employed. For example, according to another advantageous embodiment, the at least one focusing lens is made of gallium phosphide (GaP), that has an Abbe number of 6. Up to now, GaP has not been used for commercial lens fabrication due to the release of dangerous substances during the fabrication process [23].
Advantageously, plural options for designing the optics for focusing the illumination light and for collecting the scattering light are available. According to a preferred variant, the at least one focusing lens comprises one single lens. Employing the single lens, having the Abbe number below 10, in particular equal to or below 8, has advantages in terms of low costs and simple adjustment of the focusing lens. Alternatively, multiple focusing lenses can be employed wherein one or more, in particular all, of them may be made of the material having the Abbe number below 10, in particular equal to or below 8. Optics made of multiple focusing lenses may have advantages in terms of improving the imaging quality.
According to a further embodiment of the invention, the at least one focusing lens has an aspheric surface. The aspheric surface allows shaping the light field of the illumination light in an advantageous manner. In general, the aspheric lenses are corrected for the spherical aberrations but only for a certain wavelength. With moving away from the spherically corrected wavelength, the aberrations can increase and reduce the image quality. As an example, a ZnSe lens can be designed for 10 μm wavelength and therefore spherically corrected for wavelengths around this wavelength only. If this lens is used for focusing a collimated NIR/IR beam of light, the spherical aberrations could deteriorate the focal spot for particular applications. For avoiding this, a diverging beam can be used, emitted e. g. from an output of the illumination source device or an optional light splitting device as described below. The divergence of the beam directed to the focusing device preferably can be set by the optical configuration of the inventive confocal microscopy apparatus such that the spherical aberration for the visible-NIR wavelengths are minimized or even suppressed. Depending on the NA of the illumination source device or in particular the light splitting device, the distance between the emission output thereof and the focussing lens can be adjusted to minimize the spherical aberrations for a certain wavelength. This methodology can be used to design the inventive system, and the distance between the emission output and the front surface of the focussing lens can be adjusted to minimize the spherical aberrations for a predetermined wavelength, e. g. 700 nm. In this case, the spherical aberrations for the rest of the spectrum are not fully compensated but it is still possible to achieve an average lateral resolution of e. g. 0.87 μm and 2.46 μm for 6.35 mm and 50.8 mm focal length focussing lenses, respectively.
Another advantage of the invention results from the broad spectral range available for the confocal imaging. Thus, according to another preferred embodiment of the invention, the illumination spectrum of the illumination source extends from the visible to NIR wavelength range, i. e. the illumination spectrum covers this whole spectral range or at least one variable spectral interval therein. Preferably, the illumination spectrum of the illumination light covers a wavelength range from 400 nm, in particular from 400 nm, to 1 μm, in particular to 1 μm, or a wavelength interval within this wavelength range covering a frequency range of at least 1*10−6 cm−1.
Particularly preferred, the illumination source comprises a supercontinuum laser source or a swept source laser or an incoherent white light source. Advantageously, these types of light sources facilitate the creation of the above broad spectral ranges.
Preferably, the detector device includes a diffractive element being arranged for spectrally separating the scattering light. The diffractive element may comprise e. g. at least one prism and/or at least one grating. Advantageously, the diffractive element facilitates the simultaneous detection of all spectral components of the collected scattering light with spectral resolution.
According to a further advantageous embodiment of the invention, a light splitting device is arranged for relaying the illumination light from the illumination source device to the focusing device and for relaying the scattering light from the focusing device to the detector device. Particularly preferred, the light splitting device comprises e. g. at least one fiber coupler and/or at least one beam splitter element. The light splitting device has particular advantages in terms of a compact configuration of the confocal microscopy apparatus.
Advantageously, plural applications of the invention are available, e. g. in imaging of biological, commercial or medical samples. Accordingly, the sample preferably comprises a biological sample, like a biological cell, a group of biological cells, e. g. a tissue, or a component of a biological cell. Alternatively, for imaging applications in non-biological fields, the sample may comprise e. g. a workpiece, in particular a workpiece to be investigated by surface profiling.
Features disclosed in the context of the confocal microscopy apparatus and the embodiments thereof also represent preferred features of the inventive confocal microscopy method and the embodiments thereof, and vice versa. The aforementioned aspects and inventive and preferred features, in particular with regard to the configuration of the confocal microscopy apparatus as well as the dimensions and compositions of individual components which have been described in relation to the confocal microscopy apparatus, therefore also apply for the method. The preferred embodiments, variants and features of the invention described above are combinable with one another as desired.
Further details and advantages of the invention are described in the following with reference to the attached drawings, which show in:
Features of preferred embodiments of the invention are described in the following with reference to a ZnSe lens based confocal microscopy apparatus. It is emphasized that the invention is not restricted to employing ZnSe as the material of the at least one focusing lens. Other materials being transparent within the spectral range of interest, in particular in the spectral range of the illumination light emitted by the illumination source device, and having an Abbe number below 10 can be employed as well. Based on the considerations outlined below, optical parameters of the at least one focusing lens can be selected in dependency on the resolution and imaging range to be obtained. Details of chromatic confocal microscopy, in particular details of the system components, like casings or a microscope corpus, and controlling thereof, details of scanning techniques and details of detector data processing, are not described as they are known per se from conventional chromatic confocal microscopy. Similar to conventional point scanning confocal microscopes, the inventive confocal microscopy apparatus can be limited in terms of image acquisition speed which can be improved further by using a fast scanner and camera combination (not described in detail).
As schematically shown in
The illumination source device 10 creates broadband illumination light 1 with an illumination spectrum covering a plurality of illumination wavelengths. As an example, the illumination source device 10 comprises a supercontinuum laser source (SCL), like SC-Pro (manufacturer YSL Photonics, China). The illumination light 1 covers a spectrum of e. g. 400 nm to 2400 nm.
The beam relaying section 20 comprises mirrors 21, 22 and an incoupling lens 23. The illumination light 1 from the illumination source device 10 is steered through the mirrors 21 and 22. Mirror 21 is a dichroic mirror (e. g. DMPL950T, Thorlabs Inc., USA), which reflects wavelengths up to e. g. 950 nm only. The higher wavelengths are transmitted through the mirror 21 and are blocked using a beam block (not shown).
The illumination light 1 reflected by mirror 22 is coupled with the incoupling lens 23 in an optical fibre providing an input arm (i) of an optical coupler 31, like a 75/25 single-mode optical coupler (e. g., TW670R3A2, Thorlabs, USA), of the light splitting device 30. The diverging light at the optical fibre of the first output arm (o1) of the optical coupler 31 is focused using the focusing lens 41 of the focusing device 40 at the position of the sample 2. The focusing lens 41 is a ZnSe lens, having an Abbe number of 8 (e.g. 39469, Edmund Optics, UK). The focusing lens 41 may comprise an aspheric lens being corrected for spherical aberrations. The sample 2 is e. g. a biological sample or a workpiece, e. g. to be investigated by height profiling (surface profiling, examples see below).
The focusing lens 41 is designed for focusing the illumination light 1 along the imaging axis z into a plurality of wavelength-dependent focal planes in an axial imaging range of the sample 2 and for collecting scattering light created in the focal planes of the sample. The scattering light 3 from the sample 2 is coupled back to the first output arm (o1) of the optical coupler 31 and directed via the second output arm (o2) to the detector device 50, which is coupled with the control device 60.
The detector device 50 is a spectrometer comprising a diffractive element 51 for spectrally separating the scattering light 3. As an example, the diffractive element 51 comprises at least one prism (e. g. PS855, Thorlabs Inc., USA). Alternatively, the diffractive element 51 comprises at least one grating. The prism is preferred because it provides higher transmission efficiency over a broad spectrum. Furthermore, the detector device 50 comprises an imaging lens 52 and a camera device 52. The imaging lens 52 is an objective lens (e. g. AF Nikkor 85 mm, Nikon, Japan) which focusses the spectrally separated scattering light 3 onto the camera device 52. The camera device 52 comprises e. g. a linear CCD camera (like raL2048, Basler AG, Germany) working at e. g. 55 kHz line rate. With the camera device 52, e. g. a line image of the spectrally separated scattering light 3 representing the scattering in dependency on the sample depth in Z direction is obtained. By scanning the illumination light 1 relative to the sample 2 in lateral X and/or Y directions perpendicular to the Z direction, a 2D or full 3D image can be collected. The image data from the camera device 52 are received by the control device 60, where the confocal sample image is reconstructed from the image data.
Additionally, the control device 60 can be employed for controlling components of the confocal microscopy apparatus 100, like the illumination source device 10 and/or the focussing device 40 and/or the scanning operation, in order to adapt the imaging conditions, in particular the imaging range in Z direction in dependency on the particular imaging task. As an example, at least one control loop can be provided for setting the illumination source device 10 and/or the focussing device 40 and/or the scanning operation in dependency on image features for improving the image quality.
For practical applications, the confocal microscopy apparatus 100 is designed in consideration of the following aspects. First, the numerical aperture of the system should be as high as possible to achieve the best possible resolution. Secondly, the axial focal separation among different wavelength components should be increased significantly to achieve a maximum possible imaging range. However, as mentioned above, there is a trade-off between the imaging range and the spatial resolution. The resolution can be improved using a high numerical aperture objective, but this, in turn, reduces the imaging range and vice versa. This relation can be quantified by a parameter, extended depth resolution ratio (EDRR), which is the ratio of the imaging range and average lateral resolution in that region. The higher the EDRR, the better the optical device's capability to image for a longer depth with good resolution.
The inventors numerically simulated the design of the confocal microscopy apparatus 100 using OpticStudio software (Zemax LLC, UK) to optimize the aforementioned parameters and in particular the EDRR. To be able to achieve maximum axial separation between different wavelength components, the chromatic dispersion property of the material of the focussing lens 41 is utilized. The chromatic dispersion of the material is estimated by the Abbe number; the lower the Abbe number, the higher is the chromatic dispersion of the material. ZnSe has an Abbe number of 8 (referring in particular to the visible wavelength range) and is one of the smallest Abbe number materials whose lenses are commercially available. It has a transmission of more than 50% for the wavelength range of 0.55 μm to 15 μm.
Using the OpticStudio software, the inventors simulated the performance of three commercially available ZnSe lenses having a focal length of 6.35 mm (39469, Edmund Optics, UK), 12.7 mm (39471, Edmund Optics, UK), and 50.8 mm (39495, Edmund Optics, UK) at 10 μm wavelength. All of these lenses are designed to focus a collimated beam and corrected for the spherical aberration at 10 μm wavelength. However, these lenses also can be used in the visible and NIR wavelength range which is feasible because of the reasonable transmission at these wavelengths.
If the focussing lens 41 introduces significant spherical aberrations so that the lateral resolution is degraded, a diverging beam (instead of a collimated beam) from the optical fibre tip of the first output arm (o1) of the optical coupler 31 is provided and focused using the focussing lens 41, e. g. the ZnSe lens. For the diverging beam, with a certain numerical aperture, at a certain wavelength, there is a fixed distance of the focussing lens 41 from the fiber tip for which the aspherical aberrations are minimum at the focal position. Using numerical simulations, the inventors calculated the distance between the lens and the fiber tip for which the 700 nm wavelength has the minimum spherical aberrations. For this fixed distance between the lens and the fiber tip, parameters for the other wavelengths of the spectrum, i.e. 500 nm and 950 nm were simulated. For all the simulations, the fiber NA of 0.14 was considered. For 500 nm, 700 nm, and 950 nm wavelengths, the imaging range, which is the distance between the focal positions of the 500 nm and the 950 nm wavelength, full-width-half-maxima (FWHM) of the lateral resolution, the Strehl ratio (SR, or: Strehl number, ratio of an observed maximum intensity of a point source in the image plane to the theoretical maximum intensity of a perfect, diffraction-limited optical system), and the EDRR were calculated, as summarized in the table.
The above table shows the substantially increased imaging range obtained with the invention while the spatial resolution is kept as high as with the standard confocal microscopy. In particular, it is evident from the simulations that the lateral resolution, ranging between 0.7 μm to 1.57 μm for 500 nm to 950 nm wavelengths, can be achieved by using a 6.35 mm focal length lens with an imaging range of 1.57 mm. The EDRR for this lens comes out to be 1414. The imaging range can be increased to 3.4 mm by using a 12.7 mm focal length lens, and can be increased further up to 19.38 mm by using a 50.8 mm focal length lens, with an EDRR of 2377 and 7814 respectively.
With practical tests, the confocal microscopy apparatus 100 was calibrated for its performance by measuring parameters like imaging range, lateral, and axial resolution. The lateral resolution of the confocal microscopy apparatus 100 can be characterized e. g. by imaging a resolution target (R1L3S6P, Thorlabs Inc., USA) and calculating a focal spot size of the confocal microscopy apparatus 100 using the knife-edge technique [22]. The knife-edge measurement was performed by traversing the resolution target with 50 nm steps using an automated translation stage. The inventors also calibrated the imaging range of the system by placing a mirror at the sample position and moving it axially using a precision translation stage (MBT616D/M Thorlabs Inc., USA), and measuring the peak position of the reflected signal from the mirror, in the spectrometer as a function of the stage position. To measure the axial resolution, the axial point spread function is measured at different depths. To demonstrate the 3D imaging capabilities of the confocal microscopy apparatus 100 with high lateral resolution over the imaging range, volumetric imaging of a nanoparticle phantom (OCTPHANTOMS.org, UK) with particle size <1 μm was performed. Further, the inventors measured the point spread function of the nanoparticles at different depths.
The potential of the confocal microscopy apparatus 100 for imaging biological samples was demonstrated by imaging cellular features in an onion sample in 3D. Confocal images of the onion tissue were collected, including an enface image of the epidermal layer of onion tissue and onion tissue images at the depth of 30 μm to 220 μm, allowing a 3D reconstruction of the tissue volume of the onion tissue. Furthermore, since the chromatic confocal microscopy has been extensively used in industry for the height profiling [8] of samples, the feasibility of the inventive confocal microscopy apparatus 100 was also tested for the same. To this end, the inventors measured the height measurement accuracy of the confocal microscopy apparatus 100 by placing a mirror (at the position of sample 2) on a piezo-electric stage and measured the movement of the piezo stage at different driving voltages. The efficacy of the height profiling of the confocal microscopy apparatus 100 was practically demonstrated by measuring the height of microfluidic channels on a chip.
The characterization of a 6.35 mm ZnSe lens based confocal microscopy apparatus 100 is illustrated in
To demonstrate the high-resolution depth imaging capability of the inventive confocal microscopy apparatus 100, the inventors performed volumetric imaging of an iron oxide nanoparticles phantom with particle size <1 μm . The phantom (not shown) was imaged for a 0.5 mm×0.5 mm area with a depth of around 1.5 mm (limited by the depth range of the system). Enface images of iron oxide nanoparticles at three depths 0.35 mm, 0.9 mm, and 1.5 mm were obtained. The corresponding X and Y intensity profiles of the visibly smallest gold nanoparticle are plotted in
An important application of the confocal microscopy apparatus 100 is in the field of surface profiling, wherein the sample 2 is a workpiece surface to be investigated. Several of such devices are commercially available where chromatic aberrations of standard lenses are used for the axial separation of the spectral components. The reflected light from the sample is acquired in the confocal configuration and the peak of the reflected spectrum is used to measure the height profile of the sample. As an example, one of the commercially available systems (IFS2407-0,1, from MicroEpsilon) which has a spatial resolution of 3 microns (comparable to the inventive system), provides an imaging range of only 100 microns. On the contrary, using the 50.8 mm focal length ZnSe focussing lens, the inventive confocal microscopy apparatus achieves an imaging range of 1.8 cm, which is 180 times greater than the commercially available device.
For surface profiling, the inventors measured a minimum height change that one can measure using the confocal microscopy apparatus 100. A mirror was placed at the focal position of 700 nm wavelength, and the peak position of the reflected signal was monitored which is shown in
The features of the invention disclosed in the above description, the drawings and the claims can be of significance individually, in combination or sub-combination for the implementation of the invention in its different embodiments.
| Number | Date | Country | Kind |
|---|---|---|---|
| 21188799.7 | Jul 2021 | EP | regional |
| Filing Document | Filing Date | Country | Kind |
|---|---|---|---|
| PCT/EP2022/068435 | 7/4/2022 | WO |
