This patent document relates to imaging devices and in particular to imaging devices for microscopy.
Scattering-based microscopy technologies, such as reflectance confocal microscopy (RCM) are promising techniques for diagnosing various diseases in a non-invasive fashion. Certain cellular structures generate scattered light signals due to the relative difference in their refractive index compared to the surrounding cellular structures. Since intrinsic contrast of the tissue is used rather than the contrast from exogenous agents, scattering-based microscopy technologies can be used to visualize cellular morphologic changes associated with certain diseases in vivo. Among clinically available in vivo microscopy approaches, reflectance confocal microscopy has been most widely used and evaluated for diagnosis of major skin diseases. However, one major pitfall of RCM is that reflected light is not specific to a particular cell. Different cells can generate similar reflectance signals, which can pose challenges in rendering diagnosis. Therefore, the need still exists to provide high-resolution non-invasive microscopy techniques which can be used to visualize cellular details with high resolution and high specificity.
The disclosed embodiments, among other features and benefits, enable new microscopy devices for diagnosing various human diseases in vivo or ex vivo, including melanoma, non-melanoma skin cancers, and inflammatory skin conditions. An example optical imaging device includes a condenser positioned to receive light from a light source and send the light toward a polarizing beam splitter. The polarizing beam splitter is positioned to receive at least a portion of light that is output from the condenser, and to direct light having a first polarization toward an objective lens for illuminating a sample. The optical imaging device also includes an immersion medium positioned after the objective lens, where the immersion medium is configured to, when the sample is present, contact a surface of the sample and allow the light having the first polarization to illuminate the surface of the sample after passing through the immersion medium. Further, the objective lens is positioned to further receive scattered light from the sample after passing of the scattered light through the immersion medium. The immersion medium has a refractive index that is between 1.3 and 1.5 and the objective lens has a numeric aperture that is greater than 0.25. The polarizing beam splitter of the optical imaging device is positioned to also receive the scattered light from the objective lens and send light having a second polarization toward a focusing lens, and the focusing lens is positioned to receive the light having the second polarization and to direct focused light having the second polarization to an image plane.
Devices according to the technology disclosed in this patent document can provide both reflectance and absorption contrasts to visualize cellular details with high resolution and specificity. The improved specificity enabled by the disclosed technology can increase diagnostic accuracy for major skin diseases, increase diagnostic confidence, decrease time needed for rendering a diagnosis, and reduce time required for training for image reading. The disclosed technology allows using inexpensive optoelectrical components, which uniquely makes it possible to construct the microscopy devices and systems at low cost for use in a wide range of clinical settings, including rural, community, primary care, and specialty dermatology clinics. Among other features and benefits, implementations of the disclosed technology can be used to develop reflectance confocal microscopy devices to image human tissues in vivo or ex vivo (especially the human skin in vivo) and provide diagnostic information for various human diseases. The disclosed technology can be integrated with scattering-based microscopes such as reflectance confocal microscopes to simultaneously visualize non-pigmented and pigmented cells with high specificity.
In conventional RCM, light from a point light source is collimated, reflected by a beam splitter, and scanned by a beam scanner, as illustrated in
As mentioned above, a major pitfall of RCM is that reflected light is generally not specific to particular cells. Different cells can generate similar reflectance signal, which can pose challenges in rendering a diagnosis. For example, one such challenge is in distinguishing melanocytes from Langerhans cells, where images obtained by RCM could show the same bright dendritic cells for both conditions, which could produce wrong diagnosis. But the standard of care histopathologic diagnosis would show that the tissue corresponding to one image was melanoma while the tissue corresponding to the other image was melanocytic nevi, a benign condition. Difference in histopathologic diagnosis was likely caused by the fact that some of the bright dendritic cells shown in the second image were Langerhans cells rather than melanocytes. A method to distinguish between melanocytes and Langerhans cells is important for improving diagnostic accuracy for melanoma and other skin diseases.
Dermoscope is a commonly-used imaging tool in dermatology. In a dermoscope, light from an extended light source, or extended light sources, illuminates the tissue, as illustrated by the example configuration of
A two-photon microscope is a clinically available in vivo microscope that can visualize fluorescence signals from human tissue. In a two-photon microscope, light from a pulsed laser is collimated by a collimation lens, reflected by a dichroic mirror, scanned by a beam scanner, and focused by an objective lens, as illustrated in
The embodiments disclosed in this patent document address the above-mentioned shortcomings of other technologies and produce high-resolution images in scattering-based microscopy devices, allowing visualization of cellular details with high resolution and specificity. These, and other features and benefits, are achieved at least in-part by utilizing a cross-polarized detection approach which can be combined with a high-resolution, index-matched objective lens having a high numeric aperture (e.g., NA >0.25) to visualize, for example, pigmented cells and vasculature.
An example embodiment of the cross-polarized detection device (also referred to as cross-polarized microscope) according to the disclosed technology is shown in
Due to the cross-polarized nature of the detection, specular reflection from the tissue surface is mostly rejected. While this example embodiment does not provide an optical sectioning capability as in RCM, the use of a high-NA objective lens and sparsity of pigmented cells make it possible to clearly visualize individual pigmented cells. Use of an immersion medium with a refractive index of, e.g., 1.3-1.5, is important, as it reduces (i) specular reflection from the tissue surface and (ii) spherical aberrations when imaging underneath the tissue surface.
The immersion medium which can be used in embodiments of the disclosed technology disclosed can be, for example, water, oil or other liquid or gel. In some implementations, the immersion medium can have a refractive index that is similar to that of water. According to certain example embodiments, the immersion medium can fill a volume between an objective lens of a cross-polarized detection device according to the disclosed technology and a sample (e.g., a tissue).
The objective lens which can be used in embodiments of the disclosed technology can be, for example, a water-immersion objective lens, an oil-immersion objective lens or any other objective lens that is adapted for use with an immersion medium.
In some example embodiments of the disclosed technology, the imaging sensor can be an imaging sensor of a mobile device (e.g., a smartphone or a tablet).
In an example embodiment of the cross-polarized detection device according to the disclosed technology illustrated in
In an example embodiment of the cross-polarized detection device according to the disclosed technology illustrated in
One aspect of the disclosed embodiments relates to an optical imaging device that includes a condenser positioned to receive light from a light source and send the light toward a polarizing beam splitter. The polarizing beam splitter is positioned to receive at least a portion of light that is output from the condenser, and to direct light having a first polarization toward an objective lens for illuminating a sample. The optical imaging device also includes an immersion medium positioned after the objective lens, wherein the immersion medium is configured to, when the sample is present, contact a surface of the sample, and to allow the light having the first polarization to illuminate the surface of the sample after passing through the immersion medium. The objective lens is positioned to further receive scattered light from the sample after passing of the scattered light through the immersion medium. The immersion medium has a refractive index that is between 1.3 and 1.5 and the objective lens has a numeric aperture that is greater than 0.25. The polarizing beam splitter is positioned to also receive the scattered light from the objective lens and send light having a second polarization toward a focusing lens. Further, the focusing lens is positioned to receive the light having the second polarization and to direct focused light having the second polarization to an image plane.
In one example embodiment, the objective lens is coupled to a translation stage configured to impart translational movements to the objective lens. In another example embodiment, the optical imaging device further includes a processor coupled to the translation stage, where the processor is configured to cause the translation stage to move. In yet another example embodiment, the optical imaging device further includes an imaging sensor positioned at the image plane. In still another example embodiment, the imaging sensor is an imaging sensor of a camera of a mobile device. In another example embodiment, the focusing lens is a focusing lens of the camera of the mobile device. In one example embodiment, the second polarization has a different polarization state than the first polarization.
According to another example embodiment, the optical imaging device of further includes a polarizer positioned to receive the light that is output from the condenser and to provide light having a third polarization toward the polarizing beam splitter. The optical imaging device in this example embodiment also includes an analyzer positioned to receive the light having the second polarization and to provide light having a fourth polarization toward the focusing lens. In one example embodiment, the third polarization has a different polarization state than the fourth polarization. In one example embodiment, the polarizer is a rotatable polarizer, while in another example embodiment, the polarizer is a liquid crystal polarization rotator.
In one example embodiment, the optical imaging device is implemented as part of an imaging system that further includes a reflectance confocal microscope, wherein the imaging system includes a dichroic mirror, and wherein the dichroic mirror and the objective lens are configured to receive light associated with both the optical imaging device and the reflectance confocal microscope. In another example embodiment, the imaging system includes one or more diffraction gratings as part of the reflectance confocal microscope to effectuate spectral encoding by allowing different wavelengths of light incident on one of the one or more diffraction gratings to be diffracted at different angles for illumination onto different lines on the sample by the objective lens. In still another example embodiment, the reflectance confocal microscope has a divided-pupil configuration, where a first sub-portion of the objective lens pupil is configured to provide illumination and a second sub-portion of the objective lens pupil is configured receive light from the sample for producing an image of the sample.
In another example embodiment, the optical imaging device further includes a dichroic mirror positioned to receive the light having the first polarization and direct the light having the first polarization toward the objective lens. The dichroic mirror is positioned to also receive the scattered light from the objective lens and to direct the scattered light toward the polarizing beam splitter. The optical imaging device also includes a collimation lens positioned to receive light from a second light source, and a beam splitter positioned to receive light that is output from the collimation lens and direct the received light that is output from the collimation lens toward a beam scanner. The beam scanner is positioned to receive light from the beam splitter and direct scanned light toward the dichroic mirror. The dichroic mirror is positioned to also receive the scanned light and direct the scanned light towards the objective lens. Further, the objective lens is positioned to also receive the scanned light that is directed to the objective lens by the dichroic mirror and direct the scanned light toward the sample for illuminating the sample; the objective lens is positioned to also receive reflected light from the sample after the reflected light passes through the immersion medium and direct the reflected light toward a second focusing lens along an optical path through the dichroic mirror, the beam scanner and the beam splitter. Additionally, the second focusing lens is positioned to focus the light that is incident thereon onto a pinhole to enable producing an image at a focal plane of the second focusing lens.
In one example embodiment, the light source is configured to produce light having a first spectral content and the second light source is configured to produce light having a second spectral content that is different from the first spectral content. In another example embodiment, the light source is configured to generate light having one or more wavelengths in the range between 400 nm and 700 nm. In still another example embodiment, the second light source is configured to generate light having one or more wavelengths in the range between 750 nm and 1500 nm. In one example embodiment, the optical imaging device further includes an imaging sensor positioned at the image plane, while in another example embodiment, the optical imaging device also includes a photo detector positioned to receive light that is output from the pinhole. In yet another example embodiment, images formed at the imaging sensor and the photo detector are coaligned.
According to another example embodiment, the optical imaging device includes a dichroic mirror positioned to receive the light having the first polarization and direct the light having the first polarization toward the objective lens. The dichroic mirror is positioned to also receive the scattered light from the objective lens and direct the scattered light toward the polarizing beam splitter. In this example embodiment the optical imaging device also includes a collimation lens positioned to receive light from a second light source, and a beam splitter positioned to receive light that is output from the collimation lens and to direct the light that is output from the collimation lens toward a first grating. The first grating is positioned to receive, from the beam splitter, the light that is output from the collimation lens and to direct spectrally separated light to the dichroic mirror. Further, the dichroic mirror is positioned to receive the spectrally separated light and to direct the spectrally separated light towards the objective lens for illuminating the sample. The objective lens positioned to also receive light reflected from the sample after passing of the reflected light through the immersion medium and to direct the reflected light toward the beam splitter along an optical path through the dichroic mirror and the first grating. Additionally, the beam splitter is positioned to also receive the reflected light that is directed thereto from the grating. In this example embodiment, a second focusing lens is positioned to receive light that is directed thereto from the beam splitter and to direct the light that is received thereon to a second collimation lens after passing through a slit. Furthermore, a second grating is positioned to receive light that is output from the second collimation lens and to direct at least a portion of light that incident thereon to a third focusing lens for producing a focused spectrally separated light at a second image plane.
In one example embodiment, the optical imaging device further includes an imaging sensor positioned at the image plane. In another example embodiment, the optical imaging device also includes a second imaging sensor positioned at the second image plane. In still another example embodiment, images formed by the imaging sensor and the second imaging sensor are coaligned. In yet another example embodiment, the second light source is a line light source.
In another example embodiment, the optical imaging device includes a dichroic mirror positioned to receive the light having the first polarization and to direct the light having the first polarization toward the objective lens. The dichroic mirror is positioned to also receive the scattered light from the objective lens and to direct the scattered light toward the polarizing beam splitter. In this example embodiment, the optical imaging device also includes a collimation lens positioned to receive light from a second light source, a first grating positioned to receive, on a first part of the first grating, light that is output from the collimation lens and to direct spectrally separated light toward the dichroic mirror. Further, the dichroic mirror is positioned to direct at least a portion of the spectrally separated light towards the objective lens for illuminating the sample. The objective lens is positioned to also receive reflected light from the sample after passing through the immersion medium and to direct the reflected light toward a mirror along an optical path through the dichroic mirror and a second part of the first grating that is different from the first part. The mirror is positioned to direct the light received thereon towards a second grating along an optical path that traverses through a second focusing lens, a slit and a second collimation lens. In this example embodiment, a second grating is positioned to receive light from the second collimation lens and to direct at least a portion of light that is incident thereon toward a third focusing lens for producing focused spectrally separated light at a second image plane. According to one example embodiment, the optical imaging device includes an imaging sensor positioned at the image plane. In another example embodiment, a second imaging sensor is positioned at the second image plane. In still another example embodiment, images formed by the imaging sensor and the second imaging sensor are coaligned. In yet another example embodiment, the second light source is a line light source.
Another aspect of the disclosed embodiments relates to an optical imaging device that includes a condenser positioned to receive light from a light source, and a polarizer positioned to receive light that is output from the condenser and to direct light having a first polarization toward a beam splitter. The beam splitter is positioned to receive the light having the first polarization and direct light having a second polarization toward an objective lens for illuminating a sample. The optical imaging device also includes an immersion medium positioned after the objective lens, where the immersion medium is configured to, when the sample is present, contact a surface of the sample to allow the light having the second polarization to illuminate the surface of the sample after passing through the immersion medium. The objective lens is positioned to further receive scattered light from the sample after passage through the immersion medium. The immersion medium has a refractive index that is between 1.3 and 1.5 and the objective lens has a numeric aperture that is greater than 0.25. The beam splitter of the optical imaging device is positioned to also receive the scattered light from the objective lens and direct light having a third polarization toward an analyzer. The analyzer is positioned to receive the light having the third polarization and to direct light having a fourth polarization toward a focusing lens to produce focused light having the fourth polarization at an image plane.
In one example embodiment, the beam splitter is a polarizing beam splitter while in another example embodiment, the beam splitter is a non-polarizing beam splitter. According to one example embodiment, the second polarization is the same as the fourth polarization. In another example embodiment, the second polarization is different from the fourth polarization. In still another example embodiment, the polarizer is a rotatable polarizer. In yet another example embodiment, the polarizer is a liquid crystal polarization rotator.
Various information and data processing operations described herein may be implemented in one embodiment by a computer program product, embodied in a computer-readable medium, including computer-executable instructions, such as program code, executed by computers in networked environments. A computer-readable medium may include removable and non-removable storage devices including, but not limited to, Read Only Memory (ROM), Random Access Memory (RAM), compact discs (CDs), digital versatile discs (DVD), etc. Therefore, the computer-readable media that is described in the present application comprises non-transitory storage media. Generally, program modules may include routines, programs, objects, components, data structures, etc. that perform particular tasks or implement particular abstract data types. Computer-executable instructions, associated data structures, and program modules represent examples of program code for executing steps of the methods disclosed herein. The particular sequence of such executable instructions or associated data structures represents examples of corresponding acts for implementing the functions described in such steps or processes.
The foregoing description of embodiments has been presented for purposes of illustration and description. The foregoing description is not intended to be exhaustive or to limit embodiments of the present invention to the precise form disclosed, and modifications and variations are possible in light of the above teachings or may be acquired from practice of various embodiments. The embodiments discussed herein were chosen and described in order to explain the principles and the nature of various embodiments and its practical application to enable one skilled in the art to utilize the present invention in various embodiments and with various modifications as are suited to the particular use contemplated. While operations are depicted in the drawings in a particular order, this should not be understood as requiring that such operations be performed in the particular order shown or in sequential order, or that all illustrated operations be performed, to achieve desirable results. The features of the embodiments described herein may be combined in all possible combinations of methods, apparatus, modules, and systems.
This patent document claims priority to and benefits of U.S. Provisional Application 63/153,010, titled “METHODS AND APPARATUS FOR HIGH-RESOLUTION TISSUE MICROSCOPY,” filed on Feb. 24, 2021. The entire disclosure of the aforementioned application is incorporated by reference as part of the disclosure of this application.
Filing Document | Filing Date | Country | Kind |
---|---|---|---|
PCT/US2022/017459 | 2/23/2022 | WO |
Number | Date | Country | |
---|---|---|---|
63153010 | Feb 2021 | US |