The invention belongs to the optical microscopic measurement, imaging technology, especially the microscopic imaging method of phase contrast and differential interference contrast based on the transport of intensity equation.
In the field of biomedical microscopy imaging, most samples are phase objects with a uniform distribution of amplitude transmittance and an uneven distribution of refractive index or thickness. Therefore, when light waves pass through a phase object, the wavelength and amplitude change very little, while the phase changes dramatically (Schmalz J A, Gureyev T E, Paganin D M, et al. Phase retrieval using radiation and matter-wave fields: Validity of Teague's method for solution of the transport-of-intensity equation[J]. Physical Review A, 2011, 84(2): 023808). However, the human eye and optical detectors are unable to observe this phase difference with important information. To address this challenge, academics usually take the approach of staining the sample. The different affinities of different intracellular components for different chemical or fluorescent dyes are exploited to create a sufficiently large contrast in intensity or to generate different spectra for the purpose of cell imaging. Fluorescence microscopy and laser confocal microscopy are widely used to display the structural and functional properties of cells by selectively labeling specific molecules within the cells. However, both traditional dye staining methods and fluorescent labeling staining methods are not conducive to cellular research in the biomedical field because the labeling means are not able to observe living cells for a long time due to the damage to the cells (Sander P, Nehorai A. Deconvolution methods for 3-D fluorescence microscopy images[J]. IEEE Signal Processing Magazine, 2006, 23(3): 32-45).
In the study of dynamic microscopic imaging of living cells, label-free imaging is an effective imaging modality. It can be divided into phase visualization methods and phase measurement methods. The most common phase visualization methods are Phase Contrast (PC) microscopy and Differential Interference Contrast (DIC) microscopy. In 1935, the Dutch scientist Zernike invented phase contrast microscopy, which transformed the optical path length through different parts of the object into a difference in amplitude (light intensity), allowing the observation of unstained specimens by obtaining phase images with high contrast (Zuo Chao, Chen Qian, Sun Jiasong. Non-interferometric phase recovery and quantitative phase microscopic imaging based on the light intensity transport equation: a review of the literature and recent advances [1]. (China Laser, 2016, 43(6): 0609002.). However, this method can obtain qualitative phase images, does not involve quantitative analysis, and requires the use of a special condenser with annular diaphragm and phase contrast objective lens with phase plate, which are complex and expensive. 2015 Laura Waller's group in the United States proposed a digital phase contrast technique based on array light sources with structured light illumination, which uses LED array to obtain microscopic images with different illumination directions. The digital phase contrast algorithm is used to synthesize digital phase contrast microscopic images. This method has a simple structure and can be used to obtain quantitative phase contrast images quickly. However, due to the limitation of the numerical aperture of the light source, it is not effective for imaging phase objects (cells, etc.) (Tian L, Waller L. Quantitative differential phase contrast imaging in an LED array microscope [J]. Optics express, 2015, 23(9): 11394-11403). 2017 Guangdong OPPMANDI Technology Co., Ltd. proposed a dual-channel structured light digital phase contrast microscope imaging system (CN206920698U), which reduces external perturbation by simultaneous acquisition of images through an image acquisition module composed of two cameras, with less interference from the outside world and can obtain the phase contrast image in real-time. However, this method requires the addition of an unpolarized spectroscopic prism and an additional camera, which makes the structure complicated and the cost increased.
DIC microscopy is a wavefront shear interference technique that uses the principle of polarized light interference. The phase change of the sample can be expressed in the form of intensity, where the areas with large phase gradients have high contrast in the field of view and show a “pseudo-stereoscopic” effect (Fu D, Oh S, Choi W, Yamauchi T, Dorn A, Yaqoob Z, et al. Quantitative DIC microscopy using an off-axis self-interference approach. Opt. Lett. 2010; 35:2370-2372). However, this method only supports qualitative analysis of phase images and requires the use of complex experimental equipment: two sets of polarizers and polarization beam splitting prisms (Wollaston prism or Nomarski prism). In 2012, Zeng Shaoqun of Huazhong University of Science and Technology and others proposed a super-resolution differential interference phase contrast microscopy imaging system and microscopy imaging method (CN102998789A), which solved the problem of low imaging contrast of structured light and scattered light imaging, thus realizing the high-contrast super-resolution imaging of biological sample without processing. However, the spatial light modulator used is expensive, and its refresh speed limits the frame rate of image acquisition. It cannot be applied to DIC imaging in the high-speed changing process. In addition, there is the problem that the polarization state of light affects the modulation effect of light by the spatial light modulator
Therefore, how to achieve quantitative, high-speed, and low-cost phase contrast and differential interference contrast imaging in a bright-field microscope without additional complex devices has become a technical challenge in the observation of label-free samples by computational microscopy imaging.
The purpose of the present invention is to provide a microscopic imaging method of phase contrast (PC) and differential interference contrast (DIC) based on the transport of intensity equation (TIE), which can realize phase contrast and differential interference contrast imaging by bright-field microscopy without complex modification of the conventional bright-field microscope.
The technical solution to achieve the purpose of the present invention is:
Compared with the prior art, the invention has significant advantages: (1) Simple structure. It can be directly realized on the traditional bright-field microscope without adding the complicated hardware required for traditional PC imaging and DIC imaging. The proposed method can achieve the same imaging effect as traditional PC imaging and DIC imaging (expensive, complex, and demanding in environmental conditions), which not only reduces the complexity of the device but also ensures the imaging quality. (2) Non-interference. It can work well under partially coherent illumination, so the working environment is not demanding and the application field is wider. (3) Low cost. Only the traditional bright-field microscope does not need to use additional complicated devices, which solves the problem of expensive components in the existing phase contrast imaging system, and avoids the problem of the spatial light modulator being sensitive to the polarization of light.
The invention is further described in detail below with reference to the accompanying drawings.
As shown in
With reference to
Step 1, three intensity images are acquired along the optical axis, and the process is as follows: three intensity images are acquired along the optical axis: positive defocus image Iz-P, infocus image I0, and negative defocus image Iz-N. The first-order axial differentiation ∂I/∂z of the intensity I is obtained by using numerical difference estimation
where dz is the distance between the positive defocus image Iz-P and the negative defocus image Iz-N in the Z axial direction, and the value is generally 5×10−6 m.
Step 2, obtain the quantitative phase image ϕ based on the TIE. The procedure is as follows: solve the TIE using the first-order axial differentiation ova, obtained in Step 1
obtain the quantitative phase image ϕ
where k is the wave number, it can be expressed as k=2π/λ (λ is the wavelength). And ∇ is the gradient operator, · denotes the dot product, ∇−2 is the inverse Laplacian operator.
Step 3, solve TIE in the differential interference contrast (DIC) imaging mode. The specific implementation process is:
(1) Firstly, a beam of light passes through a Wollaston prism and divides into two coherent light fields with Δx, Δy shear;
(2) Any one of them produces another phase shift of π/2, the other one remains unchanged;
(3) Finally, the two beams interfered and superimposed to form an intensity interferogram, that is, the final DIC image obtained. The specific process is as follows: First, the resulting object optical field U(x,y) is:
U(x,y)=√{square root over (I0)} exp[iϕ(x,y)]
where I0 is the focus image obtained in Step 1, ϕ(x,y) is the ϕ obtained in Step 2, then the light field UΔ(x,y) after shearing Δx,Δy and phase shifting π/2 is
U
Δ(x,y)=U(x+Δx,y+Δy)=√{square root over (I/(x+Δx,y+Δy))}exp{i[ϕ(x+Δx,y+Δy)+π/2]}
then the intensity image DIC(x,y) formed by U(x,y) and UΔ(x,y) is
DIC(x,y)=|U(x,y)+UΔ(x,y)|2=|√{square root over (I0)} exp[iϕ(x,y)]+√{square root over (I/(x+Δx,y+Δy))}exp{i[ϕ(x+Δx,y+Δy)+π/2]}|2
where Δx,Δy is integer N, its value is used to adjust the amount of shear and the positive and negative is used to adjust the direction of shear; DIC(x,y) is the obtained DIC intensity image. The solution for the special case of DIC imaging is as follows:
{circle around (1)} For the case of uniform intensity there has I0=1, then
U(x,y)=exp[iϕ(x,y)]
U
Δ(x,y)=U(x+Δx,y+Δy)=exp{i[ϕ(x+Δx,y+Δy)+π/2]}
DIC(x,y)=|U(x,y)+UΔ(x,y)|2=|exp[iϕ(x,y)]+exp{i[ϕ(x+Δy,y+Δy)+π/2]}|2
{circle around (2)} For weakly phased objects for uneven intensity, i.e., ϕ(x,y)□ 1, so
U(x,y)=√{square root over (I0)} exp[iϕ(x,y)]=√{square root over (I0)}[1+iϕ(x,y)]
DIC(x,y)=I0{1+[ϕ(x,y)−ϕ(x+Δx,y+Δy)]}
{circle around (3)} For weakly phased objects for uniform intensity, thus
In this case, ϕ2(x+Δx,y+Δy)+ϕ2(x,y) can be approximated as zero, so the DIC intensity image obtained in this case is
DIC(x,y)=1+[ϕ(x,y)−ϕ(x+Δx,y+Δy)]
{circle around (4)} For the case of slowly varying intensity √{square root over (I0)}≈√{square root over (I(x+Δx,y+Δy))}, there is
DIC(x,y)=|√{square root over (I(x+Δx,y+Δy))}{exp[iϕ(x,y)]+exp{i[ϕ(x+Δx,y+Δy)+π/2]}}|2.
(4) In practice, however, it is not only limited to integer shear quantities but also fractional shear quantities can be achieved. Then the solution, in this case, must be performed in the frequency domain:
U(x,y)=√{square root over (I0)} exp[iϕ(x,y)]
U
Δ(x,y)=exp(iπ/2)FFT−1{Û(ux,uy)exp[i2π(uxΔx+uyΔy)]}
DIC(x,y)=|U(x,y)+UΔ(x,y)|2
The above method is a sub-pixel translation based on the Fourier domain, where Û(ux,uy)=FFT{U(x,y)} is the Fourier transform of, (ux,uy) is the Fourier-domain coordinate corresponding to the space domain coordinate (x,y) (i.e., the frequency-domain coordinate). The value of the shear Δx,Δy is adjustable. When the shear Δx,Δy is integer, it can be solved directly in the space domain, and when the shear Δx,Δy is fractional number, it needs to be converted to the frequency domain. Meanwhile, the magnitude of the shear Δx,Δy determines the convexity of the object in the DIC image, which is often within the range of (1,10); and the positive or negative shear value Δy,Δy determines the shading direction of the object in the DIC image.
This step results in an intensity image in the DIC imaging mode DIC(x,y).
Step 4, solve the phase transfer function in the phase contrast (PC) imaging mode, and solve the intensity image in the PC imaging mode by the annular phase contrast method or the apodization phase contrast method.
The specific implementation process is: using the quantitative phase image obtained in Step 2, based on the phase contrast imaging theory to obtain the intensity image IPC-A(u) obtained by the annular phase contrast method and the intensity image IPC-B(u) obtained by the apodization phase contrast method. The first method is the annular phase contrast method: compared with the traditional phase contrast method, the difference is that the illumination is annular (instead of plane waves) and the phase contrast plate in the imaging system is annular (instead of a point in the middle) [see
U(x,y)=√{square root over (I0)} exp[iϕ(x,y)]
where I0 is the focus image obtained in Step 1, ϕ(x,y) is the phase image ϕ obtained in Step 2, u denotes the frequency coordinate in Fourier space; I(u) is the intensity spectrum distribution; B indicates background items; A(u) is the amplitude spectrum distribution of the sample; ATF(u) denotes the amplitude transfer function; Φ(u) is the phase spectrum distribution of the sample; PTF(u) denotes the phase transfer function; uj is the corresponding frequency shift vector caused by a single tilted illumination, j indicates different angles of illumination; L(uj) denotes the intensity distribution of the illumination source in the Fourier domain; P(u) is the pupil function of the objective lens; * denotes the conjugate operation. The above expressions are general expressions for the background term, amplitude transfer function and phase transfer function under complex illumination and are applicable to all illumination modes and pupil functions; therefore, in the case of annular phase contrast, the light source expression for the annular illumination mode L(u) is
The pupil function under the annular phase contrast PPC-A(u) is
where (ux,uy) is the Fourier-domain coordinate corresponding to the space domain coordinate (x,y), λ is the wavelength, k0 is the radius of the corresponding objective limit, k1 is the outer diameter of the phase contrast ring, k2 is the inner diameter of the phase contrast ring. In the set of simulation experiments shown in
The corresponding with ATFPC-A(u) and PTFPC-A(u) results are shown in
W
j(u)=√{square root over (L(uj))}[δ(u−uj)−A(u−uj)+iΦ(u−uj)]P(u)
Thus, the spectral distribution of the intensity images acquired by the camera under single-angle tilt illumination can be written as a convolution of Wj(u) and its complex conjugate wj*(u):
(u)=Wj(u)⊗Wj*(u)=L(uj)δ(u)|P(uj)|2−L(uj)A(u)[P*(uj)P(u+uj)+P(uj)P*(u−uj)]+iL(uj)Φ(u)[P*(uj)P(u+uj)−P(uj)P*(u−uj)]
In order to linearize the phase recovery, the cross-convolution term in the above equation is neglected. When the sample is partially illuminated by spatially coherent light, the resulting annular phase contrast intensity spectrum IPC-A(u) can be written as the sum of the intensity spectrum at multiple illumination angles
I
PC-A(u)=BPC-Aδ(u)+A(u)ATFPC-A(u)±iΦ(u)PTFPC-A(u)
For the phase difference plate, the smaller the size, the higher the contrast of the low-frequency component; for the attenuation rate, it can be used to control the ratio of the low-frequency component to the high-frequency component—usually the larger the value taken the greater the attenuation and the higher the phase contrast (90%); for the phase shift amount, there are two cases of positive and negative phase contrast, the difference lies in the phase in the phase difference plate that the delay of the former is +π/2 and the delay of the latter is −π/2. The algorithm can obtain different annular phase contrast images by changing the value of the numerical aperture of the objective NA0, where the simulation results of changing the numerical aperture of the objective NA0 are shown in
Another method based on phase contrast imaging theory is the apodization phase contrast method: the difference compared to the annular phase contrast method is the use of an apodization phase contrast plate. By using selective amplitude filters in the phase contrast plate located in the objective lens in the back focal plane adjacent to the phase film, the effect of reducing halos and improving the contrast of the sample can be achieved. These amplitude filters consist of neutral density filter films, and the films are applied to the phase contrast plate around the phase film. The transmittance of the phase shift ring in the latest variant phase difference plate is about 25%, while the pair of adjacent rings around the phase shift ring in the variant phase difference plate has neutral density, and the transmittance varies uniformly from 25% to 100% on both sides [see
Thus, ATFPC-B(u) and PTFPC-B(u) of the apodization phase contrast can be expressed as
where k0 corresponds to the radius of the objective limit, k1 is the outer diameter of the phase contrast ring with phase delay, k2 is the inner diameter of the phase contrast ring with phase delay. In the simulated experimental plots shown in
I
PC-B(u)=BPC-Bδ(u)+A(u)ATFPC-B(u)+iΦ(u)PTFPC-B(u)
This procedure results in the intensity image in the phase contrast (PC) imaging mode: the intensity image IPC-A(u) obtained by the annular phase contrast method and the intensity image IPC-B(u) obtained by the apodization phase contrast method, respectively.
Number | Date | Country | Kind |
---|---|---|---|
201811396945.4 | Nov 2018 | CN | national |
Filing Document | Filing Date | Country | Kind |
---|---|---|---|
PCT/CN2019/094797 | 7/5/2019 | WO | 00 |