The invention is from the field of optical imaging. In particular the invention is from the field of real time high resolution three dimensional imaging.
Publications and other reference materials referred to herein are numerically referenced in the following text and respectively grouped in the appended Bibliography which immediately precedes the claims.
Phase shift interferometry (PSI) [1] is a well-established optical technology that allows high resolution non-contact three dimensional (3D) topographical measurements of objects. In PSI the 3D topography is obtained by using the interference signal phase values from each point of the surface of the object. As the phase is packed within the interference signal, there is a need to extract the phase. The standard approach to extract the phase from the interference signal is by changing the reference arm length of the interferometer of the PSI system in four (minimum three) equal steps with step size equivalent to π/2 phase shift [5]; for each step the interference signal is recorded. Using these four phase shifted signals the phase is extracted for each point on the surface of the sample.
There are several problems with the standard phase shift approach. First, as PSI is a very sensitive technique with sensitivity in the nanometer (nm) range, the fact that the phase shifted signals are grabbed successively and not simultaneously might introduce an error if the interferometer is not super stable during the successive phase shifted measurements. Second, dynamically changing scenes cannot be imaged without producing serious errors since the phase shifting requires time. Third, industrial rapid process control procedures are seriously slowed down because for each frame of the sample field four (minimum three) snapshots must be made in order to extract the phase. On top of all these, the extracted phase is wrapped 2π modulo so that surfaces with overall height variation larger than one fringe of the interference signal, e.g., a variation of 2π in the phase of the interference signal, cannot be easily reconstructed.
Generally speaking, a change of 2π in the phase of the interference signal is equivalent to a change of λ/2 in the surface topography. Obviously, this limits the technique to samples with height variations of only several hundreds of nanometers while the majority of applications require the ability to image samples with height variations of several micrometers. In the past, many researchers concentrated on phase unwrapping algorithms [3-9] which provide partial solution for samples with overall height variations larger than one fringe; however, these algorithms are often likely to collapse if the sample is with large steps, discontinuities or too large speckle noise. An important solution for these problems, which included two wavelengths, was suggested back in the seventies in the context of holography [10]; later this approach was implemented in PSI [11-13] and also using several wavelengths [14].
In the past, several research groups published simultaneous PSI using four CCD cameras [19-21] each grabbing an image with π/2 phase shift. However, to the best of the inventors' knowledge none of the preceding works demonstrated simultaneous PSI using only three CCDs. Moreover, none of the preceding works demonstrated multi wavelengths simultaneous PSI. In addition none of the preceding works demonstrated a three wavelengths calibration procedure to correct for the non-idealities of the optical phase components used.
It is a purpose of the present invention to provide a PSI method and system in which the phase shifted images are grabbed simultaneously and therefore do not require a specially-quiet environment nor ideal optical phase components.
It is another purpose of the present invention to provide a PSI method and system in which the phase shifted images are grabbed simultaneously at several wavelengths thereby allowing imaging samples with topographical variations larger than λ/2.
It is another purpose of the present invention to provide a PSI method and system in which the optical setups, as well as the algorithms, are completely different from those disclosed in previously proposed methods and systems.
It is another purpose of the present invention to provide a PSI method and system that overcomes the problems that have previously arisen using standard PSI system and method.
Further purposes and advantages of this invention will appear as the description proceeds.
The invention is an interference microscopy 3D imaging system comprising:
Embodiments of the system comprise two beam splitters, two wave plates, two analyzers, and two parallel detectors after the tube lens.
In embodiments of the system the three parallel detectors comprise monochrome pixels.
In embodiments of the system the illumination unit comprises at least one of the following elements: a tunable light source, a non-tunable light source, a diffuser, a collecting lens, an aperture stop, a condensing lens, a field stop, a projecting lens and a polarizer.
In embodiments of the system the light source is a three wavelength LED array or a wideband source.
In embodiments of the system the light source is a laser fiber which has three different laser wavelengths coupled into the fiber or three fiber lasers of three different wavelengths with output beams that have been united in space using some optical components such as beam splitters, polarized beam splitters or dichroic mirrors. In these embodiments the laser can be configured to allow wavelength sweeping.
In embodiments of the system the two beam orthogonally polarized interferometer has the configuration of one of the following interferometer types: Linnik, Michelson, Twyman-Green, Fizau, Nomarski, Mach-Zehnder and Mirau.
In embodiments of the system the sample is mounted on a motorized stage. The motorized stage can be connected to and controlled by a processing device and can be driven by at least one of a stepper motor, a servo and a piezoelectric transducer.
In embodiments of the system the parallel detectors and the motorized stage are connected to a processing device and are controlled by the processing device.
In embodiments of the system collimated beams are used without microscope objectives and tube lens with the three parallel detectors and the three detectors comprise either single pixels for each wavelength wherein dichroic mirrors are used to split the spectral beams and direct them to the three single pixel detectors or three colored pixels combined in one detector; thereby allowing a fast interference signal to be grabbed and processed for fast displacement or vibrations measurement.
All the above and other characteristics and advantages of the invention will be further understood through the following illustrative and non-limitative description of embodiments thereof, with reference to the appended drawings.
The invention is a system and method that enable obtaining high resolution 3D images in a single shot.
The system is an ultra-high speed, real time multi wavelength phase shift interference microscopy system that uses three synchronized color CCD cameras. Each CCD is equipped with a precision achromatic phase mask which in turn allows obtaining π/2 phase shifted signals in three different wavelengths simultaneously. The combination of simultaneous phase shifts at different wavelengths allows overcoming all the above mentioned problems of the prior art. In comparison with the methods using pixelated phase mask CCD [15-16] or the frequency domain (FD) real time techniques [3-4] that are sometimes combined with color CCD [17-18], the method described herein is less limited to high spatial variations of the sample; FD techniques require that the carrier frequency induced by the tilting of the reference mirror is higher than the sample spatial bandwidth—a requirement that can not always be met.
By using three (alternatively two) parallel detectors, each equipped with an achromatic phase shifter, three phase shifted (alternatively two) interference images are grabbed simultaneously and in parallel at three different wavelengths (the entire field of view is recorded at once). By using a simple three wavelengths phase shift algorithm the 3D images are obtained in real time.
The invention will now be described in two parts. Firstly the system will be described with respect to the figures and then the method of obtaining the results will be described.
In
In
The system in
In
Other interferometer units that can be used in embodiments of the system include, but are not limited to, Michelson-Taylor type and Mach-Zehnder type orthogonal polarization interferometers.
In PSI, a two beam interferometer of some type (Linnik, Michelson, Mirau, Twyman-Green, Nomarski, Fizau, Mach-Zehnder) is normally used to produce the interference pattern of a specimen positioned in one of the interferometer arms. The reflected interference signal from each point of the sample is then formulated according to equation 1 [2]:
I=B+A cos φ, (1)
where B is the so-called DC level, A is the modulation (envelope) and φ is the phase of the interference signal; this model holds also for sources with low temporal coherence [13]. The interference phase is related to the optical path difference (OPD) between a given point on the sample and the respective point on the reference mirror as formulated in equation 2, where λ is the central wavelength of the illuminating light source. In PSI, after the phase value of each point of the sample is extracted, the local OPD is calculated and then the 3D shape of the sample is constructed; in reflection mode, the difference in OPD between two neighbor sample points equals twice their difference in height (ΔOPD/2=Δheight).
When the observed surface has overall height variations larger than one fringe of the interference signal, the extracted phase values are wrapped and a phase unwrap algorithm should be applied in order to unwrap the 2π modulo of the phase and reconstruct the 3D shape of the object. Phase unwrap algorithms are likely to collapse in cases where the samples have steep height variations, excess speckle noise and or discontinuities.
An alternative way of using a phase unwrap algorithm is to use two (or more) wavelengths for imaging. For each wavelength the phase is extracted by grabbing three π/2 phase shifts, which ideally are described as follows (in equation 3, with i=1, 2, 3):
Ii=B+A cos [φ+(i−1)λ/2], (3)
then,
φ=tg−1[(I1+I3−2I2)/(I1−I3)] (4)
Practically, the non-ideal optical components and system alignment may cause the three π/2 phase shifted signals to have different DC levels (B) and modulations (A) along with phase shifts with some bias relative to the desired π/2 values between the signals as described in equation 5:
Ii=Bi+Ai cos[φ+(i+1)π/2+δi], (5)
In this case, based on a one time preliminary data acquisition to characterize the nature of the non-ideality of the optical components in the system, a system fitting calibration of equation 4 has to be made in order to achieve exact phase extraction from the signals. Using a predetermined movement profile of the motorized stage mounted with a sample, such as, but not necessarily a linear movement, the three phase shifted signals for each image pixel are collected for each wavelength and the DC level, modulation and bias phase shifts are determined via fitting algorithms. Then, a modified version of equation 4 is used to extract the phase for each wavelength as follows:
φ=tg−1[(c3Ĩ1+c1Ĩ3−(c3+c1)Ĩ2)/((1+c4)Ĩ1−(c2−1)Ĩ3−(c2+c4)Ĩ2)] (6)
where in equation 6, Ĩi=(A/Ai)·(Ii−Bi)+B, B=max{B1, B2, B3}, A=max{A1, A2, A3}, c1=cos(δ1−δ2), c2=sin(δ1−δ2), c3=cos(δ1−δ2) and c4=sin(δ4−δ2).
After the phase is obtained for each wavelength, one can calculate the OPD for much larger effective fringe size. For example, when using two wavelengths λ1 and λ2, after calculating their respective phases φ1 and φ2, the OPD is calculated as follows:
From equation 7 it is easy to note that the OPD can be easily calculated as long as the difference between φ1 and φ2 is smaller than 2π. Therefore, much larger steps (height variations) can be imaged and no phase unwrapping algorithm is required. Effectively, the maximum step height is limited to the effective wavelength which is given according to eq.8 (in reflection mode):
hmax=0.5λ2λ1/(λ1−λ2) (8)
When high numerical objective lenses are used, a correction factor which takes into account the effect of the numerical aperture should be applied to equation 8:
hmax=0.5λ2λ1/[(1−NA2/4)(λ1−λ2)] (9)
The standard approach to extract the phase from the interference signal is by changing the reference arm length in four equal steps with step size equivalent to π/2 phase shift [2]; for each step the interference signal is recorded. Using these phase shifted signals the phase is extracted for each point of the sample. This process is repeated for each wavelength. Then, by using equation 7 the OPD of each point of the sample is calculated and the 3D image is reconstructed (ΔOPD/2=Δheight). The fact that the phase shifting is done successively and not simultaneously is very problematic for imaging dynamically moving scenes. Moreover, the switching between wavelengths also requires time which further reduces the imaging speed and requires larger level of stability from the system.
By using a three synchronized color phase shifted parallel detector unit 1900 (see
Since close wavelength values are used, a large effective wavelength is produced which in turn imposes a relatively large error on the value of the calculated OPD (for some wavelength combinations it might be as large as ˜λ). Therefore, additional calculation of the OPD is made using the other two pixels, with less proximity wavelengths values in a four pixels square, say λ1 and λ2
Since less close wavelength values are used, a smaller effective wavelength is produced which in turns imposes a relatively smaller error on the value of the calculated OPD (for some wavelength combinations it might be as large as ˜0.1λ). In equation 11, m is an integer that was introduced in order to account for the wrapping of the phase when the smaller effective wavelength is used (λeff,21). The order of m is determined using equations 10 and 11:
m=int└(Δφ32λeff,32/λeff,21−Δφ21)/4π┘ (12)
After the order of m is determined, the OPD is recalculated:
Since the error in the OPD is still quite large by using eq.13 (˜0.1λ), additional calculation of the OPD is made using the average value of two pixels with identical wavelength values (λ2) in a four pixels square:
In equation 14, n is an integer that was introduced in order to account for the wrapping of the phase when the primary wavelength is used (λ2). The order of n is determined using equations 13 and 14:
After the order of n is determined, the OPD is recalculated with accuracy in the range of 0.005λ2 using equation 14 and 15:
Using eq.16 and the fact that ΔOPD/2=Δheight between two adjacent points on the sample (for reflection mode), the 3D image of the sample can be calculated in real time with nanometer accuracy even for large step samples.
Another embodiment of the invention uses a polarized Mirau common path interferometer. This interferometer is similar to the Mirau objective but with slight modification to allow integration into the system of the invention.
Another preferred embodiment is depicted in
Another embodiment is shown in
Producing the Phase Shift
The phase shifts between the three cameras are produced in the present invention by using two slightly different approaches to arranging the wave plates.
First Approach:
In the first approach element 33, 133 in
Second Approach
In the second approach the wave plates 22, 28 and 25 in the detection unit 1900 of
To further clarify this issue the Jones matrices formalism is now used to show how the phase shift is generated. Consider the Jones vectors of RH and LH circularly polarized waves which represent the circular waves exiting the PQWP positioned in front of the tube lens (element 33, 133 in
In equations 17-18, φ1 and φ2 are the phases of the optical waves coming from the reference and sample arms of the interferometer. After the circular waves split at the beam splitters, they are incident on a linear polarizer which is rotated at an angle α where α can be 0, 45 or 90 degrees. The Jones matrix is now written for an analyzer rotated at a degrees with respect to the P polarization direction:
The RH circular polarization wave transmitted through the analyzer is then expressed using the Jones calculus formalism, giving:
Similarly, the LH circular polarization wave is:
Clearly, the phase delay introduced between the reference and sample waves is directly related to the rotation angle of the analyzer:
Δφ=∠ELH,out−∠ERH,out=φ2−φ1+2α=Δφ+β (22)
The constant phase delay Δφ appears common to all the interference signals, which are produced at the different cameras, while the β phase delay is different in each camera. For the camera equipped with the analyzer that is rotated at α=00, the phase delay is β=0. For the camera equipped with the analyzer that is rotated at α=45°, the phase delay is β=2α=90°=π/2 rad. For the camera equipped with the analyzer that is rotated at α=90°, the phase delay is β=2α=180°=π rad.
Although embodiments of the invention have been described by way of illustration, it will be understood that the invention may be carried out with many variations, modifications, and adaptations, without exceeding the scope of the claims.
Number | Name | Date | Kind |
---|---|---|---|
8072610 | Schmit et al. | Dec 2011 | B1 |
8269980 | Szwaykowski | Sep 2012 | B1 |
9310186 | Abdulhalim | Apr 2016 | B2 |
20010035961 | Mitsutani | Nov 2001 | A1 |
20050099682 | Lauer | May 2005 | A1 |
20080002212 | Kawasaki | Jan 2008 | A1 |
20080285048 | Chen | Nov 2008 | A1 |
20100309476 | Millerd | Dec 2010 | A1 |
20150118877 | He | Apr 2015 | A1 |
Entry |
---|
Cheng et al.; “Multiple-wavelength phase-shifting interferometry”; Applied Optics, vol. 24, No. 6, Mar. 15, 1985, pp. 804-807. |
Cheng et al.; “Two-wavelength phase-shifting interferometry”; Applied Optics, vol. 23, No. 24, Dec. 15, 1984, pp. 4539-4543. |
Creath et al.; “Dynamic quantitative phase imaging for biological objexts using a pixelated phase mask”; Biomedical Optics Express, vol. 3, No. 11; Nov. 1, 2012; pp. 2866-2880. |
Creath, Katherine; “Phase-Measurement Interferometry Techniques”; E. Wolf, Progress in Optics XXVI, 1988, pp. 351-366. |
Creath, Katherine; “Step height measurement using two-wavelength phase-shifting interferometry”; Applied Optics vol. 26, No. 14, Jul. 15, 1987, pp. 2810-2816. |
Cuche et al.; “One-shot analysis”; Nature Photonics, vol. 3, Nov. 2009; pp. 633-635. |
Helen et al.; “Achromatic phase shifting by a rotating polarizer”; Optics Communications 154, Sep. 15, 1998, pp. 249-254. |
Huntley et al.; “Temporal phase-unwrapping algorithm for automated interferogram analysis”; Applied Optics, vol. 32, No. 17, Jun. 10, 1993, pp. 3047-3052. |
Koliopoulos, Chris L.; “Simultaneous phase shift interferometer”; SPIE vol. 1531, Advanced Optical Manufacturing end Testing II, 1991, pp. 119-127. |
Macy, William W., Jr.; “Two-dimensional fringe-pattern analysis”; Applied Optics, vol. 22, No. 23, Dec. 1, 1983, pp. 3898-3901. |
Brunning, J.H.; “Fringe Scanning Interferometers”; Optical Shop Testing, D. Malacara, Ed., 1978, pp. 409-437. |
Ngoi et al.; “Instantaneous phase shifting arrangement for microsurface profiling of flat surfaces”; Optics Communications, 190, Apr. 1, 2001, pp. 109-116. |
Novak et al.; “Analysis of a micropolarizer array-based simultaneous phase-shifting interferometer”; Applied Optics, vol. 44, No. 32, Nov. 10, 2005; pp. 6861-6868. |
Polhemus, C., “Two-Wavelength Interferometry”; Applied Optics, vol. 12, No. 9, Sep. 1973, pp. 2071-2074. |
Quiroga et al.; “Phase-unwrapping algorithm for noisy phase-map processing”; Applied Optics, vol. 33, No. 29, Oct. 10, 1994, pp. 6725-6731. |
Rinehart et al.; “Simultaneous two-wavelength transmission quantitative phase microscopy with a color camera”; Optics Letters, vol. 35, No. 15, Aug. 1, 2010, pp. 2612-2614. |
Safrani et al.; “High-speed 3D imaging using two-wavelength parallel-phase-shift interferometry”; Optics Letters, vol. 40, No. 20, Oct. 15, 2015, pp. 4651-4654. |
Smythe et al.; “Instantaneous phase measuring interferometry”; Optical Engineering, Jul./Aug. 1984, vol. 23, No. 1, pp. 361-364. |
Stetson, Karl A.; “Phase-step interferometry of irregular shapes by using an edge-following algorithm”; Applied Optics, vol. 31, No. 25, Sep. 1, 1992, pp. 5320-5325. |
Takeda et al.; “Fourier-transform method of fringe-pattern analysis for computer-based topography and interferometry”, J. Opt. Soc. Am., vol. 72, No. 1, Jan. 1982, pp. 156-160. |
Vrooman et al.; “Image processing algorithms for the analysis of phase-shifted speckle interference patterns”; Applied Optics, vol. 30, No. 13, May 1, 1991, pp. 1636-1641. |
Wyant, J.C.; “Testing Aspherics Using Two-Wavelength Holography”, Applied Optics, vol. 10, No. 9, Sep. 1971, pp. 2113-2118. |
Zu et al.; “Simple and effective phase unwrapping technique”; SPIE, vol. 2003, Interferometry VI, 1993, pp. 254-263. |