1. Technical Field
The invention relates to optical imaging apparatus, particularly related to polarization imaging apparatus, more specifically related to a high speed polarization imaging system that can measure Stokes components from a sample at different optical wavelengths.
2. Technical Background
The light scattered by a tissue has interacted with the ultrastructure of the tissue, which imprinted some intrinsic properties of the tissue. Tissue ultrastructure extends from membranes to membrane aggregates to collagen fibers to nuclei to cells. Photons are most strongly scattered by those structures whose size matches the photon wavelength. It has been demonstrated that light scattering can provide structural and functional information about the tissue. One important biomedical application of optical imaging and spectroscopy is non-invasive or minimally invasive detection of pre-cancerous and early cancerous changes in human epithelium, such as dysplasia or carcinoma in situ.
In recent years there has been an increasing interest in the propagation of polarized light in randomly scattering media. The investigation of backscattered light is of particular interest since most medical applications aimed at the in-vivo characterization of biological tissue rely on backscattered light. By recording the spatially dependent response of a medium to a polarized point source, one may obtain information about the scattering particles that are not accessible to mere intensity measurements. A diagnostic imaging modality based on near-infrared (NIR) radiation offers several potential advantages over existing radiological techniques. First, the radiation is non-ionizing, and therefore reasonable doses can be repeatedly employed without harm to the patient. Second, optical methods offer the potential to differentiate between soft tissues, due to their different absorption or scatter at NIR wavelengths that are indistinguishable using other modalities. And third, specific absorption by natural chromophores (such as oxy-haemoglobin) allows functional information to be obtained. NIR imaging research has focused on a variety of possible clinical applications.
The fact that the polarization state of the light contains useful information has been shown in many literatures, for example. Rahmann and Canterakis in “Reconstruction of specular surfaces using polarization imaging,” IEEE Computer Society Conference on Computer Vision and Pattern Recognition, vol. 1, pp. 149-155, 2001, describe how the polarization state of light can be used for the reconstruction of specular surfaces to determine the shape of 3-D objects. They use the fact that light reflected by dielectrics and metals becomes partially linearly polarized and that the direction of polarization depends on the orientation of the reflecting surface. Demos and Alfano in “Deep subsurface imaging in tissues using spectral and polarization filtering,” Optics Express, vol. 7, no. 1, pp. 23-28, 2000, demonstrate a technique based on polarization imaging that allows for optical imaging of the surface as well as structures beneath the surface.
There have been several polarization imaging schemes published. In U.S. Pat. No. 6,437,856, inventor Steven Louis Jacques, which issued Aug. 20, 2002, and U.S. Pat. No. 5,847,394, inventors Robert R. Alfano, et al., which issued Dec. 8, 1998, a set of measurements at different polarization orientations are taken to render a new image that is independent of the light reflected from the surface of a tissue sample and that is dependent of the light scattered from deep tissue layers. Especially, a linearly parallel polarized light is used for illumination and two images are acquired, one image selecting linearly parallel (Par) polarized light (i.e., parallel to the light source-tissue-camera plane) and one image selecting linearly perpendicular (Per) polarized light (i.e., perpendicular to the light source-tissue-camera plane). A new image is obtained by (Par−Per) or (Par−Per)/(Par+Per).
Many polarimetric sensing technologies have been developed to capture the Stokes polarization information. People use rotating retarder, rotating polarizer to obtain Stokes parameters from several successive frames of image. In these mechanically-rotation approaches, however, the exact spatial registration between various frames is difficult due to changes of viewing angle and the polarization properties during the period of between successive frames in most target detection applications.
In U.S. Pat. No. 6,798,514, inventor James Maurice Daniels, which issued Sep. 28, 2004, the light passes through two liquid crystal waveplates and a polarizing filter before falling on a light sensitive element device to measure intensity of light in four different polarizations. However, the same difficulty also applied to the approach using liquid crystal for electro-optic polarization modulation, which usually has response time in the order of 100 ms. Another drawback for the liquid crystal approach is that polarization-rotating liquid crystals are not commercially available in many important IR bands.
It is therefore the main objects of the invention to provide a polarization imaging apparatus which can consistently provide high speed and broadband Stokes images in real-time.
It is also the object of the invention to provide a polarization imaging apparatus with an auto-calibration procedure.
The key feature of the polarization imaging apparatus is that it provides fast adjustable optical phase control through high speed electro-optical variable phase retarders made from transparent electro-optic ceramics.
A preferred embodiment of the polarization imaging apparatus is shown in
Another key feature of the invention is that a simplified time sequential control and measurement algorithm which provides a fast measurement and converts sequential intensity images to Stokes images.
In one aspect, the present invention has a calibration procedure that needs one known polarization state to accurately calculate all of the parameters, such as the orientation of first and second variable phase retarter α1 and α2, respectively, as well as half-wave phase retardance δ1π of first variable phase retarder, quarter-wave phase retardance δ1π/2 of first variable phase retarder, and half-wave phase retardance δ2π of second variable phase retarder.
In one aspect, the present invention includes the ferro-electric materials, such as PLZT, La modified PMN-PT, and La modified PZN-PT to form the electric voltage controlled ferro-electric variable phase retarder.
Referring to
The illumination unit 50, and a polarization imaging sensing unit 500 in
Additional features and advantages of the invention will be set forth in the detailed description which follows, and in part will be readily apparent to those skilled in the art from that description or recognized by practicing the invention as described herein, including the detailed description which follows, the claims, as well as the appended drawings.
It is to be understood that both the foregoing general description and the following detailed description present embodiments of the invention, and are intended to provide an overview or framework for understanding the nature and character of the invention as it is claimed. The accompanying drawings are included to provide a further understanding of the invention, and are incorporated into and constitute a part of this specification. The drawings illustrate various embodiments of the invention and together with the description serve to explain the principles and operations of the invention.
It is to be understood that the invention is not limited in its application to the details of the particular arrangement shown since the invention is capable of other embodiments. Also, the terminology used herein is for the purpose of description and not of limitation.
Using Mueller's calculus, we can obtain the Stokes parameters of an input light 10 by measuring the output light intensity of the sensor 15. The transformation done by the phase retarders can be described in the following equation,
S
out=(S0,outS1,outS2,outS3,out)T=Mr2*Mr1*Sin. (2)
where Sin=(S0 S1 S2 S3)T is the unknown input Stokes vector of the target 10, which consists of four Stokes components. The parameter S0 is the intensity of the light (including un-polarized component), S1 is the intensity difference between horizontal linearly polarized and the vertical linearly polarized components, S2 is the intensity difference between 45° linearly polarized and the 135° linearly polarized components, and S3 is the difference between left- and right-circularly polarized intensities.
The quantities Mr1, and Mr2 are the Mueller matrices representing two variable phase retarders 12 and 13, respectively. These are given for the specific orientation by
where δ1 and δ2 are the two phase retardance introduced by the two variable phase retarders 12 and 13, respectively.
To be able to measure the four components of the input Stokes vector, the variable phase retarders need to be set to at least four different states labeled as k. In the following, the linkage between input state Stokes parameters and measured light intensity is detailed. The Mueller matrix for the cascaded variable retarders can be generally cast into an alternative form so that the state of polarization incident on the polarizer can be expressed as,
The actually detected signal through the polarizer is essentially
Without worrying about a global factor, the factor ½ was thrown away. Thus the intensity can be expressed in terms of three of the Muller matrix elements,
I=S
0,out
+S
1,out
=m
11
S
1,in
+m
12
S
2,in
+m
13
S
3,in (6)
It is clear that the output intensity can be linked to the input Stokes parameters through generating four known states of polarization at the input so that we have,
where mijk is the Mueller matrix element at the k-th state of variable retarders, and I, is the intensity measured with the i-th state of variable retarder. From Equation (7), it can be noticed that once the matrix A is known, the input Stokes parameters can be found out the inverse the matrix so that,
The very question now is to find out the matrix A. It can be calculated from each Muller matrix in the system or, it can be done by generating four known states of polarization so that,
where Si,inj is the i-th Stokes parameter generate by the j-th retardance. Thus we are able to link the input state polarization to the intensity measured at four retardance states. The Mueller matrix elements needed for finding the input state of polarization can be figured out through the use of four known state of polarization.
The measurement procedure is based on specifying above general principle for practical applications. As the configuration shown in
m00=1
m
11=cos2(δ1/2)·cos(δ2)−sin(δ1)·sin(δ2)√2
m
12=sin2(δ1/2)
m
13=−cos2(δ1/2)·sin(δ2)−sin(δ1)·cos(δ2)/√2 (10)
where δ1 and δ2 are the retardance of two VPRs 12 and 13, respectively. Although their values could be many different combinations for finding out the Stokes vector, the following 4-state procedure is considered to be the simplest yet most effective approach.
Referring to
Four intensity images (I0−I3) are needed and taken sequentially, with two variable phase retarders 12 and 13 controlled by a sequence of voltages which were generated by controller 101. Phase retardation changes 21 and 22 of VPR 12 and VPR 13, respectively. I0 is taken with 0 volt applied to both 12 and 13. I1 is taken with the half-wave voltage Vπ applied to 12 and 0 volt applied to 13. I2 is taken with V, is applied to both retarder 12 and 13. I3 is taken with a quarter-wave voltage Vπ/2 applied to 12 and Vπ applied to 13. The four Stokes vector images S0-S3 can be calculated from the intensity as follows:
Table 1 listed the state of retardance of first and second variable phase retarders and the corresponding four intensities measured in each equal length time slot. The intensities also can be expressed as a function of Stokes parameters S0-S3 of the input Stokes vector according to equation (2). Table 1 also listed the formula for extracting the Stokes parameters S0-S3 from these intensities.
With this simple converting formula, Stokes images can be obtained using very simple calculation from the intensity images captured by an imaging sensor.
Considering the misalignment of both retarders VPR 12 and VPR 13, and the inaccuracy of their actual half-wave voltages in a polarization system, an auto-calibration technique is necessary to maintain its accuracy. The auto-calibration procedures are for correcting the errors caused by misalignment the optical axis 16 of VPR 12 and optical axis 17 of VPR 13, and the inaccuracy of the voltages applied to each of VPRs.
Assuming:
where initial quarter-wave voltage and half-ware voltages of VPR 12 and VPR 13 are measured before assembly.
The components of Mueller matrix in Equation (5) will be:
m
11=(cos2+2α1+sin2 2α1 cos δ1)(cos2 2α2+sin2 2α2 cos δ2)+sin 2α1 cos 2α1(1−cos δ1)sin 2α2 cos 2α2(1−cos δ2)−sin 2α1 sin δ1 sin 2α2 sin δ2 (12)
m
12=(cos2 2α1+sin2 2α1 cos δ1)sin 2α2 cos 2α2(1−cos δ2)+sin 2α1 cos 2α1(1−cos δ1)(sin2 2α2+cos2 2α2 cos δ2)+sin 2α1 sin δ1 cos 2α2 sin δ2 (13)
m
13=−(cos2 2α1+sin2 2α1 cos δ1)sin 2α2 sin δ2+sin 2α1 cos 2α1(1−cos δ1)cos 2α2 sin δ2−sin 2α1 sin δ1 cos δ2 (14)
The parameter α1, α2, δ1π/2, δ1π and δ2π can be solved using a following sets of measurement procedure with a known polarization incident light, such as a horizontal polarized light:
where
is the Stokes matrix of the input light and
are measured light output. The Mueller matrix components are, according to equations (12) to (13):
(1) m11π/2,0, m12π/2,0, m12π/2,0 represent the m values while a quarter-wave voltage and a zero are applied to VPR 12 and VPR 13, respectively. The detected output is Sout(π/2,0).
(2) m11π,0, m12π,0, m13π,0 represent the m values while a half-wave voltage and a zero voltage are applied to VPR 12 and VPR 13, respectively. The detected output is Sout(π,0).
(3) m110,π, m120,π, m130,π represent the m values while a zero and a half-wave voltage are applied to VPR 12 and VPR 13, respectively. The detected output is Sout(0,π).
(4), m11π,π, m12π,π, m13π,π represent the m values while half-wave voltages are applied to both VPR 12 and VPR 13. The detected output is Sout(π,π).
(5) m11π/2,π, m12π/2,π, m13π/2,π represent the m values while a quarter-wave voltage and a half-wave voltage are applied to VPR 12 and VPR 13, respectively. The detected output is Sout(π,π/2).
The Stokes vector of an unknown incident image (S0, S1, S2, S3)T can be obtained using the equation (16):
where Sout(0,0), Sout(π,0), Sout(π,π) and Sout(π/2,π) outputs when the first VPR 12 and second VPR 13 have the phase retardation of (0,0), (π,0), (π,π), and (π/2,π), respectively; and m values can be calculated according to equations (12) to (13) using calibrated VPR parameters α1, α2, δ1π, δ1π/2 and δ2π.
It should be pointed out that the switch of the relative positions of VPR 12 and VPR 13 will not affect the outcome of the Stokes images according to equation (2).
It is to be appreciated that the orientation configuration between the two variable phase plates 12 and 13 might be achieved with an intervening fixed waveplate, so that physical orientation of the two plates could be less constrained. Hence, the 22.5 degree orientation of the second variable phase retarder 13 with respect to the first variable phase retarder 12 is achieved by any combination of relative physical rotation of the second variable phase retarder 13 with respect to the first retarder 12 and rotation of the polarization reference frame between the two variable phase retarders 12 and 13 by a fixed phase retarding plate (not shown but included as part of the present invention).
Any other orientation configuration of first variable phase retarder 12 and second variable phase retarder 13 will also work, as long as the two variable retarders oriented at different angles, however may involve more difficult calculations.
In addition to the simplified measurement algorithm and auto-calibration, a key component in this polarization imaging apparatus is the variable phase retarder. The other means to change the phase retardation, rotating waveplates, Faraday rotators and Pockel's cell have been used in laboratories worldwide. These devices, however, are bulky, high power consumption, slow or expensive.
A preferred variable phase retarder is made from an electro-optic (EO) material. The general requirement for an EO variable phase retarder is that, when a voltage is applied, a predetermined phase shift is produced for the light beam. Also the material is isotropic with no voltage applied, there is no residual birefringence to cause the initial phase shift. Preferably, the material has a high electro-optic coefficient in order to reduce operating voltages to less than 500 volts. Also the mechanical characteristics allow formation of a bar or plate for use as the electrode. Of course, the material must be transparent at the wavelength of interest, e.g., between 450 nm and 7 μm for most of the polarization imaging applications.
These requirements are satisfied by a class of ferroelectric complex oxides which 1) are optically isotropic; 2) have a Curie temperature less than about 490° C., so that electro-optic coefficients are high near room temperature; 3) have a diffusive phase transition, so that the temperature dependence of the electro-optic coefficients is lessened; and 4) which are not permanently poled by moderate electric fields since materials with a low Curie temperature that become permanently poled are less stable. Example material systems include electro-optic lanthanum modified PZT (PLZT), lead manganese niobate (PMN), a solid solution of lead zinc niobate and lead tantalate (PZN-PT), and a solid solution of lead manganese niobate and lead tantalate (PMN-PT). Besides PLZT, without being an exhaustive list the following materials and their solid solution with or without lanthanum modification, may be used: Pb(Zr,Ti)O3, Pb(Mg,Nb)O3, PbTiO3, Pb(Zn,Nb)O3 and PbTaO3. These materials are available from Corning Inc. (Corning, N.Y.) and Boston Applied Technologies, Inc. (Woburn, Mass.), referenced as OptoCeramic materials. These materials are electrical controllable, solid-state, high speed, low insertion loss, and low fabrication cost.
A preferred OptoCeramic material, PMN-PT, for use in the present invention may be described by the general formula
Pb1−zLaz[(MgtNb1−t)xTi1−x]1−z/4O3+x/2−3xt/2−xz/8+3xtz/8
wherein x is between about 0.6 and about 0.95, z is between about 0 and about 0.08, and t is between about 0.30 and about 0.36. In especially preferred electro-optic ceramic materials of the present invention, z is between about 0.01 and about 0.06. In preferred electro-optic materials of the present invention, t may be between about 0.32 and about 0.34, and x may be between about 0.65 and about 0.90.
According to the present invention, the preferred OptoCeramic PMN-PT is lanthanum modified solid solution of lead manganese niobate and lead tantalate (La:PMN-PT, or PLMNT) with a nominal 3.5/75/25 La/PMN/PT composition. For reference purposes nominal values for this PLMNT are n=2.48 and R=11.5×10−16 m2/V2 at 1.06 μm and n=2.458 and R=6.86×10−16 m2/V2 at 1.55 μm, both at 23° C. PLMNT has a polycrystalline structure with crystal sizes ranging from about 5 to 20 microns. In the form of hot-pressed ceramics, it is optically isotropic and exhibits little birefringence with zero applied voltage.
An electrode geometry of phase retarder which takes advantage of these materials is illustrated by the transverse field configuration illustrated in
As an example, an EO phase retarder is made from a PLMNT plate with metallized electrodes, which has dimensions where the width (w) between the electrodes is about 5 mm, a thickness (t) of about 4 mm, and a length (l) of about 5 mm. Such a dimensioned PLMNT plate has an insertion loss of about 0.1 dB and half-wave voltage of 320V for a 700 nm wavelength laser at 23° C.
It will be understood that the particular geometry described is an example and that other device geometries can be used. Different dimensions of w and t can be selected to provide the same π phase shift with different control voltage. The other preferred PLMNT plate has dimensions of, but not limited to a width (w) of about 0.5-5 mm, a thickness (t) of about 1.30-5 mm, and a length (l) of about 1.0-5.0 mm.
Another preferred OptoCeramic material is PLZT with a nominal 9.5/65/35 La/Pb/Zr composition. This composition is known to be transparent in a range from 450 nm to 7 μm.
Yet another preferred OptoCeramic material, PZN-PT, for use in the present invention may be described by the general formula
Pb1−y−zBayLaz[(ZntNb1−t)xTi1−x]1−z/4O3+x/2−3xt/2−xz/8+3xtz/8
wherein x is between about 0.5 and about 0.9, y is between about 0.05 and about 0.5, z is between about 0 and about 0.05, and t is between about 0.30 and about 0.36. In especially preferred electro-optic ceramic materials of the present invention, x is between about 0.65 and about 0.85, y is between about 0.1 and about 0.2, z is between about 0.02 and 0.04, and t is between about 0.32 and about 0.34.
Referring to
In the present invention, another preferred EO material for variable phase retarders 12 and 13 are made from liquid crystals for a polarization imaging system working between the optical wavelengths 350 nm to 2000 nm. Using the invented control algorithm illustrated in
A polarization imaging apparatus shown in
A preferred light source 51 is a broadband light source, such as a tungsten-halogen lamp which provides a strong intensity over a broad spectrum from UV to NIR (300 nm to 2 μm). Another preferred light source is a light emitting diode (LED) source or laser source.
The scattering light 58 from sample 56 is detected by the imaging sensing unit 500. The optical assembly 11 in 100 shown in
The first VPR 12 and second VPR 13 were controlled independently by a computer 102 through a controller unit 101 which generates a sequential of voltages to control the phase retardations of VPRs 12 and 13. A set of four intensity images, I0, I1, I2 and I3 of the sample were captured by imaging sensor 15 when the phase retardations of VPRs 12 and 13 were set at (0,0), (π,0), (π,π) and (π/2,π), respectively Then four Stokes components of a Stokes image, S0, S1, S2 and S3 can be calculated by computer 102 according to equation (1).
Referring to
It will be apparent to those skilled in the art that various modifications and variations can be made to the present invention without departing from the spirit and scope of the invention. Thus it is intended that the present invention cover the modifications and variations of this invention provided they come within the scope of the appended claims and their equivalents.
This is a continuation-in-part of U.S. patent application Ser. No. 11/701,738, filed on Feb. 2, 2007, which claims the benefit of provisional application Ser. No. 60/772,779 filed on Feb. 13, 2006, the entire teachings of all of which are incorporated herein by this reference.
This invention was made partially with Government supports under grant No. NNJO5JC13C awarded by NASA and No. DE-FG02-08ER85109 awarded by Department of Energy. The government has certain rights in this invention.
Number | Date | Country | |
---|---|---|---|
60772779 | Feb 2006 | US |
Number | Date | Country | |
---|---|---|---|
Parent | 11701738 | Feb 2007 | US |
Child | 12763173 | US |