This invention relates to optically diverse coded aperture imaging, that is to say imaging with radiation having multiple optical characteristics, such as multiple wavelengths or multiple polarisation states.
Coded aperture imaging is a known imaging technique originally developed for use in high energy imaging, e.g. X-ray or γ-ray imaging where suitable lens materials do not generally exist: see for instance E. Fenimore and T. M. Cannon, “Coded aperture imaging with uniformly redundant arrays”, Applied Optics, Vol. 17, No. 3, pages 337-347, 1 Feb. 1978. It has also been proposed for three dimensional imaging, see for instance “Tomographical imaging using uniformly redundant arrays” Cannon T M, Fenimore E E, Applied Optics 18, no. 7, p. 1052-1057 (1979)
Coded aperture imaging (CAI) exploits pinhole camera principles, but instead of using a single small aperture it employs an array of apertures defined by a coded aperture mask. Each aperture passes an image of a scene to a greyscale detector comprising a two dimensional array of pixels, which consequently receives a diffraction pattern comprising an overlapping series of images not recognisable as an image of the scene. Processing is required to reconstruct an image of the scene from the detector array output by solving an integral equation.
A coded aperture mask may be defined by apparatus displaying a pattern which is the mask, and the mask may be partly or wholly a coded aperture array; i.e. either all or only part of the mask pattern is used as a coded aperture array to provide an image of a scene at a detector. Mask apertures may be physical holes in screening material or may be translucent regions of such material through which radiation may reach a detector.
In a pinhole camera, images free from chromatic aberration are formed at all distances away from the pinhole, allowing the prospect of more compact imaging systems, with larger depth of field. However, a pinhole camera suffers from poor intensity throughput, the pinhole having small light gathering characteristics. CAI uses an array of pinholes to increase light throughput
In conventional CAI, light from each point in a scene within a field of regard casts a respective shadow of the coded aperture on to the detector array. The detector array therefore receives multiple shadows and each detector pixel measures a sum of the intensities falling upon it. The coded aperture is designed to have an autocorrelation function which is sharp with very low sidelobes. A pseudorandom or uniformly redundant array may be used where correlation of the detector intensity pattern with the coded aperture mask pattern can yield a good approximation (Fenimore et al. above).
In “Coded aperture imaging with multiple measurements” J. Opt. Soc. Am. A, Vol. 14, No. 5, May 1997 Busboom et al. propose a coded aperture imaging technique which takes multiple measurements of the scene, each acquired with a different coded aperture array. They discuss image reconstruction being performed using a cross correlation technique and, considering quantum noise of the source, the choice of arrays that maximise the signal to noise ratio.
International Patent Application No. WO 2006/125975 discloses a reconfigurable coded aperture imager having a reconfigurable coded aperture mask means. The use of a reconfigurable coded aperture mask in an imaging system allows different coded aperture masks to be displayed at different times. It permits the imaging system's resolution, direction and field of view to be altered without requiring moving parts.
A greyscale detector array used in conjunction with a coded aperture produces output data which is related to an imaged scene by a linear integral equation: for monochromatic radiation, the equation is a convolution equation which can be solved by prior art methods which rely on Fourier transformation. However, the equation is not a convolution equation for optically diverse coded aperture imaging such as that involving polychromatic (multi-wavelength) radiation, and so deconvolution via Fourier transformation does not solve it.
It is an object of the present invention to provide a coded aperture imaging technique for optically diverse imaging.
The present invention provides a method of forming an image from radiation from an optically diverse scene by coded aperture imaging, the method incorporating:
The invention provides the advantage that it enables more complex scenes to be imaged using coded aperture imaging, i.e. scenes such as those which are multi-spectrally diverse or polarimetrically diverse. It is not restricted to monochromatic radiation for example.
The optically diverse scene may be multi-spectrally diverse and the linear integral equation may be
The optically diverse scene may be polarimetrically diverse and the linear integral equation may be
The coded aperture mask may have apertures with a first polarisation and other apertures with a second polarisation, the first and second polarisations being mutually orthogonal.
The step of solving the linear integral equation may be Landweber iteration.
The method of the invention may include using a quarter-wave plate to enable the data output by the detecting means to incorporate circular polarisation information.
A converging optical arrangement such as a lens may be used to focus radiation from the optically diverse scene either upon or close to the detecting means. This increases signal-to-noise ratio compared to conventional coded aperture imaging, and allows faster processing of the detector array output. The lens may be between the coded aperture mask and the detecting means, or the mask may be between the lens and the detecting means.
In another aspect, the present invention provides a coded aperture imaging system for forming an image from radiation from an optically diverse scene, the system having:
In a further aspect, the present invention provides a computer software product comprising a computer readable medium incorporating instructions for use in processing data in which optically diverse information is encoded, the data having been output by detecting means in response to a radiation image obtained from an optically diverse scene by coded aperture imaging, and the instructions being for controlling computer apparatus to:
The coded aperture imaging system and computer software product aspects of the invention may have preferred but not essential features equivalent mutatis mutandis to those of the method aspect.
The invention will now be described, by way of example only, with reference to the accompanying drawings, in which:
In this specification, the expression “optically diverse” and associated expressions in relation to radiation from an imaged scene or object will be used to indicate that such radiation has multiple optical characteristics, such as multiple wavelengths or multiple polarisation states. Moreover, the expression “scene” will include any scene or object which is imaged by coded aperture imaging (CAI).
Referring to
Referring now also to
Referring to
In
The mask 50 modulates light incident upon it according to the light's polarisation state. In optics, a point spread function (PSF) is a useful quantity for characterising an imaging system: a PSF is defined as a pattern of light produced on a detector array in an optical system by a point of light located in a scene being observed by the system. The PSF of a CAI system containing a mask 50 changes according to the polarisation state of light incident upon the mask. Knowledge of the PSF for each polarisation state allows polarisation information for elements of a scene to be obtained by processing the CAI system's detector array output. This enables the CAI system to determine the degree of linear polarisation for points in a scene. The system's detector array receives a super-position of data for each polarisation state. For the mask 50 there are two polarisation states which are orthogonal to one another, and consequently their super-position results in a simple addition of intensities. This is the optimum situation: if they were not orthogonal the super-position would not be a simple addition of intensities and the decoding process would be more difficult.
A further option is to place a quarter-wave plate (not shown) in front of the mask 50, with its optical axis angle at 45 degrees to the horizontal and vertical polariser axes: this would enable the CAI imager to detect circular polarisation for points in a scene.
The mask 50 with or without quarter-wave plate may be used with the CAI system 10 or 30. In a geometric-optics regime the CAI system 10 would not work very well because an unpolarised scene would not be modulated at all, merely attenuated by 50%. However, when diffraction is significant there will be modulation because of interference between light that has gone through different apertures 16a. A diffraction regime exists when λz/a2 is much greater than 1, where λ is the light's wavelength, α is mask aperture diameter and z is mask to detector distance. Some mask apertures 52 may be opaque to increase modulation of intensity recorded by the detector array 14 or 34, or to make patterns for different polarisation states more linearly independent.
A mask similar to the mask 50 may also be designed for spectral discrimination: such a mask would have spectrally selective apertures (i.e. optical band-pass filters) instead of polarisation selective apertures.
Referring to
Referring now to
As feature sizes in a mask are decreased (typically to wavelength scales) and appropriate mask aperture patterns are used, then vector diffraction regimes become important: in such regimes, the polarisation of light incident on the mask influences the diffraction pattern produced. So CAI diffraction patterns convey information about both wavelength and polarisation of light from a scene.
The processing required to form an image is related to conventional CAI processing in that it requires the solution of a linear inverse problem (see Bertero M and Boccacci P, Introduction to Inverse Problems in Imaging, IoP Publishing, 1998, hereinafter “Bertero and Boccacci”). Techniques for this type of problem include Tikhonov regularisation and Landweber iteration. However, the dimensionality of the information to be inferred is increased unless additional regularisation constraints are applied: for example, exploiting (i) correlations in spectral signature of objects/surfaces (e.g. blackbody curves), or (ii) spatial structure in spectral information. If strong prior knowledge regarding spectra is available then spectrally sensitive processing may out-perform conventional processing in terms of spatial resolution even if it provides a greyscale image as an end product: this is because it does not make the incorrect assumption that the scene consists of only a single spectrum (plus noise).
Computer modelled diffraction patterns were used to predict the detector array signal generated by the CAI system 10 in response to light from a multi-spectral scene, i.e. having optical diversity in wavelength. The mask dimensions were the same as those used to generate
Diffraction effects at the three wavelengths differ, and give rise to differing incident radiation at the detector array 14 as shown in
The processing of multi-spectral data is described below, and it also applies to multi-polarisation data, i.e. data with polarisation diversity. The invention allows a CAI system to gather spectral and/or polarisation information from a scene being imaged, from a single acquired frame of detector data, without significant modification to the CAI optics 10 other than a polarisation discrimination mask 50.
The greyscale detector array 14 produces output data denoted by g(y) in response to a multi-spectral CAI image of a scene or object denoted by f(λ,x), where λ is optical wavelength assumed to lie between limits λ1 and λ2, and x and y are two-dimensional variables. The detector array output data g(y) is processed as follows: it is related to the scene via a linear integral equation of the form:
where K(λ,x) is a point spread function of the CAI system 10 for monochromatic radiation of wavelength 2. It is assumed that the detector array output data g(y) includes additive noise; a and b are suitable limits for the integral over x which may or may not be infinite.
For monochromatic radiation λ1=λ2=λ and b=−a=∞, and Equation (1) reduces to a convolution equation; but Equation (1) is not a convolution equation for polychromatic (multi-wavelength) radiation. Hence it is not possible to use prior art methods which rely on Fourier transforming both sides of Equation (1) in order to solve it. In addition, finite limits a and b will be used.
Rewriting Equation (1) in operator notation:
g=Kf (2)
It is now assumed that the detector array output data g and object or scene f being imaged lie in respective Hilbert spaces G and F. The operator K is approximated by a matrix with matrix elements having two indices: one of these indices is a combined (λ, x) index representing a sufficiently fine sampling of λ and x which are continuous variables. Here sufficiently fine sampling means that the problem to be solved is not discernibly altered as a result of the sampling. The other matrix element index represents a sufficiently fine sampling of variable y, in practice given by pixel number on the detector array 14.
The solution to Equation (2) can be expressed as a least-squares problem: i.e. to minimise over f a discrepancy functional ε2(f) given by:—
ε2(f)=∥Kf−g∥2 (3)
The solution f to this minimisation problem will satisfy a normal equation as follows:
K*Kf=K*g (4)
where K* is an adjoint operator to K, defined by scalar products <,> in the Hilbert spaces F and G by:
h,Kl
G
=
K*h,l
F (5)
for all hεG and lεF. There is a method for solving Equation (1) referred to as “Landweber” and involving an iteration of the form:
f
n+1
=f
n+τ(K*g−K*Kfn) (6)
The Equation (6) iteration employs a suitably chosen initial value of fn denoted by f0; τ is a parameter which satisfies:
where the operator K has a set of singular values of which σ1 is the largest.
In the presence of noise on the detector array output data g, the Equation (6) iteration is not guaranteed to converge: the iteration is therefore truncated at a point which depends on the noise level. Further details on the Landweber method can be found in Bertero and Boccacci.
There are alternative methods for solving Equation (1) such as a truncated singular function method and Tikhonov regularisation. The details of these methods may also be found in Bertero and Boccacci.
The polarimetric imaging problem is specified by an equation of the form:
In Equation (8), i is an index representing the two polarisation states (horizontal and vertical polarisation) transmitted by the mask 50.
As before, Equation (8) is written in operator notation as:
g=Kf (9)
It is now assumed that the detector array output data g and scene f being imaged lie in respective Hilbert spaces G and F. The operator K is approximated by a matrix with matrix elements having two indices: one of these indices is a combined (i, x) index representing a sufficiently fine sampling of x which is a continuous variable. The other matrix element index represents a sufficiently fine sampling of variable y, in practice given by pixel position on the detector array 14.
Equation (9) may again be solved using Landweber iteration. The Landweber iteration used is of the same form as that for the multi-spectral imaging problem, with the same constraints on the parameter τ.
Equation (9) may also be solved using various other methods from the theory of linear inverse problems, including Tikhonov regularisation and the truncated singular function expansion solution (again see Bertero and Boccacci).
Although data is recorded on a greyscale detector array 14 or 34, the invention uses a mask 16 or 36 to ensure that optically diverse information, i.e. multi-spectral and/or polarimetric information, is not lost, but instead becomes encoded in the data. For both multi-spectral and polarimetric imaging, the relationship between the scene being imaged and the recorded data is represented by a linear integral equation. By writing the wavelength or polarisation state dependence (optically diversity dependence) explicitly in the integral equation it is possible to solve this equation in terms of a function of position within the scene and wavelength content and/or polarisation state. The preferred method of solution is known as Landweber iteration, though various other methods may also be employed. Since these methods are known in the prior art they will not be described further.
Referring now to
Number | Date | Country | Kind |
---|---|---|---|
0822281.2 | Dec 2008 | GB | national |
0900580.2 | Jan 2009 | GB | national |
Filing Document | Filing Date | Country | Kind | 371c Date |
---|---|---|---|---|
PCT/GB09/02780 | 11/27/2009 | WO | 00 | 5/24/2011 |