Coded aperture imaging system

Information

  • Patent Grant
  • 8035085
  • Patent Number
    8,035,085
  • Date Filed
    Tuesday, February 6, 2007
    17 years ago
  • Date Issued
    Tuesday, October 11, 2011
    13 years ago
Abstract
This invention relates to a coded aperture imaging system wherein a detector array is arranged to receive radiation from a scene via a coded aperture mask. The coded aperture mask provides a plurality of uncorrelated coded aperture arrays at different positions on the mask. Each distinct coded aperture array therefore passes coded information to the detector array. The intensity pattern at the detector array, which is a summation of the intensity patterns from each of the distinct coded aperture arrays, can be decoded separately for each coded aperture array to reconstruct a separate image associated with each coded aperture array. In this way the present invention teaches a coded aperture array means with multiple, simultaneous fields of view. The different fields of view can be different sizes and/or resolutions. Preferably the coded aperture mask is reconfigurable.
Description

This invention relates to a coded aperture imaging system, especially to a coded aperture imaging system having a reconfigurable coded aperture mask and which can image two separate fields of view simultaneously.


Coded aperture imaging is a known imaging technique which is primarily used in high energy imaging such as X-ray or γ-ray imaging where suitable lens materials do not generally exist, see for instance E. Fenimore and T. M. Cannon, “Coded aperture imaging with uniformly redundant arrays”, Applied Optics, Vol. 17, No. 3, pages 337-347, 1 Feb. 1978. It has also been proposed for three dimensional imaging, see for instance “Tomographical imaging using uniformly redundant arrays” Cannon T M, Fenimore EE, Applied Optics 18, no. 7, p. 1052-1057 (1979)


Coded aperture imaging exploits the same principles as a pinhole camera but instead of having a single small aperture uses a coded aperture mask having an array of apertures. The small size of the apertures results in a high angular resolution but increasing the number of apertures increases the radiation arriving at the detector thus increasing the signal to noise ratio. Each aperture passes an image of the scene to the detector array and so the pattern at the detector array is an overlapping series of images and is not recognisable as the scene. Processing is needed to reconstruct the original scene image from the recorded data.


The reconstruction process requires knowledge of the aperture array used and system configuration and the aperture array chosen is often coded to allow subsequent good quality image reconstruction. The processing is performed using a mathematical model of the particular array at a set location.


Recently, see our co-pending UK patent application GB0510470.8, the present inventors have proposed using a reconfigurable coded aperture mask means. The use of a reconfigurable coded aperture mask means allows different coded aperture masks to be displayed at different times. This allows, for example, the direction and FOV of the imaging system to be altered without requiring any moving parts. Further the resolution of the imaging system can also be altered by changing the coded aperture mask displayed on the coded aperture mask means.


The pattern displayed on the coded aperture mask means is referred to herein as a coded aperture mask. At least part of the coded aperture mask is a coded aperture array. That is either the whole pattern displayed on the mask means is a coded aperture array or, as described in more detail below, only part of the pattern is a coded aperture array. The skilled person will be well of aware of the coded aperture arrays that can be displayed. For the avoidance of doubt the term aperture used herein does not imply a physical hole in the mask means but merely an area of the pattern which allows radiation to reach the detector.


As mentioned the reconfigurable mask means can display a variety of coded aperture masks having a variety of coded aperture arrays in different positions on the mask means. Knowledge of the particular array displayed and its location is used in reconstructing the scene image in the same way as for a fixed coded aperture.


GB0510470.8 teaches that the coded aperture mask means is reconfigurable to provide coded aperture masks having different fields of view. In this way the imaging system performance can be altered within a field of regard that can be many times larger without needing any macroscopic moving parts. The different coded aperture masks may be arranged such that only part of the coded aperture mask comprises a coded aperture array and the position of the coded aperture array in the mask defines the field of view. In other words only a portion of the mask means may be used to define a coded aperture array with the rest of the mask blocking radiation from reaching the detector array. Therefore the only radiation from the scene that can reach the detector array is that passing through the coded aperture array and hence the location of the coded aperture array relative to the detector array and the size of the coded aperture array will define the field of view of the system. Moving the position of the coded aperture array within the mask displayed on the mask means will alter the direction from which radiation can reach the detector array and so will alter the direction and size of the field of view. Thus the total size of the mask means defines the field of regard of the system and can be much larger than the size of a coded aperture array written to the reconfigurable mask means but the field of view can be controlled, for instance to provide scanning or to track an object in the scene.


The coded aperture mask means of GB0510470.8 is also reconfigurable to provide coded aperture masks having different resolutions. For instance different coded aperture masks could be displayed having coded aperture arrays with different effective aperture sizes and spacing. The coded aperture mask means may also be reconfigurable to provide coded aperture masks having different coded aperture arrays.


GB0510470.8 therefore teaches a device that is particularly applicable to multifunctional, high resolution imaging in the visible, near infrared, thermal infrared or ultra-violet wavebands, such as might be employed in surveillance.


According to the present invention there a method of coded aperture imaging comprising arranging a detector to receive radiation from a scene via a coded aperture mask wherein the coded aperture mask has a plurality of distinct coded aperture arrays at different locations of the mask.


The present invention therefore provides a method of imaging wherein two or more distinct coded aperture arrays are used simultaneously at different locations. Each coded aperture array will therefore pass radiation from a different part of the scene to the detector. Obviously the intensity pattern at the detector will comprise elements from each coded aperture array. The present inventors have realised that the resultant intensity signal can be processed to reconstruct a scene image associated with each coded aperture array. In other words the present invention provides a method imaging in a plurality of different directions simultaneously, each using the full resolution of the detector.


For some applications, where the separate fields of view required are known and fixed, the coded aperture mask may have a fixed pattern. However the present invention may be advantageously implemented using the reconfigurable coded aperture array means taught by GB0510470.8. The present invention therefore offers a very versatile method of imaging wherein, using the method of the present invention, different fields of view can be viewed simultaneously using the full detector resolution.


The different coded aperture arrays may have different resolutions and/or sizes. For instance one coded aperture array of the coded aperture mask may have a very high resolution and thus provide a detailed view of one part of the scene whereas another coded aperture array has a lower resolution for a different part of the scene.


Each coded aperture array is preferably uncorrelated with the other coded aperture arrays, i.e. there should be no significant peaks in the cross correlation between the individual mask patterns.


With a reconfigurable coded aperture mask means the method may involve periodically changing at least one of the position, size and resolution of at least one coded aperture array provide by the mask means. The changes may be done in a predetermined cyclic manner, for instance for a scanning type application or may be controlled to centre on areas of interest in the scene. For instance particular targets in the scene could be tracked by an operator or by an automated tracking controller. As there are multiple coded aperture arrays provided multiple targets can be tracked at once. The number of coded aperture arrays may also be changed periodically.


As mentioned the intensity pattern at the detector array will be the sum of the intensity pattern from each mask, The signal received at the detector array needs decoding to reconstruct the signal. The decoding can be performed by a number of different methods but in effect each image is decoded separately using information about the particular coded aperture array. The decoding could for instance be performed by a cross correlation, or balanced cross correlation, of the detected intensity with the appropriate coded aperture pattern. A Weiner filtering approach with the decoding terms keyed to the aperture pattern of the appropriate coded aperture could also be used. Deconvolution is not preferred however when using multiple different masks. Therefore the method preferably involves the step of processing the signal at the detector array to decode an image associated with each distinct coded aperture array. The method conveniently involves decoding the signal at the detector array for each distinct coded aperture array using a decoding pattern based on that particular aperture array.


In another aspect of the invention there is provided a coded aperture imager comprising a detector arranged to receive radiation from a scene via a coded aperture mask wherein the coded aperture mask is adapted to provide a plurality of distinct coded aperture array at different locations.


Preferably the coded aperture mask is a reconfigurable coded aperture mask means.


The coded aperture mask may be planar or may be curved. In some applications curved masks may offer better potential fields of view.





The present invention will now be described by way of example only with respect to the following drawings of which;



FIG. 1 shows schematically a coded aperture imaging system according to the present invention,



FIG. 2 shows a simple planar coded aperture mask means operable in two modes; a) a full FOR low resolution imaging mode and b) a high resolution narrow FOV imaging mode,



FIG. 3 illustrates some individual mask patterns that may be used at different times,



FIG. 4 shows a curved coded aperture mask means,



FIG. 5 shows a coded aperture mask having a plurality of distinct coded aperture arrays, and



FIG. 6 shows a simulation of two separate targets imaged simultaneously using uncorrelated coded aperture arrays onto the same detector array and the resultant decoded images.





CAI is based on the same principles as a pinhole camera. In a pinhole camera, images free from chromatic aberration are formed at all distances away from the pinhole, allowing the prospect of more compact imaging systems, with a much larger depth of field. However, the major penalty is the poor intensity throughput, which results from the small light gathering characteristics of the pinhole. Nevertheless, the camera is still able to produce images with a resolution determined by the diameter of the pinhole, although diffraction effects have to be considered. The light throughput of the system can be increased by several orders of magnitude, while preserving angular resolution, by using an array of pinholes. Each detector element sees the result of the summation of contributions from the various pinholes, corresponding to each viewpoint of the scene.


Another way of understanding the operating principle of CAI is to observe that this is a purely geometric imaging technique. Light from every point in a scene within the field of regard (FOR) of the system casts a shadow of the coded aperture onto the detector array. The detector measures the intensity sum of these shadows. The coded aperture is specially designed such that its autocorrelation function is sharp with very low sidelobes. Typically pseudorandom or uniformly redundant arrays (URA) (such as described in E. Fenimore and T. M. Cannon, “Coded aperture imaging with uniformly redundant arrays”, Applied Optics, Vol. 17, No. 3, pages 337-347, 1 Feb. 1978) are used where a deconvolution of the detector intensity pattern can yield a good approximation to the point distribution in the scene.



FIG. 1 shows schematically an example of coded aperture imaging system, generally indicated 2. Rays of light from points in the scene 4 fall onto a reconfigurable mask means 6 displaying a particular coded aperture array. The coded aperture array acts as a shadow mask and therefore a series of overlapping coded images are produced on the detector array 8. At each pixel on the detector array, the intensities from the overlapping, coded images are summed. The output from the detector array 8 is passed to a processor 10 where image of the scene can be subsequently decoded from the detector signals using a variety of digital signal processing techniques. The coded aperture mask means is controlled by a controller 12 which controls the reconfigurable mask means to display different coded aperture masks.


As shown in FIG. 2 the size and relationship of the reconfigurable mask means 6 to the detector array 8 defines the field of regard of the imaging system. FIG. 2a shows the reconfigurable mask means displaying a coarse coded aperture array across its whole area. The imaging system in FIG. 2a is operating in full field of regard (FOR) imaging mode and generates a relatively low resolution image of the whole FOR. The reconfigurable mask means can then be reconfigured to a high resolution mode shown in FIG. 2b where a small area of the reconfigurable mask displays a finer resolution coded. For simplicity only one such array is shown in FIG. 2.


Radiation can only reach the detector array 8 through the portion of the mask bearing the coded aperture array so only a narrow field of view (FOV) is observed but as the whole detector array receives radiation the resolution of the image is improved. The resolution and FOV of the system can thus be easily varied according to a particular need. For instance, were the imaging system to be used in a security surveillance system it could be operated generally in full FOR low resolution mode to monitor an area. However when needed particular fields of view could be selected for high resolution imaging. For instance, were motion in the image to be detected, either by an operator or automatically using image processing, the mask means could be reconfigured to give a high resolution image of each area in which the motion occurred.



FIG. 5 shows a coded aperture mask bearing a plurality of coded aperture arrays. Each array is distinct and each will pass radiation from the appropriate part of the scene to the detector array 8. Decoding of each of these signals will result a plurality of images being formed simultaneously, each of a different FOV.


It will be apparent that the field of view is determined by the size and location of the coded aperture array displayed on the reconfigurable mask means. Varying the position of a small array on the mask means changes the field of view. Thus the field of view of the imaging system can be easily steered by simply reconfiguring the mask means to alter the position of the coded aperture array. FIG. 3 illustrates a series of mask patterns that could be used with reference to a single mask only for clarity.


At time t=0 the whole mask means is in full FOR surveillance mode with a full size coded aperture array displayed. At time t=1 the system switches to a high resolution tracking and identification mode where only a portion of the mask displays a coded aperture array and the position is moved (t=2, 3 etc.) to track an object in the scene.


The present invention therefore provides a system with a rapidly reconfigurable coded mask, of sufficient extent to allow radiation from a large FOR to selectively fall on the detector array. A planar mask means, or a curved one, can be used. FIG. 4 shows an example of a curved mask means 40. As with the planar mask means a curved mask means but display different coded aperture arrays to provide different resolutions and can vary the position of the coded aperture arrays on the mask means to alter the FOV. However a curved mask means has the advantage of further increasing the FOR for a given system aperture, although is more difficult to fabricate. The mask means could also be faceted, i.e. could have a series of planar facets arranged at angles to each other. A faceted mask means may be simpler that a curved mask means in some respect, especially if each field of view was generally wholly contained within a facet, and a faceted mask means may be easier to construct than a curved mask means.


A variety of CAI decoding algorithms already available in the prior art, the majority of which have been developed for off line decoding involving the relatively low pixel count detectors associated with X-ray, g-ray and radiological imaging and some of these techniques can be applied to decoding the image associated with each different coded aperture array.


In the most general case, the signal on the detector array D from two masks can be described by:

D(x,y)=(S1(x,y){circle around (x)}A1(x,y)+S2(x,y){circle around (x)}A2(x,y))+N(x,y)  (1)

where x,y are the lateral coordinates of the two dimensional signal distribution, S1 is the signal received from the scene through mask 1, A1 is the aperture function of mask 1, S2 is the signal received from the scene through mask 2 and A2 is the aperture function of mask 2. N is the noise introduced at the detector and {circle around (x)} is the convolution operator. The object of all such decoding algorithms is to recover part of, or the whole of, S(x,y) with as few artifacts as possible.


For the present invention the signal at the detector array will actually be the sum of all the intensity patterns contributed by each of the coded aperture array. However the processing the signal based on the aperture pattern for any one of the arrays will reveal just the image as seen by that array. Thus the image associated with each separate field of view can be recovered.


Cross-correlation Methods


In this technique, each signal S(x,y) is decoded by correlating D(x,y) with an array G(x,y)

S1′(x,y)=D(x,y)⊕G1(x,y)=(S1(x,y){circle around (x)}A1(x,y)⊕G1(x,y)+S2(x,y){circle around (x)}A2(x,y)⊕G1(x,y))+N(x,y)⊕G1(x,y)   (2)
and
S2′(x,y)=D(x,y)⊕G2(x,y)=(S1(x,y){circle around (x)}A1(x,y)⊕G2(x,y)+S2(x,y){circle around (x)}A2(x,y)⊕G2(x,y))+N(x,y)⊕G2(x,y)   (3)

where ⊕ is a correlation and S′1 and S′2 are approximations to the signals.


In the simple case of G1=A1 and G2=A2, and the mask designs are such that there are uncorrelated but each with an auto correlation that approximates well to a delta function, with small sidelobes. Uniform redundant arrays were developed to achieve this with small array dimensions. If this is the case, then a reasonable quality reconstruction can be achieved. However, the real positive nature of the mask functions will result in a pedestal of 0.5 times the peak value of the autocorrelation, even in the ideal case, with associated decrease in reconstruction quality compared to the ideal case deconvolution algorithm. More generally, G is chosen such that G≠A. In this case appropriate choice of G can result in good quality reconstructions. Balanced cross correlation is an example of one such approach.


A Fourier based implementation can be computationally efficient. A closely related approach is Wiener filtering, where a weighted cross correlation is used. This approach is useful for masks which have poor autocorrelation functions.



FIG. 6 shows the results a numerical simulation of the decoding process. FIG. 6a shows two different targets which represent separate parts of the scene that are separately imaged by distinct coded aperture arrays at different parts of a coded aperture mask means. FIG. 6b shows the two uncorrelated coded aperture arrays and FIG. 6c shows a close up section of the bottom left hand corner of each array and exhibits the. uncorrelated nature of the two array patterns.



FIG. 6
d is a simulation of the actual intensity pattern that would be recorded on the detector array using each of the coded aperture arrays shown to simultaneously image one of the targets. Finally 6e shows the decoded images that would result using a cross correlation algorithm. The quality of the decoded image is low as the simulation is relatively crude and the coded aperture arrays and decoding algorithms have not been optimised. However it can clearly be seen that the separate images can be decoded from the single intensity pattern on the detector array.

Claims
  • 1. A method of coded aperture imaging, comprising: arranging a single detector to receive radiation from a scene via a single coded aperture mask, the coded aperture mask having a plurality of separate and distinct coded aperture arrays at different locations of the single coded aperture mask;periodically changing at least one of a location, size and resolution of at least one of the coded aperture arrays;detecting the radiation from the scene received simultaneously at the detector by the plurality of coded aperture arrays; andprocessing a signal representing the radiation received at the detector to decode an image associated with each of the separate and distinct coded aperture arrays.
  • 2. A method as claimed in claim 1 wherein the single coded aperture mask is provided as a reconfigurable coded aperture mask device.
  • 3. A method as claimed in claim 1 wherein at least one of the coded aperture arrays has a different resolution than another one of the coded aperture arrays.
  • 4. A method as claimed in claim 1 wherein at least one of the coded aperture arrays has a different size than another one of the coded aperture arrays.
  • 5. A method as claimed in claim 1 wherein each of the plurality of coded aperture arrays is uncorrelated with the other coded aperture arrays.
  • 6. A method as claimed in claim 1 wherein the plurality of coded aperture arrays are orthogonal.
  • 7. A method as claimed in claim 1 further comprising periodically changing a number of the coded aperture arrays.
  • 8. A coded aperture imager comprising: a single detector; anda single coded aperture mask wherein the single coded aperture mask is adapted to provide a plurality of separate and distinct coded aperture arrays at different locations of the single coded aperture mask, and to periodically change at least one of a location, size and resolution of at least one of the coded aperture arrays, andthe detector is arranged to receive radiation from a scene via the single coded aperture mask.
  • 9. A coded aperture imager as claimed in claim 8 wherein the single coded aperture mask is a reconfigurable coded aperture mask device.
  • 10. A coded aperture imager as claimed in claim 8 wherein the single coded aperture mask is curved.
  • 11. A coded aperture imager as claimed in claim 8 wherein the single coded aperture mask is faceted.
Priority Claims (1)
Number Date Country Kind
0602376.6 Feb 2006 GB national
PCT Information
Filing Document Filing Date Country Kind 371c Date
PCT/GB2007/000405 2/6/2007 WO 00 8/6/2008
Publishing Document Publishing Date Country Kind
WO2007/091047 8/16/2007 WO A
US Referenced Citations (74)
Number Name Date Kind
3860821 Barrett Jan 1975 A
3961191 Stoner et al. Jun 1976 A
4075483 Tancrell et al. Feb 1978 A
4092540 Barrett May 1978 A
4165462 Macovski et al. Aug 1979 A
4209780 Fenimore et al. Jun 1980 A
4954789 Sampsell Sep 1990 A
5047822 Little et al. Sep 1991 A
5115335 Soref May 1992 A
5294971 Braunecker et al. Mar 1994 A
5311360 Bloom et al. May 1994 A
5426312 Whitehead Jun 1995 A
5448395 Lopez et al. Sep 1995 A
5488504 Worchesky et al. Jan 1996 A
5500761 Goossen et al. Mar 1996 A
5519529 Ahearn et al. May 1996 A
5552912 Sharp et al. Sep 1996 A
5579149 Moret et al. Nov 1996 A
5636001 Collier Jun 1997 A
5636052 Arney et al. Jun 1997 A
5710656 Goossen Jan 1998 A
5772598 Halling Jun 1998 A
5784189 Bozler et al. Jul 1998 A
5825528 Goossen Oct 1998 A
5838484 Goossen Nov 1998 A
5841579 Bloom et al. Nov 1998 A
5870221 Goossen Feb 1999 A
5943155 Goossen Aug 1999 A
5949571 Goossen et al. Sep 1999 A
5953161 Troxell et al. Sep 1999 A
5995251 Hesselink et al. Nov 1999 A
6034807 Little et al. Mar 2000 A
6069361 Rubinstein May 2000 A
6195412 Tobin et al. Feb 2001 B1
6324192 Tayebati Nov 2001 B1
6329967 Little et al. Dec 2001 B1
6392235 Barrett et al. May 2002 B1
6396976 Little et al. May 2002 B1
6424450 Goossen Jul 2002 B1
6430333 Little et al. Aug 2002 B1
6467879 Kubby et al. Oct 2002 B1
6519073 Goossen Feb 2003 B1
6570143 Neil et al. May 2003 B1
6737652 Lanza et al. May 2004 B2
6819463 Noonan Nov 2004 B2
6819466 Tayebati Nov 2004 B2
6856449 Winkler et al. Feb 2005 B2
7006132 Pereira et al. Feb 2006 B2
7031577 Painter et al. Apr 2006 B2
7235773 Newman Jun 2007 B1
7251396 Larochelle et al. Jul 2007 B2
7415049 Flanders et al. Aug 2008 B2
20020075990 Lanza et al. Jun 2002 A1
20030058520 Yu et al. Mar 2003 A1
20030122955 Neidrich Jul 2003 A1
20030164814 Starkweather et al. Sep 2003 A1
20030191394 Simon et al. Oct 2003 A1
20040008397 Noonan Jan 2004 A1
20040046123 Dausch Mar 2004 A1
20050057793 Starkweather et al. Mar 2005 A1
20050248827 Starkweather et al. Nov 2005 A1
20060038705 Brady et al. Feb 2006 A1
20060157640 Perlman et al. Jul 2006 A1
20070013999 Marks et al. Jan 2007 A1
20070091051 Shen Apr 2007 A1
20080128625 Lamadie et al. Jun 2008 A1
20080151391 Zalevsky et al. Jun 2008 A1
20080259354 Gharib et al. Oct 2008 A1
20080285034 Gharib et al. Nov 2008 A1
20090008565 Gottesman Jan 2009 A1
20090020714 Slinger Jan 2009 A1
20090022410 Haskell Jan 2009 A1
20090090868 Payne Apr 2009 A1
20090167922 Perlman et al. Jul 2009 A1
Foreign Referenced Citations (38)
Number Date Country
25 28 641 Jan 1976 DE
0 318 249 May 1989 EP
0 663 763 Jul 1995 EP
1 341 025 Sep 2003 EP
1 491 958 Dec 2004 EP
1 494 046 Jan 2005 EP
1 449 636 Sep 1976 GB
2314664 Jan 1998 GB
2 414 881 Dec 2005 GB
2 418 028 Mar 2006 GB
2 434 935 Aug 2007 GB
A-55-146411 Nov 1980 JP
A-58-060723 Apr 1983 JP
A-04-005620 Jan 1992 JP
A-09-113819 May 1997 JP
A-2003-4441 Jan 2003 JP
WO 9112502 Aug 1991 WO
WO 9418582 Aug 1994 WO
WO 9624032 Aug 1996 WO
WO 9726557 Jul 1997 WO
WO 9846007 Oct 1998 WO
WO 9946768 Sep 1999 WO
WO 0017810 Mar 2000 WO
WO 0045608 Aug 2000 WO
WO 0244788 Jun 2002 WO
WO 02056055 Jul 2002 WO
WO 02056061 Jul 2002 WO
WO 03017000 Feb 2003 WO
WO 2004102958 Nov 2004 WO
WO 2006125975 Nov 2006 WO
WO 2007045875 Apr 2007 WO
WO 2007047732 Apr 2007 WO
WO 2007054769 May 2007 WO
WO 2007091051 Aug 2007 WO
WO 2007121417 Oct 2007 WO
WO 2008108840 Sep 2008 WO
WO 2008128625 Oct 2008 WO
WO 2008142543 Nov 2008 WO
Related Publications (1)
Number Date Country
20090016481 A1 Jan 2009 US