Coded aperture imaging using successive imaging of a reference object at different positions

Abstract

In coded aperture imaging knowledge of the coded array pattern and its positional relation to the detector array is needed in order to be able to reconstruct the scene image. Usually a theoretical model of the coded array is used and the actual array needs to be aligned accurately with respect to the detector. The present invention uses a coded aperture imager to image a reference object in the scene and uses the intensity pattern on the detector array to determine the decoding pattern corresponding to the coded aperture array. The reference object may be a point source in which case the pattern on the detector array may be used directly as the decoding pattern or it may be used to correct a theoretical pattern for any misalignment.

Description

This invention relates to a coded aperture imaging system and method, especially to a coded aperture imaging system having at least one reconfigurable coded mask.

Coded aperture imaging is a known imaging technique which is primarily used in high energy imaging such as X-ray or γ-ray imaging where suitable lens materials do not generally exist, see for instance E. Fenimore and T. M. Cannon, “Coded aperture imaging with uniformly redundant arrays”, Applied Optics, Vol. 17, No. 3, pages 337-347, 1 Feb. 1978. It has also been proposed for three dimensional imaging, see for instance “Tomographical imaging using uniformly redundant arrays” Cannon T M, Fenimore E E, Applied Optics 18, no. 7, p. 1052-1057 (1979)

Coded aperture imaging exploits the same principles as a pinhole camera but instead of having a single small aperture uses a coded aperture mask having an array of apertures. The small size of the apertures results in a high angular resolution but increasing the number of apertures increases the radiation arriving at the detector thus increasing the signal to noise ratio. Each aperture passes an image of the scene to the detector array and so the pattern at the detector array is an overlapping series of images and is not recognisable as the scene. Processing is needed to reconstruct the original scene image from the recorded data.

The reconstruction process requires knowledge of the aperture array used and system configuration and the aperture array chosen is often coded to allow subsequent good quality image reconstruction. The processing is performed using a mathematical model of the particular array at a set location.

Recently, see U.S. patent application Ser. No. 11/920,345, it has been proposed to use a reconfigurable coded aperture mask means. The sue of a reconfigurable coded aperture mask means allows different coded aperture masks to be displayed at different times. This allows, for example, the direction and FOV of the imaging system to be altered without requiring any moving parts. Further the resolution of the imaging system can also be altered by changing the coded aperture mask displayed on the coded aperture mask means.

The pattern displayed on the coded aperture mask means is referred to herein as a coded aperture mask. At least part of the coded aperture mask is a coded aperture array. That is either the whole pattern displayed on the mask means is a coded aperture array or, as described in more detail below, only part of the pattern is a coded aperture array. The skilled person will be well of aware of the coded aperture arrays that can be displayed. For the avoidance of doubt the term aperture used herein does not imply a physical hole in the mask means but merely an area of the pattern which allows radiation to reach the detector.

As mentioned the reconfigurable mask means can display a variety of coded aperture masks having a variety of coded aperture arrays in different positions on the mask means. Knowledge of the particular array displayed and its location is used in reconstructing the scene image in the same way as for a fixed coded aperture.

For good quality images to be produced the coded aperture array used must conform closely in position, spacing etc. to the mathematical model of the array used for image reconstruction. This require a reasonably high degree of precision in positioning the coded aperture array relative to the detector array, especially with regard to in plane rotation. As the skilled person will appreciate, rotation of a coded aperture array effective changes the pattern of the array as perceived by the detector array and thus reduces the decoded image quality.

It is therefore an object of the invention to provide a coded aperture imaging system and to a method of coded aperture imaging which has a relaxed tolerance of alignment and/or has an improved image quality.

Thus according to the present invention there is provided a method of determining decoding pattern data for a coded aperture imaging apparatus having a coded aperture mask means in fixed relation to a detector array comprising the step of imaging a reference object using the coded aperture imaging apparatus and using the intensity pattern on the detector array due to the reference object to form a decoding pattern.

The reference object may be a point source such as a laser beam focused to a point with a microscope objective. In the field, a flare released at a distance from the system could be used or a retro-reflector positioned in the field of view could be illuminated with a laser. A collimated light source could also be used to effectively provide a point source at a great distance. This would be used for recording a decoding pattern that could decode the image of a distant scene.

If a coded aperture imaging (CAI) system with a particular coded aperture is used to image a point source the intensity pattern on the detector will effectively be the shadow cast by the coded aperture. This intensity pattern therefore gives the decoding pattern required for that particular coded aperture at that particular location and orientation relative to the detector array.

Thus, unlike known CAI systems which compute a theoretical decoding pattern based on a knowledge of the mask used and its location to the detector, which requires accurate alignment of the mask, the present invention relaxes the tolerances for alignment and then determines the decoding pattern by imaging a reference.

The intensity pattern on the detector array may be used directly as the decoding pattern or it may be processed to improve the image quality, for instance the contrast of the intensity pattern could be improved.

If a point source is used at the intended wavelengths of operation of the CAI apparatus then any diffraction effects caused by the apertures will be represented in the intensity pattern on the detector array. Using an intensity pattern incorporating diffraction effects may provide better image quality than using a pattern without diffraction effects or by attempting to compensate for diffraction effects in processing.

The target scene will in general have an unknown spectral content and different parts of it will have different spectra. For example, in the visible waveband, the scene would be coloured and in the thermal infra-red waveband, different parts of the scene would be at different temperatures. Decoding patterns may be recorded from point sources with a range of wavelengths or spectra, any one of which may be the optimum one to use for decoding a particular scene or for enhancing the quality of a particular region in a scene. The lack of prior knowledge of the spectrum of the target scene is thus allowed for by obtaining a selection of decoding patterns optimised for different spectral contents, and choosing the appropriate one as desired.

The diffraction effects may be so strong that the decoding pattern is not recognisable as a shadow of the mask (e.g. the arrangement of the light and dark regions in the decoding pattern do not correspond to the arrangement of the light and dark regions in the mask). However, it will be recognised by one skilled in the art that as long as one can record a modulated pattern, it will move laterally according to the positions of the light sources in the scene in the same way as a shadow of the mask, and thus can be used as a decoding pattern in exactly the same way.

Means for obtaining light sources with desired spectral content will be well known to one skilled in the art, for example, using a filter with a white light source. It would also be possible to record decoding patterns at a selection of different wavelengths which could be either monochromatic or narrow band. One can then combine these decoding patterns by simple weighted addition to obtain a decoding pattern matching that recorded with any desired spectrum, where the weights applied correspond to the weights needed to combine the different wavelength sources into the desired spectrum. This would offer a versatile route to obtain a decoding pattern for any spectrum, given a pre-recorded set of narrow band patterns.

Alternatively a theoretical pattern could be still be used as the basis for the decoding pattern. The theoretical pattern would correspond to the mask used at the intended location and orientation. By comparing the actual intensity pattern detected with the theoretical pattern any misalignment of the mask could be detected. The comparison could conveniently be performed by correlating the detected intensity pattern with the theoretical pattern. An appropriately rotated and sized theoretical pattern could then be computed and used as the decoding pattern.

The mask may be larger than the detector array. This enables the system to have a wide field of view. When the mask is illuminated by a point source, only light from part of the mask pattern will fall on to the detector. This would be sufficient to determine the position and orientation of the mask so that a theoretical decoding pattern could to be used to decode the images.

Noting that lateral offsets of the point source result in lateral offsets of the shadow of the part of the mask pattern that falls on the detector, it is possible to construct a recorded decoding pattern of the full size of the mask by stitching sub-sections together. Images are recorded for each of a set of point light source positions. For simplicity these positions could be chosen to be on a square grid. The spacing between these positions is such that there is a small overlap in the regions of the mask that casts a shadow on the detector. The task of clipping away the overlap regions and stitching the recorded images together so that they butt up to each other correctly could be performed by observation of the images. Alternatively, an automated method could cross-correlate pairs of the images, the correlation peaks so obtained indicating the best alignment of the images and the region of overlap to be clipped. Therefore the method may involve the step of successively imaging a reference object at a plurality of different positions with respect to the imaging apparatus such that radiation from a reference object reaches the detector via a different part of the coded aperture and recording the intensity pattern at the detector array for each position.

The optimum recorded decoding mask for a given object in a scene will be generated by a point source at the same distance from the mask as the object. A consequence of the recording point source and object not being at the same distance is that the decoded image will be defocused in the same way that conventional imaging systems defocus. This effect is expected to be small for distant objects, as it would be for conventional systems. It is possible to record decoding patterns with the point source at different distances, allowing the coded aperture system to be ‘focused’ in operation simply by choosing the appropriate decoding pattern.

The present invention therefore allows a CAI system to be built and an accurate decoding pattern determined through testing of the system. This can improve the image quality of the decoded images whilst relaxing alignment tolerances in producing a CAI apparatus.

Furthermore U.S. patent application Ser. No. 11/920,345 describes the use of non-planar masks in CAI systems. Although known CAI systems use a planar mask it has been realized that a non-planar mask having a coded aperture array could be used. This could improve the field of view of a CAI system having a reconfigurable coded aperture mask means and/or may allow the CAI apparatus to conform to the shape of the platform on which it is mounted.

Generating a theoretical decoding pattern for such a curved coded aperture array can involve significant computation. The present invention allows the decoding pattern to be determined directly without requiring any processing.

Where the coded aperture mask means is reconfigurable it may be reconfigurable to any one of several different masks, each having a different coded aperture array and/or the coded aperture array located at a different position on the mask means. In such a case the method may involve imaging a suitably located reference object with each different mask configuration and using the intensity pattern at the detector to determine a decoding pattern for each different configuration.

The present invention therefore offers a means of determining a decoding pattern by effectively recording an image of the coded aperture as seen by the detector array. Additionally or alternatively the reference object may be an object having a specific known shape. In this embodiment the unprocessed intensity pattern received at the detector array when imaging a particular reference shape is recorded. Several intensity patterns may be recorded for several different basic shapes, e.g. lines, circles, squares etc. The stored intensity patterns relating to the various shapes can be correlated with the actual intensity patterns received in use. Where there is a correlation between the reference and acquired intensity patterns this is indicative that the shape used to record that particular reference intensity pattern matches a shape in the scene contributing to the image. Thus the decoding step effectively employs correlation template matching. Instances of correlation between a stored reference pattern and a pattern acquired from the scene can be used to provide image enhancement and/or image recognition.

The reference object may be a shaped light source, for instance an array of LEDs or masked light source or could be a strongly illuminated reflective shaped object.

For both embodiments of the invention, using a point source reference object to obtain an image of the mask and use of a shaped reference object for correlation, it is obviously important that the reference object is substantially the only source of radiation from the scene at the time the intensity pattern at the detector is recorded.

The imaging of a point source reference object so as to record an intensity pattern on the detector array is effectively a calibration step. As such it could be performed once, when the CAI apparatus is assembled. Once a decoding pattern can been determined for each coded aperture configuration from the imaging of a reference object the CAI apparatus can be used without requiring further reference imaging. Therefore in another aspect of the invention there is provided a method of coded aperture imaging comprising the steps of taking a coded aperture imaging apparatus having a detector array arranged to received radiation from a scene through a coded aperture mask means, recording the intensity pattern of radiation on the detector array and processing the intensity pattern using a decoding pattern to produce a scene image, wherein the decoding pattern is based on a recorded intensity pattern of the coded aperture imaging means imaging a reference object.

In this case, preferably the reference object is a point source.

The step of recording an intensity pattern of a point source could be carried out on manufacture and assembly of the imager in laboratory like conditions or it could be performed with the imager located in use. In some instances, for instance where the imager is mounted on a platform which undergoes significant vibration or other motion and there is potential for a change in relative alignment over time it may be desirable to periodically recalibrate.

As mentioned, for distant imaging applications, the point source could be a flare in the scene or a retro-reflector illuminated by a laser. Obviously when recording an intensity pattern from a point source the intensity level of the rest of the scene should be low compared to the intensity of the point source. A wavelength specific point source could be used to ensure the intensity of the point source or the point source could have a modulated output and processing of the intensity pattern on the detector array could be used to extract the signal having a matching modulation and therefore corresponding to the point source.

Using a point source in the field of view in use can also be advantageous when imaging over long distances as it allows for atmospheric aberration correction. A point source such as a retro-reflector illuminated by a strong illumination means such as a laser could be located in the scene. Any atmospheric aberration, i.e. distortion of the optical signal, caused by the propagation of the radiation through the atmosphere would result in the point source having a distorted shape as perceived at the coded aperture imager. The intensity pattern received at the detector array will then be the intensity pattern caused by the mask being illuminated by such a distorted source. This intensity pattern can then be used as the decoding pattern for the purposes of decoding any image. An image of the distorted point source decoded using such a pattern would actually give a point-like autocorrelation peak that would be similar to an image of the undistorted point source. Therefore if a point source is located within the scene to be imaged and the intensity pattern created by that point source is used as the decoding pattern any distortions in the propagation of the radiation from the scene to the imager will be compensated for. The method may therefore comprise the step of locating the reference object within the scene to be imaged. The method may also comprise the step of decoding the image using the decoding pattern to reduce the effects of any distortion caused by the intervening medium, i.e. atmospheric aberration. The method may involve modulating the radiation from the reference object to allow the intensity pattern on the detector array due to the reference object to be determined. A plurality of reference objects may be disposed at different parts of the scene and a decoding pattern determined using each different reference object. In this way a different pattern could be used for different parts of the scene where the incident radiation will have experienced different atmospheric aberrations.

In another aspect of the invention there is provided a coded aperture imager comprising a detector array arranged to image a scene through a coded aperture mask means and a processor for decoding the intensity pattern received at the detector array to produce an image, wherein the processor has a memory storing a decoding pattern based on the intensity pattern received at the detector array when imaging a point source.

Preferably the coded aperture mask means is reconfigurable to provide different mask configurations having coded aperture arrays having different patterns and/or at different locations on the mask means and the memory stores a decoding pattern for each mask configuration, each decoding pattern based on the intensity pattern received at the detector array when imaging a point source using the respective mask configuration.

As taught in GB0510470.8 a reconfigurable coded aperture mask means can provide coded aperture masks having different fields of view. In this way the imaging system performance can be altered within a field, of regard that can be many times larger without needing any macroscopic moving parts. The different coded aperture masks may be arranged such that only part of the coded aperture mask comprises a coded aperture array and the position of the coded aperture array in the mask defines the field of view. In other words only a portion of the mask means may be used to define a coded aperture array with the rest of the mask blocking radiation from reaching the detector array. Therefore the only radiation from the scene that can reach the detector array is that passing through the coded aperture array and hence the location of the coded aperture array relative to the detector array and the size of the coded aperture array will define the field of view of the system. Moving the position of the coded aperture array within the mask displayed on the mask means will alter the direction from which radiation can reach the detector array and so will alter the direction and size of the field of view. Thus the total size of the mask means defines the field of regard of the system and can be much larger than the size of a coded aperture array written to the reconfigurable mask means but the field of view can be controlled, for instance to provide scanning or to track an object in the scene.

The coded aperture mask means may also be reconfigurable to provide coded aperture masks having different resolutions. For instance different coded aperture masks could be displayed having coded aperture arrays with different effective aperture sizes and spacing. The coded aperture mask means may also be reconfigurable to provide coded aperture masks having different coded aperture arrays.

The invention will now be described by way of example only with reference to the following drawings of which;

FIG. 1 shows a schematic of a coded aperture imaging system,

FIG. 2 shows a scene image, coded aperture array, detector intensity pattern and reconstructed image,

FIG. 3 shows imaging of a reference object,

FIG. 4 illustrates the principle of imaging reference objects at different positions in a scene so as to build up a decoding pattern, and

FIG. 5 illustrates the principle of using a shaped reference object.

The present invention relates to a coded aperture imaging (CAI) apparatus. CAI is based on the same principles as a pinhole camera. In a pinhole camera, images free from chromatic aberration are formed at all distances away from the pinhole, allowing the prospect of compact imaging systems, with a large depth of field. However, the major penalty is the poor intensity throughput, which results from the small light gathering characteristics of the pinhole. Nevertheless, the camera is still able to produce images with a resolution determined by the diameter of the pinhole, although diffraction effects have to be considered. The light throughput of the system can be increased by several orders of magnitude, while preserving angular resolution, by using an array of pinholes. Each detector element sees the result of the summation of contributions from the various pinholes, corresponding to each viewpoint of the scene.

Another way of understanding the operating principle of CAI is to observe that this is a purely geometric imaging technique. Light from every point in a scene within the field of regard (FOR) of the system casts a shadow of the coded aperture onto the detector array. The detector measures the intensity sum of these shadows. The coded aperture is specially designed such that its autocorrelation function is sharp with very low sidelobes. Typically pseudorandom or uniformly redundant arrays (URA) (such as described in E. Fenimore and T. M. Cannon, “Coded aperture imaging with uniformly redundant arrays”, Applied Optics, Vol. 17, No. 3, pages 337-347, 1 Feb. 1978) are used where a deconvolution of the detector intensity pattern can yield a good approximation to the point distribution in the scene.

FIG. 1 shows schematically an example of a coded aperture imaging system, generally indicated 2. Rays of light from points in the scene 4 fall onto a particular coded aperture array 6. The coded aperture array acts as a shadow mask and therefore a series of overlapping coded images are produced on the detector array 8. At each pixel on the detector array, the intensities from the overlapping, coded images are summed. The output from the detector array 8 is passed to a processor 10 where an image of the scene can be subsequently decoded from the detector signals using a variety of digital signal processing techniques.

Recently GB0510470.8 has proposed using a reconfigurable mask means 6 to provide reconfigurable coded aperture array. The coded aperture mask means 6 is controlled by a controller 12 which controls the reconfigurable mask means to display different coded aperture masks. If only part of the coded aperture mask means displays a coded aperture array, the rest of the mask preventing radiation from reaching the detector, then the field of view of the apparatus is determined by the location and size of the coded aperture array relative to the detector, changing its position or size changes the field of view and/or resolution of the imager.

CAI therefore offers the ability to provide a compact and lightweight imaging apparatus which has a large depth of field and has a changeable field of view without requiring any moving parts.

As mentioned above the intensity pattern formed at the detector array 8 is a series of overlapping images of the scene created by the various apertures. This intensity pattern requires decoding to construct a recognizable image of the scene. FIG. 2 illustrates a scene image 50, the coded aperture array used 52 and the resultant pixel intensity at the detector array 54. Only after suitable processing is the image recovered 56.

There are a variety of CAI decoding algorithms already available in the prior art, the majority of which have been developed for off line decoding involving the relatively low pixel count detectors associated with X-ray, y-ray and radiological imaging. For real time decoding applications, factors to be considered when choosing appropriate algorithms include optimization with signal-to-noise characteristics of the detectors to be used, mask types, synergy with efficient decoding computer architectures and adaptability to support a variety of performance options.

In the most general case, the signal D leaving the detector array 8 can be described by:D(x,y)=S(x,y)A(x,y)+N(x,y)  (1)where x,y are the lateral coordinates of the 2 dimensional signal distribution, S is the signal from the scene, A is the aperture function of the mask in the system, N is the noise introduced at the detector and is the convolution operator. The object of all such algorithms is to recover part of, or the whole of, S(x,y) with as few artifacts as possible. These artifacts can be quantified by various metrics, depending upon the application for which CAI is being used. For example, human viewing of the image may require a different metric being used than for automatic (machine based) interpretation; detection, identification and/or tracking will similarly require appropriate optimisations.

For example decoding can be performed using a deconvolution:S′(x,y)=Φ⁻¹[Φ(D(x,y))/Φ(A(x,y))]=S(x,y)+Φ⁻¹[Φ(N(x,y))/Φ(A(x,y))]  (2)where Φ is the Fourier Transform operator. While computationally efficient, Φ(A(x,y)) can have small terms (a general property of large binary arrays, for example), resulting in a noisy reconstruction. Appropriate mask design will minimize this effect. It is well known that accurate deconvolution is susceptible to noise, so detector noise may affect this algorithm more than some others.

Alternatively in a cross correlation technique, S(x,y) is decoded by correlating D(x,y) with an array G(x,y)S′(x,y)=D(x,y)G(x,y)=S(x,y)A(x,y)G(x,y)+N(x,y))A(x,y)  (3)In the simple case of G=A, and the mask design A is such that its auto correlation approximates well to a delta function, with small sidelobes. Uniform redundant arrays were developed to achieve this with small array dimensions. If this is the case, then a reasonable quality reconstruction can be achieved. However, the real positive nature of the mask functions will result in a pedestal of 0.5 times the peak value of the autocorrelation, even in the ideal case, with associated decrease in reconstruction quality compared to the ideal case deconvolution algorithm. More generally, G is chosen such that G≈A. In this case, the method is known as “balanced cross correlation” and appropriate choice of G can result in good quality reconstructions.

One thing common to all decoding methods for any CAI system however is that it is necessary to have a knowledge of the mask aperture function. Usually the mask aperture function is calculated theoretically using a knowledge of the mask and its location relative to the detector array. However this requires precise alignment of the mask. Any misalignment in orientation is particularly important as rotation of the mask can result in a different pattern being perceived by the detector.

The present invention therefore records an image of the actual mask by a reference object, a point source. Referring to FIG. 3 in a calibration type step the imager is arranged to image a distant point source. Detector array 30 is illuminated by point source 34 through coded aperture array 32. As the point source 34 is the only source of illumination in the scene the pattern recorded on the detector array 30 is a single shadow of the coded aperture array 32. Thus the intensity pattern recorded at the detector array gives directly the aperture pattern of the coded aperture array as perceived by the detector array.

This intensity pattern is therefore recorded and may be used directly as the mask pattern in the decoding algorithm.

Using the mask pattern directly can have the advantage that any diffraction effects of the mask are present in the recorded intensity pattern. As mentioned previously CAI is a purely geometric imaging technique. As a result, any diffraction caused by the coded aperture mask can be expected to adversely affect imaging performance. For a given wavelength, diffraction will become more significant as the mask to detector distance increases and as the mask aperture decreases. For the case of maximum angular resolution of a CAI based imager, the mask aperture spacings are similar in size to the detector pixel spacings and typically ˜10 times the size of the wavelength of the light being imaged. Calculations show that very significant diffraction occurs in such situations.

Fortunately the effect of diffraction on image quality is not severe. However capturing an image of the coded aperture mask which inherently includes diffraction effects may offer advantages in image quality when processing.

The captured pattern could be processed prior to being stored for instance to improve contrast.

The wavelength of the point source 34 may be varied to record the intensity pattern on the detector array at a range of different wavelengths. For instance different point sources operating at different wavelengths could be used in turn. Alternatively the point source could be wavelength tuneable or could be a broad band source, such as a white light source in the visible spectrum, and used with appropriate pass band filters. The spectral content of the point source could be chosen to match the measured or predicted spectral content of the scene. Indeed a range of different spectral ranges could be used and the pattern for each captured. Analysis of the spectral content of the scene could then indicate which captured pattern should be used. It would also be possible to record decoding patterns at a selection of different wavelengths which could be either monochromatic or narrow band. One can then combine these decoding patterns by simple weighted addition to obtain a decoding pattern matching that recorded with any desired spectrum, where the weights applied correspond to the weights needed to combine the different wavelength sources into the desired spectrum. This would offer a versatile route to obtain a decoding pattern for any spectrum, given a pre-recorded set of narrow band patterns.

Alternatively the theoretical mask pattern could be used but the data recorded when imaging the reference object could be used to determine the degree of misalignment of the actual coded aperture array. The captured intensity pattern could be correlated with the theoretical pattern and, based on the correlation, any adjustment, e.g. to orientation, applied to the theoretical pattern. A practical method for doing is to examine the correlation between the captured intensity pattern and scaled and rotate versions of the theoretical pattern. The one yielding the highest correlation peak will indicate the scale and orientation of the captured pattern.

In several applications the coded aperture array may be larger than the detector array, or at least the projected pattern of the detector array when imaging a point source may be larger than the detector array so that the detector array can not capture the full projected pattern. When a theoretical pattern is used as the decoding pattern and the step of imaging the reference source is to allow correct orientation this does not matter as it is still possible to determine, from the part of the mask shadow which does fall on the detector array, the location and orientation of the mask relative to the detector.

However if the actual intensity pattern is to be used it is necessary to image a reference object at different locations in the scene so as to cause different parts of the mask pattern to be illuminated on the detector array. Each different intensity pattern can be recorded and stitched together later to form a full decoding pattern. FIG. 4 illustrates this approach. FIG. 4a shows a point source 34 located at a first location in scene. This casts a shadow of a first part of coded aperture array 43 onto detector array 30. The resultant intensity pattern 40 is illustrated. FIG. 4b shows the reference object 34 located at a different part of the scene. The resultant intensity pattern 42 is the shadow of a different part of coded aperture array 32. These two intensity patterns can be stitched together to form a full pattern as illustrated in FIG. 4c. For simplicity the different positions for the point source lie on a square grid and the spacing between these positions is such that there is a small overlap in the regions of the mask that cast a shadow on the detector. The task of clipping away the overlap regions and stitching the recorded images together so that they butt up to each other correctly could be performed by observation of the images. Alternatively, an automated method could cross-correlate pairs of the images, the correlation peaks so obtained indicating the best alignment of the images and the region of overlap to be clipped.

The step of imaging a reference source may need only be done once when the CAI apparatus is assembled. However for some applications it may be useful to periodically re-image the reference source to ensure that the stored decoding pattern is still accurate, for instance to allow for any slight misalignment that may occur through use.

In another embodiment the point source is replaced with an object having a simple shape, such as a line or a circle. This is illustrated with respect to FIG. 5. In FIG. 5a a shaped reference object 60 is imaged and the intensity pattern captured. The reference object may be a light source viewed through a shaped aperture, or may be a shaped object under strong illumination etc. The intensity pattern corresponding to each shape is stored and used in decoding to perform correlation template matching. If the scene viewed later has a matching shape in it the intensity pattern recorded for that scene will correlate with the intensity pattern stored which corresponds to the reference object being circular. The presence of the object in the input scene will be indicated by a bright region in the decoded image (the correlation peak). FIG. 5b illustrates the scene being imaged and FIG. 5c shows the input scene. FIG. 5d illustrates the decoded image.

The application of this embodiment would be target identification and tracking. The identification of a target within a particular region of the input scene may then be used to select a mask pattern that provides an enhanced image of that particular region.

Alternatively, intensity patterns may be recorded for point sources placed at positions substantially covering a desired shape. The intensity patterns can then be added together digitally.

The present invention therefore provides a means of generating and maintaining accurate decoding patterns for a CAI system. Where a reconfigurable coded aperture mask means is used a separate decoding pattern will be determined and stored for each possible mask configuration. The present invention also allows the patterns formed by complex shaped masks to be recorded easily.

The present invention also allows for correction of atmospheric aberration which is especially useful when imaging through the atmosphere over large distances. A point source reference object is located in the scene to be viewed. This reference object may for instance be a retro-reflector which can be illuminated by a laser located near the imager.

The imager is arranged to image the field of view including the point source reference object. The radiation from the reference object may be modulated, for instance the laser illuminating the retro-reflector may be pulsed. By taking the intensity pattern on the detector array when the point source is illuminated and when it is not illuminated the intensity pattern due to the point source can be easily determined.

If there is no atmospheric aberration the intensity pattern will be a clear pattern of the mask as mentioned previously and so can be used to decode the image of the scene. However, if there is any aberration the effect will be to distort the radiation from the point source. Effectively it will appear as a distorted shape. If the intensity pattern captured from the distorted shape is used as the decoding pattern it will correlate, i.e. produce a point, for each point source in the scene. As the scene is effectively made up of a series of point sources however the result will be an undistorted image. Thus use of a reference object in the scene to determine a real time decoding pattern can compensate for atmospheric distortion.

Claims

1. A method of coded aperture imaging (CAI) using CAI apparatus having a coded aperture mask in a fixed relation to a detector array which outputs image data in response to illumination by radiation passing from a scene via the coded aperture mask, the method comprising the steps of: successively imaging each of a plurality of reference objects at a plurality of different reference object positions with respect to the CAI apparatus such that radiation from the plurality of reference objects reaches the detector array via different parts of the coded aperture mask, wherein, at each of the plurality of the different reference object positions, the plurality of reference objects are each disposed at different parts of the scene, and each of the plurality of reference objects is imaged using the CAI apparatus to form a reference intensity pattern upon the detector array,obtaining reference image data output from the detector array for each reference object position,using the reference image data to derive a decoding pattern for each different reference object, andmonitoring a scene with the CAI apparatus to produce scene image data output from the detector array and using the decoding patterns to reconstruct an image of the scene from the scene image data.

2. A method according to claim 1, wherein the reference objects are point sources.

3. A method according to claim 1 wherein the reference image data is the decoding pattern.

4. A method according to claim 1, wherein the reference objects have a spectral content and at least part of the scene being monitored in the monitoring step has a spectrum which matches that spectral content.

5. A method according to claim 1, wherein the reference objects have multiple different spectral contents for which respective reference image data and decoding patterns are derived.

6. A method according to claim 1 including the step of comparing the reference image data with a theoretical decoding pattern to determine any misalignment of the coded aperture mask with respect to the CAI apparatus.

7. A method according to claim 6 including the steps of compensating the theoretical decoding pattern for any misalignment to generate a compensated theoretical pattern and using the compensated theoretical pattern as the decoding pattern.

8. A method as claimed in claim 1 including obtaining reference image data for a reference object imaged via every part of the coded aperture array.

9. A method as claimed in claim 1 wherein the reference image data obtained for different reference object positions are combined to form the decoding pattern.

10. A method according to claim 1 wherein the coded aperture mask is reconfigurable to provide any one of several mask configurations, each mask configuration having at least one of a different coded aperture array and location at a different position on the mask, and wherein the method includes the steps of imaging a reference object with each of the mask configurations to produce respective reference intensity patterns upon the detector array and deriving a respective decoding pattern for each mask configuration.

11. A method as claimed in claim 1, wherein the reference objects consist of at least partly of a reference object of known shape.

12. A method as claimed in claim 11, wherein the reference objects have different known shapes for each of which reference image data is obtained.

13. A method as claimed in claim 1 wherein the reference objects are substantially the only source of scene radiation when the reference intensity pattern is upon the detector for output of reference image data.

14. A method as claimed in claim 1 wherein the reference objects are point sources located within the scene to be monitored.

15. A method as claimed in claim 14 including the step of modulating radiation from the reference objects to allow the reference intensity pattern to be detected.

16. A method of coded aperture imaging (CAI) comprising: monitoring a scene using a CAI apparatus having a detector array arranged to receive radiation from the scene through a coded aperture mask such that the radiation produces an intensity pattern on the detector array, and the detector array responds by output of image data, andprocessing the image data using decoding patterns determined by reference image data, wherein the reference image data is derived by: successively imaging each of a plurality of reference objects at a plurality of different reference object positions with respect to the CAI apparatus such that radiation from the plurality of reference objects reaches the detector array via different parts of the coded aperture mask, wherein, at each of the plurality of the different reference object positions, the plurality of reference objects are each disposed at different parts of the scene, and each of the plurality of reference objects is imaged using the CAI apparatus to form a reference intensity pattern upon the detector array, andobtaining reference image data output from the detector array for each reference object position.

17. A method as claimed in claim 16 wherein the reference objects are point sources.

18. A coded aperture imager comprising: a detector array for receiving an intensity pattern of radiation passing from a scene through a coded aperture mask and for output of image data in response,a processor for decoding the image data to produce an image, the processor having a memory storing a decoding pattern derived from a radiation intensity pattern received at the detector array by successively imaging each of a plurality of reference objects at a plurality of different reference object positions with respect to the coded aperture imager such that radiation from the plurality of reference objects reaches the detector array via different parts of the coded aperture mask, wherein, at each of the plurality of the different reference object positions, the plurality of reference objects are each disposed at different parts of the scene, and each of the plurality of reference objects is imaged using the coded aperture imager to form a reference intensity pattern upon the detector array, and obtaining reference image data output from the detector array for each reference object position.

19. A coded aperture imager as claimed in claim 18 wherein the coded aperture mask is reconfigurable to provide different mask configurations with respective coded aperture arrays each having at least one of a different pattern and a different location on the mask and the memory stores a respective decoding pattern for each mask configuration, each decoding pattern having been derived from a respective radiation intensity pattern received at the detector array when imaging a point source using the respective mask configuration.

20. A coded aperture imaging (CAI) apparatus comprising: a coded aperture mask,a detector array providing image data output in response to illumination by radiation passing from a scene via the coded aperture mask,a plurality of reference objects for imaging by the CAI apparatus to form a reference intensity pattern upon the detector array and thereby to obtain output of reference image data from the detector array, wherein the reference objects are disposed at different parts of the scene, anda processor for processing the reference image data to derive a decoding pattern using each reference object and for using the decoding patterns to reconstruct an image of a scene from image data output by the detector array in response to illumination by radiation when the CAI apparatus monitors a scene,wherein the CAI apparatus is configured to (1) successively image each of the plurality of reference objects at a plurality of different reference object positions with respect to the CAI apparatus such that radiation from the plurality of reference objects reaches the detector array via different parts of the coded aperture mask, wherein, at each of the plurality of the different reference object positions, the plurality of reference objects are each disposed at different parts of the scene, and each of the plurality of reference objects is imaged using the CAI apparatus to form a reference intensity pattern upon the detector array, and (2) obtain reference image data output from the detector array for each reference object position.