Patent Application
20080159644
The present invention relates generally to digital imaging devices, and, more particularly, to reducing atmospheric-condition-induced defocus blur in images.
Temperature and humidity fluctuations acting on optical components in an imaging device may cause the optical characteristics of the optical components to vary, thereby adversely affecting the performance of the imaging device. Temperature and humidity changes may, for example, cause optical components to change index of refraction, change shape and move within their mounts. Such manifestations are especially prevalent in imaging devices including plastic optical components. Plastic optical components such as those found in inexpensive cameras frequently have an index of refraction that changes to a greater degree in response to atmospheric conditions than that of glass optical components. As a result, plastic optical components may not be able to hold focus in as large a temperature and humidity range as glass optical components.
Attempts have been made to correct atmospheric-condition-induced defocus blur in various imaging devices. Changes in focus resulting from atmospheric conditions may be compensated for to some extent through, for example, appropriate optomechanical designs. Optomechanical designs are described in several readily available references such as A. Ahmad (editor), Handbook of Optomechanical Engineering, CRC, 1996. In such designs, materials and mounting schemes are selected that respond to atmospheric conditions in such a way as to offset any focus change associated with changes in the atmospheric conditions. Usually this requires choosing materials that have small thermal expansion coefficients. Unfortunately, due to these choice constraints, solutions are often physically large and do not lend themselves to size-constrained systems such as small cameras. Moreover, because of high costs, optomechanical solutions may not be feasible in inexpensive imaging devices.
As a result, there is a need for methods and apparatus operative to reduce blur in images captured with imaging devices manifesting atmospheric-condition-induced defocus.
Embodiments of the present invention address the above-identified need by providing methods and apparatus for reducing blur in images captured with imaging devices manifesting atmospheric-condition-induced defocus.
In accordance with an aspect of the invention, blur is reduced in an image generated by an imaging device by determining values of one or more atmospheric variables for the image, the one or more atmospheric variables characterizing conditions under which the image is generated. With these values, a sharpening filter is determined for the image. The sharpening filter is derived from a modulation transfer function (MTF) of the imaging device at conditions characterized by the values of the one or more atmospheric variables determined for the image. The sharpening filter is subsequently applied to the image.
In accordance with one of the above-noted embodiments of the invention, a digital camera suffers from atmospheric-condition-induced defocus blur. The digital camera comprises temperature and humidity sensors, a filter memory and an image processor. The manufacturer of the digital camera loads the filter memory with several sharpening filters for different temperature and humidity conditions. These sharpening filters are derived from MTF measurements performed by the manufacturer over a range of temperature and humidity conditions. When a user takes an image, temperature and humidity are measured for that image by the temperature and humidity sensors in the digital camera. The sharpening filter corresponding to these temperature and humidity measurements is retrieved from the filter memory. The image processor applies this sharpening filter to the image, thereby reducing blur in the image.
These and other features and advantages of the present invention will become apparent from the following detailed description which is to be read in conjunction with the accompanying drawings.
The present invention will be described with reference to illustrative embodiments. It is anticipated that numerous modifications can be made to these embodiments and the results will still come within the scope of the invention. No limitations with respect to the specific embodiments described herein are intended or should be inferred.
A camera microprocessor 238 receives user inputs 240, such as from a shutter release switch, and initiates a capture sequence by triggering a flash unit 242 (if needed) and signaling a timing generator 244. The timing generator is connected generally to the elements of the digital camera, as shown in
Once stored in the camera data memory 230 or memory card 232, the compressed images may be sent to the computer 120 via a host computer interface 238 or, alternatively, by removing the memory card from the digital camera and having the computer read the data from the memory card directly using a memory card reader. The computer will preferably include software operative to store, transmit, print and further modify the images. The computer may be a general purpose computer such as, for example, a personal computer from what is commonly referred to as the “IBM PC Compatible” class of computers. Alternatively, the computer may be a purpose-specific computing device.
For purposes of illustrating aspects of the invention, it will be assumed that the optical components of the digital camera 110 suffer from atmospheric-condition-induced defocus blur. More specifically, it will be assumed that changes in two atmospheric variables, namely, temperature and humidity, cause the optical components of the digital camera to change focus. It is to be appreciated however, that defocus blur attributed to other atmospheric conditions may be reduced using similar techniques.
An MTF may be represented as a graph that shows image contrast relative to object contrast (modulation) on the vertical axis over a range of spatial frequencies (cycles/sample) on the horizontal axis. The curve in
Several conventional techniques may be utilized to characterize MTFs for the digital camera 110 at the different temperature and humidity conditions, and these techniques will be familiar to one skilled in the art. The digital camera may, for example, be used to image a test chart that is configured in accordance with International Standards Organization (ISO) 12233. This type of test chart includes a multitude of different line patterns with different spatial frequencies and a slant edge feature that allow an MTF to be readily calculated. As another example, an MTF may be determined for the digital camera by imaging a narrow line of light, typically formed by illuminating a slit. Combinations of these and other techniques may also be used.
Once MTFs for the digital camera 110 are determined across the range of anticipated temperature and humidity conditions, sharpening filters may be determined for these same atmospheric conditions. The term “sharpening filter” is to be construed broadly and is intended to encompass a set of filter data rather than a tangible optical device. A sharpening filter is preferably designed with an MTF (“filter MTF”) that is simply the ratio on a point-by-point basis between the MTF of the digital camera at a particular temperature and humidity condition (“camera MTF”) and the MTF of the digital camera at what is considered by the manufacturer to be a nominal temperature and humidity condition (“nominal MTF”). If, for example, the nominal MTF is as shown in
In this way, sharpening filters may be determined as a function of temperature and humidity for the digital camera 110. Once derived, these sharpening filters are preferably stored in the filter memory 228 of the digital camera. They may be stored, for example, as individual sharpening filters for each temperature and humidity condition, or may be represented by one or more mathematical relations that describe the desired sharpening filter as a function of humidity and temperature. Physically, the filter memory may, for example, include a conventional programmable read-only memory (PROM), erasable programmable read-only memory (EPROM) or electrically erasable programmable read-only memory (EEPROM). It may be a portion of a larger camera memory that is also used for another purpose.
Returning again to
Digital temperature sensors (e.g., digital thermometers) and digital humidity sensors (e.g., digital hygrometers) are used in a wide range of electronic applications and, as a result, will be familiar to one skilled in the art. A digital thermometer may, for example, include a thermistor, a thermocouple or a resistance temperature detector. In contrast, a digital hygrometer may include a hygroscopic polymer film that acts to vary a capacitance or resistance in the sensor.
Once temperature and humidity for the image are determined, this information is sent to the filter memory in step 340 and the proper sharpening filter for that atmospheric condition (e.g., the sharpening filter for a temperature and humidity condition closest to that just measured) is retrieved. The retrieved sharpening filter is then sent to the image processor 224. In step 350, the image processor applies the sharpening filter to the image.
Applying a sharpening filter to an image may be performed either in the frequency domain or in the spatial domain. Performing the filtering in the frequency domain may involve, for example, multiplying the filter MTF by the Fourier transform of the image. Applying the sharpening filter in the spatial domain, in contrast, typically requires that the filter MTF be transformed into a convolution kernel. Such a transformation is conventionally performed and, as a result, will be familiar to one skilled in the art. Moreover, such a transformation is described in a number of readily available references such as A. Oppenheim et al., Digital Signal Processing, Prentice-Hall, 1975, which is incorporated herein by reference.
After applying the sharpening filter, the image has been corrected for atmospheric conditions present at the time the image was generated, as indicated as result 360. After compressing the image, the image may be stored in the data memory 230 or in the memory card 232 as described above. The digital camera 110 is then ready to generate another image.
It should again be emphasized that, although illustrative embodiments of the present invention have been described herein with reference to the accompanying figures, the invention is not limited to those precise embodiments. For example, a method or apparatus in accordance with aspects of this invention may correct for defocus blur resulting from atmospheric variables in addition to or other than temperature and humidity, such as pressure (thereby requiring that the digital camera be equipped with a digital barometer). Moreover, while sharpening filters in the above-described imaging system 100 were both stored in the digital camera 110 and applied to images in the digital camera, they may instead be stored in the computer 120 and applied to images in the computer as part of the computer's image modification functions after the images have been transferred from the digital camera. In such a case, the digital camera would preferably encode each image with the atmospheric conditions present when the image was generated (e.g., temperature and humidity). The sharpening filters for the digital camera could be provided to the end user for use by the computer on a computer-readable medium (e.g., magnetic disc, compact disc or digital versatile disc) provided with the digital camera at the time of purchase, or, alternatively, through the Internet after purchase. One skilled in the art will recognize these and various other changes and modifications that may be made without departing from the scope of the appended claims.
