Determining Intensity Similarity in Low-Light Conditions Using the Poisson-Quantization Noise Model

Abstract

A Poisson-quantization noise model for modeling noise in low-light conditions is described. In one aspect, image information is received. A Poisson-quantization noise model is then generated from a Poisson noise model and a quantization noise model. Poisson-quantization noise is then estimated in the image information using the Poisson-quantization noise model.

Description

BACKGROUND

Noise is inevitable in any imaging device. This is especially the case in low-light situations (also known as photon limited situations) arising from either a weak light source illuminating an object being photographed, or the use of a small or low quality lens by the device attempting to photograph the object. In either case, the low light situation often precludes the capture and rendering of a high quality image.

SUMMARY

This Summary is provided to introduce a selection of concepts in a simplified form that are further described below in the detailed description. This Summary is not intended to identify key features or essential features of the claimed subject matter, nor is it intended to be used as an aid in determining the scope of the claimed subject matter.

In view of the above, a Poisson-quantization noise model for modeling noise in low-light conditions is described. In one aspect, image information is received. A Poisson-quantization noise model is then generated from a Poisson noise model and a quantization noise model. Poisson-quantization noise is then estimated in the image information using the Poisson-quantization noise model.

BRIEF DESCRIPTION OF THE DRAWINGS

In the Figures discussed below the left-most digit of a component reference number identifies the particular Figure in which the component first appears.

FIG. 1 illustrates an exemplary system, including a video content analysis engine, for video content analysis.

FIG. 2 is a block diagram of a computing device on which an exemplary video content analysis engine resides.

FIG. 3 includes two graphs illustrating exemplary mean and variance properties of Poisson-quantization noise.

FIG. 4 illustrates an exemplary intensity similarity function for the Poisson noise model.

FIG. 5 is a flow diagram of an exemplary method to identify pixel correlation between two frames of image information.

FIG. 6 is a flow diagram of an exemplary method to determine an intensity similarity function.

FIG. 7 illustrates an example of a suitable computing environment in which an intensity similarity function may be established based on Poisson-quantization noise.

DETAILED DESCRIPTION

Overview

The following disclosure describes a Poisson-quantization (PQ) noise model which can be used to model noise in low-light conditions. In one embodiment, the PQ noise model may be used to create an intensity similarity function. It will be understood that the terms intensity similarity function and intensity similarity measure as used herein are interchangeable. In general, an intensity similarity measure represents a probability that two slightly different observations of a same (or same colored) point in a three dimensional scene are observations of the same point.

In one embodiment, the intensity similarity measure may be used to calculate an intensity similarity to process video content. These calculations may entail finding pixel correspondence among video frames that may be used for various image processing operations, for example, denoising, object tracking, pattern matching, etc., especially in low-light conditions.

These and other aspects of the systems and methods to model Poisson-quantization noise and generate an intensity similarity function based thereon are now described in greater detail.

An Exemplary System

Although not required, systems and methods to generate a Poisson-quantization noise model and an intensity similarity measure in low-light conditions are described in the general context of computer-executable instructions (program modules) being executed by a computing device such as a personal computer. Program modules generally include routines, programs, objects, components, data structures, etc., that perform particular tasks or implement particular abstract data types. While the systems and methods are described in the foregoing context, it will be understood that acts and operations described hereinafter may be implemented in any suitable hardware, software, firmware, or combination thereof.

FIG. 1 illustrates an exemplary system 100 for processing video content. In one implementation, system 100 may be used to calculate Poisson-quantization noise using a Poisson-quantization noise model. In one implementation, the calculated Poisson-quantization noise is utilized to create an intensity similarity measure. The intensity similarity measure can be used to process video content captured by the system 100. For example, in one implementation, the intensity similarity measure is used to find correspondence among video images.

System 100 includes an imaging device such as a camera 102. Camera 102 includes optics 104, a photodetector 106, and a video content analysis engine 108. Although the imaging device is illustrated as a digital camera 102, the imaging device can also be any type of imaging device such as a conventional analog camera, a cell phone equipped with an imaging device, a personal digital assistant (PDA) equipped with an imaging device, a webcam, etc. Object image information captured by an imaging device typically includes photon noise 112 received by optics 104 and transmitted to photodetector 106. Photon noise 112 arises because photons do not arrive at optics 104 in a steady stream. Instead, photons arrive in a fluctuating manner consistent with that of a Poisson noise model. This temporal fluctuation in the intensity of photons arriving at photodetector 106 becomes especially significant in low-light conditions where the number of incoming photons is limited.

In addition to photon noise 112, other types of noise, including quantization noise, can be encountered by camera 102. Quantization noise is created when the photodetector 106 digitizes input photon energy into quantized values, thus changing photons to electrons by converting the incident optical intensity to a detector current or signal. In photon-limited conditions photon noise and quantization noise become dominant due to the lack of intensity resolution in the limited dynamic range. Thus, quantization noise and photon noise may exert an especially deleterious effect on low-light vision applications such as night vision, medical imaging, underwater imaging, microscopic imaging, astronomical imaging, and/or other applications.

Other types of noise, in addition to photon noise 112 and quantization noise, such as reset noise, dark current noise and read-out noise may also be significant. In general, these types of noise have the potential to significantly degrade the quality of an image 114 formed in camera 102. In high-speed imaging, Poisson noise often becomes significant, and the combination of Poisson noise and quantization noise may contribute significantly to uncertainty in observations. Reset noise, dark current noise and read-out noise follow a Poisson distribution. Sometimes, however, read-out noise may also be modeled by Gaussian noise. This results since Gaussian noise with variance σ^{2 and mean σ2} is nearly identical to Poisson noise with mean σ² if σ is sufficiently large. For instance, when operating camera 102 at room temperature and with a high read-out frequency, a may be sufficiently large to satisfy this condition.

Video content analysis engine 108 may be employed to effect image restoration in photon-limited images which would otherwise suffer from severe degradation. As discussed below, video content analysis engine 108 accomplishes this by: modeling photon noise 112, quantization noise, reset noise, dark current noise, and read-out noise; and creating an intensity similarity measure. These operations are useful in filtering various types of noise to improve the quality of image 114.

Computer 116 is illustrated as a desktop computer. However, computer 116 could alternately comprise a variety of other types of computer and computer-like devices, such as a notebook or portable computer, a tablet PC, a cell phone, a personal digital assistant (PDA), a workstation, a mainframe computer, a server, an Internet appliance, a set-top box, combinations thereof, and so on. In one implementation, video content analysis engine 108 is implemented on computer 116. In another implementation, a portion of video content analysis engine 108 resides on the computer 116, while another portion of video content analysis engine 108 resides on a computer readable medium outside of computer 116, or on a device separate from computer 116, such as camera 102.

Computer 116 is coupled to a network 120, such as the Internet, via any possible connection type known in the art, including telephone lines and ISDN lines. Moreover, other computers 122(1)-122(N) may be connected to the network 120. In this fashion, computers 122(1)-122(N) can share data and instructions with each other, and with computer 116. In one implementation, this includes sharing by computer 116 of video content captured by camera 102 and processed by the video content analysis engine 108 with computers 122(1)-122(N) over network 120. For example, in one implementation, camera 102 comprises a cell phone with an imaging device. In this example, images taken by the imaging device are processed by the video content analysis engine 108. These images may then be communicated to computer 116, network 120, or computers 122(1)-122(N).

An Exemplary Computing Device

Although not required, the systems and methods for creating a Poisson-quantization (PQ) noise model and an intensity similarity measure based on the PQ noise model are described in the general context of computer-executable instructions (program modules) being executed by a computing device such as a personal computer. Program modules generally include routines, programs, objects, components, data structures, etc., that perform particular tasks or implement particular abstract data types. While the systems and methods are described in the foregoing context, acts and operations described hereinafter may also be implemented in hardware, software, firmware or combinations of hardware, software, firmware, etc.

FIG. 2 illustrates an exemplary computing device 200 including program modules 202 and program data 204. Program modules 202 include the video content analysis engine 108. Video content analysis engine 108 includes PQ noise modeling module 206 and intensity similarity measure module 208. Program modules 202 also include other program modules 210 such as, an operating system, a pixel correspondence module, and one or more applications to perform denoising applications based on PQ noise model 212 generated by PQ noise modeling module 206, and/or an intensity similarity measure 214 generated by intensity similarity measure module 208. Program data 204 includes PQ noise model 212, intensity similarity measure 214 and other program data 216 such as, for example, input image data, intermediate values and results, and intensity observations.

Noise reduction in an image sequence may be accomplished by finding pixel correspondences among the images in the sequence. Once the correspondences are obtained, color/intensity values of the pixels are smoothed by selecting an average or median value for the color/intensity values of corresponding pixels found in images within the sequence. In this manner, noise in the images can be reduced.

The intensity similarity measure module 208 is useful for finding pixel correspondences in low-light conditions, because the intensity similarity measure is built upon the physics-based noise model, i.e., PQ noise model 212. To compute the intensity similarity measure 214, parameters q and q₁ of PQ noise model 212 are determined. This is achieved by fitting the observed noise data in the calibration stage, as will be described in more detail below. Once the parameters q and q₁ for the PQ noise model 212 are obtained, the intensity similarity measure 214 may be obtained. Methods describing how to obtain the similarity measure 214 are also discussed in more detail below. It will be understood that if gain and white balancing parameters in the images are fixed, such computations need only be completed once.

Below, PQ noise model 212, which is a realistic noise model in low-light conditions, is derived. The PQ noise model 212 is built upon two inevitable noise sources in low-light conditions: Poisson noise and quantization noise. The PQ noise model 212 accounts for uncertainties caused by the nature of photon arrival, as well as by the digitizing process carried out at the photodetector 106. Intensity similarity measure 214 is based on PQ noise model 212. Intensity similarity measure 214 is useful in many computer vision applications which involve intensity differencing, e.g., block matching, stereo, optical flow and image alignment. Intensity similarity measure 214 can replace existing intensity distance functions based on Euclidean distance.

Poisson-Quantization Noise Model

As mentioned above, the quality of video content captured by camera 102 may suffer from uncertainty generated by photon noise 112 and quantization noise. The Poisson-quantization (PQ) noise model 212 discussed below accounts for this uncertainty.

Poisson Noise Model

Poisson noise is modeled by a Poisson distribution with parameter λ defined for all kεN by the probability:

$\begin{array}{cc}p\left(k,\lambda \right)=\frac{{\lambda }^k}{k!}{}^{-\lambda },& \left(1\right)\end{array}$

wherein the mean E and variance V are defined as follows:

$\begin{array}{cc}E\left(\lambda \right)=\sum _{k=0}^{\infty }\mathrm{kp}\left(k,\lambda \right)=\lambda ,V\left(\lambda \right)=\sum _{k=0}^{\infty }k^2p\left(k,\lambda \right)-E^2=\lambda .& \left(2\right)\end{array}$

Quantization Noise Model

As also noted above, quantization noise is the uncertainty caused when observed amplitudes in image data are rounded to discrete levels in photodetector 106. This arises due to the finite amplitude resolution inherent in any digital system (i.e. in analog-to-digital conversion, assuming that a signal lies within a predefined range).

If the minimum number of electrons necessary to raise one level of observed intensity is q, and e_q is the quantization noise, then the count of electrons is proportional to the number of photons by the factor of the photon-electron conversion efficiency (the quantum efficiency of the sensor). Quantization noise can thus be modeled as:

$\begin{array}{cc}{e}_q=\frac{N}{q}-\lfloor \frac{N}{q}\rfloor ,& \left(3\right)\end{array}$

where N is the number of electrons generated by the measurement. More detailed quantization error analysis in computer vision can be found in “Evaluation of Quantization Error in Computer Vision” by B. Kamgar-Parsi and B. Kamgar-Parsi, as found in IEEE Trans. Pattern Anal. Mach. Intell., 11(9):929 940, 1989, which is incorporated herein by reference.

Poisson-Quantization Noise Model

Given the Poisson noise model and the quantization noise model discussed above, the PQ-noise model 212 can be formed as follows. A Poisson distribution with parameter λ and quantization Q={q₀=0, . . . , q_k, . . . , q_n+1=∞} may be defined for all kε{0, . . . , n} by the probability p(k, λ, Q) as:

$\begin{array}{cc}p\left(k,\lambda ,Q\right)=\sum _{i=q_k}^{q_{k+1}-1}\frac{{\lambda }^i}{i!}{}^{-\lambda }.& \left(4\right)\end{array}$

where the quantization parameter q_k represents the minimum number of electrons used to produce an intensity level k.

In one implementation, the quantization interval is considered constant, i.e., q_k=kq, and the observations are considered to be far from saturation. In such an instance, the quantization interval can be defined as the range of input values assigned to the same output level, and the behavior of the PQ-noise model 212 can be seen to differ from the behavior of the Poisson noise model.

To derive the mean E(λ, q) and variance V(λ,q) of the PQ-noise model 212, XεZ is considered to be a discrete random variable having a characteristic function φ(t)=E(e^itX). The quantized version X_q can thus be defined by:

$X_q=\lfloor \frac{X}{q}\rfloor .$

Moreover, the characteristic function φ_q of X_q may be given by:

${\phi }_q\left(t\right)=\frac{1-{}^{-t}}{q}\sum _{k=0}^{q-1}\frac{\phi \left(\frac{t+2\pi k}{q}\right)}{1-{}^{-\frac{t+2\pi k}{q}}}.$

This can be proven by setting p_n=P(X=n). The characteristic function φ_q of X_q is therefore:

${\phi }_q\left(t\right)=\sum _{n=-\infty }^{\infty }p_n{}^{\lfloor \frac{n}{q}\rfloor t}=\sum _{n=-\infty }^{\infty }p_n{}^{\frac{n}{q}t}{}^{\left(\lfloor \frac{n}{q}\rfloor t-\frac{n}{q}t\right)}$

Since the function:

$f\text{:}\{\begin{array}{c}Z\mapsto C\\ n\mapsto {}^{{\left(\lfloor \frac{n}{q}\rfloor t-\frac{n}{q}t\right)}_i}\end{array}$

is q-periodic, it can therefore be written as a trigonometric polynomial:

$\sum _{k=0}^{q-1}a_k{}^{\frac{2\pi \mathrm{kn}}{q}}.$

Using a discrete Fourier transformation, it can be shown that:

$\begin{array}{c}{a}_k=\frac{1}{q}\sum _{j=0}^{q-1}f\left(j\right){}^{-\frac{2\mathrm{\pi j}k}{q}}\\ =\frac{1}{q}\sum _{j=0}^{q-1}{}^{-\frac{j}{q}t}{}^{-\frac{2\mathrm{\pi j}k}{q}}\\ =\frac{1}{q}\sum _{j=0}^{q-1}{}^{-\frac{j\left(t+2\pi k\right)}{q}}\\ =\frac{1-{}^{-(t+2\pi k)}}{q\left(1-{}^{-\frac{t+2\pi k}{q}}\right)}\\ =\frac{1-{}^{-t}}{q\left(1-{}^{-\frac{t+2\pi k}{q}}\right)}.\end{array}$ $\mathrm{Therefore},\begin{array}{c}{\phi }_q\left(t\right)=\sum _{n=-\infty }^{\infty }p_n{}^{\frac{n}{q}t}\sum _{k=0}^{q-1}a_k{}^{\frac{2\pi \mathrm{kn}}{q}}\\ =\sum _{k=0}^{q-1}\sum _{n=-\infty }^{\infty }p_n{}^{n\frac{t+2\pi k}{q}}\frac{1-{}^{-t}}{q\left(1-{}^{-\frac{t+2\pi k}{q}}\right)}\\ =\sum _{k=0}^{q-1}\phi \left(\frac{t+2\pi k}{q}\right)\frac{1-{}^{-t}}{q\left(1-{}^{-\frac{t+2\pi k}{q}}\right)}.\end{array}$

Corollary 1. The mean E_q of X_q and variance V_q of X_q can be written by the mean E, the variance V, and the characteristic function φ of X as:

$E_q=\frac{E}{q}-\frac{1}{2}+\frac{1}{2q}+\frac{1}{q}\sum _{k=1}^{q-1}\frac{\phi \left(2\pi k/q\right)}{1-{}^{-\frac{2\pi k}{q}}}$ $V_q=\frac{V}{q}+\frac{1}{12}-\frac{1}{12q^2}-\frac{2E}{q^2}\sum _{k=1}^{q-1}\frac{{}^{\frac{2\pi k}{q}}\phi \left(2\pi k/q\right)}{1-{}^{-\frac{2\pi k}{q}}}+\frac{2}{q^2}\sum _{k=1}^{q-1}\frac{{}^{-\frac{2\pi k}{q}}\phi \left(2\pi k/q\right)}{{\left(1-{}^{-\frac{2\pi k}{q}}\right)}^2}+\frac{1}{q}\sum _{k=1}^{q-1}\frac{\phi \left(2\pi k/q\right)}{1-{}^{-\frac{2\pi k}{q}}}-\frac{1}{q^2}{\left(\sum _{k=1}^{q-1}\frac{\phi \left(2\pi k/q\right)}{1-{}^{-\frac{2\pi k}{q}}}\right)}^2.$

These formulas result from a computation of the derivatives of φ_q, using the fact that E_q=−iφ_q′(0) and V_q=−φ_q″(0)−E_q².

Further, by using a Poisson distribution having the characteristic function φ(t)=e^λ(eit−1) the following formulas are obtained:

$\begin{array}{cc}E\left(\lambda ,q\right)=\frac{\lambda }{q}-\frac{1}{2}+\frac{1}{2q}+\frac{1}{q}\sum _{k=1}^{q-1}\frac{{}^{\lambda \left({}^{\frac{2\pi k}{q}}-1\right)}}{1-{}^{-\frac{2\pi k}{q}}}& \left(5\right)\\ V\left(\lambda ,q\right)=\frac{\lambda }{q}+\frac{1}{12}-\frac{1}{12q^2}-\frac{2\lambda }{q^2}\sum _{k=1}^{q-1}\frac{{}^{\frac{2\pi k}{q}}{}^{\lambda \left({}^{\frac{2\pi k}{q}}-1\right)}}{1-{}^{-\frac{2\pi k}{q}}}+\frac{2}{q^2}\sum _{k=1}^{q-1}\frac{{}^{-\frac{2\pi k}{q}}{}^{\lambda \left({}^{\frac{2\pi k}{q}}-1\right)}}{1-{}^{-\frac{2\pi k}{q}}}+\frac{1}{q}\sum _{k=1}^{q-1}\frac{{}^{\lambda \left({}^{\frac{2\pi k}{q}}-1\right)}}{1-{}^{-\frac{2\pi k}{q}}}-\frac{1}{q^2}{\left(\sum _{k=1}^{q-1}\frac{{}^{\lambda \left({}^{\frac{2\pi k}{q}}-1\right)}}{1-{}^{-\frac{2\pi k}{q}}}\right)}^2.& \left(6\right)\end{array}$

Remark 1. This result can be extended to the continuous random variable case by allowing X to be a random variable in , and by allowing φ_x(t) to be the characteristic function of X. └X┘ can then be allowed to be the quantized version of X. Through use of the Fourier series of the 1-periodic function defined over , i.e.:

$f\left(x\right)={}^{t\left(\lfloor x\rfloor -x\right)}=\sum _{n=-\infty }^{\infty }\frac{{}^{-\left(t+2\pi n\right)}-1}{t+2\pi n}{}^{2\mathrm{\pi }\mathrm{nx}},$

it can be shown that show that the characteristic function φ_└x┘ of └X┘ is

${\phi }_{\lfloor X\rfloor }\left(t\right)=\sum _{n=-\infty }^{\infty }\frac{{}^{-\left(t+2\pi n\right)}-1}{t+2\pi n}{\phi }_X\left(t+2\pi n\right),$

where the summation is done by grouping terms of n and −n together if no convergence is present. The mean k_└x┘ can be derived by:

$E_{\lfloor X\rfloor }=E_X-\frac{1}{2}+\sum _{n\ne 0}\frac{{\phi }_X\left(2\pi n\right)}{2\pi n}.$

This applies to any kind of distribution, for example, the mean of a Gaussian distribution can be derived by allowing X to be a random variable following the Gaussian law N(μ,σ²). The characteristic function becomes

${\phi }_X\left(t\right)={}^{\mathrm{\mu }t-\frac{{\sigma }^2t^2}{2}}.$

Therefore,

$\begin{array}{c}{E}_{\lfloor X\rfloor }=\mu -\frac{1}{2}+\sum _{n\ne 0}\frac{{}^{\mathrm{\mu }2\pi n-2{\sigma }^2{\pi }^2n^2}}{2\pi n}\\ =\mu -\frac{1}{2}+\sum _{n=1}^{\infty }\frac{\cos \left(2\pi n\mu \right){}^{-2{\sigma }^2{\pi }^2n^2}}{\pi n}\end{array}$

As the series on the right decreases exponentially with n, a practical way to compute E_└X┘ is achieved.

FIG. 3 illustrates the differences between the ordinary Poisson (P) noise model and the PQ-noise model 212 (as delineated by the mean and variance equations shown above). In graph 302, evolution of the mean with respect to λ with q=100 for both P noise and PQ noise is shown. Due to quantization noise, strong oscillations are observed in the mean of the PQ noise, while the mean of the p noise is nearly linear with respect to λ.

Similarly, graph 304 illustrates the evolution of the variance of both P noise and PQ noise with respect to the mean, with q=100. Again, due to quantization noise, strong oscillations are observed in the mean of the PQ noise, while the variance of P noise exhibits a near linear relationship with the mean of P noise.

The oscillation in the mean of PQ noise in graph 302, and the variance of PQ noise in graph 304, decays exponentially according to the formula:

${}^{-\lambda \left(1-\cos \frac{2\pi }{q}\right)}$

The minimum intensity level of the linear range corresponds to:

$\lambda \propto \frac{1}{1-\cos \frac{2\pi }{q}}\approx \frac{q^2}{2{\pi }^2}.$

In practice, q_l does not equal q due to the shift of the function caused by the offset voltage. However, under the PQ noise model 212, with the assumption that q₀=0 and q_k=q₁+(k−1)q it is possible to derive E(λ,q) and V(λ,q) for this condition by the same derivation used for Eqs. (5) and (6) above. Thus, when E(λ,q) is reasonably high, i.e. when

$E\left(\lambda ,q\right)>>\frac{q}{2{\pi }^2},$

The following relationship between E(λ,q) and V(λ,q) holds in the linear range:

$\begin{array}{cc}V\left(E,q,q_1\right)=\frac{E}{q}+\frac{q^2+12q_1-6q-7}{12q^2}.& \left(7\right)\end{array}$

This results because it may be assumed that observed intensities are far enough from saturation that the approximation n=∞ may be used. By bifurcating the problem, two cases are formed.

Case 1. If q₁≦q, and X(λ) is a discrete random variable on the shifted Poisson distribution defined by:

$\forall k\ge q_1-qP\left(X\left(\lambda \right)=k\right)=\frac{{\lambda }^{k+q_1-q}}{\left(k+q_1-q\right)!}{}^{-\lambda }.\mathrm{then},\lfloor \frac{X\left(\lambda \right)}{q}\rfloor$

possesses the desired PQ-distribution. It can thus be seen that E_x(λ)=λ+q₁−q, and V_X(λ)=λ.

Case 2. If q₁>q, and X(λ) is a discrete random variable which satisfies

$\{\begin{array}{cc}P\left(X\left(\lambda \right)=0\right)=\sum _{j=0}^{q_1-q}\frac{{\lambda }^j}{j!}{}^{-\lambda },& \\ P\left(X\left(\lambda \right)=k\right)=\frac{{\lambda }^{k+q_1-q}}{\left(k+q_1-q\right)!}{}^{-\lambda },& \forall k\ge 1\end{array}\mathrm{then}\lfloor \frac{X\left(\lambda \right)}{q}\rfloor$

has the desired PQ-distribution. When λ is large, the approximation P(X=0)≈0 holds. Therefore, E_X(λ)≈λ+q₁−q, and V_X(λ)≈λ are deduced.

Using Corollary 1 and Remark 1, which show that

$\underset{\lambda \to \infty }{\lim }{\phi }_{X\left(\lambda \right)}\left(2k\pi \right)=\underset{\lambda \to \infty }{\lim }{\phi }_{X\left(\lambda \right)}^{\prime }\left(2k\pi \right)=0,$

it can be deduced that:

$E\left(\lambda ,q,q_1\right)=\frac{\lambda +q_1}{q}-\frac{1}{2}+\frac{1}{2q}\mathrm{and}V\left(\lambda ,q,q_1\right)=\frac{\lambda }{q^2}+\frac{1}{12}-\frac{1}{12q^2}$

in the linear range. Therefore:

$\begin{array}{c}V\left(\lambda ,q,q_1\right)=\frac{\mathrm{qE}\left(\lambda ,q,q_1\right)-q_1+q/2-1/2}{q^2}+\frac{1}{12}-\frac{1}{12q^2}\\ =\frac{E\left(\lambda ,q,q_1\right)}{q}+\frac{q^2+12q_1-6q-7}{12q^2}.\end{array}$

The PQ noise model has two unknown parameters: q and q₁. These unknown parameters can be calibrated by fitting the observed noise data to Eq. (7) above.

Intensity Similarity Measure

The similarity between two intensity observations k and l is often measured by Euclidean distance with an assumption that k and l are true signals, or the noise model being employed is non-biased. Such assumptions, however, do not hold in low-light conditions. In contrast, intensity similarity measure 214 is based on the probability that two intensity observations come from the same source intensity. For the sake of clarity, the intensity similarity measure for the Poisson noise case will be derived before intensity similarity measure 214 for the PQ-noise model 212 is derived. It will be understood that the Poisson noise model can be considered as a special case of the PQ noise model 212 in which the quantization parameters q=q₁=1.

Poisson Noise Case

In the Poisson noise model, when two observed intensities arise from the same intensity distribution, it can be assumed that two observed intensities share the same parameter λ. Given this, the probability of obtaining two observations k and l is

$\begin{array}{cc}P\left(k,l,\lambda \right)=p\left(k,\lambda \right)p\left(l,\lambda \right)=\frac{{\lambda }^{k+l}}{k!l!}{}^{-2\lambda }.& \left(8\right)\end{array}$

Since parameter λ is unknown, the actual probability may not be calculable. However, by viewing the optimal case where λ maximizes the probability, the measure which maximizes the similarity between k and l may be found. This approach corresponds to the ML estimation of the observation of the pair (k,l). Therefore, the optimal {circumflex over (λ)} can be obtained by setting the first derivative to zero:

$\frac{\partial P}{\partial \lambda }=0,$

such that

$\begin{array}{cc}\hat{\lambda }=\frac{k+l}{2},& \left(9\right)\end{array}$

is obtained. Eq. 9 maximizes the probability defined in Eq. (8). In this way, the intensity similarity function can be defined as:

$\begin{array}{cc}\begin{array}{c}d\left(k,l\right)=-\ln \left(P\left(k,l,\hat{\lambda }\right)\right)\\ =\left(k+l\right)\left(1-\ln \left(\frac{k+l}{2}\right)\right)+\ln \left(k!\right)+\ln \left(l!\right).\end{array}& \left(10\right)\end{array}$

This similarity measure does not agree with the exact definition of distance, because d(k,k)>0 if k>0. However, the similarity measure does produce the similarity between two observations.

FIG. 4 illustrates the intensity similarity function defined in Eq. (10) in graphed function 402. Graphed function 402 is similar to the l² norm when two observed intensity levels are high. In fact, when k and l are sufficiently large, d(k,l) has a connection to the squared l² norm. This can be shown by rewriting Eq. (10) with the approximation ln(k!)≈k ln(k)−k:

$\begin{array}{cc}\begin{array}{c}d\left(k,l\right)\approx k\ln \left(k\right)+l\ln \left(l\right)-\left(k+l\right)\ln \left(\frac{k+l}{2}\right)\\ =f\left(k\right)+f\left(l\right)-2f\left(\frac{k+l}{2}\right)\\ \approx \frac{f^{″}\left(\frac{k+l}{2}\right){\left(k-l\right)}^2}{4}\\ \approx \frac{{\left(k-l\right)}^2}{2\left(k+1\right)}.\end{array}& \left(11\right)\end{array}$

Poisson-Quantization Noise Case

Using the derivation in the previous section, the intensity similarity function for the PQ-noise model 212 may be formalized. The joint probability P is defined as the probability of observing k and l having parameters λ_k and λ_l respectively with the quantization Q, by

P(k,l,λ_k,λ₁,Q)=p(k,λ_k,Q)p(l,λ₁,Q),   (12)

Parameter {circumflex over (λ)} (=λ_k=λ_l), which maximizes the probability P, is first determined. This is equivalent to maximizing the probability that two intensity observations share the same intensity source. When λ_k=λ_l, it can be said that P(k,l,λ,Q)=P(k,l,λ_k,λ₁,Q). The optimal {circumflex over (λ)} exists since the logged probability −In P is convex.

Convexity of the logged probability −lnP in Eq. (12) can be shown by the following:

Proposition:

$f\text{:}\lambda \mapsto -\ln \left(\sum _{i=m}^n\frac{{\lambda }^i}{i!}{}^{-\lambda }\right)$

is convex.

Proof

$\begin{array}{c}{f}^{\prime }\left(\lambda \right)=\frac{-\sum _{i=m}^n\left(\frac{{\lambda }^i-1}{\left(i-1\right)}-\frac{{\lambda }^i}{i!}\right){}^{-\lambda }}{\sum \frac{{\lambda }^i}{i!}{}^{-\lambda }}\\ =\frac{\frac{{\lambda }^n}{n!}-\frac{{\lambda }^{m-1}}{\left(m-1\right)!}}{\sum \frac{{\lambda }^i}{i!}}\end{array}$ $\begin{array}{c}{f}^{″}\left(\lambda \right)=\frac{\sum _{i=m}^n\left(\frac{{\lambda }^{n-1}}{\left(n-1\right)!}-\frac{{\lambda }^{m-2}}{\left(m-2\right)!}\right)\frac{{\lambda }^i}{i!}-\left(\frac{{\lambda }^n}{n!}-\frac{{\lambda }^{m-1}}{\left(m-1\right)!}\right)\frac{{\lambda }^{i-1}}{\left(i-1\right)!}}{{\left(\sum \frac{{\lambda }^i}{i!}\right)}^2}\\ =\frac{\sum _{i=m}^n\frac{{\lambda }^{n+i-1}}{n!i!}\left(n-i\right)+\frac{{\lambda }^{m+i-2}}{\left(m-1\right)!i!}\left(i-m+1\right)}{{\left(\sum \frac{{\lambda }^i}{i!}\right)}^2}>0.\end{array}$

Therefore, f is convex.

Returning to the formalization of the intensity similarity function for the PQ-noise model 212:

(1). If k=l, the maximum of P(k,k,λ,Q) is given by

$\begin{array}{cc}\hat{\lambda }={\left(q_k\dots \left(q_{k+1}-1\right)\right)}^{\frac{1}{q_{k+1}-q_k^{-1}}}& \left(13\right)\end{array}$

This can be derived from the first derivation of the function described above in the proof of the convexity of the logged probability −ln P.

(2). If k≠1, the optimal {circumflex over (λ)} may be obtained by minimizing the convex function −lnP. This can be accomplished by describing a simple algorithm for finding the optimal {circumflex over (λ)} with a dichotomic search over the first derivative of P.

Algorithm for finding the optimal {circumflex over (λ)}
Inputs are k,l,qk,qk+1,ql,ql+1 and niter.
Set λmin = 0 and λmax sufficiently big, and n = 0,
While n < niter and P′ ≠ 0
do
Setλ←λmin+λmax2andn←n+1.
Compute                                                                                                                                                              P                        ′                                                              =                                                                  ∂                                                  ln                                                                                (                                                          P                                                                                            (                                                                  k                                  ,                                  l                                  ,                                  λ                                  ,                                  Q                                                                )                                                                                      )                                                                                                                      ∂                        λ
If P′ < 0 set λmin ← λ.
If P′ < 0 set λmax ← λ.
done
Set {circumflex over (λ)}←λ.

The sign of P′ can be determined by computing the sign of:

$\begin{array}{cc}\left(\begin{array}{c}\frac{{\lambda }^{q_{k+1}-1}}{\left(q_{k+1}-1\right)!}-\\ \frac{{\lambda }^{q_k-1}}{\left(q_k-1\right)!}\end{array}\right)\sum _{i=q_l}^{q_{l+1}-1}\frac{{\lambda }^i}{i!}+\left(\begin{array}{c}\frac{{\lambda }^{q_{l+1}-1}}{\left(q_{l+1}-1\right)!}-\\ \frac{{\lambda }^{q_l-1}}{\left(q_l-1\right)!}\end{array}\right)\sum _{i=q_k}^{q_{k+1}-1}\frac{{\lambda }^i}{i!}& \left(A\right)\end{array}$

Alternately, to find the optimal {circumflex over (λ)}, other descent methods such as gradient descent, Newton-Raphson, etc. can also be used.

The intensity similarity function is finally determined by plugging in the optimal {circumflex over (λ)} into the following function using Eqs. (4) and (12):

$\begin{array}{cc}\begin{array}{c}d\left(k,l,Q\right)=\underset{\lambda }{\min }\left\{-\ln \left(P\left(k,l,\lambda ,Q\right)\right)\right\}\\ =-\ln P\left(k,l,\hat{\lambda },Q\right)\\ =-\ln \left\{{}^{-2\hat{\lambda }}\left(\sum _{i=q_k}^{q_{k+1}-1}\frac{{\hat{\lambda }}^i}{i}\right)\left(\sum _{j=q_l}^{q_{l+1}-1}\frac{{\hat{\lambda }}^j}{j!}\right)\right\}\end{array}& \left(14\right)\end{array}$

An Exemplary Procedure to Process Video Content

FIG. 5 a shows an exemplary procedure 500 to create a table of intensity similarity measure. For ease of understanding, the method 500 is delineated as separate steps represented as independent blocks in FIG. 5a; however, these separately delineated steps should not be construed as necessarily order dependent in their performance. Additionally, for discussion purposes, the method 500 is described with reference to elements in FIGS. 1-2. This flow diagram may be implemented in any suitable hardware, software, firmware, or combination thereof. In the case of software and firmware, this diagram represents sets of operations implemented as computer-executable instructions. The left-most digit of a component reference number identifies the particular figure in which the component first appears.

At block 502, image information is received. For example, video information is collected using camera 102, or any other suitable photographic device. Alternately, camera 102, or any other suitable photographic device, can be used to collect several still frames of an object of interest.

At block 504, the image information received at block 502 is accumulated and stored. The accumulation of images can include, for example, a collection of approximately 1000 images. It will also be understood, however, that more or less images may be accumulated at block 504. The accumulation may be stored at any suitable memory device, including memory associated with computer 116, camera 102 or video content analysis engine 108.

At block 506, the accumulated image information stored at block 504 is used to calibrate an uncalibrated Poisson-quantization (PQ) noise model (block 508):

$\begin{array}{cc}p\left(k,\lambda ,Q\right)=\sum _{i=q_k}^{q_{k+1}-1}\frac{{\lambda }^i}{i!}{}^{-\lambda }& \left(4\right)\end{array}$

where the quantization parameter q_k represents the minimum number of electrons which produce an intensity level k. The PQ noise model has two unknown parameters: q and q_l. In practice, q_l does not equal q due to the shift of the function caused by the offset voltage. However, these unknown parameters can be estimated by fitting the observed noise data to Eq. (7) below (block 506):

$\begin{array}{cc}V\left(E,q,q_1\right)=\frac{E}{q}+\frac{q^2+12q_1-6q-7}{12q^2}.& \left(7\right)\end{array}$

Once the parameters q and q_l have been estimated, they are used in conjunction with Eq. 4 to establish a calibrated PQ-noise model with determined parameters q and q_l (block 510).

This calibrated PQ noise model with determined parameters q and q_l (block 512) is then used to establish the intensity similarity measure (block 514). The intensity similarity measure is calculated based on the probability that intensity observations come from the same source intensity. In one implementation, the intensity similarity measure is calculated from an intensity similarity function obeying the formula:

$\begin{array}{cc}\begin{array}{c}d\left(k,l,Q\right)=\underset{\lambda }{\min }\left\{-\ln \left(P\left(k,l,\lambda ,Q\right)\right)\right\}\\ =-\ln P\left(k,l,\hat{\lambda },Q\right)\\ =-\ln \left\{{}^{-2\hat{\lambda }}\left(\sum _{i=q_k}^{q_{k+1}-1}\frac{{\hat{\lambda }}^i}{i}\right)\left(\sum _{j=q_l}^{q_{l+1}-1}\frac{{\hat{\lambda }}^j}{j!}\right)\right\}\end{array}& \left(14\right)\end{array}$

Once calculated, the intensity similarity measure is used to establish an intensity similarity measure table (block 516). When creating an intensity similarity measure table (block 516) the intensity similarity is computed for each combination of observations k and l. Therefore, the table becomes a symmetric square matrix where the number of rows and columns is the number of discrete observations, e.g., when the range of observation is 0-255, the number of rows and columns becomes 256. Once created, the intensity similarity table (block 518) provides an intensity similarity measure for two intensity observations. For instance, when two intensity values k and l are observed, the intensity similarity can be measured by looking up the intensity similarity measure table 518.

An Exemplary Procedure to Process Video Content

FIG. 5 b shows an exemplary procedure 530 to find pixel correspondence between two frames of image information. For ease of understanding, the method 500 is delineated as separate steps represented as independent blocks in FIG. 5b; however, these separately delineated steps should not be construed as necessarily order dependent in their performance. Additionally, for discussion purposes, the method 530 is described with reference to elements in FIGS. 1-2 and 5a. This flow diagram may be implemented in any suitable hardware, software, firmware, or combination thereof In the case of software and firmware, this diagram represents sets of operations implemented as computer-executable instructions. The left-most digit of a component reference number identifies the particular figure in which the component first appears.

Once the table of intensity measure 518 has been created, it may be used to find pixel correspondences between two images. For example, at block 532, image information is received. This image information may be the same image information received at block 502 in method 500, or it may be new image information. Also the image information may include video information collected using camera 102, or any other suitable photographic device. Alternately, in another possible implementation, camera 102, or any other suitable photographic device, can be used to collect several still frames of an object of interest.

At block 534 two frames from either the video information or the collection of still frames are chosen.

At block 536 the two images are compared using the pre-calculated table of intensity similarity measure (block 518), and pixel correspondence between the two frames may be found using block matching optical flow estimation, or any other suitable method known in the art.

An Exemplary Procedure to Create a PQ Noise Model

FIG. 6 shows an exemplary procedure 600 to derive an intensity similarity measure. For ease of understanding, the method 600 is delineated as separate steps represented as independent blocks in FIG. 6; however, these separately delineated steps should not be construed as necessarily order dependent in their performance. Additionally, for discussion purposes, the method 600 is described with reference to elements in FIGS. 1-2. This flow diagram may be implemented in any suitable hardware, software, firmware, or combination thereof In the case of software and firmware, this diagram represents sets of operations implemented as computer-executable instructions. The left-most digit of a component reference number identifies the particular figure in which the component first appears.

Method 600 is used to derive an intensity similarity measure based upon the probability that two intensity observations come from the same source intensity. At block 602, the joint probability P of observing two intensity observations k and l having parameters λ_k and λ_l respectively with the quantization Q, is defined by:

P(k,l,λ_k,λ_l,Q)=p(k,λ_k,Q)p(l,λ_l,Q),   (12)

At block 604, maxima of joint probability P are isolated such that {circumflex over (λ)} (=λ_k=λ_l). This is equivalent to finding maxima in the probability that two intensity observations share the same intensity source. When λ_k=λ_l, it can be said that P(k,l,λ,Q)=P(k,l,λ_k,λ_l,Q). Moreover, since the logged probability −ln P is convex, maxima corresponding to {circumflex over (λ)} exist.

At block 606, intensity observations k and l are observed to determine if they are equal. If so (“yes” path from block 606) then the maxima of P(k,k,λ,Q) is found using the formula:

$\hat{\lambda }=\left(q_k\dots \left(q_{k+1}-1\right)\right)\frac{1}{q_{k+1}-q_k^{-1}}\left(\mathrm{block}608\right).$

Alternately, if at block 606, intensity observations k and l are determined to be unequal (“no” path from block 606), then a dichotomic search over the first derivative of P is conducted to find {circumflex over (λ)} corresponding to minima for the convex function −ln(P) (block 610). In one implementation, the dichotomic search over the first derivative of P is conducted using the following algorithm:

Algorithm for finding the optimal {circumflex over (λ)}
Inputs are k, l, qk, qk+1, q1, q1+1 and niter.
Set λmin = 0 and λmax sufficiently big,
and n = 0 ,
While n < niter and P′ ≠ 0
do
Setλ←λmin+λmax2andn←n+1.
Compute                                                                                                                                                              P                        ′                                                              =                                          -                                                                        ∂                                                      ln                                                                                      (                                                              P                                                                                                  (                                                                      k                                    ,                                    l                                    ,                                    λ                                    ,                                    Q                                                                    )                                                                                            )                                                                                                                                ∂                          λ
If P′ < 0 set λmin ← λ.
If P′ < 0 set λmax ← λ.
done
Set {circumflex over (λ)} ← λ.

Alternately, to find the optimal {circumflex over (λ)}, other descent methods such as gradient descent, Newton-Raphson, etc. can also be used.

The sign of P′ can be determined (block 612) by computing the sign of:

$\begin{array}{cc}\left(\begin{array}{c}\frac{{\lambda }^{q_{k+1}-1}}{\left(q_{k+1}-1\right)!}-\\ \frac{{\lambda }^{q_k-1}}{\left(q_k-1\right)!}\end{array}\right)\sum _{i=q_l}^{q_{l+1}-1}\frac{{\lambda }^i}{i!}+\left(\begin{array}{c}\frac{{\lambda }^{q_{l+1}-1}}{\left(q_{l+1}-1\right)!}-\\ \frac{{\lambda }^{q_l-1}}{\left(q_l-1\right)!}\end{array}\right)\sum _{i=q_k}^{q_{k+1}-1}\frac{{\lambda }^i}{i!}& \left(A\right)\end{array}$

Once the optimal {circumflex over (λ)} is found in block 608, or in blocks 610-612, the optimal value for {circumflex over (λ)} is then used by method 600 to determine the intensity similarity function by plugging the optimal {circumflex over (λ)} into the following function (block 614):

$\begin{array}{cc}\begin{array}{c}d\left(k,l,Q\right)=\underset{\lambda }{\min }\left\{-\ln \left(P\left(k,l,\lambda ,Q\right)\right)\right\}\\ =-\ln P\left(k,l,\hat{\lambda },Q\right)\\ =-\ln \left\{{}^{-2\hat{\lambda }}\left(\sum _{i=q_k}^{q_{k+1}-1}\frac{{\hat{\lambda }}^i}{i}\right)\left(\sum _{j=q_l}^{q_{l+1}-1}\frac{{\hat{\lambda }}^j}{j!}\right)\right\}\end{array}& \left(14\right)\end{array}$

From the intensity similarity function, an intensity similarity measure can be calculated.

An Exemplary Operating Environment

FIG. 7 illustrates an example of a suitable computing environment in which a Poisson-quantization (PQ) noise model can be used to create an intensity similarity measure. Exemplary computing environment 700 is only one example of a suitable computing environment for the exemplary system of FIG. 1, exemplary computing device of FIG. 2, and exemplary operations of FIGS. 5-6, and is not intended to suggest any limitation as to the scope of use or functionality of systems and methods the described herein. Neither should computing environment 700 be interpreted as having any dependency or requirement relating to any one or combination of components illustrated in computing environment 700.

The methods and systems described herein are operational with numerous other general purpose or special purpose computing systems, environments or configurations. Examples of well-known computing systems, environments, and/or configurations that may be suitable for use include, but are not limited to, personal computers, server computers, multiprocessor systems, microprocessor-based systems, network PCs, minicomputers, mainframe computers, distributed computing environments that include any of the above systems or devices, and so on. Compact or subset versions of the framework may also be implemented in clients of limited resources, such as handheld computers, or other computing devices. The invention is practiced in a distributed computing environment where tasks are performed by remote processing devices that are linked through a communications network. In a distributed computing environment, program modules may be located in both local and remote memory storage devices.

With reference to FIG. 7, an exemplary system for calculating an intensity similarity measure based on the PQ noise model includes a general purpose computing device in the form of a computer 710 implementing, for example, computing device 200 of FIG. 2. The following described aspects of computer 710 are exemplary implementations of computing device 200, computer 116, computers 122(1)-122(N) and camera 102. Components of computer 710 may include, but are not limited to, processing unit(s) 720, a system memory 730, and a system bus 721 that couples various system components including the system memory to the processing unit 720. The system bus 721 may be any of several types of bus structures including a memory bus or memory controller, a peripheral bus, and a local bus using any of a variety of bus architectures. By way of example and not limitation, such architectures may include Industry Standard Architecture (ISA) bus, Micro Channel Architecture (MCA) bus, Enhanced ISA (EISA) bus, Video Electronics Standards Association (VESA) local bus, and Peripheral Component Interconnect (PCI) bus also known as Mezzanine bus.

A computer 710 typically includes a variety of computer-readable media. Computer-readable media can be any available media that can be accessed by computer 710 and includes both volatile and nonvolatile media, removable and non-removable media. By way of example, and not limitation, computer-readable media may comprise computer storage media and communication media. Computer storage media includes volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storage of information such as computer-readable instructions, data structures, program modules or other data. Computer storage media includes, but is not limited to, RAM, ROM, EEPROM, flash memory or other memory technology, CD-ROM, digital versatile disks (DVD) or other optical disk storage, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices, or any other medium which can be used to store the desired information and which can be accessed by computer 710.

Communication media typically embodies computer-readable instructions, data structures, program modules or other data in a modulated data signal such as a carrier wave or other transport mechanism, and includes any information delivery media. The term “modulated data signal” means a signal that has one or more of its characteristics set or changed in such a manner as to encode information in the signal. By way of example and not limitation, communication media includes wired media such as a wired network or a direct-wired connection, and wireless media such as acoustic, RF, infrared and other wireless media. Combinations of the any of the above should also be included within the scope of computer-readable media.

System memory 730 includes computer storage media in the form of volatile and/or nonvolatile memory such as read only memory (ROM) 731 and random access memory (RAM) 732. A basic input/output system 733 (BIOS), containing the basic routines that help to transfer information between elements within computer 710, such as during start-up, is typically stored in ROM 731. RAM 732 typically contains data and/or program modules that are immediately accessible to and/or presently being operated on by processing unit 720. By way of example and not limitation, FIG. 7 illustrates operating system 734, application programs 735, other program modules 736, and program data 737.

The computer 710 may also include other removable/non-removable, volatile/nonvolatile computer storage media. By way of example only, FIG. 7 illustrates a hard disk drive 741 that reads from or writes to non-removable, nonvolatile magnetic media, a magnetic disk drive 751 that reads from or writes to a removable, nonvolatile magnetic disk 752, and an optical disk drive 755 that reads from or writes to a removable, nonvolatile optical disk 756 such as a CD ROM or other optical media. Other removable/non-removable, volatile/nonvolatile computer storage media that can be used in the exemplary operating environment include, but are not limited to, magnetic tape cassettes, flash memory cards, digital versatile disks, digital video tape, solid state RAM, solid state ROM, and the like. The hard disk drive 741 is typically connected to the system bus 721 through a non-removable memory interface such as interface 740, and magnetic disk drive 751 and optical disk drive 755 are typically connected to the system bus 721 by a removable memory interface, such as interface 750.

The drives and their associated computer storage media discussed above and illustrated in FIG. 7, provide storage of computer-readable instructions, data structures, program modules and other data for the computer 710. In FIG. 7, for example, hard disk drive 741 is illustrated as storing operating system 744, application programs 745, other program modules 746, and program data 747. Note that these components can either be the same as or different from operating system 734, application programs 735, other program modules 736, and program data 737. Application programs 735 includes, for example program modules of computing devices 102 or 104 of FIG. 1. Program data 737 includes, for example, program data of computing devices 102 or 104 of FIG. 1. Operating system 744, application programs 745, other program modules 746, and program data 747 are given different numbers here to illustrate that they are at least different copies.

A user may enter commands and information into the computer 710 through input devices such as a keyboard 762 and pointing device 761, commonly referred to as a mouse, trackball or touch pad. Other input devices (not shown) may include a microphone, joystick, game pad, satellite dish, scanner, or the like. These and other input devices are often connected to the processing unit 720 through a user input interface 760 that is coupled to the system bus 721, but may be connected by other interface and bus structures, such as a parallel port, game port or a universal serial bus (USB).

A monitor 791 or other type of display device is also connected to the system bus 721 via an interface, such as a video interface 790. In addition to the monitor, computers may also include other peripheral output devices such as printer 796 and audio device(s) 797, which may be connected through an output peripheral interface 795.

The computer 710 operates in a networked environment using logical connections to one or more remote computers, such as a remote computer 780. In one implementation, remote computer 780 represents computing device 102 or networked computer 104 of FIG. 1. The remote computer 780 may be a personal computer, a server, a router, a network PC, a peer device or other common network node, and as a function of its particular implementation, may include many or all of the elements described above relative to the computer 710, although only a memory storage device 781 has been illustrated in FIG. 7. The logical connections depicted in FIG. 7 include a local area network (LAN) 771 and a wide area network (WAN) 773, but may also include other networks. Such networking environments are commonplace in offices, enterprise-wide computer networks, intranets and the Internet.

When used in a LAN networking environment, the computer 710 is connected to the LAN 771 through a network interface or adapter 770. When used in a WAN networking environment, the computer 710 typically includes a modem 772 or other means for establishing communications over the WAN 773, such as the Internet. The modem 772, which may be internal or external, may be connected to the system bus 721 via the user input interface 760, or other appropriate mechanism. In a networked environment, program modules depicted relative to the computer 710, or portions thereof, may be stored in the remote memory storage device. By way of example and not limitation, FIG. 7 illustrates remote application programs 785 as residing on memory device 781. The network connections shown are exemplary and other means of establishing a communications link between the computers may be used.

CONCLUSION

Although the subject matter has been described in language specific to structural features and/or methodological acts, it is to be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or acts described. Rather, the specific features and acts are disclosed as exemplary forms of implementing the claimed invention.

Claims

1. A computer-readable media having computer-program instructions executable by a processor for: receiving image information;generating a Poisson-quantization noise model from a Poisson noise model and a quantization noise model;estimating Poisson-quantization noise in the image information using the Poisson—quantization noise model;determining an intensity similarity function using the Poisson-quantization noise model; andfinding pixel correspondence using the intensity similarity function.

2. The computer-readable media as recited in claim 1, wherein receiving comprises receiving at least two frames of image information.

3. The computer-readable media as recited in claim 1, wherein the Poisson noise model comprises:

4. The computer-readable media as recited in claim 1, wherein the intensity similarity function comprises:

5. The computer-readable media as recited in claim 1, wherein determining comprises finding a maximum joint probability that that two intensity observations k and l share the same intensity source.

6. The computer-readable media as recited in claim 5, wherein finding comprises performing a dichotomic search over the first derivative of the joint probability to find {circumflex over (λ)} corresponding to minima for the convex function −ln(P).

7. The computer-readable media as recited in claim 5, wherein finding comprises one of performing a gradient descent, and performing a Newton-Raphson descent to find the optimal {circumflex over (λ)}.

8. A computing device comprising: a processor; anda memory coupled to the processor, the memory comprising computer-program instructions executable by the processor for:receiving image information;generating a Poisson-quantization noise model from a Poisson noise model and a quantization noise model;estimating Poisson-quantization noise in the image information using the Poisson-quantization noise model;determining an intensity similarity function using the Poisson-quantization noise model; andfinding pixel correspondence using the intensity similarity function.

9. The device of claim 8, wherein receiving comprises receiving at least two frames of image information.

10. The device of claim 8, wherein the Poisson noise model comprises:

11. The device of claim 8, wherein generating comprises combining the Poisson noise model and the quantization noise model.

12. The device of claim 8, wherein the intensity similarity function comprises:

13. The device of claim 8, wherein determining comprises finding a maximum joint probability that two intensity observations k and l share the same intensity source.

14. The device of claim 13, wherein finding comprises performing a dichotomic search over the first derivative of the joint probability to find {circumflex over (λ)} corresponding to minima for the convex function −ln(P).

15. The device of claim 13, wherein finding comprises one of performing a gradient descent, and performing a Newton-Raphson descent to find the optimal {circumflex over (λ)}.

16. A computing device comprising: a processor;a Poisson-quantization noise modeling module executable on the processor to estimate Poisson quantization noise;an intensity similarity measure module executable on the processor to determine an intensity similarity function based on the estimated Poisson quantization noise; anda pixel correspondence module for finding pixel correspondence between image frames based on the intensity similarity function.

17. The computing device of claim 16, wherein the Poisson-quantization noise modeling module estimates Poisson quantization noise using a Poisson-quantization noise model comprising:

18. The computing device of claim 16, wherein the Poisson-quantization noise module estimates quantization parameters for two image frames.

19. The computing device of claim 16, wherein the intensity similarity function comprises:

20. The computing device of claim 16, wherein the computing device is used to improve images in one of night vision, medical imaging, underwater imaging, microscopic imaging and astronomical imaging.