Claims
- 1. A method of processing n digital source images that represent one and the same real scene and have been acquired with different exposure levels, the said images being made up of pixel matrices, each of which is represented by k components that are each associated with a digital value, for obtaining a final digital image with an ample exposure latitude, the method comprising the following sequence of operations:
aligning the source images, constructing a weighted average of the pixels corresponding to all the source images to obtain the corresponding pixels of the final image in accordance with the formula: 4pf_(x,y)=∑i=1n wi(x,y)pi_(x,y)∑i=1n wi(x,y)where {overscore (pf)}(x,y) is the pixel having the coordinates (x, y) in the final image, {overscore (p1)}(x,y), . . . , {overscore (pn)}(x,y) are the corresponding pixels forming part, respectively, of the source images 1, . . . ,n, and w1(x,y), . . . ,wn(x,y) are the weighting coefficients associated, respectively, with the said pixels, characterized in that the weighting coefficients are scalar values and are chosen in an interval of values comprised between a maximum coefficient and a minimum coefficient by carrying out the following sequence of operations:
selecting one and the same component for all the pixels of the source images, the said component being either chosen from among the k possible components or obtained from any linear combination of the said k components, assigning to each pixel of the source images an initial weighting coefficient based on the digital value of the selected component, by using for each image a weighting function that attributes weighting coefficients close to the minimum coefficient to digital values close or equal to the extremes of the range of possible digital values and gradually larger weighting coefficients to digital values forming part of the central regions of the range of possible digital values, selecting in each of the source images a grid that identifies a subset of pixels distributed in a substantially uniform manner over the pixel matrix, subjecting the initial weighting coefficients of the pixels forming part of each selected grid to at least one filtering operation capable of attenuating sudden variations among the initial weighting coefficients of pixels forming part of regions of an image situated close to each other, expanding the filtered weighting coefficients by means of interpolation to obtain estimated filtered weighting coefficients also for the pixels not forming part of the subset identified by the grid, constructing for each pixel a linear combination of the initial weighting coefficient and the filtered weighting coefficient and using the said linear combination as final weighting coefficient for the corresponding pixel of the final image.
- 2. A method in accordance with claim 1, wherein the weighting function is the same for all the source images.
- 3. A method in accordance with claim 1 wherein the source images are associated with different weighting functions of the same type, corresponding to translations of one and the same function of a quantity determined on the basis of the exposure condition of the images.
- 4. A method in accordance with claim 1 wherein the weighting function is of the Gaussian type.
- 5. A method in accordance with claim 1 wherein the weighting function is of the triangular type.
- 6. A method in accordance with claim 1 wherein the filtering of the weights is performed by means of a filter of the Gaussian type.
- 7. A method in accordance with claim 1 wherein the acquired images and the final image are monochromatic digital images, i.e. images in which k=1.
- 8. A method in accordance with claim 1 wherein k=3 and every pixel is a vector of three components that correspond to the primary optical components of the additive chromatic R, G, B synthesis and the component selected for the determination of the weights is the achromatic luminance channel Y obtainable from the linear combination of the components R, G, B in accordance with the formula:
- 9. A method of processing n digital source images in CFA (Color Filter Array) format that represent one and the same real scene and have been acquired with different exposure levels, the said images being made up of pixel matrices, each of which is represented by a digital value that, on the basis of the position of the pixel, is associated with a chromatic component of the red type R or of the green type G or of the blue type B, for obtaining a final digital image in CFA format with an ample exposure latitude, the method comprising the following sequence of operations:
aligning the source images, constructing a weighted average of the pixels corresponding to all the source images to obtain the corresponding pixels of the final image in accordance with the formula: 5pf_(x,y)=∑i=1n wi(x,y)pi_(x,y)∑i=1n wi(x,y)where {overscore (pf)}(X,y) is the pixel having the coordinates (x, y) in the final image, {overscore (p1)}(x,y), . . . ,{overscore (pn)}(x,y) are the corresponding pixels forming part, respectively, of the source images 1, . . . ,n, and w1(x,y), . . . ,wn(X,y) are the weighting coefficients associated, respectively, with the said pixels, characterized in that the weighting coefficients are scalar values and are chosen in an interval of values comprised between a maximum coefficient and a minimum coefficient by carrying out the following sequence of operations:
assigning to all the green pixels of the source images an initial weighting coefficient based on the digital value of the pixel, by using for each image a weighting function that attributes weighting coefficients close to the minimum coefficient to digital values close or equal to the extremes of the range of possible digital values and gradually larger weighting coefficients to digital values forming part of the central regions of the range of possible digital values, associating with the red pixels and the blue pixels an initial weighting coefficient that is either equal to the weighting coefficient of one of the adjacent green pixels or has been obtained from a linear combination of the weighting coefficients of the adjacent green pixels, selecting in each of the source images a grid that identifies a subset of pixels distributed in a substantially uniform manner over the pixel matrix, subjecting the initial weighting coefficients of the green pixels forming part of each selected grid to at least one filtering operation capable of attenuating sudden variations among the initial weighting coefficients of green pixels forming part of regions of an image situated close to each other, expanding the filtered weighting coefficients by means of interpolation to obtain estimated filtered weighting coefficients also for the green pixels not forming part of the subset identified by the grid, and for all the blue or red pixels, constructing for each pixel a linear combination of the initial weighting coefficient and the filtered weighting coefficient and using the said linear combination as final weighting coefficient for the corresponding pixel of the final image.
- 10. A method in accordance with claim 9 wherein the weighting function is the same for all the source images.
- 11. A method in accordance with claim 9 wherein the source images are associated with different weighting functions of the same type, or corresponding to translations of one and the same function of a quantity determined on the basis of the exposure condition of the images.
- 12. A method in accordance with claim 9 wherein the weighting function is of the Gaussian type.
- 13. A method in accordance with claim 9 wherein the weighting function is of the triangular type.
- 14. A method in accordance with claim 9 wherein the filtering of the weights is performed by means of a filter of the Gaussian type.
- 15. A method in accordance with claim 9 wherein the source images are in Bayer CFA format.
- 16. A system for combining digital images, comprising:
an image acquisition circuit operable to acquire at least two images at two different exposure levels, each image comprising a plurality of pixels; and a fusion circuit operable to combine the at least two images by:
determining an initial weighting coefficient for each pixel of each acquired image, determining a grid location for each pixel within a subset of pixels distributed in a substantially uniform manner over each acquired image; attenuating large variations among the initial weighting coefficients of the pixels in the subset of pixels to obtain a filtered weighting coefficient for each pixel within the subset; expanding the filtered weighting coefficients of the pixels in the subset of pixels by means of interpolation to obtain estimated filtered weighting coefficients for each pixel not in the subset of pixels; and constructing a final image wherein each pixel of the final image is a linear combination of the initial weighting coefficient and the filtered weighting coefficient for each pixel in the aquired images.
- 17. The system of claim 16 wherein the weighted average of each pixel is the final image is calculated in accordance with the weighting function:
- 18. The system of claim 16 wherein the initial weighting coefficient is based a weighting function that attributes weighting coefficients close to the minimum coefficient to digital values close or equal to the extremes of the range of possible digital values and gradually larger weighting coefficients to digital values forming part of the central regions of the range of possible digital values.
- 19. The system of claim 16, further comprising an alignment block operable to align the at least two image acquired by the acquisition block.
- 20. The system of claim 16, further comprising an image processing block operable to process the final image into an image format.
- 21. The system of claim 20 wherein the image format is Color Filter Array.
- 22. The system of claim 16 wherein the image acquisition block comprises an optical sensor having photosensitive elements associated with filter elements arranged in a Bayer pattern.
- 23. The system of claim 16, further comprising a scene judgment block operable to determine whether the plurality of images is to be combined.
- 24. The system of claim 16 wherein the initial weighting function is the same for all the source images.
- 25. The system of claim 16 wherein the initial weighting function is of the Gaussian type.
- 26. The system of claim 16 wherein the initial weighting function is of the triangular type.
- 27. The system of claim 16 wherein the at least two images acquired are images of the same scene.
- 28. A method, comprising:
generating a respective first weight for each pixel of multiple acquired images of a scene; generating a respective second weight for each pixel of the multiple acquired images; generating a resulting weight for each pixel of the multiple acquired images from the respective first and second weights of the pixel; weighting each pixel with its resulting weight to generate a respective weighted pixel; and generating a single resulting image by combining corresponding weighted pixels from each image.
- 29. The method of claim 28 wherein generating a respective first weight for each pixel comprises generating the respective first weight based on the brightness of the acquired image that includes the pixel.
- 30. The method of claim 28 wherein generating a respective second weight for each pixel of each acquired image comprises:
generating the respective second weight for each of a subset of pixels that are uniformly distributed over the acquired image; and interpolating the respective second weight for each of the pixels outside of the subset from at least one of the second weights of the pixels within the subset.
- 31. The method of claim 28 wherein generating a resulting weight for each pixel comprises linearly combining the respective first and second weights of the pixel.
- 32. The method of claim 28 wherein weighting each pixel with its resulting weight comprises multiplying the value of each pixel with its resulting weight.
- 33. The method of claim 28 wherein generating a single resulting image comprises summing the corresponding weighted pixels from each of the acquired images and dividing this sum by the sum of the resulting weights for all of the pixels in all of the acquired images.
Priority Claims (1)
Number |
Date |
Country |
Kind |
01830713.2 |
Nov 2001 |
EP |
|
CROSS-REFERENCE To RELATED APPLICATIONS
[0001] The present application claims priority from European patent application No. 01830713.2, filed Nov. 19, 2001, which is incorporated by reference.