Integrated histogram auto adaptive contrast control (ACC)

Abstract

The invention provides for calculating the sum of the luminance values of all pixels in each of a number of regions making up the whole image. A histogram is then created of all the sums of luminance at the end of each frame. The histogram is then rescaled such that the luminance range is normalized. Once the histogram has been created, an appropriate transfer function is created using the integrated luminance histogram for the frame. In this way detail within significant objects in the image are enhanced since the average luminance of objects in an image are weighted more than then the luminance of individual pixels providing a more realistic transfer function.

Description

DESCRIPTION OF DRAWINGS

FIG. 1 shows an example medium-bright image and a histogram for the image, in accordance with an embodiment of the present invention.

FIG. 2 shows an example dark (low-brightness) image and a histogram for the image, in accordance with an embodiment of the present invention.

FIG. 3 shows a transfer curve for enhancing the contrast in such the image shown in FIG. 1.

FIG. 4 shows a transfer curve for enhancing the contrast in such the image shown in FIG. 2.

FIG. 5 graphically illustrate an implementation of the invention.

FIG. 6 shows a flowchart detailing a process for generating a transfer function based upon an integrated luminance histogram in accordance with an embodiment of the invention.

DETAILED DESCRIPTION OF SELECTED EMBODIMENTS

Reference will now be made in detail to a particular embodiment of the invention an example of which is illustrated in the accompanying drawings. While the invention will be described in conjunction with the particular embodiment, it will be understood that it is not intended to limit the invention to the described embodiment. To the contrary, it is intended to cover alternatives, modifications, and equivalents as may be included within the spirit and scope of the invention as defined by the appended claims.

The purpose of the invention is to utilize the somewhat limited luminance range of the LCD to render the source images in the best possible way. The intent is to maximize the amount of visible detail and increase the vividness of the image with minimal addition of artifacts. The invention provides for increasing the contrast for luminance levels that occur in significant areas of the image.

When preparing an image for presentation, for example on a display such as a Liquid Crystal Display (LCD), an Organic Light Emitting Diode (OLED) screen, a Digital Light Processor (DLP), a Cathode Ray Tube (CRT), a plasma panel or other type of display, it is desirable to enhance the contrast of the image by adjusting pixel luminance levels. A transfer curve can be used for describing a mapping between input luminance levels and output luminance levels. Since different images have different luminance histograms, it is desirable to tailor the transfer curve to the particular image at hand in order to obtain optimal contrast enhancement.

The invention provides for calculating the sum of the luminance values of all pixels in each of a number of regions making up the whole image. A histogram is then created of all the sums of luminance at the end of each frame. The histogram is then rescaled such that the luminance range is normalized. For example, the luminance range can be from 16 to 235 for a total of 220 luminance bins where an average value of the bins is 256. Once the histogram has been created, an appropriate transfer function is created using the integrated luminance histogram for the frame. In this way detail within significant objects in the image are enhanced since the average luminance of objects in an image are weighted more than then the luminance of individual pixels providing a more realistic transfer function.

In a particular implementation as shown in FIG. 5, a video frame F_s is divided into regions R_i of M pixels by N pixels for a total of P pixels (i.e., P=M×N) each having a particular luminance value Y_i,j calculated as G(reen)/2 plus R(ed)/4 plus B(lue)/8 (being an approximation to the Y portion of the RGB to YUV conversion) as shown in eq. 1

Y _i,j=(0.257*R_i,j)+(0.504*G_i,j)+(0.098*B_i,j)  (eq. 1)

Once the luminance value for each pixel in a region Ri is calculated, an average value of all the luminance values of all the pixels in the region Ri is then calculated using equation (2):

$\begin{array}{cc}{Y}_{\mathrm{reg}}=\sum _{i,j=1}^{M,N}Y_{i,j}/\left(M\times N\right)& \left(\mathrm{eq}.2\right)\end{array}$

An integrated luminance histogram H_int for the video frame F_s is then generated using the integrated luminance values Y_reg from which a transfer function T_s is provided and applied on a frame by frame basis according to the process 600 described below.

FIG. 6 shows a flowchart detailing a process 600 in accordance with an embodiment of the invention. The process 600 begins at 602 by receiving a video frame in the form of pixel data. If, at 604, the pixel data is not YUV format, that the pixel data is converted to YUV format at 606. In any case, at 608, the video frame is split into a number of regions while at 610, a luminance value for each region is calculated based upon a summation of all pixel luminance values for each of the regions. At 612, a luminance histogram is generated that includes all regions. Next, at 614 a histogram difference value is generated by taking a difference between a particular histogram value and a flat histogram value of one (“1”). At 616, the histogram difference value is then multiplied by a strength factor S_F which is then added back to the flat value. In this way, the histogram is conditioned such that a strength value of zero (“0”) results in a flat line whereas a strength value of one (“1”) results in the original histogram. At 618, the conditioned histogram values are then limited (thereby limiting the maximum slope at any point in the final transfer function) such that any histogram values above the limit are added back into the histogram by sharing them evenly. At 620, a transfer function is created by integrating the conditioned histogram by starting the transfer function at a value of 0 and then for each subsequent position, add in the corresponding value from the histogram such that a flat line histogram would give a straight line transfer function (where output values would equal input values). The transfer function is then applied at 622.

It should be noted that in the described embodiment, the transfer function is updated every frame such that if sufficient memory is available (such as a frame buffer) the updated transfer function can be applied to the frame from which the transfer function was generated. Otherwise, if sufficient memory is not available, then the updated transfer function can be applied an appropriate number of frames subsequent to the frame from which it was generated (such as one or two frames later).

Embodiments of the invention, including the apparatus disclosed herein, can be implemented in digital electronic circuitry, or in computer hardware, firmware, software, or in combinations of them. Apparatus embodiments of the invention can be implemented in a computer program product tangibly embodied in a machine-readable storage device for execution by a programmable processor; and method steps of the invention can be performed by a programmable processor executing a program of instructions to perform functions of the invention by operating on input data and generating output. Embodiments of the invention can be implemented advantageously in one or more computer programs that are executable on a programmable system including at least one programmable processor coupled to receive data and instructions from, and to transmit data and instructions to, a data storage system, at least one input device, and at least one output device. Each computer program can be implemented in a high-level procedural or object-oriented programming language, or in assembly or machine language if desired; and in any case, the language can be a compiled or interpreted language.

Suitable processors include, by way of example, both general and special purpose microprocessors. Generally, a processor will receive instructions and data from a read-only memory and/or a random access memory. Generally, a computer will include one or more mass storage devices for storing data files; such devices include magnetic disks, such as internal hard disks and removable disks; magneto-optical disks; and optical disks. Storage devices suitable for tangibly embodying computer program instructions and data include all forms of non-volatile memory, including by way of example semiconductor memory devices, such as EPROM, EEPROM, and flash memory devices; magnetic disks such as internal hard disks and removable disks; magneto-optical disks; and CD-ROM disks. Any of the foregoing can be supplemented by, or incorporated in, ASICs (application-specific integrated circuits).

A number of implementations of the invention have been described. Nevertheless, it will be understood that various modifications may be made without departing from the spirit and scope of the invention. Accordingly, other embodiments are within the scope of the following claims.

Claims

1. A method of adaptive contrast control, comprising: receiving video frame formed of a plurality of pixels each having associated pixel data;generating an integrated luminance histogram for the received video frame data;generating a transfer function in accordance with the integrated luminance histogram; andupdating the video frame data using the transfer function.

2. A method as recited in claim 1, wherein generating the integrated luminance histogram, comprises; splitting the video frame into a number of regions each having approximately the same number of pixels;generating a luminance value for each of the pixels for each region;summing the luminance values for the pixels in each region;dividing the summed luminance value for each region by the number of pixels in each region to generate a region luminance value; andgenerating the integrated luminance histogram using the region luminance values for the video frame.

3. A method as recited in claim 1, further comprising; providing a pixel luminance value Yi,j for a pixel Pij according to Yi,j=(0.257*Ri,j)+(0.504*Gi,j)+(0.098*Bi,j) where Ri,j, Gi,j, Bi,j, are RGB color components for a pixel Pij.

4. A method as recited in claim 1, further comprising: scaling the integrated luminance histogram.

5. A method as recited in claim 1, further comprising displaying the updated video frame on a display.

6. A method as recited in claim 5, wherein the display is selected from the group that includes an LCD screen, an OLED screen, a DLP screen, a CRT and a plasma panel.

7. Computer program product executable by a computer processor for adaptive contrast control, comprising: computer code for receiving video frame formed of a plurality of pixels each having associated pixel data;computer code for generating an integrated luminance histogram for the received video frame data;computer code for generating a transfer function in accordance with the integrated luminance histogram;computer code for updating the video frame data using the transfer function; andcomputer readable medium for storing the computer code.

8. Computer program product as recited in claim 7, wherein generating the integrated luminance histogram, comprises; computer code for splitting the video frame into a number of regions each having approximately the same number of pixels;computer code for generating a luminance value for each of the pixels for each region;computer code for summing the luminance values for the pixels in each region;computer code for dividing the summed luminance value for each region by the number of pixels in each region to generate a region luminance value; andcomputer code for generating the integrated luminance histogram using the region luminance values for the video frame.

9. Computer program product as recited in claim 7, further comprising; computer code for providing a pixel luminance value Yi,j for a pixel Pij according to Yi,j=(0.257*Ri,j)+(0.504*Gi,j)+(0.098*Bi,j) where Ri,j, Gi,j, Bi,j, are RGB color components for a pixel Pij.

10. Computer program product as recited in claim 7, further comprising: computer code for scaling the integrated luminance histogram.

11. Computer program product as recited in claim 7, further comprising computer code for displaying the updated video frame on a display.

12. Computer program product as recited in claim 11, wherein the display is selected from the group that includes an LCD screen, an OLED screen, a DLP screen, a CRT and a plasma panel.

13. An apparatus for providing adaptive contrast control, comprising: an interface arranged to receive a video frame formed of a plurality of pixels each having associated pixel data;a histogram generator for generating an integrated luminance histogram for the received video frame data;a transfer function generator for generating a transfer function in accordance with the integrated luminance histogram; anda means for updating the video frame data using the transfer function.

14. An apparatus as recited in claim 13, wherein generating the integrated luminance histogram, comprises; means for splitting the video frame into a number of regions each having approximately the same number of pixels;means for generating a luminance value for each of the pixels for each region;means for summing the luminance values for the pixels in each region;means for dividing the summed luminance value for each region by the number of pixels in each region to generate a region luminance value; andmeans for generating the integrated luminance histogram using the region luminance values for the video frame.

15. An apparatus as recited in claim 13, further comprising; means for providing a pixel luminance value Yi,j for a pixel Pij according to Yi,j=(0.257*Ri,j)+(0.504*Gi,j)+(0.098*Bi,j) where Ri,j, Gi,j, Bi,j, are RGB color components for a pixel Pij.

16. An apparatus as recited in claim 13, further comprising: means for scaling the integrated luminance histogram.

17. An apparatus as recited in claim 13, further comprising: means for displaying the updated video frame on a display.

18. An apparatus as recited in claim 17, wherein the display is selected from the group that includes an LCD screen, an OLED screen, a DLP screen, a CRT and a plasma panel.