The present invention relates to emissive displays that receive high-dynamic range signals for display and provide an expanded luminance and dynamic range for such signals.
Most image systems attempt to render scenes with respect to a reference point, which is often specified in terms of a specific chromaticity position and peak luminance. One such reference point is the white point of the display, although other reference values can be used. Rendering scenes to a display in this way permits the image to be rendered using a relative specification rather than rendering a scene to absolute scene luminance values.
Generally, rendering a scene in terms of relative values results in images with high-perceived quality because the human visual system adapts to its environment and is therefore much better at determining relative, rather than absolute luminance values. This ability to use such a relative rendering process is very important in the imaging industry as it permits high-quality images to be produced in systems that are capable of presenting the human eye with a much smaller range of luminance values than exist in real world scenes. Thus, high quality images can be rendered on display systems that provide a much smaller range of luminance values than exist in real world environments. However, the image quality of rendered images on an electronic display can be improved by properly rendering high-dynamic-range images on displays capable of producing a larger range of luminance values than those produced by typical video display systems
Today, most image-capture systems attempt to define a reference point, such as an 18% gray card illuminated by a source simulating a standard illuminant, such as CIE standard illuminant D65. This 18% gray card is then often assumed to have a perceived lightness value, specified in terms of CIE LAB L*, of about 50, meaning that it has a perceived lightness of about 50% of the white point luminance defined by a the luminance of perfect white diffuser illuminated with the same illumination as the 18% gray card reference within the scene that is being captured. The luminance and chromaticity coordinates of this perfect white diffuser within the ambient viewing environment, referred to as the scene reference white point, infers the white point within the imaging system. It is possible, however, for scenes to contain objects having luminance values that are higher than the luminance value of the scene reference white point and these higher luminance objects should, therefore, be rendered with L* values greater than 100. That is to say, that an output device, such as an electronic display, should display these objects to have higher luminance values than the luminance value at which the scene reference white point is displayed.
Several conditions can occur in natural scenes which result in L* values greater than 100. For example, backlit, fluorescent, and self-luminous objects within a scene can have higher luminance values than the scene reference white point. For example, the sun within a sunrise or sunset picture can have luminance values in excess of 50 times the luminance of a reference white within that scene. The direction of light can also produce scene luminance values greater than the scene reference white point as directional, e.g. specular, reflections, can be significantly higher in luminance than diffuse reflections. Similarly, these reflections can be 50 or more times greater than the scene reference white point. Further, many scenes can be illuminated by multiple illumination sources having different intensities or portions of scenes can be shaded. When the capture system selects the scene reference white point relative to a portion of the scene that is illuminated with a lower intensity, other areas of the scene, which are illuminated at a higher intensity, can contain many luminance values greater than luminance of the scene reference white point.
Traditional display systems are not only incapable of producing the full luminance range that occurs in natural scenes, but typically can not produce the dynamic range (i.e., ratio of maximum scene luminance to minimum scene luminance) that occurs in natural scenes, regardless of absolute luminance. Therefore, the system designer must decide how to compress the dynamic range of the scene to provide a pleasing rendition. Typically, this is accomplished by compressing the log of the scene luminance range into a smaller log luminance range on the final display as log luminance provides a better indication of perceived brightness. This rendition often assigns a significantly different average luminance to the displayed image than the average scene luminance, by rendering the average log scene luminance near the average log display luminance. Further, this rendering typically reduces the slope of the function relating log scene luminance to log display luminance through a rendering curve. This rendering curve is not linear but instead typically has a much lower slope in the region that corresponds to both the high and low luminance areas of the original scene. These regions of lower slope will be referred to as highlight and shadow regions, respectively. This is typically the most desired rendition as it permits objects having log scene luminance values near the average log scene luminance to be differentiated in the rendered scene but forces a large range of original log scene luminance values to be rendered within a relatively small log luminance range on the display. This rendering is typically desired, since for the average image, a small percentage of the spatial area of the image having high dynamic range is rendered into these highlight and shadow regions. However, displaying the information within the highlight regions of an image can significantly improve the appearance of a displayed image. Therefore many data encoding standards permit the encoding of information that have L* values greater than 100. For example, ITUR BT709-5 specifies an encoding from scene luminance to camera code values for the motion picture industry. Such an image encoding method is represented by the curve 2 shown in
Two approaches or a blend of these two approaches have been taken when rendering these images to a traditional display. The first of these is to map the reference scene white point, often represented by a relative scene luminance value of 1.0, to the reference white point of the display. Using this approach, code value 247 can be mapped to the white point of the display, permitting the code values between 0 and 247 to be rendered with relatively high luminance. Unfortunately, the luminance of all of the code values above 247 will be clipped to the luminance of the display reference white point since the display is incapable of displaying code values above 247 with a higher luminance. This rendering approach results in a loss of information for all objects having scene luminance values higher than the scene luminance value of the reference perfect white diffuser, which reduces the image quality of the resulting image. Alternatively, the maximum relative scene luminance value provided within the encoding scheme can be mapped to the reference white point of the display, rendering the scene reference white point to a lower luminance than the reference white point of the display. Using this approach, the image will have an overall lower average luminance, sometimes resulting in lower perceived image quality.
Recently, high-dynamic-range displays have been demonstrated as discussed by Whitehead et al. in U.S. Pat. No. 7,106,505, entitled “High Dynamic Range Display Devices”. These displays can provide a dynamic range of 10,000:1 or better and can often produce white luminance values of 1000 cd/m2 or more. These displays enable images to be displayed with a much higher dynamic range than in traditional CRT, LCD, or Plasma displays that typically have dark-room contrast values of less than 1000:1 and rarely have white points above 500 cd/m2. Unfortunately, the displays that have been demonstrated in this category to date are constructed from pairs of light modulators. These can include serial pairs of light blocking modulators such as LCDs or an addressable light source in combination with a light blocking modulator. In the direct-view-display market, such displays employing a high-density array of individually addressable, discrete, inorganic LEDs to backlight an LCD panel have been demonstrated. Forming such high-density arrays of discrete, inorganic LEDs is very process intensive and therefore very expensive. Further, electronics to permit these LEDs to be addressed independently also add significant cost to the overall display, making such displays too expensive to employ in the consumer marketplace. The same is true of other configurations that require multiple light modulators for serially blocking portions of the light from a less expensive uniform light source since the light modulators themselves are typically the most expensive component of any conventional display device.
Emissive displays, including coatable electroluminescent (EL) display technologies are also known in the art. Such coatable EL displays include an EL layer formed between a two-dimensional array of addressable electrodes. These devices can include EL layers employing purely organic small-molecule or polymeric materials, typically including organic hole-transport, organic light-emitting and organic electron-transport layers as described in the prior art, including U.S. Pat. No. 4,769,292, issued Sep. 6, 1988 to Tang et al., and U.S. Pat. No. 5,061,569, issued Oct. 29, 1991 to VanSlyke et al. The EL layer can alternately be formed from a combination of organic and inorganic materials, typically including organic hole-transport and electron-transport layers in combination with inorganic light-emitting layers, such as the light-emitting layers described in U.S. Pat. No. 6,861,155 issued Mar. 1, 2005 to Bawendi et al. Alternately, the EL layer can be formed from fully inorganic materials such as the devices described in co-pending U.S. Patent Application Publication No. 2007/0057263, published Mar. 15, 2007, entitled, “Quantum Dot Light Emitting Layer”.
Coatable EL displays, being emissive displays, are capable of providing very low luminance blacks and can, therefore, have dynamic range values of 10,000:1 or more as measured using standard ANSI contrast measurements. However, because they are emissive displays, they tend to draw more power when rendering scenes to a high-luminance white point and the use of these high-luminance white points often limits the lifetime of the display. For this reason, luminance values above 500 nits are almost never applied. It is known, however, to create OLED displays having higher efficiencies by adding additional, higher efficiency emitters to the traditional RGB emitters typically employed in displays. Such displays have been discussed by Burroughes in U.S. Pat. No. 6,693,611, issued Feb. 17, 2004 and entitled “Display Devices” and Miller et al. in U.S. Pat. No. 7,230,594, issued Jun. 12, 2007 and entitled “Color OLED Display With Improved Power Efficiency”. One such format of OLED that is desirable from a manufacturing perspective is the format discussed by Miller et al., which permits the OLED display to be formed from a blanket white emitter with subpixels, including red, green, and blue color filters, as well as subpixels that are not filtered to produce red, green, blue, and white subpixels. To produce accurate color in these displays the peak luminance of the white color channel is typically defined to be about equal to the sum of the peak luminance values for the RGB subpixels when they are balanced to achieve the color of the peak white emitter. This same constraint must be applied, however, regardless of the color of any additional primaries, if accurate color rendition is required for all possible rendered colors or the peak luminance values of any of these subpixels.
Prior art in the OLED or LCD field describes rendering images to displays having more than three colors of subpixels to increase the luminance of the display. However, these approaches tend to produce color errors for all colors displayed on such displays. For example, Lee et al, in TFT-LCD with RGBW color system, SID 03 Digest 1212 2003 discuss a transformation method for LCDs having red, green, blue and additional white subpixel. In this method, luminance from an additional white subpixel is added to every color, resulting in an image in which every color is desaturated. Wang et al. in a paper entitled “Trade-off between luminance and color in RGBW displays for mobile-phone usage”, SID 07 Digest 1143-1145 2007 also discusses the problem of desaturating the content of the image in displays having more than four primaries, specifically red, green, blue and white primaries, and several methods of converting from a three-color input signal to a four or-more-color output signal for an LCD that results in various levels of image desaturation. Langendijk et al. also discuss desaturation in such displays in a paper entitled “Dynamic Wide-Color-Gamut RGBW Display” published in SID 07 Digest, 1458-1461, 2007. This paper also describes an expensive method for partially overcoming the problem in backlit LCDs wherein the color of the backlight is adjusted on an image-by-image basis to attempt to increase the effective color gamut of the display. Each of these methods add luminance from the white subpixel to the luminance produced by the red, green, and blue subpixels such that all or practically all colors rendered on the display are desaturated, often to the point that a lower-luminance, higher-saturation display is preferred to a display using such a rendering process for at least some images. However, these authors do not discuss the rendering of high-dynamic-range content on these displays and these displays are incapable of producing high-dynamic-range images due to the lack of extended bit depth beyond 8 bits and the inability of LCDs to produce dark enough blacks to achieve dynamic-range values above 1000.
In the OLED display art, it is recognized that the constraints are different for emissive displays than for LCDs as the emissive displays only use power to produce light, rather than modulating light from a backlight that consumes power regardless of the state of the modulator. Murdoch et al. in U.S. Pat. No. 6,897,876, published May 24, 2005 and entitled “Method For Transforming Three Color Input Signals To Four Or More Output Signals For A Color Display” discuss subtracting a portion of the signal from the RGB input signals and assigning this to drive an additional primary to provide a signal for driving a four-or-more-color display in a way that does not produce color error. However, to provide a signal for increasing the luminance of the display, this patent discusses adding different proportions of the subtracted portion to drive the additional primary than is subtracted from the RGB drive signals. As such, color error can be introduced for practically all colors, with the possible exception of fully-saturated colors. Also in the OLED display art, Boroson et al. in U.S. Patent Application Publication 2007/0139437 entitled “OLED Display With Improved Power Performance” describes a display and an image processing method in which the sum of the gamut-defining pixel peak luminance values (e.g., the peak luminance of the red, green, and blue subpixels), is less than the display peak luminance and wherein at least a portion of the display peak luminance is formed from a within-gamut pixel. As described, this higher display peak luminance is achieved by either desaturating the input image data for all colors or by limiting the peak red, green, and blue luminance values, reducing the luminance of the saturated colors. As described, the display peak luminance will typically be only slightly higher than the gamut-defining pixel peak luminance values, with all examples providing a display peak luminance less than 1.5 times higher than the sum of the peak red, green, and blue luminance values.
Therefore, a display is needed that is capable of producing higher dynamic-range images with higher peak-brightness values. Ideally, such a display would provide a dynamic range greater than 10,000:1 on a pixel-by-pixel basis with a peak luminance of 1000 cd/m2 or greater. Such a display would ideally render images with accurate color and yet permit colors that are higher in luminance than the luminance of the reference white diffuser to be rendered with a luminance that is higher than the luminance of the display white point.
One aspect of the present invention includes a method of controlling an electroluminescent display system that receives a three-component input image signal having triplets of intensity values, the intensity values having at least an image intensity range and a highlight intensity range, the smallest intensity value of the highlight range being greater than the greatest intensity value of the image range, including:
(a) providing a plurality of light-emitting elements for emitting red, green, and blue light and at least one additional light-emitting element for emitting at least one additional color of light, the luminance of the emitted light being responsive to a current provided to each light-emitting element; and
(b) controlling the current to each light-emitting element to cause each light-emitting element to produce a corresponding luminance value, wherein the corresponding luminance value of the at least one additional light-emitting element is greater than the corresponding luminance value of at least one of the red, green, or blue light-emitting elements at the same current;
(c) transforming the received three-component input image signal to a four-or-more-component drive signal and providing the four-or-more-component drive signal to control the current to each light-emitting element; and
The present invention improves the dynamic range and peak luminance of electroluminescent displays to permit high dynamic range image content to be displayed without significantly increasing the power consumption of the display. These benefits are provided without making dramatic or expensive modification to known display structures.
The need is met by providing a method of controlling an electroluminescent display system that receives a three-component input image signal having a triplet of intensity values and transforming the three-component input image signal to a four-or-more-component drive signal for driving an EL display having red, green, and blue light-emitting elements and at least one additional light-emitting element to produce a high-luminance, high-dynamic-range image. The method of the present invention includes the steps shown in
As shown in
In at least some embodiments, the one or more additional light-emitting elements are capable of providing light that is within the gamut defined by chromaticity coordinates of the light emitted by the red, green, and blue light-emitting element and specifically is near the display white point. By stating that the chromaticity coordinates are near the chromaticity coordinates of the display white point, it is implied that if one additional light-emitting element is provided, it will have chromaticity coordinates that are within a distance of 0.1 units in the 1976 CIE uniform chromaticity scale diagram of the chromaticity coordinates of the display white point. If more than one additional light-emitting element is provided then a line or area formed by connecting the chromaticity coordinates of these light-emitting elements will include chromaticity coordinates that are within 0.1 units in the 1976 CIE uniform chromaticity scale diagram of the chromaticity coordinates of the display white point. The display white point is defined as the color that is created by providing equal red, green, and blue three-component color signal values to the display.
The ability to create light that is near the display white point can be important since specular reflections have been shown to have chromaticity coordinates nearly equal to the chromaticity coordinates of the illumination source, which is often rendered to match the display white point. Further, it is known that objects illuminated by higher intensity illumination sources often are lower in saturation than objects illuminated by lower intensity illumination sources and therefore have chromaticity coordinates inside the color gamut of objects in the image range. For each of these reasons, the distribution of chromaticity coordinates for objects having scene luminance values greater than the luminance of the scene reference white point, can be expected to be biased towards the display white point, that is, they can be expected to be less saturated in color and nearer the display white point than objects having scene luminance values lower than the luminance of the scene reference white point. This can be particularly true for objects having scene luminance values that are significantly higher than the luminance of the scene reference white point since specular reflections will often produce luminance values that are much higher than luminance of the scene reference white point.
To fully appreciate this method, it is useful to discuss a typical display system in which this method can be applied. One such system is shown in
The display additionally includes one or more circuits 50, 52, 54, and 56 for controlling the current to each light-emitting element 42, 44, 46, 48. Each circuit provides a corresponding current to each light-emitting element 42, 44, 46, 48 to cause each light-emitting element 42, 44, 46, 48 to produce a corresponding luminance value. Within this invention, the corresponding luminance value of the at least one additional light-emitting element 48 within the display 14 is greater than the corresponding luminance value of at least one of the red, green, or blue light-emitting elements at the same current. As will be discussed in more detail later, the voltage on a capacitor 64, the current and voltage on a power line 68 and the physical characteristics of a power TFT 66 primarily determine the current provided to each light-emitting element.
Within this disclosure the terms “corresponding current” and “corresponding luminance” are applied. Corresponding currents for the red 42, green 44, and blue 46 light-emitting elements are the currents that are required to drive the light-emitting elements 42, 44, and 46 to provide the reference white point of the display (i.e., the luminance and chromaticity coordinates of the display white point). In some display configurations, the corresponding currents for the red 42, green 44, and blue 46 light-emitting elements will be the maximum current that can be provided to these light-emitting elements. However, it is not required that these currents be at their maximum but will be the currents required to drive the display in response to a signal corresponding to a perfect white diffuser within the scene (i.e., signals corresponding to an input intensity of 1). The corresponding current of the additional light-emitting element is equal to the minimum of the corresponding currents of the red 42, green 44, or blue 46 light-emitting elements. The corresponding luminance is the luminance that is produced by either the light-emitting element or a sum of the individual light-emitting elements in response to the corresponding currents of one or all of the light-emitting elements.
Referring back to
Within this disclosure, the terms “image range” and “highlight range” each refer to disjoint combinations of intensity values. Generally, the image range will include triplets of intensity values in which each of the red, green, and blue intensity values are less than or equal to the red, green and blue intensity values that are used to form a color at the display white point (i.e., the intensity values at which a perfect white diffuser within a captured scene is rendered). The highlight range typically will include triplets of intensity values in which at least one of the red, green, and blue intensity values are greater than the red, green, and blue intensity values that are used to form a color at the display white point.
This EL display system 12 can provide a dynamic range greater than 100,000:1 on a pixel-by-pixel basis with a peak luminance of 1000 cd/m2 or greater. As will be discussed in more detail, this is accomplished by employing the redundancy provided by the at least one additional light-emitting element 48 to provide higher luminance values than could be achieved by combining the light output of the red 42, green 44, and blue 46 light-emitting elements, thus increasing the dynamic range of the display. When a high-dynamic-range signal is input to the display system as the three-component input image signal 22, a perfect white diffuser within the original scene can be rendered using corresponding currents for the red 42, green 44, and blue 46 light-emitting elements, resulting in corresponding luminance values that will typically be near the sum of the maximum luminance values of the red, green and blue light-emitting elements. Therefore, triplets representing lower luminance objects in the original scene than a perfect white diffuser (i.e., the triplets having an intensity value within the image intensity range), will generally be rendered to luminance values lower than the corresponding luminance values of the red, green and blue light-emitting elements. Further, triplets representing higher luminance objects in the original scene than a perfect white diffuser (i.e., the triplets having an intensity value within the highlight range) will generally be rendered to luminance values higher than the corresponding luminance, which will typically be near the sum of the maximum luminance values of the red, green and blue light-emitting elements.
In some embodiments, the corresponding luminance value of the at least one additional light-emitting element 48 is greater than the sum of the corresponding luminance values of the red 42, green 44, and blue 46 light-emitting elements (i.e., the corresponding luminance of at least one additional light-emitting element 48 will be higher than the luminance of the display white point). As such this at least one additional light-emitting element 48 can be used to provide substantial increases in the dynamic range of the display. In fact, it can be desirable for the sum of the maximum luminance values for the additional light-emitting elements 48 within the display 14 to be more than 2 or 3 times the sum of the corresponding luminance values for all of the red 42, green 44, and blue 46 light-emitting elements within the display.
The present invention can be illustrated through a specific example. In this example, the display system 12, shown in
In the present example, the display 14 is an active-matrix display, such as illustrated by the portion of an n-channel active matrix display shown in
In this display, the maximum current that can be provided from the power line 68 to the light-emitting element 42 is limited to a maximum value. This maximum value can be influenced by factors, including the maximum voltage range that the column driver 18 can provide at the select TFT 58, the time that is provided to charge the capacitor 64 and the size and mobility of the power TFT 66. However, independent of the limiting factor, each light-emitting element 42, 44, 46, and 48 within the display 14 will provide a maximum luminance in response to the maximum digital value of the four-or-more-component drive signal 30 provided by the digital signal processor 20 to the column driver 18. Therefore, in the current example, the electroluminescent display is an active-matrix display and a circuit is associated with each light-emitting element to provide a maximum current to each light-emitting element to cause each light-emitting element to produce a maximum luminance value. The corresponding current for each light-emitting element must, therefore, be equal to or less than the maximum current that can be provided to each light-emitting element. Often, the corresponding current for at least one of the red 42, green 44, or blue 46 light-emitting elements will equal the maximum current for the respective light-emitting element to minimize the voltage and maximize the power efficiency of the display.
In the present example, the light-emitting elements of the display 14 will include red 42, green 44, and blue 46 light-emitting elements for emitting red, green, and blue light. The display will additionally include at least one additional light-emitting element 48 for emitting white light. That is, the additional light-emitting element 48 emits substantially white light.
As shown in
In this example, it will further be assumed that the minimum luminance that can be produced by the sum of the light from all four light-emitting elements 42, 44, 46, 48 will be 0.010 cd/m2 when measured in a dark room, a value that is also typical for an organic light-emitting display with this structure. Thus when the white light-emitting elements are driven at their maximum luminance values, the white color channel alone will have a dynamic range of 100,000:1. Although displays are known in the art having red 42, green 44, blue 46 and at least one additional light-emitting element 48, the additional light-emitting element found in the prior-art typically does not produce significantly higher luminance values than each of the other light-emitting elements and seldom is capable of producing luminance values greater than the sum of the maximum luminance of the red 42, green 44, and blue 46 light-emitting elements. Therefore, the dynamic range of prior-art displays is defined by the ratio of the combined red, green, and blue corresponding luminance values and the black level. That is, corresponding displays of the prior art typically have a dynamic range of approximately 445 cd/m2:0.010 cd/m2 or around 45,000:1. It is notable that in the design shown, the color filters on the red, green, and blue light-emitting elements provide very saturated colors, while the white light-emitting element is unfiltered and thus retains a very high efficiency. Therefore, the efficiency of the at least one additional light-emitting element is significantly greater than the efficiency of the red, green, and blue light-emitting elements.
It should further be noted that prior-art displays are not driven to produce luminance values that are 2 times the sum of the corresponding luminance of the red 42, green 44, and blue 46 light-emitting elements because such a drive scheme using transform techniques known in the art result in desaturated images that significantly reduce image quality. However, it has been observed that the present invention is particularly advantaged when maximum luminance value of the at least one additional light-emitting element 40, (the white light-emitting element in this example) is several multiples of the sum of the corresponding luminance values of the red 42, green 44, and blue 46 light-emitting elements. When comparing the maximum luminance value of the additional light-emitting element 48 to the sum of the corresponding luminance values of the red 42, green 44 and blue 46 light-emitting elements, it is not necessary that the maximum luminance produced by individual light-emitting elements fulfill this criterion but that the average luminance produced by the display when driving each of the light-emitting elements 42, 44, 46, 48 in the display 14 to their maximum value fulfill this criterion.
Several design modifications can be made to the display to further increase the ratio of the maximum luminance of the light produced by the one or more additional light-emitting elements to the sum of the corresponding luminance values of the red, green, and blue light-emitting elements. These design modifications include forming a larger number of the one or more additional light-emitting elements 48 than red 42, green 44, or blue 46 light-emitting elements within the display 14 and designing the circuit 56 for driving the one or more additional light-emitting elements 48 to provide a higher maximum current than the maximum current provided by the circuits 50, 52, 54 for driving the red 42, green 44, or blue 46 light-emitting elements. For example, the area of the additional light-emitting element 48 can be larger than the area of the other light-emitting elements or the size of the power transistor can be larger than the driving transistors of the other light-emitting elements. As shown, when the transform step 86 of the present invention is applied in this display at least one triplet of image signal values can be rendered to have a luminance that is at least 2 times higher than the sum of the corresponding luminance values of the red 42, green 44, and blue 46 light-emitting elements.
In the display system 12 as shown in
In this example, the digital signal processor 20 will receive a three-component input image signal for the bar harbor sunrise scene as described and provided at: http://www.cis.rit.edu/fairchild/HDRPS/Scenes/BarHarborSunrise.html. This three-component input image signal includes scaled XYZ tristimulus values for each pixel location within the BarHarborSunrise image. The digital signal processor 20 will then transform (step 86 in
The transform step 82 will generally include the steps shown in
To complete the determine tone scale step 140 of
The minimum normalized log scene luminance value is then computed (step 160). For this example, this value is −4.87 for the Bar Harbor scene of this example. A cumulative histogram is then formed (step 162) for the entire range of normalized base 10 logarithms of the luminance values from the minimum value to 0. The cumulative probability values are then scaled (step 164) to cover the entire log luminance range of the scene, thus providing an input to output relationship for log luminance values and providing a base tone scale. The resulting curve for the input image is shown as 180 in
The luminance values in the input image signal can then be mapped through the tone scale according to step 142 in
Once step 142 of
After application of this matrix, the three-component input image signal is then normalized to provide relative RGB intensity values by dividing each of the values by the result of the value that is obtained for the white point of the display with a relative log luminance of 0. The minimum of the RGB intensity values within each triplet of values corresponding to a pixel in an image is determined. This minimum value is subtracted from each RGB value and is assigned to the fourth channel to serve as the white component in the four-component signal concluding step 144 within
Referring again to
As shown in
At least one threshold value (T) is defined (step 202), which is the proportion of the maximum RGB linear intensity values at which a first slope change is to occur. In this example, it will be assumed that the threshold value will be 0.80 for all three channels. Input limit values (RIlim, GIlim, BIlim) are then defined (step 204). These input limit values define a maximum red, green, or blue value above which no further chromatic content will be added. For this example, this value will be assumed to be 1.5. Therefore, any red, green, or blue values within the four-component image signal having a value of 1.5 or greater will employ the maximum red, green, or blue value. RGB threshold values will then be calculated (step 206). These thresholds (RT,GT, BT) represent the proportion of the maximum RGB value to which the output limit values, input limit values, and thresholds are mapped. The output limit values proportion (PROlim, PGOlim, PBOlim) is calculated by computing the ratio of the output limit values (ROlim, GOlim, BOlim) to the maximum relative log luminance value of 2.13, providing values of 0.5164, 0.5399 and 0.4695 for the red, green, and blue respectively. The input limit value proportions (PRIlim, PGIlim, PBIlim) are calculated by dividing the input limit values (RIlim, GIlim, BIlim), which is a value of 1.5 in this example, by the maximum relative log luminance value of 2.13, providing 0.7042 for each of the red, green, and blue channels. The RGB threshold value proportions (PRT,PGT, PBT) are calculated by multiplying the RGB threshold values (RT,GT, BT) by the output limit values (ROlim, GOlim, BOlim) and dividing the result by the maximum relative log luminance value of 2.13, resulting in values of 0.4131, 0.4319, and 0.3756 for the red, green, and blue channels.
Slopes are then calculated (step 208) for each channel. This slope represents the slope of a portion of the input-to-output limiting function having input values between the RGB threshold value proportions (PRT,PGT, PBT) and the input-limit value proportions (PRIlim, PGIlim, PBIlim). This value is calculated for the red channel as shown:
M
R=(PRIlim−RPROlim)/(PRIlim−PRT)
This same calculation is performed for the green and blue channels as well by substituting green and red values for the red to obtain values MG, MB as well.
A ratio value T is calculated 210 for each of the red, green, and blue values within the four-component signal. This T is the ratio of the input red, green, and blue values to the output red, green, and blue values. The value of T for the red channel is computed as:
where IR is the red value within the four-component signal and PIR is the ratio of IR to the maximum relative log luminance value of 2.13. Once again, analogous calculations are performed for the green and blue converted linear intensity values to obtain TG and TB values. The limited red values are then computed (step 212) from:
LI
R=min(TR, TG, TB)*IR.
Once again, analogous calculations are performed for the green and blue channels. The multiplication within step 212 provides scaled, converted linear intensity values and the use of the min function permits this manipulation to occur without producing hue changes in the resulting values. Through this method, the red, green and blue values are limited to the range of values that the display can physically produce. The multi-part linear functions for the ratio T permits this manipulation to be performed with reduced loss of detail as compared to a clipping function. However, some loss of detail still occurs due to the clipping of values above the input limit values. As described, the transforming step (82 in
To avoid this loss of detail the white signal is then further increased (step 148 in
where LR, LG, and LB are the proportion of the luminance of the white point of the display produced by each of the red, green, and blue light-emitting elements 42, 44, 46, respectively. The final linear intensity value for the white channel is then computed 224 by adding Wadd to the white value within the four-component signal. Notice that through this manipulation, the spatial detail in the image that is lost while limiting the red, green, and blue signals within the four-component signal is regained. However, values within the signal that are limited, and only these values, undergo a loss of saturation. Therefore, most intensity values within the image range will not be affected by either the limiting step (146 in
In this example, the maximum luminance of the display is specified to be equal to the maximum luminance of the white-light-emitting elements, providing a dynamic range of 100,000:1 for highlight information within the scene. Further, because of the method used to convert the three-component signal to a four-component signal, the triplets of image intensity values within the image range were transformed so that the four-or-more-component drive signal causes three or fewer of the red, green, blue, and at least one additional light-emitting element to produce light and wherein at least a portion of the triplets of the image values within the highlight range are transformed such that the four-or-more-component drive signal causes each of the red, green, blue and at least one additional light-emitting element to produce light. Further in this example the input image signal specified, defined, or inferred a display white point and included triplets of image intensity values within the highlight range. The transforming step (82 in
In the method employed in this example, in response to triplets of intensity values within the highlight range, it is typical that at least one of the four-or-more-component drive signals intended to drive the red, green, and blue light-emitting elements is greater than zero and the four-or-more-component drive signals that are intended to drive at least one of the remaining of the red, green, and blue light-emitting elements equals zero. Further, the four-or-more component drive signals that are intended to drive at least one of the additional light-emitting elements is greater than zero. In this display, the peak luminance of the display will typically be equal to the maximum luminance of the additional light-emitting element, as all four of the light-emitting elements are not simultaneously employed.
Notice that by using the method as described, the white-light-emitting elements, which are the most efficient light-emitting elements, are used to produce as much of the luminance information in the image as possible without significantly reducing the color quality of the display. Therefore, it results in a display that is quite power efficient. Further, while the white light-emitting element is driven with higher currents than it would be using prior-art three-to-four-color-conversion techniques, this additional current is required only for light-emitting elements within the highlight region of any image. This number tends to be relatively small (only a few percent of all pixels) for most natural scenes, and therefore the method provides this higher dynamic range without substantial increases in current. Further, the method does not require increases in voltage to provide increases in current beyond that which would be required to drive the display to a peak luminance of 445 cd/m2 using prior-art methods. Therefore, this increase in dynamic range is achieved without increases in voltage to the panel. This fact, coupled with the modest increase in average current for the display indicates that the power consumed by the display will be increased by a very modest amount, typically less than 10%, while providing a 2× increase in dynamic range.
Although it is not practical that a natural image has a large number of triplets of intensity values within the highlight range, it is possible that the three-component input image signal contain a large number of triplets within the highlight range. Under such a condition all four light-emitting elements within each pixel of the display can be driven near their maximum current. In most EL displays, such a condition will result in the buildup of heat or demand excessive amounts of power. Therefore, it is important that the present invention further include a method for limiting the peak current to the display. It should be noted that the four-component image signal contains linear intensity values, (i.e., values that are intended to be linearly related to luminance of the display). Since a linear relationship generally relates output luminance to current, each of the values within the resulting four-component image signal can be scaled by an appropriate linear relationship for each component and the result summed across groups of pixels to estimate the current required to display the four-component image signal. The result of the summation can then be compared to an aim maximum panel current and, if it exceeds the aim maximum panel current, the four-component image signal can be scaled by a common value that is less than 1. This will reduce the luminance of the output image and reduce the current and power required to present the image on the display. This common value can be computed as the ratio of the maximum current to the summed current. These steps provide an automatic current limiting algorithm to reduce the luminance of the display in response to scenes having a large number of high-input intensity values. By incorporating these steps within the transforming step (82 of
It is notable that in this example, the input image signal specifies, defines, or infers a display white point color and luminance, specifically, a display white-point color and luminance are inferred from the statistics of the images. Other image formats, such as ITUR BT709-5 specifies the display white-point color and infers a luminance. Further, in this example, the display white point can be produced with the sum of the maximum luminance values of two or fewer of the red, green, and blue light-emitting elements and less than the maximum luminance of the remaining of the red, green, and blue light-emitting element. Specifically, in this example the maximum luminance of the blue light-emitting element is used to create the display white point with red and green luminance values that are less than the maximum red and green luminance values. Further, a portion of the triplets of image intensity values within the highlight range would be produced with the maximum luminance of the remaining of the red, green, and blue light-emitting elements, specifically green highlights would employ the maximum luminance of the green light-emitting elements, red highlights would employ the maximum luminance of the red light-emitting element, and yellow highlights would employ the maximum luminance of the green and red light-emitting elements.
It is also worth noting that this example provides the majority of its calculations in log luminance, which is perceptually more uniform than luminance. However, the algorithm can also be applied in other color spaces, including even more visually relevant color spaces, such as CIE lightness (L*) or CIE CAM 02 brightness.
This example provides a method for converting a three-component input image signal to a four-or-more-component image signal. This method includes providing an electroluminescent display having a plurality of light-emitting elements for emitting red, green, and blue light and at least one additional light-emitting element for emitting at least one additional color of light, the luminance of the light being responsive to a current provided to each light-emitting element; and one-or-more circuits for controlling the current to each light-emitting element, the circuits providing a maximum current to each light-emitting element to cause each light-emitting element to produce a maximum luminance value, wherein the maximum luminance value of the at least one additional light-emitting element is greater than the maximum luminance value of at least one of the red, green, or blue light-emitting elements. The method further includes providing one or more display drivers for receiving a three-component input image signal, transforming the three-component input image signal to a four-or-more-component drive signal, and providing the four-or-more-component drive signal to the one or more circuits to control the current to each light-emitting element, each of the four-or-more-component drive signals providing a signal for driving either a red, green, blue, or an additional light-emitting element. In this method, the input image signal includes a triplet of intensity values, the intensity values having at least an image range and a highlight range, the smallest intensity value of the highlight range being greater than the greatest intensity value of the image range; and the transforming step transforms at least one of the triplets having an intensity value within the image range to drive signals that produce a luminance less than the sum of the maximum luminance values of the red, green and blue light-emitting elements and transforms at least one of the intensity values having an intensity value within the highlight range to drive signals that produce a luminance greater than the sum of the maximum luminance of the red, green, and blue light-emitting elements.
As noted, earlier in the example that was provided, all four light-emitting elements are typically not driven simultaneously and the maximum luminance of the display is equal to the maximum luminance of the white light-emitting element. As noted, this results in a power efficient drive method. However, in applications where peak luminance is much more important than power efficiency, it is possible to drive all of the light-emitting elements simultaneously to produce the highest possible luminance within the highlight region. Although such a method will require higher power consumption, peak luminance values could be as high as 1500 cd/m2 for the display in the previous example, providing a dynamic range as high as 150,000:1. This can be achieved using the method above by substituting the aim peak luminance of 1500 cd/m2 into the method, instead of an aim peak luminance of 1000 cd/m2. In this method, in response to a triplet of intensity values within the highlight range, each of the four-or-more-component drive signals that are intended to drive the red, green, and blue light-emitting elements will be greater than zero; and the four-or-more component drive signals that are intended to drive at least one of the additional light-emitting elements will be greater than zero.
In digital systems that are typically employed, the drive signals will be digital signals. As the additional light-emitting element has a larger luminance range than the red, green, or blue light-emitting elements it is desirable that the drive signal for the additional light-emitting element have a greater bit-depth than the drive signal for the red, green, or blue light-emitting elements.
Referring again to
As discussed earlier, the three-component input image signal 22 in
As described in the examples of this disclosure, the one or more drivers 16, 18, 20 can include a digital signal processor 20. In the present invention, this digital signal processor 20 can be a field programmable gate array, application-specific-integrated circuit or a general microprocessor capable of conducting the processing steps necessary to perform the transform step 86.
It should be noted that in addition to receiving a three-component input image signal including a triplet of intensity values, the intensity values having at least an image range and a highlight range, the smallest intensity value of the highlight range being greater than the greatest intensity value of the image range, the display system 12 of the present invention can be used to display graphics or other scenes that do not include highlight information. In such cases, algorithms can be used to detect the presence of graphical images or other non-high-dynamic-range input signals and to apply a more traditional image processing path for these images. Alternatively, the image type can be provided to the display to alter the image processing path. Therefore the display system 12 can additionally receive an input image signal and transform the three-component input image signal 22 to a four-or-more-component drive signal that produces all luminance values at or less than the sum of the maximum luminance values of the red, green and blue light-emitting elements.
The invention has been described in detail with particular reference to certain preferred embodiments thereof, but it will be understood that variations and modifications can be effected within the spirit and scope of the invention.