The present application is related to display systems, and more particularly, to techniques for mapping the input color image data from an input gamut to another so as to an output gamut to reduce desaturation of color images on high brightness displays.
Novel sub-pixel arrangements are disclosed for improving the cost/performance curves for image display devices in the following commonly owned United States Patents and Patent Applications including: (1) U.S. Pat. No. 6,903,754 (“the '754 patent”) entitled “ARRANGEMENT OF COLOR PIXELS FOR FULL COLOR IMAGING DEVICES WITH SIMPLIFIED ADDRESSING;” (2) United States Patent Publication No. 2003/0128225 (“the '225 application”) having application Ser. No. 10/278,353 and entitled “IMPROVEMENTS TO COLOR FLAT PANEL DISPLAY SUB-PIXEL ARRANGEMENTS AND LAYOUTS FOR SUB-PIXEL RENDERING WITH INCREASED MODULATION TRANSFER FUNCTION RESPONSE,” filed Oct. 22, 2002; (3) United States Patent Publication No. 2003/0128179 (“the '179 application”) having application Ser. No. 10/278,352 and entitled “IMPROVEMENTS TO COLOR FLAT PANEL DISPLAY SUB-PIXEL ARRANGEMENTS AND LAYOUTS FOR SUB-PIXEL RENDERING WITH SPLIT BLUE SUB-PIXELS,” filed Oct. 22, 2002; (4) United States Patent Publication No. 2004/0051724 (“the '724 application”) having application Ser. No. 10/243,094 and entitled “IMPROVED FOUR COLOR ARRANGEMENTS AND EMITTERS FOR SUB-PIXEL RENDERING,” filed Sep. 13, 2002; (5) United States Patent Publication No. 2003/0117423 (“the '423 application”) having application Ser. No. 10/278,328 and entitled “IMPROVEMENTS TO COLOR FLAT PANEL DISPLAY SUB-PIXEL ARRANGEMENTS AND LAYOUTS WITH REDUCED BLUE LUMINANCE WELL VISIBILITY,” filed Oct. 22, 2002; (6) United States Patent Publication No. 2003/0090581 (“the '581 application”) having application Ser. No. 10/278,393 and entitled “COLOR DISPLAY HAVING HORIZONTAL SUB-PIXEL ARRANGEMENTS AND LAYOUTS,” filed Oct. 22, 2002; and (7) United States Patent Publication No. 2004/0080479 (“the '479 application”) having application Ser. No. 10/347,001 and entitled “IMPROVED SUB-PIXEL ARRANGEMENTS FOR STRIPED DISPLAYS AND METHODS AND SYSTEMS FOR SUB-PIXEL RENDERING SAME,” filed Jan. 16, 2003. Each of the aforementioned '225, '179, '724, '423, '581, and '479 published applications and U.S. Pat. No. 6,903,754 are hereby incorporated by reference herein in its entirety.
For certain subpixel repeating groups having an even number of subpixels in a horizontal direction, systems and techniques to affect improvements, e.g. polarity inversion schemes and other improvements, are disclosed in the following commonly owned United States patent documents: (1) United States Patent Publication No. 2004/0246280 (“the '280 application”) having application Ser. No. 10/456,839 and entitled “IMAGE DEGRADATION CORRECTION IN NOVEL LIQUID CRYSTAL DISPLAYS”; (2) United States Patent Publication No. 2004/0246213 (“the '213 application”) (U.S. patent application Ser. No. 10/455,925) entitled “DISPLAY PANEL HAVING CROSSOVER CONNECTIONS EFFECTING DOT INVERSION”; (3) U.S. Pat. No. 7,218,301 (“the '301 patent”) having application Ser. No. 10/455,931 and entitled “SYSTEM AND METHOD OF PERFORMING DOT INVERSION WITH STANDARD DRIVERS AND BACKPLANE ON NOVEL DISPLAY PANEL LAYOUTS”; (4) U.S. Pat. No. 7,209,105 (“the '105 patent”) having application Ser. No. 10/455,927 and entitled “SYSTEM AND METHOD FOR COMPENSATING FOR VISUAL EFFECTS UPON PANELS HAVING FIXED PATTERN NOISE WITH REDUCED QUANTIZATION ERROR”; (5) U.S. Pat. No. 7,187,353 (“the '353 patent”) having application Ser. No. 10/456,806 entitled “DOT INVERSION ON NOVEL DISPLAY PANEL LAYOUTS WITH EXTRA DRIVERS”; (6) United States Patent Publication No. 2004/0246404 (“the '404 application”) having application Ser. No. 10/456,838 and entitled “LIQUID CRYSTAL DISPLAY BACKPLANE LAYOUTS AND ADDRESSING FOR NON-STANDARD SUBPIXEL ARRANGEMENTS”; (7) United States Patent Publication No. 2005/0083277 (“the '277 application”) having application Ser. No. 10/696,236 entitled “IMAGE DEGRADATION CORRECTION IN NOVEL LIQUID CRYSTAL DISPLAYS WITH SPLIT BLUE SUBPIXELS”, filed Oct. 28, 2003; and (8) United States Patent Publication No. 2005/0212741 (“the '741 application”) having application Ser. No. 10/807,604 and entitled “IMPROVED TRANSISTOR BACKPLANES FOR LIQUID CRYSTAL DISPLAYS COMPRISING DIFFERENT SIZED SUBPIXELS”, filed Mar. 23, 2004. Each of the aforementioned '280, '213, '404, '277 and '741 published applications and the '301, 105, 353 patent are hereby incorporated by reference herein in its entirety.
These improvements are particularly pronounced when coupled with sub-pixel rendering (SPR) systems and methods further disclosed in the above-referenced U.S. Patent documents and in commonly owned United States Patents and Patent Applications: (1) U.S. Pat. No. 7,123,277 (“the '277 patent”) having application Ser. No. 10/051,612 and entitled “CONVERSION OF A SUB-PIXEL FORMAT DATA TO ANOTHER SUB-PIXEL DATA FORMAT,” filed Jan. 16, 2002; (2) U.S. Pat. No. 7,221,381 (“the '381 patent”) having application Ser. No. 10/150,355 entitled “METHODS AND SYSTEMS FOR SUB-PIXEL RENDERING WITH GAMMA ADJUSTMENT,” filed May 17, 2002; (3) U.S. Pat. No. 7,184,066 (“the '066 patent”) having application Ser. No. 10/215,843 and entitled “METHODS AND SYSTEMS FOR SUB-PIXEL RENDERING WITH ADAPTIVE FILTERING,” filed Aug. 8, 2002; (4) United States Publication No. 2004/0196302 (“the '302 application”) having application Ser. No. 10/379,767 and entitled “SYSTEMS AND METHODS FOR TEMPORAL SUB-PIXEL RENDERING OF IMAGE DATA” filed Mar. 4, 2003; (5) U.S. Pat. No. 7,167,186 (“the '186 patent”) having application Ser. No. 10/379,765 and entitled “SYSTEMS AND METHODS FOR MOTION ADAPTIVE FILTERING,” filed Mar. 4, 2003; (6) U.S. Pat. No. 6,917,368 (“the '368 patent”) entitled “SUB-PIXEL RENDERING SYSTEM AND METHOD FOR IMPROVED DISPLAY VIEWING ANGLES”; and (7) United States Patent Publication No. 2004/0196297 (“the '297 application”) having application Ser. No. 10/409,413 and entitled “IMAGE DATA SET WITH EMBEDDED PRE-SUBPIXEL RENDERED IMAGE” filed Apr. 7, 2003. Each of the aforementioned '302, and '297 applications and the '277, '381, '066, '186 and the '368 patents are hereby incorporated by reference herein in its entirety.
Improvements in gamut conversion and mapping are disclosed in commonly owned United States Patents and co-pending United States Patent Applications: (1) U.S. Pat. No. 6,980,219 (“the '219 patent”) entitled “HUE ANGLE CALCULATION SYSTEM AND METHODS”; (2) United States Patent Publication No. 2005/0083341 (“the '341 application”) having application Ser. No. 10/691,377 and entitled “METHOD AND APPARATUS FOR CONVERTING FROM SOURCE COLOR SPACE TO TARGET COLOR SPACE”, filed Oct. 21, 2003; (3) United States Patent Publication No. 2005/0083352 (“the '352 application”) having application Ser. No. 10/691,396 and entitled “METHOD AND APPARATUS FOR CONVERTING FROM A SOURCE COLOR SPACE TO A TARGET COLOR SPACE”, filed Oct. 21, 2003; and (4) U.S. Pat. No. 7,176,935 (“the '935 patent”) having application Ser. No. 10/690,716 and entitled “GAMUT CONVERSION SYSTEM AND METHODS” filed Oct. 21, 2003. Each of the aforementioned '341, and '352 applications and the '219 and '935 patents are hereby incorporated by reference herein in its entirety.
Additional advantages have been described in (1) U.S. Pat. No. 7,084,923 (“the '923 patent”) having application Ser. No. 10/696,235 and entitled “DISPLAY SYSTEM HAVING IMPROVED MULTIPLE MODES FOR DISPLAYING IMAGE DATA FROM MULTIPLE INPUT SOURCE FORMATS”, filed Oct. 28, 2003; and in (2) United States Patent Publication No. 2005/0088385 (“the '385 application”) having application Ser. No. 10/696,026 and entitled “SYSTEM AND METHOD FOR PERFORMING IMAGE RECONSTRUCTION AND SUBPIXEL RENDERING TO EFFECT SCALING FOR MULTI-MODE DISPLAY” filed Oct. 28, 2003, each of which is hereby incorporated herein by reference in its entirety.
Additionally, each of these co-owned and co-pending applications is herein incorporated by reference in its entirety: (1) United States Patent Publication No. 2005/0225548 (“the '548 application”) having application Ser. No. 10/821,387 and entitled “SYSTEM AND METHOD FOR IMPROVING SUB-PIXEL RENDERING OF IMAGE DATA IN NON-STRIPED DISPLAY SYSTEMS”; (2) United States Patent Publication No. 2005/0225561 (“the '561 application”) having application Ser. No. 10/821,386 and entitled “SYSTEMS AND METHODS FOR SELECTING A WHITE POINT FOR IMAGE DISPLAYS”; (3) United States Patent Publication No. 2005/0225574 (“the '574 application”) and United States Patent Publication No. 2005/0225575 (“the '575 application”) having application Ser. Nos. 10/821,353 and 10/961,506 respectively, and both entitled “NOVEL SUBPIXEL LAYOUTS AND ARRANGEMENTS FOR HIGH BRIGHTNESS DISPLAYS”; (4) United States Patent Publication No. 2005/0225562 (“the '562 application”) having application Ser. No. 10/821,306 and entitled “SYSTEMS AND METHODS FOR IMPROVED GAMUT MAPPING FROM ONE IMAGE DATA SET TO ANOTHER”; (5) U.S. Pat. No. 7,248,268 (“the '268 patent”) having application Ser. No. 10/821,388 and entitled “IMPROVED SUBPIXEL RENDERING FILTERS FOR HIGH BRIGHTNESS SUBPIXEL LAYOUTS”; and (6) United States Patent Publication No. 2005/0276502 (“the '502 application”) having application Ser. No. 10/866,447 and entitled “INCREASING GAMMA ACCURACY IN QUANTIZED DISPLAY SYSTEMS.”
Additional improvements to, and embodiments of, display systems and methods of operation thereof are described in: (1) Patent Cooperation Treaty (PCT) Application No. PCT/US 06/12768, entitled “EFFICIENT MEMORY STRUCTURE FOR DISPLAY SYSTEM WITH NOVEL SUBPIXEL STRUCTURES” filed Apr. 4, 2006, and published in the United States as United States Patent Application Publication 200Y/AAAAAAA; (2) Patent Cooperation Treaty (PCT) Application No. PCT/US 06/12766, entitled “SYSTEMS AND METHODS FOR IMPLEMENTING LOW-COST GAMUT MAPPING ALGORITHMS” filed Apr. 4, 2006, and published in the United States as United States Patent Application Publication 200Y/BBBBBBB; (3) U.S. patent application Ser. No. 11/278,675, entitled “SYSTEMS AND METHODS FOR IMPLEMENTING IMPROVED GAMUT MAPPING ALGORITHMS” filed Apr. 4, 2006, and published as United States Patent Application Publication 200Y/CCCCCCC; (4) Patent Cooperation Treaty (PCT) Application No. PCT/US 06/12521, entitled “PRE-SUBPIXEL RENDERED IMAGE PROCESSING IN DISPLAY SYSTEMS” filed Apr. 4, 2006, and published in the United States as United States Patent Application Publication 200Y/DDDDDDD; and (5) Patent Cooperation Treaty (PCT) Application No. PCT/US 06/19657, entitled “MULTIPRIMARY COLOR SUBPIXEL RENDERING WITH METAMERIC FILTERING” filed on May 19, 2006 and published in the United States as United States Patent Application Publication 200Y/EEEEEEE (referred to below as the “Metamer Filtering application”.) Each of these co-owned applications is also herein incorporated by reference in their entirety.
The organization and methods of operation of the display systems and techniques disclosed herein are best understood from the following description of several illustrated embodiments when read in connection with the following drawings in which the same reference numbers are used throughout the drawings to refer to the same or like parts:
In one embodiment of the display system, the display system comprises an image pipeline that accepts input color image data of one color gamut to be rendered on a display having high brightness subpixel layouts. In one embodiment, the system comprises a boost function that maps the input color data onto another color gamut that boosts the luminance of colors that might appear dark if rendered against a white or very light background.
High brightness displays are becoming more used—particularly in cellphones and other handheld devices—for their ability to render bright images while reducing power consumption, as compared to conventional RGB stripe displays. High brightness displays are those that may have a “white” (or unfiltered) subpixel (e.g. RGBW) or other multiprimary colors (e.g. RGBXW, where the “X” could be cyan, magenta or yellow or any other colored subpixel). These present methods may well work with any RGBX display—where X would tend to be a bright (e.g. high luminance) colored subpixel. Several high brightness displays are disclosed in the '575 application incorporated by reference above.
With any RGBW or multiprimary system (including not only the novel ones described in the '575 application but also in conventional ones, like RGBW quad systems), the problem of “simultaneous contrast” is an issue that arises with rendering images having pure (or highly saturated) colors rendered against a white or very light background. In fact, such saturated colors would tend to look dark against such a white or light background. This is especially evident for yellow, cyan and possibly magenta—which are bright mixed colors. This discussion provides a possible solution to the problem of displaying these bright mixed colors on a display with RGBW (or “X”) primary colors. In general the techniques disclosed herein examine the input color image data for “major colors” and a “minor color” to determine which section of the color space an input color image data value is located. For example, if the input color image data is specified as RGB data, and the R and G data values are high and the B value is low, then the color is near yellow; if R and B are high and G is low, then the color is near magenta; and if B and G are high and R is low, then the color is near cyan. When such a condition is met, the technique computes a substitute color value for the low valued color data value. In effect, the technique seeks to adjust the level of the low valued color, referred to as “boost,” in a manner that allows for smooth color transitions (i.e., the “boost” decreases smoothly) as the minor color increases or as the major colors decrease.
As may be seen in
Continuing with the present example, the following parameters are read in at step 304—Ymax, Cmax, Mmax, Width and Maxcol. Parameters Ymax, Cmax, Mmax and width determine the slope and intercept of the gain curves, as shown in
With continued reference to
Each step 312, 314 and 316 show gain curves and an exemplary formula for processing the data. In general, the processing in the present system as shown in
As noted above, the processing looks for “major colors” and “minor color” to determine which section of color space an input color image data value (e.g., an RGB value) is located. For example, if R and G are high and B is low, then the color is near yellow; if R and B are high and G is low, then the color is near magenta; and if B and G are high and R is low, then the color is near cyan. If such a condition is met, then the system seeks to adjust the level of “boost” of the low valued color, so that the boost decreases smoothly as the minor color increases or as the major colors decrease. As shown in
B=B+min(min(Gain—R,Gain—G)*Gain—B,maxcol)
and R and G remain the same. If R and B are high and G is low, a possible boost for green (G) is computed as:
G=G+min(min(Gain—R,Gain—B)*Gain—G,maxcol)
and R and B remain the same. If B and G are high and R is low, a possible boost for red (R) is computed as:
R=R+min(min(Gain—B,Gain—G)*Gain—R,maxcol
and B and G remain the same. Various functions may suffice for such boost processing—i.e. to decrease boost—including a linear drop, as either minor color increases or major colors decrease. The slope of the function will determine how localized the boost is. For exemplary purposes, charts 900 and 1000 in
Table 1 provides a possible embodiment of computing boost functions that work for our exemplary mixed colors of yellow, cyan and magenta, respectively:
In the above example, the functions used are a linear ramp with a max value of redmax (for cyan boost), greenmax (for magenta boost), and bluemax (for yellow boost). “Width” is a value that determines the intercept of the boost function at the y axis. These equations create a “gain” function for each color, which is used to modify the minor color (or white).
For further exposition of the present example, the yellow boost may be considered, for example. The first step is to determine which major color is smaller. In one embodiment, this will be used in the gain function since it may be desirable to have the gain diminish as color moves away from 255,255,n. An alternate embodiment is to take the average of two gain functions (one for R and one for G). For such a “middle color”, it may be desirable to calculate the gain.
For minor color (in this case, blue), its gain may then be calculated. It should be noted that as blue increases in the image (i.e. color moves towards white), it may be desirable to have the gain decrease, as boost may no longer be needed.
A next step is to multiply the gains together and add to the blue value. In this example, the “width” represents the range that boost will be applied. This width could be the same for all colors, or it could be adjusted color by color. Additionally, it should be noted that the linear curve can be replaced with a different function to better smooth out the transitions.
In effect, the technique computes a substitute color data value for the minimum color data value. The substitute color data value is computed as a function of a relationship between slopes of first and second gain curves. The first gain curve indicates a function of color adjustment values for the primary color indicated by the minimum color data value, and the second gain curve indicates a function of color adjustment values for the other primary colors.
Chart 430 in
Those of skill in the art would appreciate that the color gamut regions—either input or output—need not assume any particular geometric area (e.g. triangular) as shown in
As was mentioned above, the boost block or function may be placed in the image procession pipeline at many various locations. If placed before the input gamma LUT, then the boost processing could evaluate which color region the RGB value is located. If the RGB value is near yellow, cyan, or magenta, then the “minor color” is increased in value.
If the boost processing is located in the GMA, then the boost processing could evaluate which color region the RGB value is located, but it uses the RGB values after the input LUT (but perhaps before the GMA). If the color is located near yellow, cyan, or magenta, then the white subpixel value could be increased in value.
If the boost processing is located after the output gamma LUT, then the boost processing could evaluate which color region the RGB value is located but it increases the white subpixel value after the output LUT. This may work well for broad colors, but might cause some fuzzing out sharp lines since the data has already passed through the SPR.
If the boost function is inside the GMA, then the sharpness of the color transition may be increased because colors are linearly added inside the gamma pipeline.
In yet another embodiment, an adjustment may be made to prevent any possible inversions of luminance through the addition of the boost function. For one example, this might happen if the boost is too localized to mixed color points i.e. yellow.
12
While the techniques and implementations have been described with reference to exemplary embodiments, it will be understood by those skilled in the art that various changes may be made and equivalents may be substituted for elements thereof without departing from the scope of the appended claims. In addition, many modifications may be made to adapt a particular situation or material to the teachings without departing from the essential scope thereof. Therefore, the particular embodiments, implementations and techniques disclosed herein, some of which indicate the best mode contemplated for carrying out these embodiments, implementations and techniques, are not intended to limit the scope of the appended claims.
Filing Document | Filing Date | Country | Kind | 371c Date |
---|---|---|---|---|
PCT/US07/79408 | 9/25/2007 | WO | 00 | 3/30/2009 |
Number | Date | Country | |
---|---|---|---|
60827710 | Sep 2006 | US |