The present application is related to commonly owned United States Patent Applications: (1) U.S. Pat. Publication No. 2005/0083345 (‘the '345 application) entitled “HUE ANGLE CALCULATION SYSTEM AND METHODS”; (2) U.S. Pat. Publication No. 2005/0083341 (‘the '341 application) entitled “METHOD AND APPARATUS FOR CONVERTING FROM SOURCE COLOR SPACE TO RGBW TARGET COLOR SPACE”; (3) U.S. Pat. Publication No. 2005/0083352 (‘the '352 application) entitled “METHOD AND APPARATUS FOR CONVERTING FROM A SOURCE COLOR SPACE TO A TARGET COLOR SPACE”, which are hereby incorporated herein by reference.
In commonly owned United States Patent Applications: (1) U.S. Pat. Publication No. 2002/0015110 (‘the '110 application) [U.S. patent application Ser. No. 09/916,232], entitled “ARRANGEMENT OF COLOR PIXELS FOR FULL COLOR IMAGING DEVICES WITH SIMPLIFIED ADDRESSING,” filed Jul. 25, 2001; (2) U.S. Pat. Publication No. 2003/0128225 (‘the '225 application) [U.S. patent application Ser. No. 10/278,353], entitled “IMPROVEMENTS TO COLOR FLAT PANEL DISPLAY SUB-PIXEL ARRANGEMENTS AND LAYOUTS FOR SUB-PIXEL RENDERING WITH INCREASED MODULATION TRANSFER FUNCTION RESPONSE,” filed Oct. 22, 2002; (3) U.S. Pat. Publication No. 2003/0128179 (‘the '179 application) [U.S. patent application Ser. No. 10/278,352], entitled “IMPROVEMENTS TO COLOR FLAT PANEL DISPLAY SUB-PIXEL ARRANGEMENTS AND LAYOUTS FOR SUB-PIXEL RENDERING WITH SPLIT BLUE SUB-PIXELS,” filed Oct. 22, 2002; (4) U.S. Pat. Publication No. 2004/0051724 (‘the '724 application) [U.S. patent application Ser. No. 10/243,094], entitled “IMPROVED FOUR COLOR ARRANGEMENTS AND EMITTERS FOR SUB-PIXEL RENDERING,” filed Sep. 13, 2002; (5) U.S. Pat. Publication No. 2003/0117423 (‘the '423 application) [U.S. patent application Ser. No. 10/278,328], entitled “IMPROVEMENTS TO COLOR FLAT PANEL DISPLAY SUB-PIXEL ARRANGEMENTS AND LAYOUTS WITH REDUCED BLUE LUMINANCE WELL VISIBILITY,” filed Oct. 22, 2002; (6) U.S. Pat. Publication No. 2003/0090581 (‘the '581 application) [U.S. patent application Ser. No. 10/278,393], entitled “COLOR DISPLAY HAVING HORIZONTAL SUB-PIXEL ARRANGEMENTS AND LAYOUTS,” filed Oct. 22, 2002; (7) U.S. Pat. Publication No. 2004/0080479 (‘the '479 application”) [U.S. patent application Ser. No. 10/347,001] entitled “IMPROVED SUB-PIXEL ARRANGEMENTS FOR STRIPED DISPLAYS AND METHODS AND SYSTEMS FOR SUB-PIXEL RENDERING SAME,” filed Jan. 16, 2003, novel sub-pixel arrangements are therein disclosed for improving the cost/performance curves for image display devices and herein incorporated by reference.
For certain subpixel repeating groups having an even number of subpixels in a horizontal direction, the following systems and techniques to affect proper dot inversion schemes are disclosed and are herein incorporated by reference: (1) U.S. Pat. Publication No. 2004/0246280 (‘the '280 application) [U.S. patent application Ser. No. 10/456,839] entitled “IMAGE DEGRADATION CORRECTION IN NOVEL LIQUID CRYSTAL DISPLAYS”; filed Jun. 6, 2003, (2) U.S. Pat. Publication No. 2004/0246213 (‘the '213 application) [U.S. patent application Ser. No. 10/455,925] entitled “DISPLAY PANEL HAVING CROSSOVER CONNECTIONS EFFECTING DOT INVERSION”; filed Jun. 6, 2003, (3) U.S. Pat. Publication No. 2004/0246381 (‘the '381 application) [U.S. patent application Ser. No. 10/455,931] entitled “SYSTEM AND METHOD OF PERFORMING DOT INVERSION WITH STANDARD DRIVERS AND BACKPLANE ON NOVEL DISPLAY PANEL LAYOUTS”; filed Jun. 6, 2003, (4) U.S. Pat. Publication No. 2004/0246278 (‘the '278 application) [U.S. patent application Ser. No. 10/455,927] entitled “SYSTEM AND METHOD FOR COMPENSATING FOR VISUAL EFFECTS UPON PANELS HAVING FIXED PATTERN NOISE WITH REDUCED QUANTIZATION ERROR”; filed Jun. 6, 2003, (5) U.S. Pat. Publication No. 2004/0246279 (‘the '279 application) [U.S. patent application Ser. No. 10/456,806] entitled “DOT INVERSION ON NOVEL DISPLAY PANEL LAYOUTS WITH EXTRA DRIVERS”; and (6) U.S. Pat. Publication No. 2004/0246404 (‘the '404 application) [U.S. patent application Ser. No. 10/456,838] entitled “LIQUID CRYSTAL DISPLAY BACKPLANE LAYOUTS AND ADDRESSING FOR NON-STANDARD SUBPIXEL ARRANGEMENTS” filed Jun. 6, 2003.
These improvements are particularly pronounced when coupled with sub-pixel rendering (SPR) systems and methods further disclosed in those applications and in commonly owned United States Patent Applications: (1) U.S. Pat. Publication No. 2003/0034992 (‘the '992 application) [U.S. patent application Ser. No. 10/051,612], entitled “CONVERSION OF A SUB-PIXEL FORMAT DATA TO ANOTHER SUB-PIXEL DATA FORMAT,” filed Jan. 16, 2002; (2) U.S. Pat. Publication No. 2003/0103058 (‘the '058 application) [U.S. patent application Ser. No. 10/150,355], entitled “METHODS AND SYSTEMS FOR SUB-PIXEL RENDERING WITH GAMMA ADJUSTMENT,” filed May 17, 2002; (3) U.S. Pat. Publication No. 2003/0085906 (‘the '906 application) [U.S. patent application Ser. No. 10/215,843], entitled “METHODS AND SYSTEMS FOR SUB-PIXEL RENDERING WITH ADAPTIVE FILTERING,” filed Aug. 8, 2002; (4) U.S. Pat. Publication No. 2004/0196302 (‘the '302 application) [U.S. patent application Ser. No. 10/379,767] entitled “SYSTEMS AND METHODS FOR TEMPORAL SUB-PIXEL RENDERING OF IMAGE DATA” filed Mar. 4, 2003; (5) U.S. Pat. Publication No. 2004/0174380 (‘the '380 application) [U.S. patent application Ser. No. 10/379,765] entitled “SYSTEMS AND METHODS FOR MOTION ADAPTIVE FILTERING.” filed Mar. 4, 2003; (6) U.S. Pat. Publication No. 2004/0174375 (‘the '375 application) [U.S. patent application Ser. No. 10/379,766] entitled “SUB-PIXEL RENDERING SYSTEM AND METHOD FOR IMPROVED DISPLAY VIEWING ANGLES” filed Mar. 4, 2003; (7) U.S. Pat. Publication No. 2004/0196297 (‘the '297 application) [U.S. patent application Ser. No. 10/409,413] entitled “IMAGE DATA SET WITH EMBEDDED PRE-SUBPIXEL RENDERED IMAGE” filed Apr. 7, 2003, which are hereby incorporated herein by reference.
The accompanying drawings, which are incorporated in, and constitute a part of this specification illustrate exemplary implementations and embodiments of the invention and, together with the description, serve to explain principles of the invention.
Reference will now be made in detail to implementations and embodiments, examples of which are illustrated in the accompanying drawings. Wherever possible, the same reference numbers will be used throughout the drawings to refer to the same or like parts.
Most monitors and TVs today were designed to display three-valued color data such as RGB and/or sRGB or three-valued chroma/luminance signals such as YIQ or YCbCr. The term sRGB is used to describe the non-linear system that most personal computer images are assumed to be stored in. This is sometimes referred to as R′G′B′ or non-linear RGB. To make brighter displays and displays with larger color gamuts, manufacturers are starting to consider multi-primary displays. These displays will have more than three primary colors. However, there are no convenient sources of multi-primary image data, and there are a large number of sources of three-valued color data that need to be converted for new multi-primary displays. In the process of converting images to multi-primary or other expanded gamut systems, it would be desirable to take advantage of the larger gamuts of these systems.
Methods and systems are disclosed that can convert the gamut, expanding or contracting, of existing three valued color data into gamuts that can take advantage of this new class of displays. Such methods and systems can work for multi-primary displays with any number of primaries.
One of the assumptions of gamut conversion is that TV cameras, digital cameras, and other input devices do not destroy the expanded gamut of the real world, but compress much of it into the limited gamut that they can represent, as suggested in
To see how the gamut of various devices interact,
Many algorithms for conversion from one gamut to another have been published in the literature. The most frequent use is to convert sRGB display data for output on CMY color printers, as in
In order to reduce the costs of computation, one embodiment will now be described. Since sRGB is already perceptually uniform, there is no need to convert to the computationally expensive CIE Lab. Instead, it may be desirable to convert sRGB directly into YCbCr, or some other even more computationally inexpensive conversion to separate chroma/luma. This is much easier to implement in hardware than conversion to CIE Lab. If the three-value color input happens already to be YCrCb, this is also a perceptually uniform system and can be used as they are without conversion. The same is true for most TV color-spaces, once they have been digitized, for example YPbPr, YUV and YIQ. If the source colors are linear RGB, a gamma conversion table can be used to convert them to sRGB first. Once the resulting color is in a perceptually uniform separate chroma/luma space, the hue angle may be computed. One such computationally inexpensive method of calculating the hue angle is described in the '345 application referenced above. Once hue angle is calculated, it is used as an index into a table of gamut expansion values. In one embodiment, the output of the expansion table could be expressed as a number between 0 and two, probably very close to one. These numbers can be represented as fixed-point binary numbers with one bit above the binary point. This allows for integer multipliers, with appropriate shifts afterwards, to be used to implement gamut expansion as an inexpensive system. The expansion number could be used to multiply both the components of chroma—thus, changing the saturation without effecting hue or luma.
For designing a system (for example, a monitor), such a system might have several input paths—e.g. sRGB, YCbCr, S-VHS, etc. For each of these paths, different hardware and/or software could service each of the several paths—particularly, if optional processing is not needed for the assumed image data input. For example, YCbCr would not necessarily need a chroma/luma separator because the space is already of that form. It could also be possible to design a system to read a header in the image data to discern which image data format is being input and optional subsystems and routines could be bypassed. Other possible embodiments and implementations are possible for designing a complete system that assumes different input and processing needs upon such different inputs.
As stated above, if the expansion number is less than one, it decreases the saturation of the color. If the number is one, it leaves the saturation substantially the same. If the number is greater than one, it increases the saturation and the gamut of the color. Of course, it is possible to implement alternative embodiments in which other numeric scales denote the same treatment of the image data.
It will now be described one embodiment of a gamut conversion table and how to construct the same. One possible approach to building a gamut conversion table is to traverse the edges of the gamut of the input and output color-spaces. This is usually done in CIE Chromaticity space where the edges of the gamut are straight lines.
One embodiment to creating the gamut conversion table is to start by traversing the edges of the gamuts off-line beforehand. The resulting data then is used to generate gamut conversion tables that are burned into hardware implementations. The purpose of traversing the edges of each gamut is to generate an intermediate table of maximum saturation values. Of course, there may be intermediate values of saturation—apart from maximum—that may be of interest to the system. This table could be quantized to contain one value for each degree of hue. For convenience of this example, it will be assumed that the hues occupy 360 integer degrees around the color gamut. Of course, in another embodiment disclosed in a related and incorporated application, the units of angle could be changed to create a number of “degrees” around the gamut that is a power of two, for example 256. This change in degrees may make implementing gamut expansion easier in hardware.
Traversing these gamuts can be done in several ways. One way would be to generate one color in a perceptually uniform luma/chroma space for each hue angle but with arbitrarily chosen saturation and chroma. These colors can be converted to CIE chromaticity, corrected to lie on the edge of the gamut polygon, and then converted back to chroma/luma to get the maximum saturation values. To traverse the edges of the gamut, a color with each desired hue angle may be generated one after another. Color 202 in
The ratios of values in these maximum saturation curves could be used to generate the final gamut conversion tables. The ratio of the CMY and sRGB values, for example, could generate a gamut conversion table that would convert sRGB values into a gamut that may be a better fit for a CMY printer. It should be noted that, at some hue angles in
The ratio of the multi-primary to sRGB maximum saturation curves in
As discussed in the related application entitled, “METHOD AND APPARATUS FOR CONVERTING FROM SOURCE COLOR SPACE TO RGBW TARGET COLOR SPACE”, there is described a method and system for detecting out-of-gamut colors and moving them to a “good spot” on the surface of the output gamut space—where a “good spot” could be defined as one that has substantially the same hue as the out-of-gamut color.
However, it might be advantageous to scale all the colors between BLACK and point A. This causes all colors on line BLACK-A to be scaled, so the color at point A moves to point B in
In some systems, the output gamut is a simple geometric case and it is possible to detect domains where one gamut was inside the other and to calculate the scale factor. In most multi-primary gamuts, however, the shapes of the gamuts are too complex to detect domains and the domains do not have simple geometric shapes.
If gamut clamping alone is used, any color between point A1 and B1 would be moved to point B1 and colors between B1 and BLACK would be left untouched, including color C1. It should be noted that all the colors between point A2 and BLACK would be left untouched because they were already in-gamut.
However, if gamut scaling is used instead, the color at point A1 would be moved to B1 and all the colors on the line between A1 and B1 would be moved inside the gamut. Also all the colors between B1 and BLACK would be scaled, for example the color at point C1 would move to point D1. In addition, the colors on the line between BLACK and point A2 would be expanded, moving the color at A2 out of its original gamut to the point B2. Point C2, serving as an example for all the other colors on this line, would be moved slightly out as well to point D2. These two lines show that, in some domains, colors are scaled down to fit in the output gamut and in other regions the colors are scaled up to expand into the output gamut.
These scale factors are different for each unique combination of luma and saturation, so, in one embodiment, they could be pre-calculated and stored in a LUT. However this LUT might be quite large and impractical for most systems. Thus, another embodiment would calculate the scale factor on-the-fly for each color converted for a display system.
Referring to
To find the point A, it is possible to “normalize” point C in the input color-space. This could be accomplished by dividing all the components of color C by its maximum component. It should be noted that in a typical system the color components are integers between 0 and 255. In those cases, the results of the division is simply multiplied by 256 or shifted left 8 bits. For ease of explanation, the range of color components from 0 to 1 is used in the present discussion. It should also be noted that the division could be done by inverting the maximum value and multiplying all the components of color C by that inverse value. The inverse of a number can be stored in a LUT (look up table) and quickly fetched. After point C has been normalized, it is converted to the output color-space to get the color at point A. Given a function CONV that converts from the input to the output color-space, a function INV that returns the inverse of a number, and a function MAX that returns the maximum component of a color, the formula for calculating the point A is:
A=CONV(C*INV(MAX(C)))
CONV, as a function, could be implemented by calculating the hue angle, using the hue angle to determine the chromaticity triangle number, and using that to select a multi-primary conversion matrix to perform the matrix multiply resulting in a color in the target color space. To find the point B, it is possible to convert point C to the output color-space and then normalize it. In the following formula, the color C is first converted to a temporary point C2, and then this is used to calculate the point B.
C2=CONV(C)
B=C2*INV(MAX(C2)
Then a gamut scaling ratio for color C could be the ratio of the lengths of the lines from BLACK to point A and from BLACK to point B. Since BLACK is the zero point, the two points A and B can be treated as vectors and their magnitudes are equivalent to the length of the lines. This makes the ratio:
R=|B|/|A|
Finally, the converted color C2 (from the formula above) is multiplied by this scaling ratio to calculate the gamut scaled color D in FIG. 5.
D=C2*R
It should be noted that the process of calculating the magnitude of the colors A and B could be computationally expensive.
R=MAX(B)/MAX(A)
However, the point B was chosen to lie on the surface of the output gamut, so it should have at least one component with the maximum value of one. Thus, the value 1 may be substituted for MAX(B) without needing to actually calculate the point B at all, resulting in a considerable savings in the resulting hardware. The value of R now becomes the inverse of MAX(A) and can be looked up in another inverse LUT:
R=INV(MAX(A))
The upper parallel path on
The center parallel path on
In the first embodiment of gamut conversion, as shown in
In the above embodiments, reference to functional blocks can be implemented using any combination of hardware and/or software, including components or modules such as one or more memory devices or circuitry. For example, a programmable gate array or like circuitry can be configured to implement such functional blocks. In other examples, a microprocessor operating a program in memory can also implement such functional blocks.
While the invention has been described with reference to an exemplary embodiment, it will be understood by those skilled in the art that various changes may be made and equivalents may be substituted for elements thereof without departing from the scope of the invention. In addition, many modifications may be made to adapt a particular situation or material to the teachings without departing from the essential scope thereof. Therefore, it is intended that the invention not be limited to the particular embodiment disclosed as the best mode contemplated for carrying out this invention, but that the invention will include all embodiments falling within the scope of the appended claims.
Number | Name | Date | Kind |
---|---|---|---|
4439759 | Fleming et al. | Mar 1984 | A |
4737843 | Spencer | Apr 1988 | A |
4946259 | Matino et al. | Aug 1990 | A |
4989079 | Ito | Jan 1991 | A |
5416890 | Beretta | May 1995 | A |
5438649 | Ruetz | Aug 1995 | A |
5448652 | Vaidyanathan et al. | Sep 1995 | A |
5450216 | Kasson | Sep 1995 | A |
5642176 | Abukawa et al. | Jun 1997 | A |
5661371 | Salerno et al. | Aug 1997 | A |
5694186 | Yanagawa et al. | Dec 1997 | A |
5719639 | Imamura | Feb 1998 | A |
5724112 | Yoshida et al. | Mar 1998 | A |
5724442 | Ogatsu et al. | Mar 1998 | A |
5731818 | Wan et al. | Mar 1998 | A |
5748828 | Steiner et al. | May 1998 | A |
5751268 | Sheridon | May 1998 | A |
5880707 | Aratani | Mar 1999 | A |
5899550 | Masaki | May 1999 | A |
5903366 | Hirabayashi et al. | May 1999 | A |
5917556 | Katayama | Jun 1999 | A |
5929843 | Tanioka | Jul 1999 | A |
5933253 | Ito et al. | Aug 1999 | A |
5987165 | Matsuzaki et al. | Nov 1999 | A |
5990997 | Jones et al. | Nov 1999 | A |
5995669 | Shingu et al. | Nov 1999 | A |
6054832 | Kunzman et al. | Apr 2000 | A |
6100872 | Aratani et al. | Aug 2000 | A |
6108053 | Pettitt et al. | Aug 2000 | A |
6147728 | Okumura et al. | Nov 2000 | A |
6256425 | Kunzman | Jul 2001 | B1 |
6262698 | Blum | Jul 2001 | B1 |
6297826 | Semba et al. | Oct 2001 | B1 |
6360008 | Suzuki et al. | Mar 2002 | B1 |
6384836 | Naylor, Jr. et al. | May 2002 | B1 |
6453067 | Morgan et al. | Sep 2002 | B1 |
6459419 | Matsubayashi | Oct 2002 | B1 |
6483518 | Perry et al. | Nov 2002 | B1 |
6536904 | Kunzman | Mar 2003 | B2 |
6633302 | Ohsawa et al. | Oct 2003 | B1 |
6714212 | Tsuboyama et al. | Mar 2004 | B1 |
6714243 | Mathur et al. | Mar 2004 | B1 |
6724934 | Lee et al. | Apr 2004 | B1 |
6750874 | Kim | Jun 2004 | B1 |
6771028 | Winters | Aug 2004 | B1 |
6781626 | Wang | Aug 2004 | B1 |
6980219 | Higgins | Dec 2005 | B2 |
20010019382 | Song et al. | Sep 2001 | A1 |
20020063670 | Yoshinaga et al. | May 2002 | A1 |
20020180688 | Drzalc et al. | Dec 2002 | A1 |
20020191130 | Liang et al. | Dec 2002 | A1 |
20030058466 | Hoshuyama | Mar 2003 | A1 |
20030117457 | Qiao | Jun 2003 | A1 |
20030128872 | Lee et al. | Jul 2003 | A1 |
20030151694 | Lee et al. | Aug 2003 | A1 |
20030179212 | Matsushiro et al. | Sep 2003 | A1 |
20030193056 | Takayama et al. | Oct 2003 | A1 |
20030214499 | Ohsawa et al. | Nov 2003 | A1 |
20040046725 | Lee | Mar 2004 | A1 |
20040072380 | Yamazaki et al. | Apr 2004 | A1 |
20040095521 | Song et al. | May 2004 | A1 |
20040169807 | Rho et al. | Sep 2004 | A1 |
20040179160 | Rhee et al. | Sep 2004 | A1 |
20040195963 | Choi et al. | Oct 2004 | A1 |
20040222999 | Choi et al. | Nov 2004 | A1 |
20040223005 | Lee | Nov 2004 | A1 |
20050031199 | Ben-Chorin et al. | Feb 2005 | A1 |
20050083341 | Higgins et al. | Apr 2005 | A1 |
20050083352 | Higgins | Apr 2005 | A1 |
20050225562 | Higgins et al. | Oct 2005 | A1 |
Number | Date | Country |
---|---|---|
2 282 928 | Apr 1995 | GB |
6-261332 | Sep 1994 | JP |
WO 0137251 | May 2001 | WO |
WO 2004086128 | Oct 2004 | WO |
Number | Date | Country | |
---|---|---|---|
20050083344 A1 | Apr 2005 | US |