The present application is related to display systems, and more particularly, to systems and methods for subpixel rendering source image data over time. Temporal subpixel rendering may be used to improve viewing angle in LCD displays or to improve subpixel rendering in other display technologies.
In commonly owned U.S. Patent Applications: (1) U.S. patent application Ser. No. 09/916,232 entitled “ARRANGEMENT OF COLOR PIXELS FOR FULL COLOR IMAGING DEVICES WITH SIMPLIFIED ADDRESSING” filed Jul. 25, 2001, and published as U.S. Patent Application Publication No. 2002/0015110 (“the '110 application”); (2) U.S. patent application Ser. No. 10/278,353, entitled “IMPROVEMENTS TO COLOR FLAT PANEL DISPLAY SUB-PIXEL ARRANGEMENTS AND LAYOUTS FOR SUB-PIXEL RENDERING WITH INCREASED MODULATION TRANSFER FUNCTION RESPONSE,” filed Oct. 22, 2002, and published as U.S. Patent Application Publication No. 2003/0128225 (“the '225 application”); (3) U.S. patent application Ser. No. 10/278,352, entitled “IMPROVEMENTS TO COLOR FLAT PANEL DISPLAY SUB-PIXEL ARRANGEMENTS AND LAYOUTS FOR SUB-PIXEL RENDERING WITH SPLIT BLUE SUBPIXELS,” filed Oct. 22, 2002, and published as U.S. Patent Application Publication No. 2003/0128179 (“the '179 application”); (4) U.S. patent application Ser. No. 10/243,094, entitled “IMPROVED FOUR COLOR ARRANGEMENTS AND EMITTERS FOR SUBPIXEL RENDERING,” filed Sep. 13, 2002, and published as U.S. Patent Application Publication No. 2004/0051724 (“the '724 application); (5) U.S. patent application Ser. No. 10/278,328, entitled “IMPROVEMENTS TO COLOR FLAT PANEL DISPLAY SUB-PIXEL ARRANGEMENTS AND LAYOUTS WITH REDUCED BLUE LUMINANCE WELL VISIBILITY,” filed Oct. 22, 2002, and published as U.S. Patent Application Publication No. 2003/0117423 (“the '423 application”); (6) U.S. patent application Ser. No. 10/278,393, entitled “COLOR DISPLAY HAVING HORIZONTAL SUB-PIXEL ARRANGEMENTS AND LAYOUTS,” filed Oct. 22, 2002, and published as U.S. Patent Application Publication No. 2003/0090581 (“the '581 application”); and (7) U.S. patent application Ser. No. 10/347,001, entitled “SUB-PIXEL ARRANGEMENTS FOR STRIPED DISPLAYS AND METHODS AND SYSTEMS FOR SUB-PIXEL RENDERING SAME,” filed Jan. 16, 2003, and published as U.S. Patent Application Publication No. 2004/0080479 (“the '479 application”), novel subpixel arrangements are therein disclosed for improving the cost/performance curves for image display devices. The '110, '225, '179, '724, '423, '581 and '479 applications are all incorporated by reference herein.
These improvements are particularly pronounced when coupled with subpixel rendering (SPR) systems and methods further disclosed in those applications and in commonly owned U.S. Patent Applications: (1) U.S. patent application Ser. No. 10/051,612, entitled “CONVERSION OF RGB PIXEL FORMAT DATA TO PENTILE MATRIX SUB-PIXEL DATA FORMAT,” filed Jan. 16, 2002, and published as U.S. Patent Application Publication No. 2003/0034992 (“the '992 application”); (2) U.S. patent application Ser. No. 10/150,355, entitled “METHODS AND SYSTEMS FOR SUB-PIXEL RENDERING WITH GAMMA ADJUSTMENT,” filed May 17, 2002, and published as U.S. Patent Application Publication No. 2003/0103058 (“the '058 application”); (3) U.S. patent application Ser. No. 10/215,843, entitled “METHODS AND SYSTEMS FOR SUB-PIXEL RENDERING WITH ADAPTIVE FILTERING,” filed Aug. 8, 2002, and published as U.S. Patent Application Publication No. 2003/0085906 (“the '906 application”). The '992, '058, and '906 applications are herein incorporated by reference herein.
The accompanying drawings, which are incorporated in, and constitute a part of this specification illustrate exemplary implementations and embodiments of the invention and, together with the description, serve to explain principles of the invention.
Reference will now be made in detail to implementations and embodiments, examples of which are illustrated in the accompanying drawings. Wherever possible, the same reference numbers will be used throughout the drawings to refer to the same or like parts.
A further reduction in acceptable viewing angle (i.e. inner cone 16) may occur when the image data itself is sub-pixel rendered in accordance with any of the SPR algorithms and systems as disclosed in the incorporated applications or with any known SPR system and methods. One embodiment of such a system is shown in
This reduction in acceptable viewing angle is primarily caused by color artifacts that may appear when viewing a subpixel rendered image because high spatial frequency edges have different values for red, green, and blue subpixels. For example, black text on a white background which uses SPR on a design similar to
Currently, red and blue image data are averaged via a SPR process to create the proper value on the red and blue subpixels on a display. This averaging causes viewing angle problems for some liquid crystal displays because the viewing angle characteristics are a function of the voltage setting on the pixel. To smooth out the visual effects, several embodiments disclosed herein describe a temporal method to create the average value such that the viewing angle is not affected by subpixel rendering. As will be discussed further below in connection with
As an example,
For illustrative purposes,
As the viewing angle increases to angle ΘUP, then the observer would view a fall-off of ΔG in the green subpixel brightness—while viewing a ΔR,B fall-off 902 in the brightness of either the red or the blue subpixel brightness. Thus, at OUP, there is G′˜80, R′˜20, B′˜20, which results in the image of the white line assuming a more greenish hue—e.g. 80−2×(20)−2×(20). For angle ODOWN, the green pixels will again fall off an amount ΔG, while the red and blue subpixels will actually rise an amount ΔR,B 904. In this case, the white line will assume a magenta hue.
So, to correct for this color artifact, it might be desirable to drive the red and blue subpixels effectively on a different curve so that the delta fall-off in the green vs. the red/blue subpixels better match each other as a relative percentage of their total curve. An intermediate curve which is the average curve between 100% and 0% is shown in
Other embodiments and refinements of the above temporal subpixel rendering are possible.
As may be seen, the response time for liquid crystals (as shown in
To correct this color imbalance,
An alternate embodiment that achieves a 50% average brightness but experiences near 100% and 0% peak luminances would improve the overall viewing angle performance because the liquid crystal has it's best viewing angles at these two extreme luminance values. If the LC does not fully switch, then the brightness of the red and blue pixels will be wrong and color fringing will be seen. In this case, a “gain” or offset to the pixel values can be applied so as to achieve the desired brightness. For example, if the pixel cannot fully switch in a frame time (˜15 ms), then the average brightness (transmission) of the LCD will be less than the average of the two pixel values. If a black to white edge is desired, then the two values are 100% and 0% for an average of 50%. If, for example, the LC only switches to 50% and then goes back to 0%, it will be necessary to multiply the two pixel values by 0.5 and then add 0.25. Then the two states will switch between 100*0.5+0.25=75% and 0*0.5+0.25=25% for an average of the desired 50%. These gain and offset values are adjusted empirically or can be calculated; once determined, they will be the same for all panels unless the LC material or cell gap is changed. The color stability will not be as good as with faster responding LC material, but will be an improvement over non-temporal filtering. One may also just adjust the lower value, leaving the higher value constant. This may improve the viewing angle.
Temporal Patterns With Arbitrary Numbers of Frames
An alternative embodiment is now described that uses multiple numbers of frames to achieve the desired temporal averaging.
With either
Other embodiments of suitable pulse trains to achieve substantially the same result can be designed to match any given liquid crystal performance curve. For example, if the liquid crystal has a fast rise time and slow fall time then an appropriate pulse train may be 0% for frame 1, 100% for frame 2 and 3, and then repeat.
In general, by using arbitrary number of frames in an on/off-pattern-period, one can design pulse trains or patterns of ON's and OFF's that ultimately give the correct average pixel luminance. As discussed, separate patterns can be applied to each color. This technique may have lower temporal resolution, but judiciously applied to static images, the correct amount of emitted light from a particular pixel may be realized. In the case of scrolling text, the technique may also be applied. Since the operator in general is not attempting to read the text while it is moving, any temporal distortion of the text due to the applied pattern will not negatively impact the user's experience. The patterns can be designed to provide color correction to scrolling text.
This embodiment avoids the necessity of employing a voltage offset from the zero value as used in
Another example of a suitable pulse train is as follows: consider a four frame pattern 1,1,1,0 (or some other arbitrary pattern) that is applied to red and blue subpixels such that the flicker from each cancels each other—i.e. red and blue subpixels are out of luminance phase. Green remains unmodulated in this example. Theoretically, the output luminance will be 75% of maximum for red and blue subpixels. However, given the asymmetry of the ON and OFF response times, the response will be less than 75%, approaching 50% depending on the specific LC response time. The flicker frequency will be 15 Hz assuming a 60 Hz refresh rate, but the variations can be minimized by phasing the red and blue to cancel each other. The remaining flicker will be a fraction of the total light due to the proximity of a 100% green pixel, so the flicker effect will be attenuated.
Inversion Schemes For Effecting Temporal SPR
For LCDs which are polarity inverted to achieve zero DC voltage across the cell, there is an extra requirement when using temporal filtering. Usually the polarity is inverted every frame time, either row by row (row inversion), column by column (column inversion) or pixel by pixel (dot inversion). In the case of dot inversion, the polarity of the inversion either varies every row (1:1) or every two rows (1:2). The choice of inverting the polarity every frame is somewhat for convenience of the circuitry; polarity can be inverted every two frames without degrading the LC material. It may be desirable to invert every two frames when temporal dithering is employed so as to not get extra DC applied to the cell along edges. This could occur for the case with inversion every frame because some pixels may be switching 1 0 1 0 . . . ; if the polarity is switching every frame, then the “1” state will always be the same polarity.
Various Implementation Embodiments
One further embodiment for implementing a temporal SPR system is shown in
As may be seen, red source image data 1202 may be stored in the system or otherwise input into the system. This temporal averaging for red and blue data will result in the same visual appearance compared to an RGB stripe system; viewing angle and response time effects will be the same. It may also simplify the data processing for pictorial applications such as camera or TV applications. This one embodiment for remapping may work well for rendering text, but might lead to some inaccuracies in gray levels which can affect picture quality. Thus, yet another embodiment for a remapping for images, as shown in
Use of Adaptive Filtering
Adaptive filtering can be applied to decide when to use the values directly or to average them. For edges, the R and B values are temporally averaged frame by frame, preserving the viewing angle. For non-edges, the adjacent values are first averaged and then outputted to the output subpixels. Averaging adjacent image data values for edges is not necessarily desirable because averaging would tend to blur the edge—thus making the transition less sharp. So, it may be desirable to detect where and when an edge is occurring in the image.
The averaging will make pictures slightly more accurate. Note that the averaging goes to left pixel on odd frames and right pixel on even. A typical algorithm is as follows (shown for red):
This application is a divisional of U.S. Nonprovisional application Ser. No. 10/379,767 entitled SYSTEMS AND METHODS FOR TEMPORAL SUBPIXEL RENDERING OF IMAGE DATA, filed on Mar. 4, 2003, which is incorporated by reference herein. The present application is related to commonly owned U.S. patent applications: (1) U.S. patent application Ser. No. 10/379,766 entitled “SUB-PIXEL RENDERING SYSTEM AND METHOD FOR IMPROVED DISPLAY VIEWING ANGLES,” published as U.S. Patent Application Publication 2004/0174375; and (2) U.S. patent application Ser. No. 10/379,765, entitled “SYSTEMS AND METHODS FOR MOTION ADAPTIVE FILTERING,” published as U.S. Patent Application Publication 2004/0174380. U.S. Patent Application Publications 2004/0174375 and 2004/0174380 are hereby incorporated by reference herein.
Number | Date | Country | |
---|---|---|---|
Parent | 10379767 | Mar 2003 | US |
Child | 11462979 | Aug 2006 | US |