The present application relates to systems and methods in various embodiments for providing efficient memory structures and methodologies for displays comprising novel subpixel layouts.
In commonly owned United States patents and patent applications including: (1) U.S. Pat. No. 6,903,754 (“the '754 patent”) entitled “ARRANGEMENT OF COLOR PIXELS FOR FULL COLOR IMAGING DEVICES WITH SIMPLIFIED ADDRESSING;” (2) United States Patent Publication No. 2003/0128225 (“the '225 application”) having application Ser. No. 10/278,353 and entitled “IMPROVEMENTS TO COLOR FLAT PANEL DISPLAY SUB-PIXEL ARRANGEMENTS AND LAYOUTS FOR SUB-PIXEL RENDERING WITH INCREASED MODULATION TRANSFER FUNCTION RESPONSE,” filed Oct. 22, 2002; (3) United States Patent Publication No. 2003/0128179 (“the '179 application”) having application Ser. No. 10/278,352 and entitled “IMPROVEMENTS TO COLOR FLAT PANEL DISPLAY SUB-PIXEL ARRANGEMENTS AND LAYOUTS FOR SUB-PIXEL RENDERING WITH SPLIT BLUE SUB-PIXELS,” filed Oct. 22, 2002; (4) United States Patent Publication No. 2004/0051724 (“the '724 application”) having application Ser. No. 10/243,094 and entitled “IMPROVED FOUR COLOR ARRANGEMENTS AND EMITTERS FOR SUB-PIXEL RENDERING,” filed Sep. 13, 2002; (5) United States Patent Publication No. 2003/0117423 (“the '423 application”) having application Ser. No. 10/278,328 and entitled “IMPROVEMENTS TO COLOR FLAT PANEL DISPLAY SUB-PIXEL ARRANGEMENTS AND LAYOUTS WITH REDUCED BLUE LUMINANCE WELL VISIBILITY,” filed Oct. 22, 2002; (6) United States Patent Publication No. 2003/0090581 (“the '581 application”) having application Ser. No. 10/278,393 and entitled “COLOR DISPLAY HAVING HORIZONTAL SUB-PIXEL ARRANGEMENTS AND LAYOUTS,” filed Oct. 22, 2002; and (7) United States Patent Publication No. 2004/0080479 (“the '479 application”) having application Ser. No. 10/347,001 and entitled “IMPROVED SUB-PIXEL ARRANGEMENTS FOR STRIPED DISPLAYS AND METHODS AND SYSTEMS FOR SUB-PIXEL RENDERING SAME,” filed Jan. 16, 2003, novel sub-pixel arrangements are disclosed for improving the cost/performance curves for image display devices. Each of the aforementioned '225, '179, '724, '423, '581, and '479 published applications and U.S. Pat. No. 6,903,754 are hereby incorporated by reference herein in its entirety.
For certain subpixel repeating groups having an even number of subpixels in a horizontal direction, systems and techniques to affect improvements, e.g. proper dot inversion schemes and other improvements, are disclosed in the following commonly owned United States patent documents: (1) United States Patent Publication No. 2004/0246280 (“the '280 application”) having application Ser. No. 10/456,839 and entitled “IMAGE DEGRADATION CORRECTION IN NOVEL LIQUID CRYSTAL DISPLAYS”; (2) United States Patent Publication No. 2004/0246213 (“the '213 application”) (U.S. patent application Ser. No. 10/455,925) entitled “DISPLAY PANEL HAVING CROSSOVER CONNECTIONS EFFECTING DOT INVERSION”; (3) United States Patent Publication No. 2004/0246381 (“the '381 application”) having application Ser. No. 10/455,931 and entitled “SYSTEM AND METHOD OF PERFORMING DOT INVERSION WITH STANDARD DRIVERS AND BACKPLANE ON NOVEL DISPLAY PANEL LAYOUTS”; (4) United States Patent Publication No. 2004/0246278 (“the '278 application”) having application Ser. No. 10/455,927 and entitled “SYSTEM AND METHOD FOR COMPENSATING FOR VISUAL EFFECTS UPON PANELS HAVING FIXED PATTERN NOISE WITH REDUCED QUANTIZATION ERROR”; (5) United States Patent Publication No. 2004/0246279 (“the '279 application”) having application Ser. No. 10/456,806 entitled “DOT INVERSION ON NOVEL DISPLAY PANEL LAYOUTS WITH EXTRA DRIVERS”; (6) United States Patent Publication No. 2004/0246404 (“the '404 application”) having application Ser. No. 10/456,838 and entitled “LIQUID CRYSTAL DISPLAY BACKPLANE LAYOUTS AND ADDRESSING FOR NON-STANDARD SUBPIXEL ARRANGEMENTS”; (7) United States Patent Publication No. 2005/0083277 (“the '277 application”) having application Ser. No. 10/696,236 entitled “IMAGE DEGRADATION CORRECTION IN NOVEL LIQUID CRYSTAL DISPLAYS WITH SPLIT BLUE SUBPIXELS”, filed Oct. 28, 2003; and (8) United States Patent Publication No. 2005/0212741 (“the '741 application”) having application Ser. No. 10/807,604 and entitled “IMPROVED TRANSISTOR BACKPLANES FOR LIQUID CRYSTAL DISPLAYS COMPRISING DIFFERENT SIZED SUBPIXELS”, filed Mar. 23, 2004. Each of the aforementioned '280, '213, '381, '278, '404, '277 and '741 published applications are hereby incorporated by reference herein in its entirety.
These improvements are particularly pronounced when coupled with sub-pixel rendering (SPR) systems and methods further disclosed in the above-referenced U.S. patent documents and in commonly owned United States patents and patent applications: (1) United States Patent Publication No. 2003/0034992 (“the '992 application”) having application Ser. No. 10/051,612 and entitled “CONVERSION OF A SUB-PIXEL FORMAT DATA TO ANOTHER SUB-PIXEL DATA FORMAT,” filed Jan. 16, 2002; (2) United States Patent Publication No. 2003/0103058 (“the '058 application”) having application Ser. No. 10/150,355 entitled “METHODS AND SYSTEMS FOR SUB-PIXEL RENDERING WITH GAMMA ADJUSTMENT,” filed May 17, 2002; (3) United States Patent Publication No. 2003/0085906 (“the '906 application”) having application Ser. No. 10/215,843 and entitled “METHODS AND SYSTEMS FOR SUB-PIXEL RENDERING WITH ADAPTIVE FILTERING,” filed Aug. 8, 2002; (4) United States Publication No. 2004/0196302 (“the '302 application”) having application Ser. No. 10/379,767 and entitled “SYSTEMS AND METHODS FOR TEMPORAL SUB-PIXEL RENDERING OF IMAGE DATA” filed Mar. 4, 2003; (5) United States Patent Publication No. 2004/0174380 (“the '380 application”) having application Ser. No. 10/379,765 and entitled “SYSTEMS AND METHODS FOR MOTION ADAPTIVE FILTERING,” filed Mar. 4, 2003; (6) U.S. Pat. No. 6,917,368 (“the '368 Patent”) entitled “SUB-PIXEL RENDERING SYSTEM AND METHOD FOR IMPROVED DISPLAY VIEWING ANGLES”; and (7) United States Patent Publication No. 2004/0196297 (“the '297 application”) having application Ser. No. 10/409,413 and entitled “IMAGE DATA SET WITH EMBEDDED PRE-SUBPIXEL RENDERED IMAGE” filed Apr. 7, 2003. Each of the aforementioned '992, '058, '906, '302, 380 and '297 applications and the '368 patent are hereby incorporated by reference herein in its entirety.
Improvements in gamut conversion and mapping are disclosed in commonly owned United States Patents and co-pending United States patent applications: (1) U.S. Pat. No. 6,980,219 (“the '219 Patent”) entitled “HUE ANGLE CALCULATION SYSTEM AND METHODS”; (2) United States Patent Publication No. 2005/0083341 (“the '341 application”) having application Ser. No. 10/691,377 and entitled “METHOD AND APPARATUS FOR CONVERTING FROM SOURCE COLOR SPACE TO RGBW TARGET COLOR SPACE”, filed Oct. 21, 2003; (3) United States Patent Publication No. 2005/0083352 (“the '352 application”) having application Ser. No. 10/691,396 and entitled “METHOD AND APPARATUS FOR CONVERTING FROM A SOURCE COLOR SPACE TO A TARGET COLOR SPACE”, filed Oct. 21, 2003; and (4) United States Patent Publication No. 2005/0083344 (“the '344 application”) having application Ser. No. 10/690,716 and entitled “GAMUT CONVERSION SYSTEM AND METHODS” filed Oct. 21, 2003. Each of the aforementioned '341, '352 and '344 applications and the '219 patent is hereby incorporated by reference herein in its entirety.
Additional advantages have been described in (1) United States Patent Publication No. 2005/0099540 (“the '540 application”) having application Ser. No. 10/696,235 and entitled “DISPLAY SYSTEM HAVING IMPROVED MULTIPLE MODES FOR DISPLAYING IMAGE DATA FROM MULTIPLE INPUT SOURCE FORMATS”, filed Oct. 28, 2003; and in (2) United States Patent Publication No. 2005/0088385 (“the '385 application”) having application Ser. No. 10/696,026 and entitled “SYSTEM AND METHOD FOR PERFORMING IMAGE RECONSTRUCTION AND SUBPIXEL RENDERING TO EFFECT SCALING FOR MULTI-MODE DISPLAY” filed Oct. 28, 2003, each of which is hereby incorporated herein by reference in its entirety.
Additionally, each of these co-owned and co-pending applications is herein incorporated by reference in its entirety: (1) United States Patent Publication No. 2005/0225548 (“the '548 application”) having application Ser. No. 10/821,387 and entitled “SYSTEM AND METHOD FOR IMPROVING SUB-PIXEL RENDERING OF IMAGE DATA IN NON-STRIPED DISPLAY SYSTEMS”; (2) United States Patent Publication No. 2005/0225561 (“the '561 application”) having application Ser. No. 10/821,386 and entitled “SYSTEMS AND METHODS FOR SELECTING A WHITE POINT FOR IMAGE DISPLAYS”; (3) United States Patent Publication No. 2005/0225574 (“the '574 application”) and United States Patent Publication No. 2005/0225575 (“the '575 application”) having application Ser. Nos. 10/821,353 and 10/961,506 respectively, and both entitled “NOVEL SUBPIXEL LAYOUTS AND ARRANGEMENTS FOR HIGH BRIGHTNESS DISPLAYS”; (4) United States Patent Publication No. 2005/0225562 (“the '562 application”) having application Ser. No. 10/821,306 and entitled “SYSTEMS AND METHODS FOR IMPROVED GAMUT MAPPING FROM ONE IMAGE DATA SET TO ANOTHER”; (5) United States Patent Publication No. 2005/0225563 (“the '563 application”) having application Ser. No. 10/821,388 and entitled “IMPROVED SUBPIXEL RENDERING FILTERS FOR HIGH BRIGHTNESS SUBPIXEL LAYOUTS”; and (6) United States Patent Publication No. 2005/0276502 (“the '502 application”) having application Ser. No. 10/866,447 and entitled “INCREASING GAMMA ACCURACY IN QUANTIZED DISPLAY SYSTEMS.”
In one embodiment, a display system is disclosed, said display system comprising a display, said display further comprising a plurality of logical pixels wherein said logical pixels further comprise a first number of center-subpixels; a memory, said memory storing said image data to be rendered by said display; wherein said memory is mapped such that said center-subpixels are stored in addressable memory cells.
In another embodiment, a display system is disclosed, said display system comprising a display capable of rendering both a first resolution data set and a second resolution data set, said display system capable of inputting RGB stripe color data and capable of outputting subpixel rendered image data onto said display; said display system further comprising: a first processing unit for said first resolution data set; a second processing unit for processing said second resolution data set; wherein said image data from said first processing unit and said second processing unit is multiplexed to output to said display according to a sync signal.
The accompanying drawings, which are incorporated in, and constitute a part of this specification illustrate exemplary implementations and embodiments of the invention and, together with the description, serve to explain principles of the invention.
The traditional RGB stripe system As shown in
As shown in
Generally speaking, several sub-pixels are combined to display one color dot called as pixel. For legacy RGB stripe display as noted above, one physical pixel typically consists of three colored subpixels—red, green and blue. However, for certain displays having novel subpixel architectures (as noted in many of the applications herein incorporated by reference), other logical groupings of colored subpixels are possible to provide a potentially multi-colored spot. For example, one or two center-subpixels and some adjacent ones may be combined into one pixel through a subpixel rendering algorithm, which is still serves as one potentially multi-color dot. Such an arrangement is called a “logical” pixel. “Center-subpixels” may be physically in the center of a logical pixel and may also be the brightest portion in a logical pixel.
To express one pixel, the logical pixel approach typically needs more subpixels than a physical one; however, its total number of subpixel on screen could be reduced because all adjacent subpixels are shared by the other pixels. The number of center-subpixel in a logical pixel may also be smaller than the number of subpixel in a physical pixel. It is noted that the colors of center-subpixel may vary according to the position; however, an array of center-subpixels is usually repeated.
In one embodiment of a system made in accordance with the principles of the present application, center-subpixels and some adjacent subpixels are combined to form a logical pixel. For the variety of novel subpixel layouts that are disclosed in the patent applications incorporated by reference, there are two broad categories of layouts: (1) subpixel layouts comprising an odd number of center-subpixels for two logical pixels and (2) subpixel layouts comprising an even number of center-subpixels for two logical pixels.
As an example of the first category of subpixel layouts,
As an example of the second category of subpixel layouts,
It should be appreciated that the layouts depicted in
In one embodiment, such a display system comprising a subpixel layout that is different from the traditional RGB stripe layout may need to accept legacy RGB stripe image data. In such a case, there is a notion of how many center-subpixels are updated for one RGB stripe input pixel for such a system. In the case of an “odd number” display system (e.g. as shown in
Memory Structures for Novel Systems
For these novel systems, it may be desirable to design memory structures that are typical for RGB stripe systems. For example, if an even number system were to use conventional memory structures bases on the three subpixel repeating group as shown in
Thus, it may be possible and desirable to design two kinds of memory structure based on even and odd number display systems. These memories could be updated based on how many center-subpixels of each display are needed. For example, for odd number displays, 2M-1 center-subpixels for two logical pixels may be updated with one memory-write cycle. For even number displays, M center-subpixels for one logical pixel may also be updated with one memory-write cycle.
One benefit of the above novel display systems might be a reduction in the number of output Gamma Look-Up Tables (LUTs). For example, most conventional display system uses one output gamma LUT per each color. Since three colors are processed in parallel and also displayed together, there typically is three output gamma LUTs. However, in the case of the odd and even number display systems disclosed herein, since they output M or 2M-1 center-subpixels with one memory-write cycle, M or 2M-1 output gamma LUTs might suffice depending upon subpixel layout. For example, for even number displays, the number of center-subpixels, M, is smaller than the number of subpixel per physical pixel. In case of layouts of
As shown in
As shown in
Embodiments of an odd number display and an even number display are shown in
Memory Support for VGA Rendering
VGA operation requires a large frame buffer ( for example, 3.7 MBit) which adds excess cost and size to driver ICs, particularly for cell phone and other small portable display systems. If the frame buffer is eliminated, the bandwidth to the panel for synchronous operation is high (˜20 MHz), which can cause EMI problems. Thus, a novel VGA architecture is disclosed herein that applies to a wide variety of portable display systems.
An alternative architecture is shown in
Memory 2106, 2108 may comprise 12 bit architecture with RG data in upper memory and BW data in lower memory. It will be appreciated that other architectures will also work—e.g. 18 bit. In this mode of operation, white pixel processing may be performed by the image processor. RG and BW swapping may be also done to support rotation modes of the display. Thus, it is possible to achieve compatibility with existing qVGA data with system 2100.
If VGA data is available, a different data path may be used, as illustrated in
To support both VGA and qVGA data, the two data paths 2302 and 2304 are combined. This is shown schematically in
It should be noted that while two input gamma and GMA block are shown, they can actually be multiplexed so that only one set of gates are required. It should also be noted that the memory read timing may follow the VGA sync signal. In qVGA mode, a PLL may generate the LCD output timing.
Efficient Gamma Table Implementations
In at least one embodiment of a display system, gamma tables are used to support “gamma pipeline”. To implement gamma pipeline, a RAM table may be employed. Such an approach may work well; but there may be other considerations for such a system—e.g. 1) loading time may be long, especially for mobile phone, 2) ASIC size is increased. It may be desirable to use ROM table, but the system possibly loses the capability to adjust the gamma values.
In one embodiment of a display system made in accordance with the principles of the present invention, it is possible to employ a two stage system and method to adjust gamma for both input and output gamma which is ROM based and programmed with a few registers.
Conventional output gamma, particularly for mobile phone and other display systems, it is typical to use 10 bits for processing and 6 bits output. Thus a 10 to 6 bit table is employed, which uses 1024*6/8=768 bytes of memory for each color. Thus, for a three-color system (e.g. RGB) there are three such tables; while for four color system (e.g. RGBW), there may be four tables.
The following discussion will describe one possible embodiment and particularly for the treatment of one color. It will be appreciated that other colors may be treated similarly. One embodiment may adjust gamma within a pre-determined amount (e.g. +/−0.5 for merely one example) around the desired value of inverse gamma (e.g. 1/2.2 for merely one example)—possibly by some increment (e.g. 0.1 or some other value that may be pre-determined or dynamically generated). In this embodiment, it is possible to store a gamma (e.g. 1/2.2 for merely one example) as 10 bit address and 6 bit entries (or M bit address and N bit entries where M=>N in general).
For most LCDs, it will be sufficient to use this default table. However, if gamma needs to be adjusted, it is possible to add extra smaller correction LUT ROM tables that contain the “difference” between multiple gamma values (e.g. between, for example, 1/2.2 and 1/2.0). A first step in data processing might be to look up the 6 bit value corresponding to the 10 bit input. Then the 6-bit output value may be used as the address for a second LUT to look up the correction value. The two outputs are added and output to the display.
For merely one example, the range of output gamma from 1.7 to 2.7 in steps of 0.1 is shown in
In another embodiment, the calculated error in this process compared to fixed ROM tables may be less than 0.5 out of 63. If this error becomes visible in gray wedges, a dithering method may be used to reduce the error. This can be easily accomplished by switching between two ROM correction LUTs at frame rate. Flicker should be negligible since the change in luminance is small.
For input gamma, it may suffice to use one gamma table, e.g. sRGB, for each color RGB. This is, for one example, a 6 bit address with 10 bit outputs (e.g. 80 bytes×3 =240 bytes). However, if adjustments are needed to input gamma, the same strategy can be employed as described for output gamma. In this case, a secondary table may use more bits because of the 10 bit output. For merely one example, for +/−0.5 input, the error from 2.2 gamma may have a max of approximately 96—so a 7 bit LUT output may be added to the 2.2 value. Since the purpose of input gamma is to match to human eye, it is possible that only one or two extra gamma choices may suffice e.g. 2.0, 2.2, 2.4. For this limited set, the max value of error may be reduced—e.g. approximately 36, so a 6 bit table may be sufficient. Thus, in one embodiment, the size of the correction LUT may therefore be 64*6=48 bytes for each table for each color. For merely one example if two tables are used, the total ROM size may be 64*10/8=80 bytes for main use, plus 96 bytes for two extra tables, for a total of 176 bytes/color.
In comparison with a conventional system, to achieve fully programmable gamma tables for 6-6-6 input, 10 bit internal processing, and RGBW output, a conventional system may comprise: 240 bytes input SRAM and 3072 bytes output SRAM. Alternatively, for a conventional system using ROM tables, it may require 1920×3=720 bytes input ROM (three choices for each RGB) and 34K bytes for 11 choices of output ROM (RGBW).
By comparison, an embodiment of the present application may suffice with a total input ROM of 240 bytes for sRGB ROM, 528 bytes for secondary input LUTs. So, for the primary LUT, it would suffice to have 768*4=3072 bytes, plus 960 bytes for secondary LUT for RGBW. Complete programming can be accomplished with three 8 bit registers. For other embodiments, if the number of bits is changed for input and output, it would be easy to calculate the memory savings.
While the invention has been described with reference to an exemplary embodiment, it will be understood by those skilled in the art that various changes may be made and equivalents may be substituted for elements thereof without departing from the scope of the invention. In addition, many modifications may be made to adapt a particular situation or material to the teachings without departing from the essential scope thereof. Therefore, it is intended that the invention not be limited to the particular embodiment disclosed as the best mode contemplated for carrying out this invention, but that the invention will include all embodiments falling within the scope of the appended claims.
This application claims the benefit of U.S. Provisional Application No. 60/668,578 entitled IMPROVED METHODS AND SYSTEMS FOR BY-PASSING SUBPIXEL RENDERING IN DISPLAY SYSTEMS, filed on Apr. 4, 2005 and is herein incorporated by reference in its entirety. The following co-owned (and filed on same date) applications are related to the present application and are herein incorporated by reference: (1) U.S. patent application Ser. No. 60/668,511 entitled “SYSTEMS AND METHODS FOR IMPLEMENTING LOW-COST GAMUT MAPPING ALGORITHMS”; (2) U.S. patent application Ser. No. 60/668,512 entitled “SYSTEMS AND METHODS FOR IMPLEMENTING IMPROVED GAMUT MAPPING ALGORITHMS” and (3) U.S. patent application Ser. No. 60/668,578 entitled “IMPROVED METHODS AND SYSTEMS FOR BY-PASSING SUBPIXEL RENDERING IN DISPLAY SYSTEMS.
Filing Document | Filing Date | Country | Kind | 371c Date |
---|---|---|---|---|
PCT/US06/12768 | 4/4/2006 | WO | 00 | 10/4/2007 |
Number | Date | Country | |
---|---|---|---|
60668510 | Apr 2005 | US |