Patent Grant
9646546
The invention relates to displays for color images. The invention has application to color displays generally including computer displays, televisions, digital video projectors and the like.
A typical liquid crystal display (LCD) has a backlight and a screen made up of variable-transmissivity pixels in front of the backlight. The backlight illuminates a rear face of the LCD uniformly. A pixel can be made dark by reducing the transmissivity of the pixel. The pixel can be made to appear bright by increasing the transmissivity of the pixel so that light from the backlight can pass through. Images can be displayed on an LCD by applying suitable driving signals to the pixels to create a desired pattern of light and dark areas.
In a typical color LCD, each pixel is made up of individually controllable red, green and blue elements. Each of the elements includes a filter that passes light of the corresponding color. For example, the red element includes a red filter. When only the red element in a pixel is set to transmit light, the light passes through the red filter and the pixel appears red. The pixel can be made to have other colors by applying signals which cause combinations of different transmissivities of the red, green and blue elements.
Fluorescent lamps are typically used to backlight LCDs. PCT publication No. WO03077013A3 entitled HIGH DYNAMIC RANGE DISPLAY DEVICES discloses a high dynamic range display in which LEDs are used as a backlight.
There is a need for cost effective color displays. There is a particular need for such displays that provide high quality color images.
This invention has a number of aspects. One aspect of the invention provides methods for displaying images at a viewing area. The methods comprise providing an array comprising a plurality of groups of individually-controllable light sources, the light sources of each group emitting light of a corresponding one of a plurality of colors; driving the array in response to image data such that each of the groups projects a luminance pattern onto an active area of a modulator comprising a plurality of pixels; and, controlling the pixels of the modulator to selectively allow light from the active area to pass to the viewing area. The methods may display different color components of the image or different groups of color components of the image in a time-multiplexed manner.
Another aspect of the invention provides apparatus for displaying images at a viewing area. The apparatus comprises an array comprising a plurality of groups of individually-controllable light sources. The light sources of each group emit light of a corresponding one of a plurality of colors. The apparatus also includes a modulator having an active area comprising a plurality of pixels. The active area is illuminated by the array. Each pixel is controllable to vary a proportion of light incident on the active area that is passed to the viewing area. The apparatus also comprises a control circuit configured to drive each of the groups of the light sources according to a control signal to project a luminance pattern onto the active area of the modulator. The luminance pattern for each of the groups has a variation in intensity over the active area. In some embodiments the controller is configured to operate different ones of the groups or different sets of two or more of the groups in a time-multiplexed manner. In some embodiments of the invention the controller individually controls different parts of the array. In such embodiments of the invention, different ones of the groups or different sets of the groups may be active in different parts of the array during the same time interval.
Further aspects of the invention and features of specific embodiments of the invention are described below.
In drawings which illustrate non-limiting embodiments of the invention,
Throughout the following description, specific details are set forth in order to provide a more thorough understanding of the invention. However, the invention may be practiced without these particulars. In other instances, well known elements have not been shown or described in detail to avoid unnecessarily obscuring the invention. Accordingly, the specification and drawings are to be regarded in an illustrative, rather than a restrictive, sense.
Modulator 12 may be a transmission-type modulator, such as an LCD panel, in which the amount of light transmitted through each pixel 13 can be varied, or a reflectance-type modulator. In some embodiments of the invention, modulator 12 comprises a gray-scale modulator such as a monochrome LCD panel or a digital mirror array.
The light sources of array 14 include independently-controllable light sources of each of a plurality of colors. The colors of the light sources can be combined with one another in different proportions to produce colors within a color gamut. For example, the colors may be red green and blue. These colors can be mixed to provide any color within the RGB color gamut. In the illustrated embodiment, the light sources comprise red light sources 16R, green light sources 16G and blue light sources 16B. The light sources are typically arranged so that light sources of each color are distributed substantially uniformly through array 14.
The symmetrical arrangement of light sources 16 permits light sources 26 to provide relatively uniform illumination of the active area of modulator 12 with light of any one of the colors for which there are light sources 16. Preferably the point spread functions of adjacent light sources 16 of each color overlap with one another.
It is not necessary that the maximum intensity of all of light sources 16 be the same. For example, it is convenient to use LEDs for the light sources. LEDs of different colors tend to have different efficiencies. Typically the efficiency (the amount of light generated for a given electrical power) of green LEDs is greater than that of red LEDs. Typical red and green LEDs have greater efficiencies than typical blue LEDs. Up to a point, one can obtain brighter LEDs of any available color at greater expense. Those who design displays can select appropriate LEDs on the basis of factors such as maximum light output, electrical power requirements, and cost. Currently it is common to find it most cost effective to provide red, green and blue LEDs having flux ratios of approximately 3:5:1. With such a flux ratio, the red LEDs are three times brighter than the blue LEDs and the green LEDs are five times brighter than the blue LEDs.
In some embodiments of the invention, the number of light sources 16 of each color in array 14 is at least approximately inversely proportional to the flux ratio of the light sources. For example, where an array has light sources of three colors having flux ratios of 3:5:1, then the numbers of light sources of each of the three colors in the array could be in the ratio 5:3:15. The light sources of each color are substantially uniformly distributed on the array. In some embodiments, the point spread functions of the light sources of each color have widths that increase with the spacing between adjacent light sources of that color. The point spread functions of the light sources of one color may have widths that are in direct proportion to the spacing between adjacent light sources of that color in array 14. In some embodiments, a ratio of an average spacing between adjacent ones of the light sources in any one of the groups of light sources to a width of a point spread function of the light sources in the group of light sources is the same within ±20% for all of the groups of light sources in the array.
Each light source 16 illuminates at least part of the active area of modulator 12. Light sources 16 of different colors in different areas of array 14 are independently controllable.
Display 10 may be operated to display a color image in a frame sequential mode wherein, the operation of the light sources in array 14 is time multiplexed.
Method 30 sequentially executes blocks 32B and 32C which apply modulation and light source driving signals for other colors. After the last (Nth) set of modulation and light source driving signals has been applied, method 30 loops back to block 32A.
Preferably method 30 cycles through blocks 32A, 32B and 32C quickly enough that a person looking at viewing area 15 perceives a color image that does not flicker annoyingly. The human visual system generally ignores flicker that occurs at frequencies above roughly 50 Hz to 60 Hz.
In some embodiments of the invention, method 30 is repeated at a rate of at least 50 to 60 Hz. Where there are three colors (such as red, green and blue) this would require modulator 12 to operate at a rate of about 150 to 180 Hz. In cases where method 20 is used to drive a display 10 at relatively high rates then modulator 12 must be of a type that can support those rates.
Display may include a controller 19 that generates suitable light source control signals 17 and modulator control signals 18 to display a desired image. The desired image may be specified by image data 11 which directly or indirectly specifies color values for each pixel. Image data 11 may have any suitable format and may specify luminance and color values using any suitable color model. For example, image data 11 may specify:
Light source control signals 17 may be generated by determining in controller 19 an intensity for driving each of LEDs 16 such that light sources 16 project desired luminance patterns onto the active area of modulator 12 for each color. Preferably, for each of the colors, the luminance of the luminance pattern at each pixel 13 is such that a luminance specified for that pixel 13, for that color, by image data 11 can be achieved within the range of modulation of the pixel. That is, it is desirable that the luminance L be such that:
L×TMIN≦LIMAGE≦L×TMAX (1)
where: TMIN is the minimum transmissivity of a pixel; TMAX is the maximum transmissivity of the pixel; and LIMAGE is the luminance for the pixel for that color specified by image data 11.
Controller 19 may generate modulator control signals 18 by, for each color, for each pixel 13 of modulator 12, dividing the desired luminance specified by image data 11 by the luminance at that element provided by array 14 when driven by the component of light source control signal 17 for that color.
The luminance provided by light source array 14 may be termed an effective luminance pattern ELP. Since each color is applied at a separate time, the ELP may be computed separately for each color and the computation to determine modulator control signals 18 may be performed independently for each color.
Method 20 computes ELPs for each color of light in blocks 22-1, 22-2, and 22-3. Method 20 determines the modulator control signal for each color in blocks 23-1, 23-2 and 23-3. In the embodiment of
It can be appreciated that method 30 can be energy efficient for a number of reasons including:
Method 40 may be practiced separately for different parts of the active area of modulator 12. Each part of the active area is illuminated by a cluster of light sources of array 14 that include light sources of all of the different colors represented in array 14. In block 42 method 40 determines the color that is most important for the part being considered. Preferably block 42 ranks colors from the most important color for the part (ranked first) to the least important color for the part.
Which color is “most important” may be determined in any suitable manner. For example, the colors may be ranked according to any one of or any combination of the following:
Where more than one of the above factors are used to rank colors for a part of the active area of modulator 12 then any suitable weighting of the different factors may be used. Those skilled in the art will understand that the weighting may be fine tuned to provide the best reproduction of images of a certain type or to provide desired effects.
In block 44, a desired effective luminance pattern (ELP) is established for the most important (highest ranked) color identified in block 42. The ELP may be established in any suitable manner. For example, the ELP may be established as described above.
Block 46 determines modulator values for the most important color. The modulator values may be determined by dividing a desired luminance for each pixel in the part (as specified by image data 11) by the luminance for that pixel provided by the ELP established in block 44.
Block 48 determines desired ELPs for the other colors of light sources in array 14. The ELPs for the other colors may be obtained approximately by dividing the desired luminance for each pixel (as specified by image data 11) by the modulator values determined in block 46 for the most important color.
Block 50 generates and applies to modulator 12 a modulator control signal which controls the pixels of modulator 12 to have the values determined in block 46 and generates and applies to array 14 light source control signals which cause the light sources 16 of array 14 to illuminate the active area of modulator 12 with light having intensity that, for each color, varies over the active area of modulator 12 according to the ELP for that color determined in block 44 or 48.
Blocks 44 to 50 ensure that, for each part of modulator 12, the most important color identified in block 42 is accurately represented since the ELP and modulator values are both selected for that most important color. The most important color may be different in different parts of modulator 12. Other colors in the image of image data 11 are reproduced approximately.
In many cases, the image displayed by performing blocks 42 to 50 will be fairly accurate because, in typical images, it is common for some parts of the image to be single-colored. In single-colored parts of the image only the most important color needs to be represented. Further, in typical images, some parts of the image will be gray. In parts of the image that are predominantly a shade of gray, similar modulator values would be selected for all of the colors and so, in grey parts, using a modulator value determined for the most important color is also reasonably accurate for other lower-ranked colors.
Block 54 determines modulator values for each part of modulator 12 for the second most important color in the part. The modulator values may be determined in the same manner that modulator values for the most important color are determined in block 46. In block 56, driving signals are delivered to array 14 and modulator 12. Modulator 12 is driven with the driving signals which set the pixels of modulator 12 to the modulator values determined in block 54 for the second most important color in each part.
As noted above, block 50 usually does not perfectly reproduce the image specified by image data 11 for colors other than the color identified as the most important color. In block 50, in some pixels a lower ranked color may be brighter than specified by image data 11, while in other pixels the color may be dimmer than specified by image data 11.
Block 56 may optionally compensate for the errors in reproduction of the second most important colors. In the illustrated embodiment, this is done by applying correction factors to the pixel values for the second most important color in block 52. Pixel values modified by the correction factors are used in block 54 to determine the modulator values for the color. For example, if block 50 results in the intensity of a second most important color in a pixel being 15% greater than specified by image data 11 then block 52 may apply a correction factor to the pixel value for the second most important color so that in block 56 the intensity of the second most important color for that pixel is reduced by 15%.
For example, consider a pixel for which image data 11 specifies RGB values of 200, 100, 50. In the part of modulator 12 in which the pixel is located, the colors are ranked in the order: red, green blue. Suppose, block 50 actually causes the light intensities of the pixel to have the values red: 200; green: 80; and blue: 60. If block 52 were not performed then, in block 56 the green intensity of the pixel would be 80 instead of the desired value 100. By performing block 52 the intensity of green light emitted by the pixel in block 56 can be increased to compensate for the fact that the green intensity of the pixel was lower than desired in block 50. For example, block 52 could adjust the desired value for the pixel so that the green intensity of the pixel in block 56 is 120 instead of 100. The green intensity of the pixel will then average to the desired value of 100.
In cases where loop 58 is performed for a tertiary color then the correction of block 52 should be determined to obtain the desired value for each color averaged over block 50 and all repetitions of block 56.
It can be appreciated that method 40 sequentially changes the values for the pixels of modulator 12. Except in unusual cases (for example, monochrome images) array 14 provides light of all colors for each setting of modulator 12. For an embodiment in which there are three colors with correction provided for all colors, for each color, the accuracy with which that color component of the image is displayed varies across subsequent frames as: “perfect”→“average”→“average”→perfect” etc. In a pure field sequential display method, each color is displayed only during a sub-frame during which the color is properly displayed. However, the color is “off” in other sub-frames.
For each color, with a method such as method 40 the net variation in intensity between subsequent frames or sub-frames will thus be much smaller most of the time than in a pure field sequential display method. The reduced fluctuation in color intensity as compared to pure field sequential methods makes it possible to operate at reduced frame rates while avoiding artefacts that result from large fluctuations in the intensity of a color, such as color break up. For example, method 40 may be practiced so that subsequent display blocks 50 and 56 are performed at a low rate. For example, less than 110 Hz. The rate is as low as 50-60 Hz in some embodiments. Method 40 can provide benefits in perceived image quality at higher rates as well.
Block 52 may limit the amount of correction provided to avoid undesirable flicker. If for example, a single pixel of the second-ranked color is dimmer than it should be by 80%, increasing the brightness of that pixel by 80% in the next frame could cause undesirable perceptible flicker. Block 52 may simply cut off compensation at a certain point, for example, block 50 may clip the intensity of a pixel at 150% of its pixel value. In the alternative, block 52 may implement a non-linear correction scale such that small corrections are made completely whereas larger corrections are reduced. For example, an adjustment table such as Table I may be provided.
Optionally block 52 determines a new ELP for the second most important color. Typically this is not necessary as in many real images the correction factors will be small enough that the corrected brightness for the pixel can be achieved by varying modulator values.
In some embodiments, blocks 52 to 56 are repeated for colors of tertiary or lower ranking as indicated by loop 58. After all desired repetitions of blocks 52 to 56, method 40 loops back to block 42 as indicated by line 59. In some embodiments, for at least some least important colors, modulator values are not set.
In some embodiments of the invention, block 54 ensures that the modulator values do not differ from the most recent previous modulator values by more than some threshold amount. This may be done on a pixel-by-pixel basis or for larger parts of the active area. Preventing the modulator values from changing too radically between block 50 and block 56 (or between sequential iterations of block 56) can help to avoid perceptible flicker.
Where method 40 is being used to display a sequence of frames that make up a video image, rather than a still image, blocks 50 and each repetition of block 56 (if block 56 is repeated e.g. for secondary and tertiary colors) may display a separate frame of the video sequence. In the alternative, if modulator 12 can be switched fast enough, blocks 50 and 56 may be repeated for each frame of the video sequence.
In some embodiments of the invention, only less important colors are corrected as described above. The most important colors may each be displayed in a separate sub frame. For example, consider a case where the colors in a part are ranked in order red, green, blue. In a first sub-frame array 14 could illuminate modulator 12 with red light only. The signals driving modulator 12 could be selected to properly reproduce the red color. In a second sub-frame, array 14 illuminates modulator 12 with green and blue light only. The signals driving modulator 12 could be selected to properly reproduce green. The level of blue could be corrected in subsequent frames, as described above. In such embodiments, modulator 12 should operate quickly enough that flicker is not perceptible. For example, modulator 12 may be operated at a rate of 120 Hz or more so that the two most important colors (red and green in this example) are both properly displayed inside one 60 Hz frame. Less important colors are corrected over subsequent frames.
Software for implementing he invention may provide adjustable parameters which control things such as the amount of variation permitted for any pixel between sequential frames; the maximum amount of correction for a color provided in a frame; the method by which colors are ranked; the manner in which the active area of the modulator is divided into parts; and so on.
Certain implementations of the invention comprise computer processors which execute software instructions which cause the processors to perform a method of the invention. For example, one or more processors in a display driver 19 may implement the methods of
Where a component (e.g. a software module, processor, assembly, device, circuit, etc.) is referred to above, unless otherwise indicated, reference to that component (including a reference to a “means”) should be interpreted as including as equivalents of that component any component which performs the function of the described component (i.e., that is functionally equivalent), including components which are not structurally equivalent to the disclosed structure which performs the function in the illustrated exemplary embodiments of the invention.
As will be apparent to those skilled in the art in the light of the foregoing disclosure, many alterations and modifications are possible in the practice of this invention without departing from the spirit or scope thereof. For example:
While a number of exemplary aspects and embodiments have been discussed above, those of skill in the art will recognize certain modifications, permutations, additions and sub-combinations thereof. It is therefore intended that the following appended claims and claims hereafter introduced are interpreted to include all such modifications, permutations, additions and sub-combinations as are within their true spirit and scope.
This application is a continuation of U.S. patent application Ser. No. 14/542,324 filed 14 Nov. 2014, which is a continuation of U.S. patent application Ser. No. 12/941,961 filed 8 Nov. 2010 now U.S. Pat. No. 8,890,795, which is a continuation of U.S. patent application Ser. No. 11/722,706 filed 22 Jun. 2007 now U.S. Pat. No. 7,830,358, which is the US national stage of PCT international patent application No. PCT/CA2005/001975 filed 23 Dec. 2005, which claims priority from U.S. patent application No. 60/638,122 filed 23 Dec. 2004 all of which are hereby incorporated herein by reference. This application claims the benefit under 35 U.S.C. §119 of U.S. patent application No. 60/638,122 filed 23 Dec. 2004.
| Number | Name | Date | Kind |
|---|---|---|---|
| 5107534 | Freyre | Apr 1992 | A |
| 5233338 | Surguy | Aug 1993 | A |
| 5359345 | Hunter | Oct 1994 | A |
| 5724062 | Hunter | Mar 1998 | A |
| 5734362 | Eglit | Mar 1998 | A |
| 6031626 | Shu et al. | Feb 2000 | A |
| 6091849 | Spaulding et al. | Jul 2000 | A |
| 6243055 | Fergason | Jun 2001 | B1 |
| 6448951 | Sakaguchi et al. | Sep 2002 | B1 |
| 6932477 | Stanton | Aug 2005 | B2 |
| 7064740 | Daly | Jun 2006 | B2 |
| 7176879 | Yoshihara | Feb 2007 | B1 |
| 7270425 | Arai | Sep 2007 | B2 |
| 7499017 | Daly | Mar 2009 | B2 |
| 7830358 | Seetzen | Nov 2010 | B2 |
| 8284152 | Lew et al. | Oct 2012 | B1 |
| 8890795 | Seetzen | Nov 2014 | B2 |
| 9224341 | Seetzen | Dec 2015 | B2 |
| 20020057253 | Lim et al. | May 2002 | A1 |
| 20020060662 | Hong | May 2002 | A1 |
| 20020070914 | Bruning et al. | Jun 2002 | A1 |
| 20020113761 | Mizutani | Aug 2002 | A1 |
| 20020122019 | Baba et al. | Sep 2002 | A1 |
| 20020149576 | Tanaka et al. | Oct 2002 | A1 |
| 20020196220 | Sato et al. | Dec 2002 | A1 |
| 20030090455 | Daly | May 2003 | A1 |
| 20030231160 | Yoshihara | Dec 2003 | A1 |
| 20040012801 | Murakami | Jan 2004 | A1 |
| 20040046725 | Lee | Mar 2004 | A1 |
| 20040085496 | Paukshto et al. | May 2004 | A1 |
| 20040201561 | Funamoto | Oct 2004 | A1 |
| 20040246275 | Yoshihara | Dec 2004 | A1 |
| 20040264212 | Chung et al. | Dec 2004 | A1 |
| 20050001537 | West et al. | Jan 2005 | A1 |
| 20050052590 | Ochiai et al. | Mar 2005 | A1 |
| 20050062708 | Yoshihara | Mar 2005 | A1 |
| 20050162737 | Whitehead et al. | Jul 2005 | A1 |
| 20050185272 | Whitehead et al. | Aug 2005 | A1 |
| 20060126326 | Ng et al. | Jun 2006 | A1 |
| 20060146007 | Lim et al. | Jul 2006 | A1 |
| 20060158454 | Heynderickx et al. | Jul 2006 | A1 |
| 20060170645 | Fisekovic et al. | Aug 2006 | A1 |
| 20070001994 | Roth | Jan 2007 | A1 |
| 20110050559 | Seetzen | Mar 2011 | A1 |
| 20150070409 | Seetzen | Mar 2015 | A1 |
| Number | Date | Country |
|---|---|---|
| 2025104 | Mar 1991 | CA |
| 1331060 | Jul 1994 | CA |
| 2354018 | Jun 2000 | CA |
| 1422423 | Jun 2003 | CN |
| H07-226536 | Aug 1995 | JP |
| 2001-142409 | May 2001 | JP |
| 2001-196637 | Jul 2001 | JP |
| 2002-099250 | Apr 2002 | JP |
| 2002-532762 | Oct 2002 | JP |
| 2003-077318 | Mar 2003 | JP |
| 2004-191490 | Jul 2004 | JP |
| 2004-333583 | Nov 2004 | JP |
| 2013-179714 | Sep 2013 | JP |
| 10-2004-0071958 | Aug 2004 | KR |
| 9406249 | Mar 1994 | WO |
| 02069030 | Sep 2002 | WO |
| 03077013 | Sep 2003 | WO |
| 2004107025 | Dec 2004 | WO |
| Entry |
|---|
| Yamada, F. et al., “Invited Paper: Color Sequential LCD Based on OCB with an LED Backlight”, SID 00 Digest, pp. 1180-1183, 2000. |
| Seetzen, H., et al., “A High Dynamic Range Display Using Low and High Resolution Modulators”, SID 03 Digest, pp. 1450-1453, 2003. |
| Number | Date | Country | |
|---|---|---|---|
| 20160125818 A1 | May 2016 | US |
| Number | Date | Country | |
|---|---|---|---|
| 60638122 | Dec 2004 | US |
| Number | Date | Country | |
|---|---|---|---|
| Parent | 14542324 | Nov 2014 | US |
| Child | 14979425 | US | |
| Parent | 12941961 | Nov 2010 | US |
| Child | 14542324 | US | |
| Parent | 11722706 | US | |
| Child | 12941961 | US |
