The disclosed technology relates generally to display devices and more particularly to color compensation for panel display devices using a light source array for backlighting.
Display devices with a light-transmissive display panel, such as a light-transmissive liquid crystal display (LCD) panel, incorporate a backlighting system to illuminate the light-transmissive display panel. Modern backlighting systems (e.g., direct-lit backlighting, full-array backlighting, etc.) may illuminate a display panel with an array of light sources (e.g., light-emitting diodes (LEDs)) located directly behind the display panel. Using an array of light sources for backlighting allows for local dimming, which may provide brighter or darker portions of the display image to enhance the contrast of the display image.
This summary is provided to introduce in a simplified form a selection of concepts that are further described below in the detailed description. This summary is not intended to identify key features or essential features of the claimed subject matter, nor is it intended to limit the scope of the claimed subject matter.
In general, in one aspect, one or more embodiments relate to a display device that includes a display panel, a backlight device, and a display driver. The backlight device includes a plurality of light sources to illuminate the display panel. The plurality of light sources are configured such that color of light emitted from the plurality of light sources varies with luminance levels of the plurality of light sources. The display driver is configured to process a first input grey level of a first color for a target pixel of the display panel based at least in part on a specified luminance level of a corresponding light source of the plurality of light sources to determine a first output grey level of the first color for the target pixel. The display driver is further configured to process a second input grey level of a second color for the target pixel based at least in part on the specified luminance level of the corresponding light source to determine a second output grey level of the second color for the target pixel. The first output grey level and the second output grey level are determined to compensate for a change in color of light emitted from the corresponding light source. The display driver is further configured to update the target pixel based on the first output grey level and the second output grey level.
In general, in one aspect, one or more embodiments relate to a display driver that includes a color compensation block and driver circuitry. The color compensation block is configured to process a first input grey level of a first color for a target pixel of a display panel to determine a first output grey level of the first color for the target pixel. The display panel is illuminated by a backlight device comprising a plurality of light sources configured such that color of light emitted from the plurality of light sources varies with luminance levels of the plurality of light sources. Processing the first input grey level is based at least in part on a specified luminance level of a corresponding light source of the plurality of light sources. The color compensation block is further configured to process a second input grey level of a second color for the target pixel based at least in part on the specified luminance level of the corresponding light source to determine a second output grey level of the second color for the target pixel. The first output grey level and the second output grey level are determined to compensate for a change in color of light emitted from the corresponding light source. The driver circuitry is configured to update the target pixel based on the first output grey level and the second output grey level.
In general, in one aspect, one or more embodiments relate to a method for color compensation for a display device that includes a display panel illuminated by a backlight device including a plurality of light sources. The plurality of light sources are configured such that color of light emitted from the plurality of light sources varies with luminance levels of the plurality of light sources. The method includes processing a first input grey level of a first color for a target pixel of a display panel to determine a first output grey level of the first color for the target pixel. Processing the first input grey level is based at least in part on a specified luminance level of a corresponding light source of the plurality of light sources. The method further includes processing a second input grey level of a second color for the target pixel based at least in part on the specified luminance level of the corresponding light source to determine a second output grey level of the second color for the target pixel. The first output grey level and the second output grey level are determined to compensate for a change in color of light emitted from the corresponding light source. The method further includes updating the target pixel based on the first output grey level and the second output grey level.
Other aspects of the embodiments will be apparent from the following description and the appended claims.
So that the manner in which the above recited features of the present disclosure can be understood in detail, a more particular description of the disclosure, briefly summarized above, may be had by reference to embodiments, some of which are illustrated in the appended drawings. It is to be noted, however, that the appended drawings illustrate only exemplary embodiments, and are therefore not to be considered limiting of inventive scope, as the disclosure may admit to other equally effective embodiments.
To facilitate understanding, identical reference numerals have been used, where possible, to designate identical elements that are common to the figures. It is contemplated that elements disclosed in one embodiment may be beneficially utilized in other embodiments without specific recitation. Suffixes may be attached to reference numerals for distinguishing identical elements from each other. The drawings referred to herein should not be understood as being drawn to scale unless specifically noted. Also, the drawings are often simplified and details or components omitted for clarity of presentation and explanation. The drawings and discussion serve to explain principles discussed below, where like designations denote like elements.
The following detailed description is merely exemplary in nature, and is not intended to limit the disclosed technology or the application and uses of the disclosed technology. Furthermore, there is no intention to be bound by any expressed or implied theory presented in the preceding technical field, background, or the following detailed description.
In the following detailed description of embodiments, numerous specific details are set forth in order to provide a more thorough understanding of the disclosed technology. However, it will be apparent to one of ordinary skill in the art that the disclosed technology may be practiced without these specific details. In other instances, well-known features have not been described in detail to avoid unnecessarily complicating the description.
The term “coupled” as used herein means connected directly to or connected through one or more intervening components or circuits. Further, throughout the application, ordinal numbers (e.g., first, second, third, etc.) may be used as an adjective for an element (i.e., any noun in the application). The use of ordinal numbers is not to imply or create any particular ordering of the elements nor to limit any element to being only a single element unless expressly disclosed, such as by the use of the terms “before”, “after”, “single”, and other such terminology. Rather, the use of ordinal numbers is to distinguish between the elements. By way of an example, a first element is distinct from a second element, and the first element may encompass more than one element and succeed (or precede) the second element in an ordering of elements.
Display devices with a light-transmissive display panel, such as a light-transmissive liquid crystal display (LCD) panel, may be configured to illuminate the display panel with an array of light sources (such as light emitting diodes (LEDs)) located directly behind the display panel. Such backlighting technologies may be referred to as direct-lit backlighting or full-array backlighting. The light sources may each be configured to illuminate corresponding areas or zones of the display panel.
In some implementations, the luminance levels of the light sources may be individually controlled to achieve “local dimming.” “Local dimming” is a technique for enhancing image contrast by individually controlling the luminance levels of the respective light sources to provide brighter and/or darker portions of the display image. For example, the luminance level of a light source illuminating a particular zone of the display panel may be reduced when a darker image is desired in that zone. The luminance levels of the light sources may be controlled based on image data which may specify grey levels of respective colors (e.g., red (R), green (G) and blue (B)) for respective pixels of the display panel.
A potential problem with local dimming is that the color of the light emitted by the light sources may change with the luminance levels, causing unwanted coloration in the display image. LEDs, which are widely used as light sources to illuminate a display panel, may exhibit color changes with the luminance levels depending on the manufacturing process and/or the driving technique of the LEDs. For example, the light emitted by some LEDs may become reddish as the luminance level decreases. When such LEDs are used as light sources to illuminate a display panel, the local dimming technique, in which the luminance levels of the light sources are adjusted individually, may cause unwanted coloration in the display image due to changes in the color emitted by the light sources.
The present disclosure provides various technologies for mitigating unwanted display image coloration potentially caused by color changes of light sources with the luminance levels. In one or more embodiments, a display device includes a display panel, a backlight device, and a display driver. The backlight device may include a plurality of light sources to illuminate the display panel. The plurality of light sources may be configured such that the color of the light emitted from the light sources varies with the luminance levels of the light sources. The display driver may be configured to process a first input grey level of a first color for a target pixel of the display panel based at least in part on a specified luminance level of a corresponding light source of the plurality of light sources to determine a first output grey level of the first color for the target pixel. The display driver may be further configured to process a second input grey level of a second color for the target pixel based at least in part on the specified luminance level of the corresponding light source to determine a second output grey level of the second color for the target pixel. The first output grey level and the second output grey level are determined to compensate for a change in color of light emitted from the corresponding light source. The display driver may be further configured to update the target pixel based on the first output grey level and the second output grey level. The following is a detailed description of various embodiments of the present disclosure.
One issue with the local dimming technique is that some types of light sources, including LEDs, exhibit color changes with the luminance level, which may cause unwanted coloration of portions of the display image depending on the luminance levels of the portions.
The display device 1000 further includes a display driver 300, a backlight device 400, and a backlight driver 500. The display driver 300 is configured to receive image data from an image source 600 and drive the display panel 200 to display an image corresponding to the image data. The image source 600 may be a processor such as an application processor, a host, a central processing unit (CPU), a microprocessor unit (MPU) or a different type of processor configured to provide the image data.
The backlight device 400 and the backlight driver 500 form a backlighting system. The backlight device 400 is configured to illuminate the display panel 200 with an array of light sources 420. Since the light sources 420 are positioned behind the display panel 200 as shown in
The image memory 310 is configured to receive image data corresponding to a display image to be displayed on the display panel 200 from the image source 600 (shown in
The image processing circuitry 320 is configured to apply image processing to the raw pixel data retrieved from the image memory 310 to generate processed pixel data. The image processing circuitry 320 includes a color compensation block 360 configured to perform color compensation to mitigate unwanted coloration potentially caused by color changes of light emitted by the light sources 420. The details of the color compensation will be described in detail later. The image processing performed by the image processing circuitry 320 may further include color adjustment, demura correction, deburn correction, image scaling, gamma transformation, or other image processing.
The driver circuitry 330 is configured to receive the processed pixel data from the image processing circuitry 320 and drive or update the pixels of the display panel 200 based at least in part on the processed pixel data. The driver circuitry 330 may include a source driver (also referred to as a data driver) configured to generate data voltages based on the processed pixel data and drive source lines (also referred to as data lines) of the display panel 200 to program or update the pixels of the display panel 200 with the generated data voltages. In one implementation, each pixel of the display panel 200 may include R, G, and B subpixels and the processed pixel data may specify the luminance level of each of the R, G, and B subpixels of each pixel. The driver circuitry 330 may be configured to program or update the R, G, and B subpixels of each pixel based at least in part on the processed pixel data to control the luminance levels of the R, G, and B subpixels.
The image analysis circuitry 340 and the backlight control circuitry 350 are collectively configured to generate and provide backlight control instructions to the backlight driver 500 based at least in part on the image data to control the luminance levels of the respective light sources 420 (shown in
In one or more embodiments, the image analysis performed by the image analysis circuitry 340 may be based on a plurality of “zones” defined for the display panel 200.
In one or more embodiments, the image analysis data generated by the image analysis circuitry 340 may include average picture levels (APLs) of the respective zones 220 calculated based on the raw pixel data or the processed pixel data. The APL of a particular zone 220 may be calculated based on the raw pixel data or the processed pixel data for the pixels located in the zone 220. In one implementation, the APL of a particular zone 220 may be the average of the luminance levels of the pixels located in the zone 220. In embodiments where the raw pixel data (or the processed pixel data) for each pixel includes R, G, and B grey levels that specify the luminance of the R, G, and B subpixels, respectively, the luminance level of each pixel may be calculated based on the R, G, and B grey levels. The luminance level of each pixel may be calculated as a weighted sum of the R, G, and B grey levels of each pixel. The backlight control circuitry 350 may be configured to control the luminance level of each light source 420 based on the APL of the zone 220 that each light source 420 opposes.
In the shown embodiment, the backlight control circuitry 350 includes a base luminance level determination circuit 352, a light source luminance memory 354, and a modification circuit 356. The base luminance level determination circuit 352 is configured to determine base luminance levels of the respective light sources 420 based on the image analysis data received from the image analysis circuitry 340. In embodiments where the image analysis data includes the APLs of the respective zones 220, the base luminance level determination circuit 352 may be configured to determine the base luminance levels of the respective light sources 420 based on the APLs of the respective zones 220 that the respective light sources 420 oppose. In one implementation, the base luminance level of a particular light source 420 may increase with an increase in the APL of the corresponding zone 220 that the particular light source 420 opposes. The base luminance level determination circuit 352 is further configured to forward and store the determined base luminance levels of the respective light sources 420 in the light source luminance memory 354.
The modification circuit 356 is configured to retrieve the base luminance levels of the respective light sources 420 from the light source luminance memory 354 and determine the specified luminance levels of the respective light sources 420 by modifying the base luminance levels of the respective light sources 420 based on a display brightness value (DBV). The DBV specifies a desired display brightness level, which may be a desired overall brightness level of the display image displayed on the display panel 200. The modification circuit 356 may be configured to determine a modification coefficient based on the DBV and determine the specified luminance levels of the respective light sources 420 by applying the modification coefficient to the base luminance levels of the respective light sources 420. In one implementation, the modification circuit 356 may be configured to determine the specified luminance levels of the respective light sources 420 by multiplying the base luminance levels of the respective light sources 420 by the modification coefficient. The modification circuit 356 is further configured to provide the specified luminance levels of the respective light sources 420 to the backlight driver 500 and also to the color compensation block 360.
In one implementation, the DBV may be generated by the image source 600 (shown in
The color compensation block 360 is configured to receive input pixel data and apply the color compensation to the input pixel data for the respective pixels to generate output pixel data for the respective pixels. The input pixel data may be the raw pixel data or may be generated by applying one or more other image processes (e.g., color adjustment, demura correction, deburn correction, image scaling) to the raw pixel data by the image processing circuitry 320 (shown in
The color compensation performed by the color compensation block 360 is based on the specified luminance levels of the respective light sources 420 received from the backlight control circuitry 350. In one implementation, the color compensation block 360 may be configured to process input pixel data for a target pixel located in a particular zone 220 based on the specified luminance level of the light source 420 that corresponds to or opposes the particular zone 220 to generate the output pixel data for the target pixel located in the particular zone 220. The processing of the input pixel data for the target pixel located in the particular zone 220 may further be based on the specified luminance levels of one or more light sources 420 that oppose one or more zones 220 adjacent to the particular zone 220.
The color compensation is achieved by individually processing the R, G, and B grey levels RIN, GIN, and BIN of the input pixel data and thereby determining the R, G, and B grey levels ROUT, GOUT, and BOUT of the output pixel data, respectively. For simplicity, the R, G, and B grey levels RIN, GIN, and BIN of the input pixel data may also be referred to as the R, G, and B input grey levels RIN, GIN, and BIN, respectively, and the R, G, and B grey levels ROUT, GOUT, and BOUT of the output pixel data may also be referred to as the R, G, and B output grey levels ROUT, GOUT, and BOUT, respectively. In various implementations, a change in a first one of the R, G, and B output grey levels ROUT, GOUT, and BOUT with respect to the specified luminance level may be different than a change in a second one of the R, G, and B output grey levels ROUT, GOUT, and BOUT with respect to the specified luminance level for the same value of the input grey levels RIN, GIN, and BIN. For example, to compensate for the coloration that makes the display image undesirably reddish, the change in the R output grey level ROUT with respect to the specified luminance level may be different from changes in the G and B output grey levels GOUT and BOUT with respect to the specified luminance level for the same value of the input grey levels RIN, GIN, and BIN. The difference in the changes in the R, G, and B output grey levels ROUT, GOUT, and BOUT with respect to the specified luminance level may achieve desired color compensation.
In some embodiments, as discussed in relation to
In the shown embodiment, the color compensation block 360 includes an R compensation block 362R, a G compensation block 362G, and a B compensation block 362B which are configured to process the R, G, and B input grey levels, respectively. The R compensation block 362R includes a compensation level register 364, a compensation level determination circuit 366, and a modification circuit 368. Although not shown, the G compensation block 362G and the B compensation block 362B may be configured identically to the R compensation block 362R. Each of the G compensation block 362G and the B compensation block 362B may include a compensation level register, a compensation level determination circuit, and a modification circuit which corresponds to the compensation level register 364, the compensation level determination circuit 366, and the modification circuit 368 of the R compensation block 362R.
The compensation level register 364 of the R compensation block 362R is configured to store compensation level correlation information indicative of the correlation between the specified luminance levels and compensation levels to be applied to R input grey levels of respective pixels. The compensation level determination circuit 366 is configured to determine compensation levels for the R input grey levels of the respective pixels based on the specified luminance levels of the light sources 420 in accordance with the compensation level correlation information. In some embodiments, the compensation level correlation information stored in the compensation level register 364 may include compensation levels for some but not all of the allowed specified luminance levels. In one implementation, the compensation level correlation information may include compensation levels for the minimum specified luminance level, the maximum specified luminance level, and one or more intermediate specified luminance levels. The compensation level determination circuit 366 may be configured to determine for compensation levels for all of the allowed specified luminance levels by interpolating the compensation levels included in the compensation level correlation information. The modification circuit 368 is configured to apply the compensation levels to the R input grey levels of the respective pixels to determine the R output grey levels of the respective pixels.
In one implementation, the R output grey level of a target pixel located in a particular zone 220 may be determined as follows. The R compensation block 362R may receive the specified luminance level of the light source 420 that opposes the particular zone 220 in which the target pixel is located. The compensation level determination circuit 366 may determine the compensation level for the target pixel according to the compensation level correlation information stored in the compensation level register 364. The modification circuit 368 may determine the R output grey level of the target pixel by applying the determined compensation level to the R input grey level of the target pixel. In some embodiments, the modification circuit 368 may determine the R output grey level of the target pixel by multiplying the R input grey level of the target pixel by the determined compensation level. In other embodiments, the modification circuit 368 may determine the R output grey level of the target pixel by applying a different arithmetic operation (e.g., addition, subtraction, etc.) to the R input grey level of the target pixel based on the determined compensation level.
The G compensation block 362G and the B compensation block 362B, which process the G and B input grey levels to determine the G and B output grey levels, respectively, are configured to operate similarly to the R compensation block 362R except for that the contents of the compensation level correlation information stored in the compensation level register are different. Each of the G compensation block 362G and the B compensation block 362B includes a compensation level register, a compensation level determination circuit and a modification circuit which are configured to operate identically to the compensation level register 364, the compensation level determination circuit 366, and the modification circuit 368 of the R compensation block 362R, respectively. It is noted, however, that in order to achieve the color compensation, the compensation level correlation information stored in the compensation level registers of the G and B compensation blocks 362G and 362B may indicate a different correlation between the specified luminance levels and compensation levels than the compensation level correlation information stored in the compensation level register 364 of the R compensation block 362R.
In some embodiments, the compensation levels for a target pixel located in a particular zone may be determined by interpolating the compensation levels determined based on the specified luminance levels of light sources that oppose the particular zone and one or more zones adjacent to the particular zone. An example of the operation of the compensation level determination circuit 366 of the R compensation block 362R according to such embodiments is described below. It is noted that the compensation level determination circuits of the G compensation block 362G and the B compensation block 362B may operate in the same manner as the compensation level determination circuit 366 of the R compensation block 362R.
Referring to
Referring to
The compensation level determination circuit 326 may further determine compensation levels for pixels located at the centers (e.g., the geographic centers) of the nearby zones based on the specified luminance levels for the light sources 420 (or the hypothetical light sources 425) in accordance with the compensation level correlation information stored in the compensation level register 364. The compensation level determination circuit 326 may further determine the compensation level for the target pixel P by interpolating the compensation levels for the pixels located at the centers of the nearby zones based on the position of the target pixel P.
In one or more embodiments, a horizontal interpolation is first implemented to compute horizontally-interpolated compensation levels LP1 and LP2 for intermediate points P1(x, y1) and P2(x, y2), and a vertical interpolation is then implemented to compute the compensation level LP for the target pixel P. In one implementation, the horizontally-interpolated compensation levels CLP1 and CLP2 may be computed according to the following equations (1a) and (1b):
In this case, the compensation level CLP for the target pixel P may be calculated according to the following equation (2):
In alternative embodiments, a vertical interpolation may be first implemented and a horizontal interpolation may be then implemented to calculate the compensation level CLP for the target pixel P in a similar manner.
Referring to
To mitigate the effect of the variation in the number of light sources 420 from which each zone 220 receives light, in one or more embodiments, the specified luminance level of each light source 420 may be determined based on the arrangement of one or more light sources 420 around the zone 220 that each light source 420 opposes. In one implementation, the specified luminance level of a light source 420 that opposes a particular zone 220 may be adjusted based on the number of light sources 420 that are arranged around the particular zone 220.
In the shown embodiment, the backlight control circuitry 1350 includes a base luminance level determination circuit 1352, a light source luminance memory 1354, and a light source compensation memory 1356, a first modification circuit 1358, and a second modification circuit 1360. The base luminance level determination circuit 1352 and the light source luminance memory 1354 are configured to operate in the same manner as the base luminance level determination circuit 352 and the light source luminance memory 354 shown in
The light source compensation memory 1356 is configured to store luminance compensation values for the respective light sources 420 to be applied to the base luminance levels of the respective light sources 420. The luminance compensation values for the respective light sources 420 are predetermined to compensate for the image brightness unevenness discussed above based on the locations of the respective light sources 420. In one implementation, the luminance compensation value for a particular light source 420 may be determined based on an arrangement of one or more light sources 420 around the particular light source 420. For example, the luminance compensation value for a light source 420 that opposes a particular zone 220 may be determined based on whether the particular zone 220 is located at an edge of the display panel 200, at a corner of the display panel 200, or in the interior portion of the display panel 200. The luminance compensation values thus determined may effectively compensate for the unevenness of the display panel 200, which may be caused by a decrease in the brightness level of the peripheral portion of the display panel 200.
The first modification circuit 1358 and the second modification circuit 1360 are collectively configured to determine the specified luminance levels of the respective light sources 420 based on the base luminance levels stored in the light source luminance memory 1354, the luminance compensation values stored in the light source compensation memory 1356, and the DBV.
The first modification circuit 1358 is configured to retrieve the base luminance levels of the respective light sources 420 from the light source luminance memory 1354 and also retrieve the luminance compensation values for the respective light sources 420 from the light source compensation memory 1356. The first modification circuit 1358 is further configured to modify the base luminance levels of the respective light sources 420 based on the luminance compensation values for the respective light sources 420 and provide the modified base luminance levels of the respective light sources 420 to the second modification circuit 1360. In one implementation, the first modification circuit 1358 may be configured to modify the base luminance levels of the respective light sources 420 by multiplying the base luminance levels of the respective light sources 420 by the luminance compensation values for the respective light sources 420. In an alternative implementation, the first modification circuit 1358 may be configured to modify the base luminance levels of the respective light sources 420 by applying a different arithmetic operation (e.g., addition or subtraction) based on the luminance compensation values for the respective light sources 420.
The second modification circuit 1360 is configured to determine the specified luminance levels of the respective light sources 420 by further modifying the modified base luminance levels of the respective light sources 420 based on a DBV that specifies a desired display brightness level. The second modification circuit 1360 may be configured to determine a modification coefficient based on the DBV and determine the specified luminance levels of the respective light sources 420 by applying the modification coefficient to the base luminance levels of the respective light sources 420. In one implementation, the second modification circuit 1360 may be configured to determine the specified luminance levels of the respective light sources 420 by multiplying the base luminance levels of the respective light sources 420 by the modification coefficient. The second modification circuit 1360 is further configured to provide the specified luminance levels of the respective light sources 420 to the backlight driver 500 and also to the color compensation block 360. The color compensation block 360 is configured to apply the color compensation to the input pixel data for the respective pixels based on the specified luminance levels of the respective light sources 420 to generate the output pixel data for the respective pixels.
In the shown embodiment, the R compensation level for the specified luminance level of LL is “70%” and the compensation levels for red for the specified luminance levels of LH1 and LH2 are “95%” and “100%”, respectively. Meanwhile, the compensation levels for green (G) and blue (B) are “100%” regardless of the specified luminance level. The compensation levels determined as shown in
In one or more embodiments, the method 1600 provides color compensation for a display device that includes a display panel illuminated by a backlight device including a plurality of light sources configured such that the color of light emitted from the plurality of light sources varies with luminance levels of the plurality of light sources.
The method 1600 shown in
Steps 1602 and 1604 may be implemented by the color compensation block 360 shown in
Referring back to
While many embodiments have been described, those skilled in the art, having benefit of this disclosure, will appreciate that other embodiments can be devised which do not depart from the scope. Accordingly, the scope of the invention should be limited only by the attached claims.
Number | Name | Date | Kind |
---|---|---|---|
4980678 | Zenda | Dec 1990 | A |
20030179171 | Toriumi | Sep 2003 | A1 |
20070075950 | Yamada | Apr 2007 | A1 |
20100253711 | Muroi | Oct 2010 | A1 |
20170221426 | Inamura | Aug 2017 | A1 |