Patent Grant
11908372
The present disclosure relates to a technology for processing image data for driving a display panel.
As society becomes more and more information-oriented, the demand for products requiring display devices has increased in various ways. Recently, various display devices such as liquid crystal display (LCD) devices, plasma display panels (PDP), organic light emitting diode display (OLED) devices, or the like, are used.
A display device displays an image on a panel by controlling the brightness of each pixel according to received image data. Generally, a self-light-emitting display device, which does not use a backlight, but uses pixels emitting light by themselves, such as an organic light emitting display device, may control the brightness of each pixel by controlling the size of a driving current supplied to the pixel. In such a display device, since the size of a driving current supplied to a pixel is controlled by an analog voltage, a so-called data voltage, converted from image data, the brightness of each pixel may consequently be controlled according to image data.
In order to accurately control the brightness of each pixel using an analog voltage converted from image data in a display device, a driving voltage supplied to each pixel needs to be fixed. In a self-light-emitting display device, for example, an organic light emitting display device, a driving current supplied to each pixel may be controlled using a difference between an analog voltage converted from image data and a driving voltage. Here, when the driving voltage is changed, the difference between the analog voltage and the driving voltage is also changed, and this may lead to a change of a driving current supplied to each pixel and a change of the brightness of each pixel. Such changes of the brightness of pixels may be perceived by a user as a poor image quality.
An aspect of the present disclosure is to provide a technology for improving image quality by reducing the change of the brightness of pixels. Since the change of the brightness of pixels may be due to the change of driving voltages or driving environments, another aspect of the present disclosure is to provide a technology for reducing the change of the brightness of pixels even when driving voltages or driving environments vary. Since the change of driving voltages or driving environments may depend on image types displayed using image data, still another aspect of the present disclosure is to provide a technology for reducing the change of the brightness of pixels depending on image data or image types.
To this end, in an aspect, the present disclosure provides a method of processing image data, comprising: calculating, as values representing the luminance of pixels disposed on a panel, a first representative value from image data according to a first method and a second representative value from the image data according to a second method different from the first method; calculating a weight using a value derived by applying the first representative value and the second representative value to a lookup table; generating converted image data by applying the weight to the image data; and transmitting the converted image data to a panel driving device for driving the panel.
In the lookup table, intervals of one axis and the other axis may respectively be 2K (K is a natural number).
The first representative value may be calculated according to a first equation comprising, as a factor, a simple equation of grayscale values for pixels or grayscale values for sub-pixels forming a pixel, and the second representative value may be calculated using a second equation comprising, as a factor, a quadratic equation of grayscale values for pixels or grayscale values for sub-pixels forming a pixel.
The first representative value may be calculated according to the first equation comprising, as a factor, a pixel grayscale value obtained by calculating a weighted average of grayscale values of a red (R) sub-pixel, a green (G) sub-pixel, and a blue (B) sub-pixel.
The second representative value may be calculated by dividing the maximum value, among a first square sum obtained by summing up the squares of grayscale values of R sub-pixels, a second square sum obtained by summing up the squares of grayscale values of G sub-pixels, and a third square sum obtained by summing up the squares of grayscale values of B sub-pixels, by the maximum value, among a first sum obtained by summing up the grayscale values of R sub-pixels, a second sum obtained by summing up the grayscale values of G sub-pixels, and a third sum obtained by summing up the grayscale values of B sub-pixels.
The first representative value may be a value calculated by dividing the maximum value, among a first square sum obtained by summing up the squares of grayscale values of R sub-pixels, a second square sum obtained by summing up the squares of grayscale values of G sub-pixels, and a third square sum obtained by summing up the squares of grayscale values of B sub-pixels, by 2{circumflex over ( )}M (M is the number of bits of data indicating grayscale values) and dividing its result by the total number of pixels.
The first representative value may increase as the number of pixels having brightness (which are turned on) increases.
The second representative value may increase as the grayscale values of pixels having brightness (which are turned on) increases.
The first representative value, the second representative value, and the weight may be calculated respectively according to the types of sub-pixels forming a pixel.
The first representative value may be an average of grayscale values of the respective types of sub-pixels, and the second representative value may be calculated by dividing a sum of the squares of the grayscale values of the respective types of sub-pixels by a sum of the grayscale values of the respective types of sub-pixels.
The first representative value may be calculated by dividing a sum of the squares of the grayscale values of the respective types of sub-pixels by the maximum grayscale value or the maximum grayscale value+1 and dividing its result by the total number of the respective types of sub-pixels, and the second representative value may be calculated by dividing a sum of the squares of the grayscale values of the respective types of sub-pixels by a sum of the grayscale values of the respective types of sub-pixels.
In another aspect, the present disclosure provides an image data processing device, comprising: a representative value calculating circuit to calculate values representing the luminance of pixels disposed on a panel, that is, a first representative value from image data according to a first method and a second representative value from the image data according to a second method; a weight calculating circuit to calculate a weight using a lookup table comprising first representative values in an axis and second representative values in the other axis; a weight applying circuit to apply the weight to the image data to generate converted image data; and an image data transmitting circuit to transmit the converted image data to a panel driving device to drive the panel.
The weight calculating circuit may calculate the weight by selecting four candidate values proximate to a pair of a first representative value and a second representative value from the lookup table and applying the interpolation to the four candidate values.
The representative value calculating circuit may calculate a plurality of first representative values and a plurality of second representative values for respective sub-pixels forming a pixel, and the weight calculating circuit may calculate the weight using an average of the plurality of first representative values and an average of the plurality of second representative values.
The panel may be a self-light-emitting display panel.
The weight calculating circuit may calculate a reflection rate of the weight according to a display brightness value (DBV), which is a control value for the brightness of the panel, and the weight applying circuit may apply the weight at the reflection rate to the image data to generate converted image data.
The weight applying circuit may generate the image data as it is as converted image data when the DBV is no less than a predetermined value.
In still another aspect, the present disclosure provides a method of processing image data, comprising: calculating at least one representative value representing the luminance of pixels disposed on a panel; calculating a weight using the at least representative value; calculating a reflection rate of the weight by analyzing the chroma of image date; generating converted image data by applying the weight to the image data at the reflection rate; and transmitting the converted image data to a panel driving device for driving the panel.
When calculating a reflection rate, a device may calculate a chroma analysis value for the image data and apply the chroma analysis value to a reflection rate curve previously stored in order to calculate the reflection rate, wherein the chroma analysis value may be calculated by calculating a difference between the biggest grayscale value and the smallest grayscale value of sub-pixels, obtaining a sum by summing up the differences of grayscale values regarding all pixels, and dividing the sum by the total number of achromatic-colored pixels.
The reflection rate curve may have a characteristic that the reflection rate decreases as the chroma analysis value increases when the chroma analysis value is no more than a first reference value.
The reflection rate curve may have a characteristic that the reflection rate increases as the chroma analysis value increases when the chroma analysis value is no less than a second reference value.
As described above, the present disclosure allows reducing the change of the brightness of pixels to improve image quality. In addition, the present disclosure allows minimizing the change of the brightness of pixels even when driving voltages or driving environments vary and reducing the change of the brightness of pixels depending on image data or image types.
Referring to
The image data processing device 110 may receive image data RGB from outside, for example, from a host device, convert the image data RGB, and transmit a converted image data RGB′ to the panel driving device 120.
The panel driving device 120 may receive the converted image data RGB′, generate an analog voltage, a so-called data voltage, using the converted image data RGB′, and then, supply the analog voltage to each pixel disposed on the panel 150 through a data line DL.
On the panel 150, a plurality of pixels may be disposed. Each pixel may be a self-light-emitting pixel. For example, each pixel may comprise an organic light emitting diode and emit light by itself by a driving current supplied to the organic light emitting diode. The brightness (luminance) of each pixel may be controlled by a driving voltage ELVDD, ELVSS supplied from the power management device 140 and an analog voltage supplied from the panel driving device 120.
The power management device 140 may supply driving voltages ELVDD, ELVSS to the panel 150. The driving voltages ELVDD, ELVSS may be divided into a driving high voltage ELVDD and a driving low voltage ELVSS and the power management device 140 may generate driving high voltages ELVDD and driving low voltages ELVSS by converting power suppled from outside. The power management device 140 may supply a driving high voltage ELVDD to the panel 150 through a first power line PL1 and a driving low voltage ELVSS to the panel 150 through a second power line PL2. In the first power line PL1 and the second power line PL2, there may be line resistances. Due to such line resistances, a voltage drop may occur. As generally known, when a current level is low, the voltage drop due to the line resistance may be small, and when a current level is high, the voltage drop due to the line resistance may be great.
The gate driving device 130 may supply a scan signal to the panel through a gate line GL. According to a scan signal, a specific line is selected in the panel 150 and an analog voltage may be supplied from the panel driving device 120 to a pixel connected with the selected line. The image data processing device 110 may supply a synchronization signal and/or a control signal to the panel driving device 120, the gate driving device 130, and the power management device 140 to control the timing for supplying a scan signal and the timing for supplying an analog voltage.
The image data processing device 110 may be referred to as a timing controller, the panel driving device 120 may be referred to as a source driver or a column driver, and the gate driving device 130 may be referred to as a gate driver. Each device may be formed in an independent integrated circuit or two or more devices may be formed in one integrated circuit.
The brightness of each pixel may be controlled by a driving voltage ELVDD, ELVSS supplied from the power management device 140 and an analog voltage supplied from the panel driving device 120. However, if there is a voltage drop in a power line PL1, PL2 through which a driving voltage ELVDD, ELVSS is supplied, a pixel may be driven at an undesired brightness.
Referring to
Since a current, flowing into a power line through which a driving voltage is supplied, is reduced as the average brightness of an image decreases, a voltage drop in the power line decreases and this results in supplying a voltage higher than a desired driving voltage to the panel. Even when an analog voltage, corresponding to a same grayscale value, is supplied to a pixel, if a driving voltage, in particular, a driving high voltage increases, the luminance increases. The increase of the luminance of a pixel may be a cause of degradation of image quality as well as a cause of acceleration of deterioration of the pixel.
Meanwhile, as shown in
Referring to
In both the first image 310 and the second image 320, the increase in the luminance due to the decrease in the average brightness may occur. However, since image types or image characteristics of the first image 310 and the second image 320 are different, the increase in amounts of the luminance may be different. In a display device according to an embodiment, image data is compensated according to an image type, so that the image data compensation suitable to various image types may be performed.
The types of two-dimensional images shown in
Referring to
The representative value calculating circuit 410, calculating representative values which represent the luminance of pixels disposed on the panel, may calculate a first representative value F1 from image data RGB according to a first method and a second representative value F2 from image data RGB according to a second method.
The storing circuit 430 may store a lookup table LUT comprising at least two axes and the weight calculating circuit 420 may calculate a weight WT using a value corresponding to the first representative value F1 in a first axis of the lookup table LUT and to the second representative value F2 in a second axis thereof.
The weight applying circuit 440 may generate a converted image data RGB′ by applying a weight WT to image data RGB.
The image data transmitting circuit 450 may transmit the converted image data RGB′ to the panel driving device.
The first representative value F1 and the second representative value F2 may represent different characteristics of an image.
Referring to
When a type or characteristic of an image is identified, a weight suitable for the corresponding image may be searched and applied to image data so that the luminance of the relevant pixel may be compensated. Weights suitable for types or characteristics of respective images may be previously measured and stored in a memory in a form of a lookup table.
Referring to
In the lookup table LUT, weights V1-V136 may be placed only on the left in relation to a diagonal line. Such an example may appear when the second representative values of all types of images are always greater than or equal to the first representative values thereof.
In the lookup table LUT, first representative values and second representative values respectively have appropriate gradation intervals between them considering the size of the memory and the weights V1-V136 may be stored in this lookup table LUT. The image data processing device may calculate a weight by selecting four candidate values proximate to a pair of calculated first and second representative values from the lookup table LUT and applying the interpolation to the four candidate values. For example, in a case when the first representative value is 18 and the second representative value is 230, the image processing device may select four candidate values V18, V19, V33, V34 corresponding to a first area 610 from the lookup table LUT and apply the interpolation to the four candidate value V18, V19, V33, V34 to calculate a weight.
In the lookup table LUT, the intervals of a first axis and a second axis may respectively be 2K (K is a natural number). According to such configuration, a circuit may be simplified by replacing the division of the interpolation with the bit shift.
Referring to
The calculating circuit 710 may calculate a plurality of representative values.
The calculating circuit 710 may calculate a plurality of candidate representative values AF1-AF3, which can be a first representative value F1. The selecting circuit 720 may select one of the plurality of the candidate representative values AF1-AF3 according to a selection value S1 to generate a first representative value F1.
The calculating circuit 710 may calculate a first candidate representative value AF1 or a second candidate representative value AF2 using an equation comprising, as a factor, a simple equation of grayscale values for pixels or grayscale values for sub-pixels forming a pixel.
For example, the calculating circuit 710 may calculate the first candidate representative value AF1 using, as a factor, a pixel grayscale value Y obtained by calculating a weighted average of grayscale values of a red (R) sub-pixel, a green (G) sub-pixel, and a blue (B) sub-pixel.
Equation 1 is an exemplary equation for calculating the first candidate representative value AF1.
AF1=avg(Y),Y=a*R+b*G+c*B [Equation 1]
Here, R is a grayscale value of an R sub-pixel forming a pixel, G is a grayscale value of a G sub-pixel forming a pixel, and B is a grayscale value of a B sub-pixel forming a pixel. Additionally, a is a weight for the grayscale value of the R sub-pixel, b is a weight for the grayscale value of the G sub-pixel, c is a weight for the grayscale value of the B sub-pixel, and they may have a relation of a+b+c=1.
For another example, the calculating circuit 710 may calculate the second candidate representative value AF2 using the maximum value of averages of grayscale values of the sub-pixels.
Equation 2 is an exemplary equation for calculating the second candidate representative value AF2.
AF2=MAX(avg(R),avg(G),avg(B)) [Equation 2]
The calculating circuit 710 may calculate a second representative value F2 using, as a factor, a quadratic equation of grayscale values for pixels or grayscale values for sub-pixels forming a pixel. For example, the calculating circuit 710 may calculate the second representative value F2 by dividing the maximum value, among a first square sum obtained by summing up the squares of grayscale values of R sub-pixels, a second square sum obtained by summing up the squares of grayscale values of G sub-pixels, and a third square sum obtained by summing up the squares of grayscale values of B sub-pixels, by the maximum value, among a first sum obtained by summing up the grayscale values of R sub-pixels, a second sum obtained by summing up the grayscale values of G sub-pixels, and a third sum obtained by summing up the grayscale values of B sub-pixels.
Meanwhile, the calculating circuit 710 may calculate a second representative value F2 by selecting the maximum value among values, each obtained by dividing a sum of the squares of grayscale values of each sub-pixel by a sum of the grayscale values thereof. However, when comparing this method of calculating a second representative value F2 with the aforementioned method of calculating a second representative value F2, the aforementioned method uses one divider, whereas this method uses the number, corresponding to the number of sub-pixels, of dividers, for example 3 dividers, and therefore, the aforementioned method may be advantageous in terms of the size of a chip.
In addition, the calculating circuit 710 may calculate the third candidate representative value AF3 by dividing the maximum value, among a first square sum obtained by summing up the squares of grayscale values of R sub-pixels, a second square sum obtained by summing up the squares of grayscale values of G sub-pixels, and a third square sum obtained by summing up the squares of grayscale values of B sub-pixels, by 2{circumflex over ( )}M (M is the number of bits of data indicating a grayscale value) and dividing its result by the total number of pixels.
The representative value calculating circuit 410 may calculate representative values for pixels or representative values for the respective sub-pixels. Calculating representative values for pixels may be referred to as a white mode and calculating representative values for the respective sub-pixels may be referred to as an RGB mode.
In the RGB mode, the representative value calculating circuit 410 may calculate a first representative value F1 and a second representative value F2 for the respective sub-pixels R, G, B, the weight calculating circuit (see 420 in
In the RGB mode, a first candidate representative value AF1 for each sub-pixel may be an average grayscale value for each sub-pixel. For example, in the RGB mode, the following relations may be formed: AF1(R)=avg(R), AF1(G)=avg(G), AF1(B)=avg(B).
In the RGB mode, a second representative value F2 may be calculated by dividing a sum of the squares of grayscale values of each sub-pixel by a sum of the grayscale values thereof. For example, the following relations may be formed: F2(R)=sum(R{circumflex over ( )}2)/sum(R), F2(G)=sum(G{circumflex over ( )}2)/sum(G), F2(B)=sum(B{circumflex over ( )}2)/sum(B).
Additionally, in the RGB mode, a third candidate representative value AF3 may be calculated by dividing a sum of the squares of grayscale values of each sub-pixel by 2{circumflex over ( )}M (M is the number of bits of data indicating a grayscale value) and dividing its result by the total number of each type of sub-pixels.
On the other hand, there can be a mixed mode of the white mode and the RGB mode. In the mixed mode, the representative value calculating circuit 410 may calculate representative values for the respective sub-pixels and transmit them to the weight calculating circuit (see 420 in
Referring to
The chroma reflecting circuit 820 and the DBV reflecting circuit 830 are optional, and thus, when the chroma reflecting circuit 820 and the DBV reflecting circuit 830 are not used, the application control circuit 810 may multiply a grayscale value for each pixel included in image data by a weight to generate converted image data.
When the chroma reflecting circuit 820 is used, the application control circuit 810 may apply a weight to image data using a first reflection rate calculated by the chroma reflecting circuit 820.
The chroma reflecting circuit 820 may calculate the first reflection rate according to chroma. For example, when chroma is high, the chroma reflecting circuit 820 may calculate a first reflection rate for a weight to be high. When chroma is low to the point of being achromatic, the chroma reflecting circuit 820 may calculate a first reflection rate for a weight to be high.
The chroma reflecting circuit 820 may calculate a chroma analysis value and calculate a first reflection rate by putting the chroma analysis value into a pre-stored reflection rate curve.
The chroma reflecting circuit 820 may calculate the chroma analysis value by calculating a difference between the biggest grayscale value of a sub-pixel and the smallest grayscale value of a sub-pixel for each pixel, summing up such differences of grayscale values of all the pixels to obtain a sum, and dividing a sum by the number of achromatic-colored ones among all the pixels.
Here, the chroma reflecting circuit 820 may determine a pixel comprising sub-pixels having the same grayscale values as an achromatic-colored pixel and a pixel comprising at least one sub-pixel having a grayscale value different from those of the others as a chromatic-colored pixel.
Referring to
According to such a curve, the weight applying circuit may apply a weight only in the low chroma area 910 or the high chroma area 920, but no weight in the medium chroma area 930.
A first set value SR1 indicating the low chroma area 910 and a second set value SR2 indicating the high chroma area 920 may be set as register values. The weight applying circuit may calculate a first reflection rate using a linear interpolation in the low chroma area 910 and the high chroma area 920. Here, in order to use the bit shift method instead of the division, the first set value SR1 and the second set value SR2 may have values of 2K (K is a natural number).
Referring again to
Converted grayscale value=grayscale value 128*first reflection rate 50%*weight 0.5+grayscale value 128*(1−first reflection rate)=32+64=96
When the DBV reflection circuit 830 is used, the application control circuit 810 may apply a weight to image data using a second reflection rate calculated in the DBV reflection circuit 830.
The DBV reflection circuit 830 may calculate a second reflection rate according to a DBV determined by a user or a host. For example, the DBV reflection circuit 830 may calculate the second reflection rate to be high as the DBV is high.
Referring to
According to the curve 1010, the weight applying circuit may apply a high rate of a weight as a DBV is high and a low rate of a weight as a DBV is low.
An area 1030 where a DBV is equal to or higher than a third set value SR3 is referred to as an HBM area. When a DBV belongs to the HBM area, a display device may display a warning message, for example, that, since the brightness of a panel is too high, this may cause the deterioration of eyesight. In a case when a user chooses the HBM area in spite of such a warning message, it would be advisable in terms of policy not to apply the luminance reduction by a weight. Accordingly, when a DBV is no less than a predetermined value (a third set value), the weight applying circuit may use image data as it is without applying a weight to generate converted image data.
Referring again to
Converted grayscale value=grayscale value 128*second reflection rate 50%*weight 0.5+grayscale value 128*(1−second reflection rate)=32+64=96
The application control circuit 810 may simultaneously apply the first reflection rate and the second reflection rate. For example, the first reflection rate and the second reflection rate are respectively 50%, the weight is 0.5, and the grayscale value is 128, a converted grayscale value can be calculated as follows.
Converted grayscale value=grayscale value 128*first reflection rate 50%*second reflection rate 50%*weight 0.5+grayscale value 128*(1−first reflection rate*second reflection rate)=16+96=112
As described above, the present disclosure allows reducing the change of the brightness of pixels to improve image quality. In addition, the present disclosure allows reducing the change of the brightness of pixels even when driving voltages or driving environments vary and reducing the change of the brightness of pixels depending on image data or image types.
| Number | Date | Country | Kind |
|---|---|---|---|
| 10-2020-0000228 | Jan 2020 | KR | national |
This application is a divisional of U.S. patent application Ser. No. 17/136,669 filed on Dec. 29, 2020 which claims priority from Republic of Korea Patent Application No. 10-2020-0000228, filed on Jan. 2, 2020, each of which is hereby incorporated by reference in its entirety.
| Number | Name | Date | Kind |
|---|---|---|---|
| 7978201 | Cho | Jul 2011 | B2 |
| 9378682 | Lim | Jun 2016 | B2 |
| 10818039 | Yin | Oct 2020 | B2 |
| 20140320546 | Lim | Oct 2014 | A1 |
| 20190251705 | Yin | Aug 2019 | A1 |
| 20210210009 | Jun | Jul 2021 | A1 |
| 20220208069 | Jun | Jun 2022 | A1 |
| Number | Date | Country | |
|---|---|---|---|
| 20220208069 A1 | Jun 2022 | US |
| Number | Date | Country | |
|---|---|---|---|
| Parent | 17136669 | Dec 2020 | US |
| Child | 17698278 | US |
