This application claims the benefit of Korean Patent Application No. 10-2014-0154650 filed on Nov. 7, 2014, which is incorporated herein by reference for all purposes as if fully set forth herein.
1. Field
This document relates to a method and device for clipping a gray scale level of pixels displayed by a display device during the dimming of the backlight of the display device.
2. Related Art
An active crystal type liquid crystal display (LCD) device displays images by using a Thin Film Transistor (hereinafter referred to as a “TFT”) as a switching device. Since the LCD device is not a spontaneous light emitting device, the LCD device uses a backlight unit to irradiate light onto a liquid crystal display panel. Light sources of the backlight unit and power consumption of an inverter circuit to drive the light sources account for most of the entire power consumption.
In order to reduce power consumption of the backlight unit, a backlight dimming method is widely used. The backlight dimming method may be divided into a local dimming method and a global dimming method, in which the local dimming method includes dividing a display surface into a plurality of blocks and separately controlling backlight brightness of each block, while the global dimming method includes reducing backlight brightness of the entire display surface all together. The local dimming method may improve static contrast by locally controlling brightness of a display surface within a period of one frame, and may reduce power consumption. However, the local dimming method has a drawback in that its algorithm and hardware is very complicated, and the method may only be applied to a direct-type light emitting diode (LED) backlight unit. The global dimming method may improve dynamic contrast and may reduce power consumption. Further, the global dimming method uses an algorithm and hardware that has low complexity, and may be applied to any type of a backlight unit.
The global dimming method includes: a backlight modulation process that reduces power consumption by reducing backlight brightness; and an image compensation process that compensates for reduced backlight brightness by using gray scales of pixel data of an image. In the global dimming method, a gray level of pixel data is increased to compensate for reduced backlight brightness, but there is a limitation in the compensation using gray scales of pixel data. For example, in the case of 8-bit pixel data, the highest gray level of the pixel data is 255, such that the gray scale may not be adjusted beyond that level. Accordingly, a general global dimming method may not express a gray level appropriately due to the highest gray level saturation of pixel data. In order to solve the problem, pixel data having the highest gray level may be clipped in advance from an input image at a predetermined clipping rate, so that the highest backlight brightness may be controlled. The clipped pixel data refer to pixel data having brightness that may not be expressed due to a limitation in the highest gray level values. The clipped rate is a percentage value obtained by dividing a number of clipped pixels by the total number of pixels of an input image. The general global dimming method may include determining a clipped rate, and then generating a histogram of the input image to determine a gray level, so that based on the determined gray level, pixel data having gray scales above that level may be clipped from the input image.
In the histogram, a number of pixels is counted starting from the highest gray scale, and the counting is repeated by reducing a gray scale in the histogram until the count exceeds a predetermined threshold. A gray scale previous to a gray scale that is above the threshold is determined to be a frame max. Once the frame max is determined, a frame gain (also referred to as scaling factor herein) is calculated by dividing the highest gray scale value, e.g., 255, by the frame max. By multiplying pixel data and the frame gain, pixel data may be modulated such that brightness of pixels may be increased, and the highest brightness of a backlight unit may be reduced, thereby reducing power consumption.
In order to obtain the frame max, a method of accumulating counts includes counting a number of pixels in a histogram of
In the histogram of
If there are a large number of clipped pixels, there may be more clipping artifacts felt by an observer, which leads to deterioration in image quality. The clipping artifact may be calculated as an annoyance level proposed by the Applicants of the present disclosure in Korean Patent Publication No. 10-2015-0039468 (Apr. 10, 2015).
If a frame gain is too high when modulating pixel data, a number of clipped pixel data is increased, such that an observer may feel deterioration in image quality. A degree of deterioration in image quality felt by an observer due to data clipping may vary depending on gray scales. For example, in the case where a frame max is set to be 200, a frame gain is multiplied by each of gray scales 255 and 201 of a clipped original image, and then the gray scales 255 and 201 are changed to 255. Once backlight brightness is reduced by a value of redundant brightness that is obtained by multiplying a frame gain and pixel data, thereby reducing power consumption, gray scales 201 and 255 are all represented by a gray scale of 200. Accordingly, deterioration in image quality of an original image having the gray scale of 255 seems more severe than deterioration in image quality of an original image having the gray scale of 201.
In order to solve the above problem, the inventors of the present disclosure have proposed a method of adjusting a frame gain in consideration of both a depth factor and a width factor of an annoyance level in Korean Patent Application No. 10-2013-0118088 (Oct. 2, 2013), in which the depth factor is an indication of a degree of image quality deterioration felt by an observer due to a clipping artifact, and the width factor is an indication of a gray scale at which an observer may feel image quality deterioration due to a clipping artifact. However, the method requires additional memory capacity and a large amount of operations.
In the method of accumulating counts, the width factor of an annoyance level may be estimated, but the depth factor of an annoyance level may not be obtained, which will be described below with reference to
In the case where a threshold is set to be 25,000, a gray scale that is above the threshold is 128 in images of
Accordingly, in the method of accumulating counts, a frame max and a frame gain are the same in the image of
The present disclosure provides a data clipping method and device, in which deterioration in image quality felt by an observer due to clipped pixel data may be estimated more accurately, so that a frame gain may be adjusted according to an input image reducing deterioration in image quality.
In one general aspect, a number of pixels at each grayscale level of an input image to an LCD is determined. The determined number of pixels at each grayscale level is accumulated to generate an accumulated distribution of the number of pixel at each grayscale level. The accumulated distribution of the number of pixels at each grayscale level is filtered to generate a filtered accumulated distribution of the number of pixels. A threshold grayscale level at which the filtered accumulated distribution of the number of pixels exceeds a threshold value is determined, and a scaling factor is determined based on the determined threshold grayscale level. The grayscale level of pixels of the input image having a grayscale level lower than or equal to the determined threshold grayscale level are up-scaled based on the scaling factor, the grayscale value of pixels of the input image having a grayscale level greater than the threshold grayscale level are set to have a predetermined clipping grayscale level, and a backlight of the LCD is dimmed based on the scaling factor.
The accompanying drawings, which are included to provide a further understanding of the invention and are incorporated in and constitute a part of this specification, illustrate embodiments of the invention and together with the description serve to explain the principles of the invention. In the drawings:
Hereinafter, exemplary embodiments of the present invention will be described with reference to the drawings. Throughout the specification, like reference numerals denote substantially like components.
The data clipping device and method according to an exemplary embodiment of the present disclosure provides a method of accumulating counts of a histogram to estimate a clipping artifact felt by an observer due to clipped pixel data. Further, based on the clipping artifact estimated by the method of accumulating a secondary count of a histogram, the display device of the present disclosure may adjust a frame gain according to characteristics of an image, so that a clipping artifact may be reduced and power consumption of a backlight unit may be further reduced.
In the present disclosure, a histogram of an input image is prepared, in which when an accumulated number of pixels is counted by reducing gray scales starting from the highest-level gray scale of a histogram, the method of the present disclosure includes not only accumulating each bin of a histogram, but also adding an accumulated count of higher-level bins of the histogram. The bin refers to each gray scale of a histogram. Hereinafter, the above method of accumulating counts will be referred to as a “method of accumulating a secondary count”. In the method of accumulating a secondary count, by sharply changing an accumulated count in an accumulated count direction, it may be identified that as a bin gets smaller than a frame max, clipping artifacts becomes more severe.
The method of accumulating a secondary count with respect to the image in
In order to show an effect produced by the method of accumulating a secondary count according to the present disclosure,
In the method of accumulating a secondary count according to the present disclosure, an accumulated count is significantly increased as a bin of a histogram is changed, such that the threshold for the secondary count is set to a higher value. In the case where a threshold is set to be 1,500,000, a gray scale above the threshold is 149 in the image of
In the image of
In the method of accumulating a secondary count according to the present disclosure, a clipping artifact level, i.e., an annoyance level may be more accurately identified according to images. In the method for accumulating counts, a clipping artifact level in the images of
Referring to
A pixel array of the display panel 100 includes data lines (DL), gate lines (GL, or scan lines) that intersect the data lines, and pixels arranged in a matrix form, so as to display an input image.
Each of the pixels includes a liquid crystal cell, a storage capacity (Cst), a Thin-Film Transistor (TFT), and the like. The liquid crystal cell uses liquid crystal molecules driven by an electric field generated between a pixel electrode and a common electrode to which a common voltage is applied, to delay the phase of light, thereby adjusting transmissivity according to data. The storage capacitor maintains the voltage of the liquid crystal cell for a period of one frame. The TFT is turned on according to a gate pulse from the gate lines (GL) to supply a data voltage from the data lines to the pixel electrode of the liquid crystal cell.
The display panel 100 may be driven by any known liquid crystal mode, such as a Twisted Nematic (TN) mode, a Vertical Alignment (VA) mode, an In Plane Switching (IPS) mode, a Fringe Field Switching (FFS) mode, and the like. The liquid crystal display (LCD) device may be implemented in various forms, such as a transmissive LCD, a semi-transmissive LCD, a reflective LCD, and the like. The tansmissive LCD or a semi-transmissive LCD includes the backlight unit 200 and the light source driver 202.
The backlight unit 200 may be configured to be an edge type backlight unit or a direct type backlight unit. The backlight unit 200 is disposed under a rear surface of the display panel 10 to irradiate light onto the display panel 100. The light source driver 202 supplies an electric current to light sources of the backlight unit 200, so that the light sources may emit light. The light source driver 202 adjusts brightness of the light sources by controlling an electric current applied to the light sources according to a dimming signal (DIM) from a backlight controller 18 illustrated in
The display panel driver writes pixel data to pixels of the display panel 100. The display panel driver includes a data driver 102, a gate driver 104, a timing controller 110, and the like.
The data driver 102 generates data voltages by converting modulated digital video data received from the timing controller 110 into a gamma compensation voltage, and supplies the generated data voltages to the data liens (DL) of the display panel 100. The gate driver 104 supplies a gate pulse, which is synchronized with the data voltages supplied to the data lines (DL), to the gate lines (GL) under the control of the timing controller 130, and sequentially shifts the gate pulse.
The timing controller 110 transmits digital video data of an input image received from a host system 120 to the data driver 102. The timing controller 110 controls the timing of operations of the data driver 102 and the gate driver 104 by using a timing signal, such as a vertical synchronizing signal, a horizontal synchronizing signal, a data enable signal, a main clock, and the like, which is synchronized with digital video data and received from the host system 120. The timing controller 110 modulates pixel data of an input image based on a frame gain by using a data clipping device illustrated in
The host system 120 may be any one of a television (TV) system, a set-top box, a navigation system, a DVD player, a blue-ray player, a personal computer (PC), a home theater system, and a phone system. The host system 120 may adjust a resolution of an input image appropriately according to a resolution of the display panel 100 by using a scaler, and transmits the adjusted resolution to the timing controller 110 along with the timing signal.
The data clipping device may be mounted in a data clipping device. The data clipping device clips pixel data having a high-level gray scale in a histogram of an input image. Further, the data clipping device modulates the pixel data by using a frame gain (S) and controls a dimming signal.
As illustrated in
Referring to
A first accumulated count generator 12 calculates, by using a method of accumulating counts, a primary accumulated count of gray scale N as follows: CN=CN+1+PN, in which N represents a number of pixels of gray scale N, and Np represents a number of pixels of gray scale N−1 in a histogram.
The second accumulated count generator 13 filters the primary accumulated count of gray scale levels. In some embodiments, the second accumulated count generator 13 uses a low pass filter to filter the primary accumulated count of gray scale levels. For instance, the second accumulated count generator 13 may accumulate the primary accumulated count (CN) of gray scale N, so as to output a secondary accumulated count (DN=DN+1+CN) of gray scale N. In other words, accumulation or integration may be a form of low pass filtering of the primary accumulated count of gray scale levels. As a result, the effect of a particular primary accumulated count becomes less pronounced because its effect on the display will be in the context of its incremental change to the secondary accumulated count up to that point of gray scale. In other embodiments, different forms of filtering other than accumulation or integration may be used to make the effect of a particular primary accumulated count becomes less pronounced. For example, the second accumulated count generator 13 may use a digital filter, an analog filter, an integrator, or an accumulator.
The comparator 14 stores a specific threshold. The comparator 14 compares the secondary accumulated count input from the second accumulated count generator 13 with a threshold. In response to the secondary accumulated count (DN) being greater than the threshold, the comparator 14 transmits an Enable signal to the first accumulated count generator 12. Upon receiving the Enable signal from the comparator 14, the first accumulated count generator 12 reduces a gray scale of a histogram and continues accumulation of counts at the gray scale level. In response to the secondary accumulated count (DN) being greater than the threshold, the comparator 14 outputs gray scale N−1 of a secondary accumulated count stored previously to the DN as a frame max (frame max in
The data modulator 16 calculates a frame gain (S) as follows: S=255/frame max. Further, the data modulator 16 modulates pixel data by multiplying pixel data of an input image and the frame gain (S). The modulated pixel data may be transmitted to the data driver 102 by the timing controller 110.
The backlight driver 18 controls a dimming signal (DIM) based on the frame gain (S) calculated by the data modulator 16 to reduce backlight brightness by 1/S times or lower. Accordingly, the backlight brightness may be controlled according to a reciprocal number of the frame gain (S).
As described above, the data clipping method and device according to the present disclosure may identify a clipping artifact level according to images by using a secondary accumulated count, so that a frame gain may be adjusted according to characteristics of images. As a result, the display device of the present disclosure may accurately estimate deterioration in image quality felt by an observer due to clipped data, so that a frame gain may be adjusted according to an input image without deterioration in image quality.
Although embodiments have been described with reference to a number of illustrative embodiments thereof, it should be understood that numerous other modifications and embodiments can be devised by those skilled in the art that will fall within the spirit and scope of the principles of this disclosure. More particularly, various variations and modifications are possible in the component parts and/or arrangements of the subject combination arrangement within the scope of the disclosure, the drawings and the appended claims. In addition to variations and modifications in the component parts and/or arrangements, alternative uses will also be apparent to those skilled in the art.
Number | Date | Country | Kind |
---|---|---|---|
10-2014-0154650 | Nov 2014 | KR | national |