The present invention relates to a display driver operable to control for dimming a backlight in response to decompression of image data. Particularly it relates to a technique useful in application to e.g. a liquid crystal display system.
In recent years, liquid displays are incorporated in battery-driven information devices, mobile phones and others. Most of such displays are of a transmission or translucent type which needs a backlight. Today large part of the power consumption of a liquid crystal display is attributed to a backlight. Hence, it is necessary to devise means for reducing such power consumption. Especially, in regard to mobile phones, it has become possible to watch moving pictures of e.g. TV programs on them. Therefore, it has been required to drive mobile phones by batteries for a long time with their displays kept in action.
Examples of the means for reducing the power consumption of backlight include the way as described by Published Unexamined Patent Application JP-A-11-65531. For instance, on condition that a backlight emits light at a 100-percent output power, and the light passes through a liquid crystal cell lying in front of it at a transmission of 80 percent, 80 percent of the light can be seen. In this case, in spite of 100-percent light emission that the backlight achieves, the liquid crystal cell cuts 20 percent thereof. In contrast, on condition that the backlight radiates light at a 80-percent output power, and the liquid crystal cell allows 100 percent of the light to pass therethrough, 80 percent of the light can be seen likewise. However, in this case, the light emission of the backlight can be reduced to 80 percent. By making use of the difference as described above, the light emission of the backlight is suppressed in quantity.
In a case where a pixel of a 80-percent luminance takes the maximum in the histogram of pixel values of an image, exactly the same image can be displayed with a quantity of light emission of 80 percent by decompressing display data to five-forth thereof, and reducing in quantity the light emission of a backlight to 80 percent.
An image can be displayed with a smaller amount of light emission in comparison to the way of utilizing the maximum luminance of the image by using the histogram to take the following procedure: decompressing image data so that gradation data Ds corresponding, in appearance frequency, to a predetermined value of x percent with respect to the maximum value forms the maximum gradation; and then dimming a backlight according to the decompression.
Published Unexamined Patent Application JP-A-2006-308632 discloses an image display technique, which includes: conducting conversion of enlargement of the distribution of gradations on image data; and at the time of controlling or adjusting, in quantity, the light of a backlight according to the enlargement, controlling the gradations of the image data so as to reduce the change in brightness resulting from the adjustment of the light. According to the patent document JP-A-2006-308632, gradation values of the image data are corrected so that the product of the average of gradation values of image data subjected to the conversion of enlargement of the distribution of gradations, and the light adjustment factor becomes closer to the average of gradation values of the image data before the conversion.
Prior to the invention, the inventors were involved in research and development of a liquid crystal driver semiconductor integrated circuit intended to be incorporated in a mobile phone.
In the research and development, the inventors conducted a detailed study of the related art concerning a technique for reducing the power requirements of backlights as described in Published Unexamined Patent Application JP-A-11-65531. After the study, the inventors clarified the problem that the adoption of the conventional technique makes difficult to sufficiently decompress display data in connection with a pixel of a higher gradation in comparison to the gradation Ds corresponding to the predetermined value of x percent, and therefore dimming a backlight decreases the luminance of a pixel of a higher gradation. In addition, it was revealed that the amount of decrease in luminance varied depending on which image to display. Therefore, to use the conventional technique to achieve the image quality over a certain level in regard to all displayed images, it is essential to set the predetermined value of x percent to a smaller value so that even with a displayed image, whose quantity of decrease in luminance is the worst, the absolute value of the amount of decrease in luminance is made smaller. In this case, the image quality over a certain level can be ensured. However, the effect of cutting backlight's power consumption becomes smaller for all images. According to the patent document JP-A-2006-308632, the gradation values of image data are corrected so that the display mean value luminances before and after the conversion for enlargement of the distribution of gradations agree with each other. Sometimes it is not expected that the control taking the step of conforming the display mean value luminances to each other by the luminance mean can increase the image quality after correction.
After the study prior to the invention as described above, the invention was made by the inventors.
It is an object of the invention to provide a display driver which controls the ratio of backlight dimming so that the image quality after backlight dimming is kept at a constant level for every displayed image, and which can achieve a balance between the image quality and power cutting ratio.
The above and other objects of the invention and novel features thereof will be apparent from the description hereof and the accompanying drawings.
Of the embodiments of the invention herein disclosed, representative one will be briefly outlined below.
A means in connection with a display driver according to an embodiment of the invention is characterized by using e.g. MSE (Mean Square Error) or PSNR (Peak Signal to Noise Ratio) as an index of image quality to control the data decompression ratio and backlight dimming ratio so that the image quality after backlight dimming is at a constant level. As an example of the controlling means, a method using MSE will be briefly described below. Incidentally, the same as the description presented here is true for a method using PSNR. First, the amount of decrease in luminance for an input displayed image in the case of decompressing display data and dimming a backlight is previously calculated, as MSE, based on the data decompression ratio and backlight dimming ratio of a preceding frame. If the MSE is larger than a predetermined reference value, the data decompression ratio and backlight dimming ratio are made smaller than those of the preceding frame. In contrast, if e MSE is smaller than the predetermined reference value, the data decompression ratio and backlight dimming ratio are made smaller than those of the preceding frame. Using the control as described above, MSE or PSNR of an output displayed image, namely an index of image quality thereof, is made the predetermined reference value regardless of a displayed image.
The effect achieved by the representative embodiment of the invention herein disclosed will be briefly described below.
With a technique for reducing the power requirements of backlights which includes decompressing display data and dimming a backlight according to the invention, it becomes possible to control the backlight dimming ratio so that the image quality after backlight dimming is kept fixed.
The preferred embodiments of the invention herein disclosed will be outlined, first. Here, the reference numerals, characters and signs for reference to the drawings, which are accompanied with paired round brackets, only exemplify what the concepts of members or parts referred to by the numerals, characters and signs contain.
[1] A display driver in connection with the invention (see
According to the above means, the reference gradation is changed so that an error between a display luminance corresponding to display data, and a display luminance after light adjustment becomes equal to a first reference value, and the decompression ratio for current display data, and the dimming ratio pertinent to the display panel are determined. The image quality after backlight dimming is easier to keep at a constant level in comparison to a control method such that the display mean luminances before and after the conversion are simply brought into agreement with each other.
[2] In the display driver described in [1], the decompression unit multiplies a value of each pixel component of display data by a coefficient to maximize the reference gradation, thereby to decompress the display data.
[3] In the display driver described in [1], the error calculating unit calculates an error between a luminance of display data of a current display frame, and a luminance obtained by decompressing the display data of the current display frame by use of a reference gradation of a preceding display frame.
[4] In the display driver described in [1], MSE (Mean Square Error) is used as the error.
[5] In the display driver described in [1], the first reference value in connection with the reference gradation control unit can be changed by a value set in a register from outside the display driver.
[6] In the display driver described in [4], in the gradation control unit, a gradation number of the reference gradation varied in every frame is changed as to a value set in a register from outside the display driver, or a numerical value of MSE (Mean Square Error).
[7] From another perspective, a display driver in connection with the invention (
[8] In the display driver described in [7], wherein the first to third reference values can be each changed by a value set in a register from outside the display driver.
[9] The display driver described in [8], wherein the second reference value is larger than the first reference value, which is one of requirements to achieve a lower power consumption.
[10] In regard to the display driver described in [9], in the gradation control unit, the difference between reference gradations before and after the change thereof is changed as to a value set in a register from outside the display driver, or a numerical value of MSE (Mean Square Error).
[11] From another perspective, a display driver in connection with the invention (
[12] In the display driver described in [11], the percentage judging unit operable to judge flesh color has: the function of translating the input display data into all or one of hue, color saturation, and lightness; and the function of identifying flesh color from all or one of the hue, color saturation and lightness.
[13] In the display driver described in [11], the first, fourth and fifth reference values can be changed by a value set in a register from outside the display driver.
[14] In the display driver described in [13], the fourth reference value is smaller than the first reference value, which is one of requirements to increase the image quality.
[15] The display driver described in [14], in the gradation control unit, a gradation number of the reference gradation varied in every frame is changed as to one of a value set in a register from outside the display driver, and a numerical value of MSE (Mean Square Error).
[16] From still another perspective, a display driver in connection with the invention (
[17] In the display driver described in [16], the first reference value can be changed by a value set in a register from outside the display driver.
[18] In the display driver described in [17], in the gradation control unit, a gradation number of the reference gradation varied in every frame is changed as to one of a value set in a register from outside the display driver, and a numerical value of MSE (Mean Square Error).
[19] From another perspective, a display driver in connection with the invention (
[20] In the display driver described in [19], the first reference value can be changed by a value set in a register from outside the display driver.
[21] In the display driver described in [20], in the gradation control unit, a gradation number of the reference gradation varied in every frame is changed as to one of a value set in a register from outside the display driver, and a numerical value of MSE (Mean Square Error).
The embodiments will be described further in detail.
<<Liquid Crystal Display Driver>>
The control processor 114, LC panel 115 and backlight module 116 are disposed as external blocks. The control processor 114 transmits display data to the LC driver 101 through the system interface 102. The LC panel 115 receives the source signal 111, and gate and common signals 112 from the LC driver 101, and then offers a display. On receipt of supply of power source from the LC driver 101 through the backlight-power-source line 113, the backlight module 116 turns on the backlight. Then, the backlight illuminates the LC panel 115 at a desired brightness. Consequently it becomes possible to see a display on the LC panel 115 by visible light.
Using the blocks, the LC driver 101 works as follows. The LC driver 101 captures display data from the outside through the system interface 102, in which the display data is transferred to the backlight control circuit 104. The backlight control circuit 104 performs the step of decompressing the display data to be described later, and stores the resulting data in the graphic RAM 105. The timing generator 106 generates a timing signal to read the graphic RAM 105, and transmits the display data to the source-line drive circuit 108 in synchronization with the timing signal. The source-line drive circuit 108 selects a voltage from among gradation voltages generated by the gradation-voltage generator 107 according to display data as described above, and sends the selected voltage as the source signal 111 to the LC panel 115. In addition, the timing signal generated by the timing generator 106 is used to produce gate and common signals 112 in the LC drive level generator 109. The signals thus produced are also sent to the LC panel 115. Further, the backlight power-source circuit 110 generates a voltage according to information from the backlight control circuit 104. The voltage is applied to the backlight-power-source line 113, causing the backlight module 116 to go on. The backlight thus activated illuminates the LC panel 115, and therefore it becomes possible to see a display. The control processor 104 performs the lighting and extinction of the backlight as follows. First, the information for lighting/extinction is written in the control register 104 through the system interface 102, and then transmitted to the backlight power-source circuit 110. Subsequently, the backlight power-source circuit 110 produces a voltage for lighting/extinction, which is applied to the backlight-power-source line 113. Then, the backlight module 116 goes on/out. A signal for the action of such lighting or extinction has priority over a signal for controlling the voltage of the backlight power source, which the backlight control circuit 104 generates.
<<Backlight Control Circuit>>
Now, the first specific example of the backlight control circuit 104 will be described with reference to
The backlight control circuit 104 has: an MSE calculating circuit 203 as an error calculating unit; a Ds control circuit 205 as a reference gradation control unit; a data decompression circuit 220 as a decompression unit; and a backlight voltage generator 230 as a light-adjustment control unit.
The MSE calculating circuit 203 accepts, as inputs, input display data Din (200), a frame SYNC 201 showing a one-frame period, and gradation data Ds(n-1) fed back from the preceding frame, which is denoted by the numeral 202. When decompressing data based on gradation data Ds(n-1) denoted by the numeral 202 to dim the backlight, the MSE calculating circuit 203 calculates MSE (Mean Square Error) as an index of what extent the luminance will reduce to, and transmits a result of the calculation to the Ds control circuit 205 of the subsequent stage. The gradation data Ds represents a reference gradation used as a criterion for deciding the backlight dimming ratio and the expansion ratio of display data. For instance, if 256 gradations are used for display, the gradation data Ds takes on a value meeting the condition of:
0<Ds<255.
Next, the MSE calculating circuit 203 will be described with reference to
m: number of pixels in horizontal direction
n: number of pixels in vertical direction
The Ds control circuit 205 accepts, as inputs, an MSE from the MSE calculating circuit 203, gradation data Ds(n-1) denoted by the numeral 202, and MSE reference value k (204) from the outside, performs addition and subtraction of gradation data Ds(n-1) denoted by the numeral 202 so that the MSE becomes equal to the MSE reference value k (204), and then transmits the resulting data Ds(n) to the data decompression unit 220 and backlight control circuit 230 of subsequent stages. In a more preferred embodiment, the Ds control circuit 205 increases the data Ds(n-1) denoted by the numeral 202 by a number of A in gradation in the case of the MSE larger than the MSE reference value k, and decreases the data Ds(n-1) denoted by the numeral 202 by the number of A in gradation in the case of the MSE smaller than the MSE reference value k, which are as expressed by:
MSE<k:Ds−A(Ds is decreased)
MSE≧k:Ds+A(Ds is increased) [Number 3]
A: A fixed number between zero and the maximum number of gradation, which can be set by an external register.
According to the forms of the MSE calculating circuit 203 and Ds control circuit 205 as described above, the data Ds(n) denoted by the numeral 206 is shifted so that MSE converges to the MSE reference value k (204) regardless of a displayed image. Incidentally, the MSE reference value k can be changed by an external register as shown in
In regard to this embodiment, it is desirable to avoid changing the decompression ratio and dimming ratio in case that MSE is in a range of “MSE reference value k+B (B is an appropriate constant)”. This is because MSE does not converge on condition that A>1, and MSE is between a value given by “MSE reference value k+A” and the MSE reference value k denoted by the numeral 204. With this embodiment, the numerical value “A” is defined as an appropriate constant. However, if the difference between the value of MSE and MSE reference value k (204) is small, it is sufficient to shift the numerical value “A” in a small range.
The data decompression unit 220 accepts, as inputs, input display data and data Ds(n) 206 from the Ds control circuit 205. Then, data decompression unit 220 decompresses the display data so that the data Ds(n) 206 achieves the maximum gradation, and outputs to the graphic RAM 105.
The data decompression unit 220 will be described further. First, the display data decompression coefficient calculating unit 221 uses the data Ds(n) 206 to carry out a computation of 255/Ds(n). In this step, the display data decompression coefficient “e” denoted by the numeral 222 is calculated so that the data Ds(n) 206 achieves the maximum gradation. Next, in the multiplication unit 223, the display data decompression coefficient “e” 222 is multiplied by the input display data Din 200, and the result of the multiplication is set as a parameter P. If the result of the multiplication exceeds 255, the operation unit 224 executes a saturate operation by which the parameter P is substituted with 255. Finally, the operation unit 225 performs a truncation to the closest whole number, and outputs the decompression display data thus acquired to the graphic RAM 105. The multiplication by the operation unit 223 is executed for each of R, G and B pixels of image data. Gradations are assigned within a range of 256 depending on colors produced by colors of R, G, and B. Therefore, the multiplication of the display data decompression coefficient by display data represents a change in the gradation of a pixel, or a change in the luminance of a pixel.
The backlight voltage generator 230 accepts data Ds(n) denoted by 207 as an input, in which reference is made to the table 231 with the data Ds(n), whereby a backlight voltage select signal 232 is produced and output to the backlight module 116.
By executing a series of the forms of actions, an output display can be made to converge, over a few frames, to the image quality of PSNR corresponding to the MSE reference value k with respect to input display data. Examples of the correspondence between MSE and PSNR values are shown in
<<Handling of Solid Image>>
Now, the second specific example of the backlight control circuit, on which an arrangement is made to provide for a solid image, will be described. As for a so-called solid image whose input displayed image is formed in a monochrome and monogradation, it has been revealed from the study by the inventors that the reduction in luminance is more difficult to visually recognize in comparison to other images. Hence, the description here pertains to a backlight control circuit additionally provided with the function of adjusting a displayed image consisting of solid one in whole or an image having a high percentage of solidly displayed areas therein—both herein referred to as “solid image” simply—to increase the decompression ratio of the displayed image data and the backlight dimming ratio, and is presented in contrast to the backlight control circuit 104 of
Next, the difference between the backlight control circuit of
The reference value weighting circuit 504 receives, as inputs, a reference value weighting coefficient L input from the outside and denoted by the numeral 505, and a judgment signal Bj (503) from the solid image judging circuit 501. On receipt of the inputs, the reference value weighting circuit 504 multiplies the MSE reference value k by the coefficient L (L>1) in the case of Bj=0, and multiplies by one (1) in the case of Bj=1, and then outputs a result of the multiplication to the Ds control circuit 205 of the subsequent stage. The setting of the MSE reference value weighting coefficient L (505) can be changed by the control register 103 as shown in
According to the arrangement as described above, the backlight dimming ratio can be made larger in comparison to that achieved by the backlight control circuit of
According to another embodiment, the backlight control circuit may be arranged to have, instead of the reference value weighting circuit 504, a circuit located in a stage subsequent to the MSE calculating circuit 203, which accepts, as inputs, the judgment signal Bj and MSE, and weights MSE, and multiplies MSE by P (P<1) on condition that a displayed image is solid one.
<<Measure to Handle an Image with Many Flesh-Colored Portions>>
A portrait image containing many flesh-colored pixels is easier for the backlight control circuit of
The flesh-color detector 801 accepts input display data as an input. On receipt of the input, the flesh-color detector calculates a hue H for each pixel according to the following expression:
The flesh-color detector outputs a judgment signal Hj=0 if the hue H is in a range between 0 and 30, which corresponds to a hue region of flesh color, and it outputs a judgment signal Hj=1 if the hue H is between 30 and 360. In this example, a hue is used to identify flesh color, however the identification may be actualized by other means using a color saturation, lightness or RGB, or a combination thereof as long as flesh color can be identified.
The reference value weighting circuit 804 accepts, as inputs, a reference value weighting coefficient V (803) from the outside and a judgment signal Hj (802) from the flesh-color detector 801. On receipt of the inputs, the reference value weighting circuit 804 multiplies the MSE reference value k by V (V<1) when Hj=0, and multiplies by one (1) when Hj=1, and then outputs a result of the multiplication to the Ds control circuit 205 of the subsequent stage. The setting of the reference value weighting coefficient V (803) can be changed by the control register 103 as shown in
According to the arrangement as described above, the backlight dimming ratio can be made smaller in comparison to that offered by the backlight control circuit of
The backlight control circuit as shown in
<<Backlight Control on the Maximum of Errors Calculated for Each Division Area>>
In the backlight control circuit of
The display data area division circuit 1001 divides display data into two or more parts which correspond in number to display areas resulting from division. Subsequently, the MSE calculating circuit 1002 calculates MSE for each division area based on the resulting data. The maximum MSE select circuit 1003 selects the maximum MSE (MSEmax) from among MSEs making up each of MSE(1) to MSE(t) of the respective division areas, and outputs to the Ds control circuit 205 of the subsequent stage. In this example, the arrangement described with reference to
Using this arrangement, the Ds control circuit 205 of the subsequent stage controls gradation data Ds based on each MSEmax. Therefore, the backlight dimming ratio is decided so that MSE or PSNR is at or above a certain level as to any division area of the display panel.
<<Backlight Control for Each Division Area on an Error Calculated for Each Division Area>>
The display system of
In the example described here, the LC driver has the backlight control circuit 104, graphic RAM 105, timing generator 106, gradation-voltage generator 107, source-line drive circuit 108, LC drive level generator 109, and backlight power-source circuit 110 for each division area. However, the LC driver may be arranged to have only one set of these parts, and to handle the data for each display area according the time division technique.
The invention made by the inventor has been concretely described above based on the embodiments thereof. However, the invention is not limited to the embodiments. It is obvious that various changes and modifications may be made without departing from the subject matter thereof.
For instance, in the above description, MSE is cited as the error between a display luminance corresponding to input display data and a display luminance after backlight adjustment. However, an index other than MSE may be adopted as long as it represents the difference of luminance.