Patent Application
20080100554
1. Technical Field
The present invention relates to an image display device, an image display method, an image display program a recording medium containing the image display program, and an electronic apparatus, which execute a process on input image data.
2. Related Art
In an existing image display device, such as a laptop computer, that uses a non-luminescent display device, such as a liquid crystal panel, when electric power is not supplied from the outside, image display is performed in such a manner that a light source (for example, cold-cathode tube) converts electric power supplied from a battery to light and the amount of light transmitted through the liquid crystal panel is then controlled. In general, of electric power consumed in the whole device, a percentage of electric power consumed by the light source is relatively large. Then, during battery driving, electric power consumed by the device is reduced by reducing (hereinafter, also referred to as “dimming” where appropriate) the amount of source light emitted from the light source. In addition, when the amount of source light is reduced, visibility decreases with a decrease in luminance of the entire screen. For this reason, there has been a need for technology that is able to balance a reduction in consumed electric power by reducing the amount of source light and retention of visibility.
Japanese Unexamined Patent Application Publication No. 2004-246099, for example, describes a technology that reduces consumed electric power without impairing apparent brightness by converting RGB data to luminance/color difference data (hereinafter, referred to as “YCbCr data”) and executing a process of luminance enhancement and a process of reduction in the amount of backlight (dimming) Other than that, Japanese Unexamined Patent Application Publication No. 2004-54250 describes a technology related to the invention.
However, in the technology described in the above JP-A-2004-246099, image quality may possibly decrease due to a decrease in saturations of a display image even when apparent brightness is not changed. In addition, in the technology described in the above JP-A-2004-54250 as well, saturations of a display image may possibly decrease when electric power consumed by a light source is reduced.
In advantage of some aspects of the invention is that it provides an image display device, an image display method, an image display program, a recording medium containing an image display program, and an electronic apparatus, which are able to appropriately perform dimming of backlight for power saving while effectively suppressing a decrease in saturations of an image.
A first aspect of the invention provides an image display device the image display device corrects image data, which are used for displaying an image, using a gray scale value assigned to each pixel and also controls the amount of source light emitted from a light source. The image display device includes a source light amount control device and an image correction device. The source light amount control device determines the amount of source light and then controls the amount of source light. The image correction device corrects a signal used for changing saturations of the image data so as to reduce a change in the saturations due to a change in the amount of source light, the change in the amount of source light being performed by the light source amount control device.
The image display device is appropriately used to correct image data, which are used for displaying an image, using a gray scale value assigned to each pixel and also to control the amount of source light emitted from a light source. The source light amount control device determines the amount of source light and then controls the amount of source light. In addition, the image correction device corrects a signal used for changing saturations of the image data (that is, corrects color differences) so as to reduce a change in the saturations due to a change in the amount of source light (hereinafter, also referred to as “light control”), the change in the amount of source light being performed by the light source amount control device. Thus, because saturation correction is executed in correspondence with light control, it is possible to execute light control while appropriately suppressing a change in saturations. Hence, it is possible to appropriately execute dimming, for power saving while effectively suppressing a decrease in saturations of an image.
In the image display device, the image correction device may correct the signal so as to reduce a change in an average value of saturations of the image data when the source light control device controls to change the amount of source light. Thus, it is possible to execute light control while effectively suppressing a change in saturations. Thus, it is possible to execute light control (power saving) with higher image quality by effectively suppressing a decrease in saturations.
In the above image display device, the image correction device may correct the signal so that an average value of saturations of image data, in which a signal for changing saturations has been corrected and the source light amount control device has controlled to change the amount of source light, is substantially equal to an average value of saturations of image data which have been corrected from image data, in which a signal for changing saturations has not been corrected, so that the saturations are approximated to a predetermined saturation reference. That is, the correction is executed so that a value obtained by the product of a light control rate and an average value of saturations of image data, in which a signal for changing saturations has been corrected, is substantially equal to an average value of saturations of image data which have been corrected so that the saturations are approximated to a predetermined saturation reference.
In the above image display device, the source light amount control device may determine the amount of source light on the basis of luminances and saturations of the image data. Thus, the source light amount control device is able to determine the amount of source light in consideration of not only the luminances but also the saturations.
In the above image display device, the source light amount control device may determine the amount of source light on the basis of a value specified by the luminances or a value specified by the saturations, whichever is larger. In this manner, the amount of source light may be determined by appropriately detecting a high saturation color and, hence, it is possible to suppress dimming on a high saturation color. Thus, it is possible to appropriately execute dimming for power saving while suppressing a decrease in saturations of image data having a high saturation color. That is, because a high saturation color may be detected even when the luminances of image data are small, it is possible to execute dimming with high image quality while effectively suppressing a decrease in saturations.
In the above image display device, the value specified by the luminances may include an average value of the luminances, the value specified by the saturations may include twice an average value of color differences specified by blue-yellow axis and twice an average value of color differences specified by red-green axis, wherein the source light amount control device may determine the amount of source light on the basis of a maximum value among the average value of the luminances, twice the average value of the color differences specified by blue—yellow axis, and twice the average value of the color differences specified by red-green axis. In this manner; it is possible to appropriately determine a high saturation image on image data that are described by YCbCr. Thus, an additional circuit, such as YCbCr to RGB conversion circuit, for the above determination need riot be provided, so that it is not likely to increase costs due to addition of a large circuit.
In addition, in the above image display device, the value specified by the luminances may include an average of the luminances, the value specified by the saturations may include twice an average value of saturations, each of which is defined by taking an average of a color difference specified by blue-yellow axis and a color difference specified by red-green axis, wherein the source light amount control device may determine the amount of source light on the basis of a maximum value among the average value of the luminances and twice the average value of the saturations, each of which is defined by taking the average of a color difference specified by blue-yellow axis and a color difference specified by red-green axis. In this manner as well, it is possible to suppress an increase in costs due to addition of a large circuit.
In the above image display device, the image correction device may correct the signal on the basis of the amount of source light that is determined by the source light amount control device.
In addition, the image display device may be applied to an electronic apparatus provided with a power supply unit that supplies the image display device with voltage.
A second aspect of the invention provides an image display method that corrects image data, which are used for displaying an image, using a gray scale value assigned to each pixel and that controls the amount of source light emitted from a light source. The image display method includes determining the amount of source light and then controlling the amount of source light, and correcting a signal used for changing saturations of the image data so as to reduce a change in the saturations due to a change in the amount of source light by controlling the amount of source light.
A third aspect of the invention provides an image display program that executes a process to correct image data, which are used for displaying an image, using a gray scale value assigned to each pixel and that also executes a process to control the amount of source light emitted from a light source. The image display program has instructions for causing a computer to determine the amount of source light and then control the amount of source light, and correct a signal used for changing saturations of the image data so as to reduce a change in the saturations due to a change in the amount of source light by controlling the amount of source light.
According to the above described image display method and image display program as well, it is possible to appropriately perform dimming of backlight for power saving while effectively suppressing a decrease in saturations in an image.
Note that various computer readable media, such as a flexible disk, a CD-ROM, or an IC card, may be used as a recording medium that contains the image display program.
The invention will be described with reference to the accompanying drawings, wherein like numbers reference like elements.
Embodiments of the invention will now be described with reference to the accompanying drawings.
A first embodiment of the invention will be described with reference to the drawings.
A digital video camera 20, a digital still camera 21, or the like, is connected to the input I/F 10 as a device that inputs a dynamic image. In addition, images distributed through a network device, images distributed through radio wave, and the like, are also input through the input I/F 10 to the image display device 1.
The CPU 11 is a section that controls various processes executed in the image display device 1. Particularly when dynamic image data are input through the input I/F 10 or dynamic images stored in the HID 14 are reproduced, the CPU 11 transfers dynamic image data to the image processing engine 15 and then instructs the image processing engine 15 to display the dynamic image.
The power supply unit 31 supplies electric power stored in a battery that is set inside the power supply unit 31 or electric power supplied from the outside of the image display device 1, to various components, including a backlight 32, of the image display device 1.
The backlight 32 is a light source, such as a cold-cathode tube or an LED (light emitting diode); that converts electric power, which is supplied from the power supply unit 31, to light. Light emitted from the backlight 32 is diffused by various sheets interposed between the backlight 32 and the display panel 30 and is irradiated toward the display panel 30 as substantially uniform light.
The display panel 30 is a transmissive liquid crystal panel. The display panel 30 modulates light in accordance with a driving signal corresponding to image data that are Input through the display I/F 17 and controls a transmittance ratio of the amount of light that is received from the backlight 32 to the amount of light that is transmitted through the display panel 30 for each pixel. Thus, the display panel 30 displays a color image. Note that, because the display panel 30 performs display by controlling a transmittance ratio of light, the luminances of an image which will be displayed vary in proportion to the amount of light supplied from the backlight 32.
Specifically, the level correction section 43 includes a histogram generating section 50, a level correction parameter generating section 51, and a level correction execution section 57. In addition the brightness correction section 44 includes a luminance summation (ΣY) computing section 60, an average luminance (Yave) computing section 61, a coefficient summation (ΣF(Y)) computing section 62, a brightness correction amount (G3) computing section 69, an enhanced brightness correction amount computing section 65, a brightness correction execution section 66; and a light control rate (α) computing section 71. Furthermore, the saturation correction section 80 includes a color difference summation (Σ|cb|, Σ|cr|) computing section 82, an average saturation (Save) computing section 83, a coefficient summation (Σ|Fc(cb)|, Σ|Fc(cr)|) computing section 84, a saturation correction amount (Gc) computing section 85, an enhanced saturation correction amount (Gd1) computing section 86, and a saturation correction execution section 87. The thus configured image processing engine 15 is formed of a hardware circuit, such as an ASIC. The following will describe processes executed by the above sections.
The frame image acquisition section 40 sequentially acquires image data of a frame image, which is an image of each frame of a dynamic image, from dynamic image data that are input through the input I/F 10 to the image display device 1.
In addition, the input dynamic image data are data that indicate a plurality of still images (hereinafter, referred to as “frame images”) that are successive in time sequence, for example. The dynamic image data may be compressed data or the input dynamic image may be interlaced data. In such a case, the frame image acquisition section 40 executes extraction of the compressed data, or executes conversion of the interlaced data to non-interlaced data. Thus, the frame image acquisition section 40 converts image data of each frame image of dynamic image data to image data of a type that can be handled by the image processing engine 15 to acquire the image data. Note that, when still image data are input, the frame image acquisition section 40 is also able to handle a still image by acquiring image data of the still image.
In the present embodiment, for a large number of pixels that are arranged in a matrix, for example, of 640 by 480 pixels, YCbCr data, which are represented mainly using Y (luminance), Cb(U) (color difference specified by blue-yellow axis) and Cr(V) (color difference specified by red-green axis), are acquired as image data. In this case, “0≦Y≦255”, “−128≦Cb, Cr≦127”, and “Cb, Cr=0” indicate a gray axis. Note that the number of pixels that display a frame image and the number of gray scale levels of each pixel are not limited to it. In addition, as to the model describing image data as well, it is not limited to YCbCr data. It may be data using various models, such as RGB data that use 256 gray scale values, that is, “0” to “125” (8-bit) for respective colors R (red), G (green), and B (blue).
The color conversion section 41 converts the image data, which are acquired by the frame image acquisition section 40, to luminance data and color difference data. Specifically, the color conversion section 41 changes the acquired image data to YCbCr data. More specifically, the color conversion section 41, when the acquired data are YCbCr data, does not execute color conversion. Only when the acquired image data are RGB data, the color conversion section 41 executes color conversion. Specifically, when the acquired image data are ROB data, the color conversion section 41 calculates conversion equation, for example, indicated as follows to convert the RGB data to YCbCr data
Y=0.299R+0.587G+0.114B Equation (1)
Cb=−0.1684R−0.3316G+0.5000B Equation (2)
Cr=0.500R−0.4187G−0.0813B Equation (3)
Note that the color conversion section 41 may store a color conversion table that contains the conversion results of Equation (1) to Equation (3) for each gray scale levels (0 to 255) of RGB and then convert the image data to gray scale values that use 256 gray scales (8-bit) on the basis of the color conversion table.
The image data processed in the color conversion section 41 are stored in the frame memory 42. Specifically, the frame memory 42 keeps image data of one screen. Note that the image processing engine 15 may be configured without the frame memory 42. When the image processing engine 15 includes the frame memory 42, it is possible to execute a process on the frame from which an image characteristic amount is extracted. However, when the image processing engine 15 does not include the frame memory 42, it is also possible to execute a process using an image characteristic amount of the previous frame.
The level correction section 43 receives luminance values X from the color conversion section 41 and executes level correction for expanding a region in which the luminance values X are distributed. Thus, the level correction section 43 acquires luminance values Y. When in the level correction, the histogram generating section 50 initially calculates a histogram of luminance data X of a frame image, and the level correction parameter generating section 51 acquires the upper limit value XH and lower limit value XL of the luminance values X of the frame image through the histogram as level correction parameters. For example, when the histogram as shown in
The level correction execution section 52, as shown in
Y(X)=255×(X−XL)/(XH−XL) Equation (4)
The following will describe the process executed by the brightness correction section 44. The brightness correction section 44 executes brightness correction so that the brightness is approximated to a predetermined brightness reference. Specifically, the luminance values Y, for which level correction has been executed, are converted to luminance values Y″ in accordance with the following equation.
Y″=F(Y)×G3+Y Equation (5)
In Equation (5), “Y” is a luminance value, for which level correction has been executed, “G3” is an amount of brightness correction (hereinafter, referred to as “brightness correction amount”) at a predetermined luminance value, and “F(Y)” is a brightness correction coefficient that indicates a ratio of a correction value to the reference correction amount G3 at each of the luminance values Y. The following will describe a method of determining a correction curve shown in Equation (5), that is, a method of determining a brightness correction coefficient F(Y) and a brightness correction amount G3 one by one.
The brightness correction coefficient F(Y) employs a function that is determined in advance.
Thus, the image display device 1 according to the first embodiment includes two types of brightness correction coefficients F(Y) and uses one of the correction coefficients F(Y) depending on positive value or negative value of the brightness correction amount G3. Specifically, when the brightness correction amount G3 is positive, the brightness correction coefficients F(Y) that employ “192” as the correction point are used. On the other hand, when the brightness correction amount G3 is negative, the brightness correction coefficients F(Y) that employ “64” as the correction point are used. Thus, as shown in
G3=Ga(Yth−Yave) Equation (6)
In Equation (6), “Ga” is a brightness correction intensity coefficient that is a predetermined value equal to 0 or above, and “Yth” is a brightness reference (that is, a reference gray scale value) As is apparent from Equation (6), the brightness correction amount G3 is proportional to a value obtained by subtracting the average value Yave of the luminances from the brightness reference Yth, so that, when the luminance values Y are corrected in, accordance with the brightness correction amount G3, the luminance values Y are corrected so as to be approximated to the brightness reference Yth. Thus, it is possible to reduce biased luminance values of image data. Note that the value of the brightness correction intensity coefficient Ga and the brightness reference Yth may be determined as constants in advance or may be set by a user. Alternatively, the value of the brightness correction intensity coefficient Ga and the brightness reference Yth may be determined in coordination with types of image data.
Note that the brightness correction may be executed through Equation (5) when the brightness correction amount G3 is determined; however, actually in the present embodiment, the brightness correction amount G3 that is calculated in the brightness correction amount computing section 69 is transferred to the enhanced brightness correction amount computing section 65 as a parameter without calculation of Equation (−5).
Here, a parameter used to reduce the amount of light emitted from the backlight 32 below a predetermined amount of light and to reduce the luminances of an image that is displayed on the display panel 30 is defined as “α” (“α” corresponds to a light control rate). In this case, the light control rate a is positive number and is 1 or below, so that, when the light control rate α is “1”, the backlight 32 emits a predetermined maximum amount of light. That is, the amount of light is always controlled by dimming relative to a predetermined amount of light. In addition, the light control rate α is a rate that is linearly related to stimulus given to the visual sense of a human being. In other words, the rate is made in consideration of sensitivity characteristic of the visual sense of a human being, so that, when the light control rate α is “0.5”, for example, the stimulus given to the visual sense of a human being by the luminances of an image displayed on the display panel 30 is 50% of the stimulus when the light control rate α is “1”.
The brightness correction section 44, by further executing correction in accordance with the following equation, executes correction to reduce variation in luminances, which occurs in an image displayed due to light control while correcting biased luminance values (hereinafter, this correction is termed as “enhanced brightness correction”). The correction equation of the enhanced brightness correction is defined by the following equation.
Z(Y)=F=(Y)×G4+Y Equation (7)
Here, a correction amount G4 is determined so that the product of the average value of luminance values Z, for which enhanced brightness correction is executed, and the light control rate α is equal to the average value of the luminance values Y″ (hereinafter, “correction amount G4” is termed as “enhanced brightness correction amount G4”). That is, the enhanced brightness correction amount G4 is determined so as to satisfy the following Equation (8).
α×Zave=Y″ave Equation (8)
Equation (8) indicates that the luminances that display an image based on the luminance values Y″ are visually made equal to the luminances that display an image based on the luminance values Z after light control. Here, the right-hand side and left-hand side of Equation (8) may be expressed as the following equation.
Y″ave=ΣY″/N=(ΣF(Y)×G3+ΣY)/N Equation (9)
Z′ave=ΣZ′/N=(ΣF(Y)×G4+ΣY)/N Equation (10)
G4=G3/α+(1−α)ΣY/(αΣF(Y)) Equation (11)
Here, the enhanced brightness correction amount G4 that appears in Equation (11) is not as a function of the luminance values Y″ but as a function of the brightness correction amount G3, so that the brightness correction section 44 is able to calculate the enhanced brightness correction amount G4 on the basis of the brightness correction amount G3 without calculation using Equation (5) actually. Using the thus calculated enhanced brightness correction amount G4, it is possible to execute enhanced brightness correction that reduces variation in luminances due to light control after biased luminance values have been corrected.
Here, as described above, when the brightness correction is executed, there is a possibility that a contrast corresponding to a high luminance region is reduced.
on the higher gray scale side than the luminance value corresponding to the average luminance value Yave of the luminance values Y, including when the brightness correction amount G3 is not 0, a gray scale difference L1 of the luminance values Y″ without light control and a gray scale difference L2 of effective luminance values α×Z′ with light control may be expressed as the following equations.
L1=255−Y″(Yave)=255−(F(Yave)×G3+Yave) Equation (12)
L2=α×255−α×Z′(Yave)=α×(255−(F(Yave)G4+Yave)) Equation (13)
Then, from Equation (12) and Equation (13), a contrast retention rate R and an equation when the contrast retention rate R is limited to Rlim (which is set by an image quality retention rate setting section 70, which will be described later) are determined as the following equations.
R=L2/L1=α×(255−(F(Yave)G4+Yave))/(255−(F(Yave)×G3+Yave)) Equation (14)
Rlim=αlim×(255−(F(Yave)G4lim+Yave))/(255−(F(Yave)×G3+Yave)) Equation (15
“αlim” in Equation (15) indicates a limit light control rate, and “G4lim” indicates a limit correction amount. Here, the limit light control rate αlim may be expressed as the following equation.
αlim(ΣF(Y)×G3+ΣY)/(ΣF(Y)×G4lim+ΣY) Equation
The above limit correction amount G4lim and the limit light control rate αlim are respectively used as a final correction amount G4′ and a final light control rate α′, which are actually used for correction, so that it is possible to appropriately execute light control while retaining an optimum image quality with constantly the same reference (Rlim) relative to an image. In addition, by executing correction with Equation (7) using the final correction amount G4′, it is possible to execute brightness correction when the light control rate α is limited to the final light control rate M′. That is when the luminance values, which are corrected when the light control rate a is limited to the final light control rate a′, are Z′, the brightness correction is executed in accordance with the following equation.
Z′(Y)=ΣF(Y)×G4′+Y Equation (18)
On the other hand, the image quality retention rate setting section 70 sets Rlim (which is a value corresponding to a value to limit a decrease n contrast) in advance before image display through writing into a register by the CPU 11. For example, the image quality retention rate setting section 70 refers to the residual amount of power stored in a battery mounted in the image display device 1 and then estimates a value such that the image display device 1 can drive for a predetermined target driving time, thus setting the Rlim. However, setting of the Rlim is not limited to it. The Rlim may be switched to a predetermined value in response to switching to a power saving mode in which power consumption is suppressed when the power source that supplies power to drive the image display device 1 is switched from an external power source to the battery, or the like. In addition, it is applicable that a user arbitrarily sets the Rlim by, for example, displaying a screen for power saving setting on the display panel 30. In order to prevent steep dimming and steep variation in image quality, they may be gradually switched frame by frame.
The following will describe a process executed by the saturation correction section 80 according to the first embodiment. Through the above described process (brightness correction) in the brightness correction section 44, it is possible to retain an average luminance of a display image even when dimming is performed. That is, it is possible to perform dimming of the backlight 32 for power saving while suppressing a decrease in brightness of an image. However, only with the above brightness correction, there is a possibility that saturations decrease over the entire image after the process and the carnality of the image display then decreases. This is presumably because a color gamut is reduced due to dimming and saturations S (color differences Cb, Cr), as well as luminances, are also reduced to a, times of the original saturations S. Thus, in the present embodiment, not only a process to enhance the luminances Y but also a process to enhance the color differences Cb, Cr (enhanced saturation correction) is executed. Specifically, the saturation correction section 80 enhances the color differences Cb, Cr. More specifically, the saturation correction section 80 executes enhanced saturation correction so that an average saturation is retained even when dimming is performed. That is, saturation correction is executed so that an average saturation does not change even when the amount of source light is changed.
The saturation correction section 80 executes saturation correction so that the saturations are approximated to a predetermined saturation reference. Specifically, in accordance with the following equation, the color differences cb, cr are converted to color differences Cb, Cr. And, the word “saturation correction” is the same meaning as the word “chroma correction”. Within this document, it explains using the word “saturation correction”.
Cb=Fc(cb)×Gc+cb Equation (19)
Cr=Fc(cr)×Gc+cr Equation 20)
Here, “cb, cr” are color differences after color conversion in the color conversion section 40, “Gc” is a correction amount at a predetermined saturation (hereinafter, referred to as “saturation correction amount”), and “Fc(C)” is a correction coefficient (hereinafter, referred to as “saturation correction coefficient”) that indicates a ratio of a correction value to the reference correction amount Gc at each color difference value. The following will describe a method of determining a correction curve shown in Equation (19) and Equation (20), that is, a method of determining saturation correction coefficients Fc(C) and a saturation correction amount Gc one by one.
The saturation correction coefficients Fc(C) employ a function that is determined in advance. The saturation correction coefficients Fc(C) will be described with reference to
The saturation correction coefficients Fc(C), as shown in
In addition, the saturation correction amount Gc is given by the following equation.
Gc=Gs(sth−save) equation (21)
Here, “Gs” is a saturation correction intensity coefficient and is a predetermined value of 0 or above, “sth” is a saturation reference reference saturation value), and “save” is an average saturation. In this case, the saturation s is expressed as “s=(|cb|+|cr|)/2”. Note that the value of the saturation correction intensity coefficient Gs and the saturation reference sth may be determined as constants in advance or may be set by a user. Alternatively, the value of the saturation correction intensity coefficient Gs and the saturation reference sth may be determined in coordination with types of image data.
As is apparent from Equation (21), the saturation correction amount Gc is proportional to a value obtained by subtracting the average saturation save from the saturation reference sth, so that, when the saturation values S are corrected in accordance with the saturation correction amount Gc, the saturation values S are corrected so as to be approximated to the saturation reference sth. Thus, it is possible to reduce biased saturation values of image data.
Note that the saturation correction may be executed when the saturation correction amount Gc is determined through Equation (19) and Equation (20); however, actually in the present embodiment, the saturation correction amount Gc that is calculated in the saturation correction amount computing section 85 is transferred to the enhanced saturation correction amount computing section 86 as a parameter without calculation of Equation (19) and Equation (20).
The saturation correction section 86, by further executing correction in accordance with the following equation, executes enhanced saturation correction to reduce variation in saturations, which occurs in an image displayed due to light control while correcting biased saturation values. The correction equation of the enhanced saturation correction is defined by the following equation.
Cb′(cb)=Fc(cb)×Gc1+cb Equation (22)
Cr(cr)=Fc(cr)×Gc1+cr Equation (23)
In Equation (22) and Equation (23), “Gc1” indicates the enhanced saturation correction amount. In this embodiment, the enhanced saturation correction amount Gc1 is determined so that the product of the average value of saturation values S determined from color differences Cb′, Cr′, for which enhanced saturation correction is executed, and the light control rate α is equal to the average value of saturation values S determined from the color differences Cb, Cr, for which normal saturation correction is executed. That is, the enhanced saturation correction amount Gc1 is determined so as to satisfy the following Equation (24).
α×S′ave=Save Equation (24)
Equation (24) indicates that the saturations that display an image based on the color differences Cb, Cr are visually made equal to the saturations that display an image based on the color differences Cb, Cr after light control. Note that the light control rate a uses a value that is finally determined by the brightness correction section 44. Here, the right-hand side and left-hand side of Equation (24) may be expressed as the following equation.
Save=ΣS/N=(Σ|Fc(cb)|×Gc+Σ|cb|+Σ|Fc(cr)|×Gc+Σ|cr|)/N Equation (25)
Save=Σ′/N=(Σ|Fc(cb)|×Gc1+Σ|cb|+Σ|Fc(cr)|×Gc1+Σ|cr|)/N Equation (26)
Gc1=Gc/α+{(1−α)(Σ|cb|+Σ|cr|)}/α{(Σ|Fc(cb)|+Σ|Fc(cr)|)} Equation (27)
Here, the enhanced saturation correction amount Gc1 that appears in Equation (27) is not as a function of the Saturation values S but as a function of the saturation correction amount Gc, so that the saturation correction section 80 is able to calculate the enhanced saturation correction amount Gc1 on the basis of the saturation correction amount Gc without calculation using Equation (19) actually. Using the thus calculated enhanced saturation correction amount Gc1, it is possible to execute enhanced saturation correction that reduces variation in saturations due to light control after biased saturation values are corrected. Thus, the saturation correction section 80 may be regarded as an image correction device according to the invention.
Subsequently, the light source control section 48 controls the amount of source light (that is, “light source luminance”) generated by the backlight 32 so that the light source control section 48 controls power supplied from the power supply unit 31 to the backlight 32 in accordance with the light control rate α. That is, the light source control section 48 executes light control. Here, the light control rate a is a value that is made in consideration of sensitivity characteristic of the visual sense of a human being, so that a light source light control rate K that indicates a ratio of an actual amount of light to a predetermined amount of light emitted from the backlight 32 may be determined as the following equation using a gamma coefficient γ.
K=αγ Equation (28)
For example, the gamma coefficient γ is a value such as “2.2”. Using Equation (28), the light source light control rate K that indicates a ratio of amount of light by which the backlight 32 is actually dimmed from the light control rate a that is made in consideration of the visual characteristic of a human being. When the light control rate α is “1”, the light control rate K of the backlight 32 is “1”. Thus, the backlight 32 emits a maximum amount of light.
In addition, because the amount of light emitted from the backlight 32 is generally proportional to the luminances of an image displayed on the display panel 30, so that the relationship between actual luminances L of an image displayed on the display panel 30 when light control is performed and actual luminances LU0 of an image when light control is not performed may be expressed as the following equation.
LU=K×LU0 Equation (29)
For example, when the light control rate α is set to “0.85” in order to reduce 15% of luminance that is visually sensed by a human being, because the gamma coefficient γ is “2.2”, the light source light control rate K is “0.7” from Equation (28). From Equation (29), the luminance L when light control is performed may be reduce by 30% as compared to the luminance LU0 when no dimming is performed. Thus, it is possible to reduce power supplied to the backlight 32. The light source control section 48 performs light control in such a manner that the light source light control rate K is calculated from the light control rate α using Equation (28) and a control signal that controls power supplied to the backlight 32 in accordance with the light source light control rate K is sent to the power supply unit 31.
The image display signal generating section 45 converted the luminance values Y′, for which brightness correction is performed, and the color difference data Cb′, Cr′, for which saturation correction is performed, to RGB data. In this case, in accordance with the following equation that converts luminance data and color difference data to RGB data, the RGB data, for which brightness correction is performed, may be obtained. Note that conversion of Equation (30) to Equation (32) may also be executed using a color conversion table actually.
R=Y′+1.4020Cr′ Equation (30)
G=Y′−0.3441Cb′−0.7139Cr′ Equation (31)
B=Y′+1.7718Cb′−0.012Cr′ Equation (32)
In addition, the image display signal generating section 45 sends a generated image display signal to the display panel 30 while synchronizing with the timing when the light source control section 48 controls a light source. Then, the display panel 30, on the basis of the received image display signal, controls the amount of transmission for each pixel by modulating light emitted from the backlight 32, thus displaying an image.
As described above, according to the first embodiment, because enhanced saturation correction is performed in correspondence with dimming, it is possible to perform light control (power saving) without a decrease in saturations while retaining high image quality. That is, according to the present embodiment, it is possible to appropriately execute dimming of the backlight 32 for power saving while not only suppressing a decrease in luminances (brightness) of a display image but also effectively suppressing a decrease in saturations.
The following will describe a saturation correction process that is executed by the saturation correction section 80 with reference to
At first, in step S101, the saturation correction section 80 calculates Σ|cb|, Σ|cr|, Σ|Fc(cb)|, and Σ|Fc(cr)| for pixels from input color differences cb, cr. Specifically, the color difference summation computing section 82 of the saturation correction section 80 calculates Σ|cb| and Σ|cr|, while the coefficient summation computing section 84 of the saturation correction section 80 calculates Σ|Fc(cb)| and Σ|Fc(cr)|. In this case, the color difference summation computing section 82 and the coefficient summation computing section 84 execute a process when each frame image is being input. When the above process is completed, the process proceeds to step S102.
In step S102, the saturation correction amount computing section 85 of the saturation correction section 80 calculates a saturation correction amount Gc. Specifically, the saturation correction amount computing section 85 acquires an average saturation save from the average saturation computing section 83 and substitutes the above described Expiation (21) using the acquired average saturation save, thus calculating the saturation correction amount Gc. Note that the average saturation computing section 83 calculates the average saturation save using Σ|cb| and Σ|cr| that are calculated in step 101. When the above process is completed, the process proceeds to step S103.
In step S103, the enhanced saturation correction amount computing section 86 of the saturation correction section 80 calculates an enhanced saturation correction amount Gc1 using the saturation correction amount Gc and the light control rate α. In this case, the saturation correction amount Gc is a value that is calculated in the saturation correction amount computing section 85 in step S102, and the light control rate α is a value that is acquired from the light control rate computing section 71. Specifically, the enhanced saturation correction amount computing section 86 calculates the enhanced saturation correction amount Gc1 on the basis of the above described Equation (27). In this case, the enhanced saturation correction amount computing section 86 calculates the enhanced saturation correction amount Gc1 by substituting Equation (27) using the saturation correction amount Gc acquired from the saturation correction amount computing section 85, the light control rate α acquired from the light control rate computing section 71, Σ|cb| and Σ|cr| acquired from the color difference summation computing section 82, and Σ|Fc(cb)| and Σ|Fc(cr)| acquired from the coefficient summation computing section 84. Then, the process proceeds to step S104. Note that the processes of step S102 and step S103 are executed after each frame image has been input.
In step S104, the saturation correction execution section 87 of the saturation correction section 80 executes saturation correction on image data using the enhanced saturation correction amount Gc1 that is calculated in step S103 and the saturation correction coefficients Fc(C) stored in the saturation correction coefficient storage section 81. In this case, the saturation correction execution section 87 executes saturation correction on the next frame image. When the above processes are completed, the process escapes the flow.
According to the above saturation correction process, because enhanced saturation correction is performed in correspondence with dimming, it is possible to perform light control without a decrease in saturations while retaining high image quality. That is, it is possible to reduce power consumption while effectively suppressing a decrease in saturations of an image.
Here, a specific example of the result when the saturation correction process is executed will be described with reference to
The following will describe a second embodiment of the invention. The second embodiment differs from the first embodiment in that, in addition to the above described saturation correction, a process to determine the amount of source light in accordance with the luminance and color difference of image data is executed. The reason why the above process is executed will be described below. Owing to the above described brightness correction, the average luminance may be retained in a display image even when dimming is performed. However, there is a possibility that an extreme decrease in saturations occurs in an image having a high saturation colors such as red (R) and blue (B). Red or blue has a high saturation but has a small value in luminance. Therefore, the above steep decrease in saturations is presumably caused by excessive dimming. Specifically, a description will be made with reference to
In the above described first embodiment, image correction is performed by converting RGB to YCbCr using Equation (1) to Equation (3). However, because R and B contribute to the luminances Y to a less degree than G, it is recognized as a dark image even when it is a bright image. For example, when (R,G,B)=(0,0,255), Y=29 (or 30). Thus, it should be bright blue but it has a luminance equivalent to a dark gray. That is, when the backlight is dimmed for a dark image, it may excessively dim a high saturation R or B and cause an image not to be reproduced appropriately. Thus, in the second embodiment, the amount of source light is determined (that is, dimmed) in consideration of saturations S as well as luminances Y. Specifically, the amount of source light is determined on the basis of a value specified by luminances or a value specified by saturations, whichever is larger. In this manner, a high saturation image is appropriately determined, and, for the high saturation image, dimming is suppressed even when luminances are low.
Specifically, in the second embodiment, a high saturation image is determined in a YCbCr space. Light control may be performed using a maximum value of RGB or a maximum value of averages of RGB. However, when an input image is originally YCbCr data, it is necessary to provide an additional RGB conversion circuit in addition to a YCbCr to RGB conversion circuit of the image display signal generating section 45. Thus, it may increase costs. For the above reason, in the second embodiment, a determination of high saturation image is performed on the basis of YCbCr data in place of RUB data. Specifically, the average values are taken respectively from YCbCr and the maximum value among the average values is used. In this case, “2 Cb” and “2 Cr” are determined using the following Equation (33) and Equation (34) that are transformed from the above Equation (1) to Equation (3).
From Equation (33) and Equation (34), when (R,G,B) (255,0,0), 2Cr=255, and when (R,G,B)=(0,0,255), 2Cb=255. Thus, the same scale (0 to 255) may be used as that of Y. Thus, in the present embodiment, a determination of high saturation image is performed using “2|Cb|” and “2|Cr|”. Specifically, a determination of high saturation image is performed by comparing average values of luminances Y, twice the average values of color differences cb, and twice the average values of color differences cr. Note that C (cyan) and Y (yellow), which are complementary colors of R and B, may also be determined from “2|Cb|”, “2|Cr|”. In addition, G and its complementary color M (magenta) does not take 255, in any one of “Y”, “2|Cb|”, “2|Cr|”. When (R,G,B)=(0,255,0), 2|Cr|=216. Thus, there is no large influence.
The light control reference value calculation section 90 includes an average color difference computing section 91 and a light control reference value computing section 92. The average color difference computing section 91 acquires Σ|cb| and Σ|cr| that are calculated by the color difference summation computing section 82 of the brightness correction section 44 and, using these summations, calculates average color differences |cb|ave and |cr|ave. In addition, the light control reference value computing section 92 acquires the average color differences |cb|ave, |cr|ave, and the like, from the average color difference computing section 91 and, using these average color differences, calculates a light control reference value Wave. Specifically, the light control reference value computing section 92 determines the light control reference value Wave on the basis of the following Equation (35).
Wave=max(Yave,2|cb|ave,2|cr|ave) Equation (35)
As is apparent from Equation (35), the light control reference value computing section 92 determines the average luminance Yave, twice the average value of the color differences cb (2|cb|ave), or twice the average value of the color differences (2|cr|ave), whichever is the maximum value, as the light control reference value Wave.
In this manner, the light control reference value Wave that is calculated by the light control reference value calculation section 90 is supplied to the enhanced brightness correction amount computing section 65 of the brightness correction section 44. The enhanced brightness correction amount computing section 65 determines a limit correction amount G4lim′ on the basis of the light control reference value Wave. In this case, the enhanced brightness correction amount computing section 65 defines Rlim by changing the reference input gray scale value from “Yave” to “Wave”. Specifically, Rlim′ is determined using the following Equation (36) which is modified from the above described Equation (15). Note that the limit light control rate αlim that appears in Equation (36) is expressed as the above described Equation (16)
Rlim′=αlim×(255−(F(Wave)G4lim′+Wave))/(255−(F(Wave)×G3+Wave)) Equation (36)
Then, by substituting Equation (16) using the limit correction amount G4lim′ that is determined from Equation (37), it is possible to obtain a limit light control rate αlim. In addition, by substituting Equation (28) using the limit light control rate αlim, it is possible to obtain a light source light control rate K (hereinafter, this “K” referred to as “luminance lower limit value Klim”) that indicates a lower limit value of luminances. Using the thus obtained limit correction amount G4lim′ and luminance lower limit value Klim, light control and image correction are executed. As described above, the light control reference value calculation section 90 and the brightness correction section 44 may be regarded as a source light amount control device of the invention.
As described above, according to the second embodiment, it is possible to determine the amount of source light by appropriately detecting a high saturation color specifically, to suppress dimming in correspondence with a high saturation color). Thus, it is possible to appropriately execute dimming of the backlight 32 for power saving while suppressing a decrease in saturations of image data that contain a high saturation color. That is, because a high saturation color may be detected even when luminances of image data are small, it is possible to execute light control (power saving) with high image quality while effectively suppressing a decrease in saturations.
Furthermore, in the second embodiment, the light control reference value Wave may be simply obtained through calculation using characteristic amounts (Yave, |cb|ave, |cr|ave) that are used for normal image correction (brightness correction, saturation correction) in the luminance/color-difference signal mode (YCbCr) as it is. Thus, it is not necessary to add a large circuit (a YCbCr to RGB conversion circuit and a high saturation detection circuit in RGB mode). Hence, there is no possibility to increase costs.
The following will describe a process executed when the limit correction amount G4lim′, and the like, is obtained on the basis of the light control reference value Wave with reference to
At first, in step S201, the color difference summation computing section 82 of the saturation correction section 80 calculates Σ|cb| and Σ|cr| for each pixel using input color differences cb, cr. In this case, the color difference summation computing section 82 executes a process when each frame image is being input. When the above process is completed, the process proceeds to step S202.
In step S202, the light control reference value calculation section 90 calculates the average color differences |cb|ave and |cr|ave and also calculates the light control reference value Wave. In this case, the average color difference computing section 91 of the light control reference value calculation section 90 acquires Σ|cb| and Σ|cr| that are calculated by the color difference summation computing section 82 of the saturation correction section 80 and, using these summations, calculates the average color differences |cb|ave and |cr|ave. In addition, the light control reference value computing section 92 of the light control reference value calculation section 90 acquires the average color differences |cb|ave and |cr|ave that are calculated by the average color difference computing section 91 and determines the light control reference value Wave on the basis of the above described Equation (35). When the above process is completed, the process proceeds to step S203.
In step S203, the brightness correction section 44 calculates the limit correction amount G4lim′ and the limit light control rate αlim. Specifically, the enhanced brightness correction amount computing section 65 of the brightness correction section 44 acquires the light control reference value Wave from the light control reference value calculation section 90 and then calculates the limit correction amount Glim′. Specifically, the enhanced brightness correction amount computing section 65 obtains the limit correction amount G4lim′ by substituting Equation (37) using the acquired light control reference value Wave. Then, by substituting Equation (16) using the obtained limit correction amount G4lim′, the limit light control rate αlim is obtained. Furthermore, by substituting Equation (28) using the limit light control rate αlim, the luminance lower limit value Klim is obtained. When the above process is completed, the process proceeds to step S204. Note that the processes of step S202 and step S203 are executed after each frame image has been input.
In step S204, using the limit correction amount G4lim′ and the limit light control rate αlim (luminance lower limit value Klim) that are obtained in step S203, light control and image correction are executed. Specifically, the brightness correction execution section 66 executes image correction, and the light source control section 48 executes light control. Note that, actually, in addition to the above described image correction, saturation correction described in the first embodiment is also executed by the saturation correction section 80. In this case, the saturation correction section 80 executes saturation correction using the limit light control rate αlim that is obtained in the process of step S203. When the above processes are completed, the process escapes the flow. Note that the process of step S204 is executed on the next frame image.
According to the above processes, because a high saturation color may be detected even when luminances of image data are small, it is possible to execute light control with high image quality while effectively suppressing a decrease in saturations.
Note that, in the above described example, the light control reference value computing section 92 calculates the light control reference value Wave by comparing an average value Yave of the luminances, twice the average value of the color differences cb, and twice the average value of the color differences cr, but it is not limited to it. In another example, the light control reference value computing section 92 may calculate the light control reference value Wave by comparing the average value Yave of the luminances and twice the average value Save of saturations, each of which is defined by taking the average of the color difference cb and the color difference cr (that is, saturations S are obtained using “S=|cb|+|cr|)/2”. In other words, the light control reference value computing section 92 calculates the light control reference value Wave on the basis of the following Equation (38).
Wave′=max(Yave,2Save) Equation (38)
In this case, as is apparent from Equation (38), the light control reference value computing section 92 determines the maximum value from among the average luminance Yave and twice the average value Save of saturations, each of which is defined by taking the average of the color difference cb and the color difference cr, as the light control reference value Wave′. Note that, when Equation (38) is used, information indicating the color differences cb, cr are averaged. Thus, it is more accurate by calculating the light control reference value Wave using the above described Equation (35) than by calculating the light control reference value Wave, using this Equation (38). This is because, in Equation (35), the light control reference value Wave is determined using “2|cr|” and “2|cb|” without averaging information of the color differences cb, cr.
The above described calculations are basically presumed to be performed in a circuit at timing between the adjacent frames of a dynamic image, but the calculations may be executed through software processing. For example, the function implemented in the components of the image processing engine 15 or 15′ may be implemented through an image display program, that is executed by the CPU (computer) 11. Note that the image display program may be stored in the hard disk 14 or in the ROM 12 in advance, or the image display program may be externally supplied through a computer readable recording medium, such as the CD-ROM 22, and then the image display program read by the CD-ROM drive 16 may be stored in the hard disk 14. In addition, the image display program may be stored in the hard disk 14 by accessing to a server, or the like, that supplies the image display program and then downloading the data through a network device, such as an internet.
Furthermore, some of functions may be implemented in a hardware circuit the other functions, which are not implemented in the hardware circuit, may be implemented by software. For example, histograms, ΣY, Σ|cb|, Σ|cr|, ΣF(Y), Σ|Fc(cb)|, ΣFc(cr)|, and the like, which are processed for pixels, may be implemented in the circuit, and average values, light control rates, image correction amounts, which are calculated for each frame, may be executed by the CPU 11 through software processing at timing between the adjacent frames. Moreover, when a still image display is intended as a photo viewer or when a dynamic image is converted in advance to dimmed data and a corrected dynamic image before display, all the functions may be executed through software processing.
The following will describe specific examples of electronic apparatuses to which the image display device 1 according to the above described embodiments are applicable with reference to
At first, an example in which the image display device 1 according to the above described embodiments are applied to a display portion of a mobile personal computer (that is, a laptop personal computer) will be described.
Subsequently, an example in which the image display device 1 according to the above described embodiments is applied to a display portion of a mobile telephone will be described.
Note that the electronic apparatus to which the image display device 1 according to the aspects of the invention is applicable is not limited to the above described examples.
| Number | Date | Country | Kind |
|---|---|---|---|
| 2006-292556 | Oct 2006 | JP | national |
