This application is based upon and claims the benefit of priority from Japanese Patent Application No. 2010-200212, filed Sep. 7, 2010; the entire contents of which are incorporated herein by reference.
Embodiments described herein relate generally to an image display apparatus and an information processing apparatus.
In a conventional liquid crystal display (LCD), luminances of light sources included in the backlight of the LCD are controlled by dividing the screen of the LCD, for the purposes of, for example, increasing the display dynamic range and reducing the consumption of power. For instance, in JP-A 2007-034251 (KOKAI), the emission intensity of each light source of a backlight is calculated so that the overall luminance of the backlight exceeds the luminance indicated by an input video signal.
However, this technique involves low reproducibility of dark portions and high consumption of power when displaying a video image, such as a night scene, in which the luminance range is wide and bright and dark portions coexist.
Referring to the accompanying drawings, an image display apparatus and an information processing apparatus according to embodiments will be described in detail. In the embodiments, like reference numbers denote like elements, and duplicate descriptions will be avoided assuming that the like elements perform like operations.
In general, according to one embodiment, an image display apparatus includes a liquid crystal panel, a backlight, a luminance distribution calculation unit, an error calculation unit, and an emission intensity update unit. The backlight includes a plurality of light sources which emit light. The luminance distribution calculation unit calculates a predicted value for an intensity distribution of light entering the liquid crystal panel if each of the light sources is lit with an emission intensity. The error calculation unit obtains a brightness of a display image which is realized if the each of the light sources is lit with the emission intensity, and the error calculation unit calculates an error between the obtained brightness and an ideal brightness of the display image corresponding to the input video signal. The emission intensity update unit updates the emission intensity of the each of the light sources to reduce the error.
<Image Display Apparatus>
Referring first to
The emission intensity calculation unit 101 calculates the emission intensity of the backlight suitable for display, based on a one-frame video signal. The emission intensity calculation unit 101 is a type of information processing unit.
The signal correction unit 102 corrects the luminance (light transmittance) of each pixel indicated by the video signal, based on the calculated emission intensity of the backlight 105, and outputs the corrected video signal to the liquid crystal controller 104.
The backlight controller 103 controls lighting (emission) of the backlight 105 in accordance with the emission intensity calculated by the emission intensity calculation unit 101.
The liquid crystal panel controller 104 controls the liquid crystal panel 106 based on the video signal corrected by the signal correction unit 102.
The backlight 105 is lit under the control of the backlight controller 103.
The liquid crystal panel 106 receives light from backlight 105, and varies the amount of light passing therethrough under the control of the liquid crystal controller 104. Namely, the liquid crystal panel 106 modulates the light emitted by the backlight 105, thereby realizing image display.
The structure and operation of each element will be described in detail.
<Backlight>
The backlight 105 includes a plurality of light sources. These light sources are lit with respective intensities under the control of the backlight controller 103 to light up the liquid crystal panel 106 from behind.
In
In
An LED, a cold cathode tube, a hot cathode tube, etc. are suitable for the light emission element. In particular, the LED is most preferable as the light emission element since the range between its maximum luminance and its minimum luminance is wide, and its emission can be controlled with high dynamic range. The emission intensity (luminance) and the emission timing of each light source can be controlled by the backlight controller.
<Backlight Controller>
The backlight controller 103 controls the intensity of each light source of the backlight 105 based on the corresponding emission intensity calculated by the emission intensity calculation unit 101. The backlight controller 103 can independently control the emission intensity (luminance) and the emission timing of each light source of the backlight 105.
In the first embodiment, the liquid crystal panel 106 is of an active matrix type. As shown in
The switch element 407 is provided for video signal writing, and has its gate connected to one of the scanning line 406, and its source connected to one of the signal lines 405. More specifically, the gates of the switch elements arranged in each row are connected in common to the one scanning line 406, and the sources of the switch elements arranged in each row are connected in common to the one signal line 405. Further, the drain of each switch element 407 is connected to the pixel electrode 409 of the same and also to the auxiliary capacitor 408 of the same arranged electrically parallel to the pixel electrode 409.
The pixel electrode 409 is formed on the array substrate 401, and the counter electrode 411 electrically opposite to the pixel electrode 1909 is formed on a counter substrate (not shown). A predetermined counter voltage is applied to the counter electrode 411 by a counter voltage generation circuit (not shown). The liquid crystal layer 410 is held between the pixel electrode 409 and the counter electrode 411, and the peripheral portions of the array substrate 401 and the counter electrode 411 are sealed by a seal member (not shown). Any liquid crystal material may be used for the liquid crystal layer 410. However, ferroelectric liquid crystal, liquid crystal of an optically compensated bend mode (OCB), etc., are preferable as the liquid crystal material.
The scanning line driving circuit 402 comprises a shift register, a level shifter, a buffer circuit, etc. The scanning line driving circuit 402 outputs a row selection signal to each scanning line based on a vertical start signal and/or a vertical clock signal, which are output as control signals from a display ratio controller (not shown).
The signal line driving circuit 403 comprises an analog switch, a shift register, a sample hold circuit, a video bus, etc., which are not shown. The signal line driving circuit 403 receives a horizontal start signal and a horizontal clock signal output as control signals from the display ratio controller.
The liquid crystal controller 104 controls the liquid crystal panel 106 to adjust its liquid crystal transmittance to that corrected by the signal correction unit 102.
The emission intensity calculation unit 101 calculates the emission intensity of each light source suitable for display, based on a video signal. Referring now to
The emission intensity calculation unit 101 comprises a luminance distribution calculation unit 504, an error calculation unit 501, an emission intensity update unit 502 and a memory 503. Although the memory 503 stores the emission intensity of each light source, it may store an arbitrary value as the initial intensity value for each light source.
The luminance distribution calculation unit 504 calculates a luminance distribution as a type of intensity distribution of the light entering the liquid crystal panel 106 when each light source of the backlight 105 emits light of the intensity corresponding to that stored in the memory 503.
Based on the luminance distribution calculated by the luminance distribution calculation unit 504 and an input video signal, the error calculation unit 501 calculates an error that will occur at each position on the display screen when display is performed in accordance with the input video signal based on the calculated luminance distribution. The error means the difference at each position between the lightness of an actual display image produced by the image display apparatus and that of an ideal display image corresponding to the input video signal. More specifically, the error is, for example, an increase in luminance in a dark portion of the display image, or a decrease in luminance in a bright portion.
The emission intensity update unit 502 updates the emission intensities stored in the memory 503 for the respective light sources so that each error calculated by the error calculation unit 501 will be reduced.
The emission intensity calculation unit 101 thus iterates updating of the above-mentioned luminance distribution, the error and the emission intensity to thereby calculate the emission intensities of the light sources. The initial value of iteration processing for each light source may be arbitrarily determined. For instance, the minimum or maximum value that can set for each light source may be set as the initial value. Further, for one video image (i.e., one frame), the iteration processing may be executed a predetermined number of times. A detailed description will be given of each element of the emission intensity calculation unit that calculates each error in terms of a numerical value proportional to the luminance, and updates the emission intensity of each light source so that the maximum error occurring on the display screen will be reduced.
The luminance distribution calculation unit 504 calculates, at each position on the display screen, a predicted value for the luminance distribution of the light entering the liquid crystal panel 106 when the light sources are lit with the respective emission intensities stored in the memory 503. The light entering the liquid crystal panel 106 when the light sources are lit has an emission distribution corresponding to the actual hardware structure of the light sources of the backlight 105, since the light sources each have an emission distribution corresponding to the hardware structure. The intensity of the light entering the liquid crystal panel 106 will hereinafter be referred to simply as the luminance of the backlight 105 or that of the light sources.
l
BL(ξn,ψn)=lSET,n·lP,n(ξn,ψn) (1)
where ξn and ψn are the coordinates of each position relative to the center of the illumination region of the nth light source, and lp,n is the relative luminance of the nth light source at the relative coordinates.
The relative luminance at each pixel position, assumed when each light source of the backlight 105 is lit with the emission intensity lSET,n, is calculated as the sum of the values obtained by multiplying the relative luminance of each light source corresponding to said each pixel position by the emission intensity of said each light source. Namely, the luminance distribution lBL(x, y) of the backlight 105 is given by the following equation (2), using the luminance distribution data lP,n corresponding to each light source:
where x and y are the coordinates of each pixel on the liquid crystal panel 106, x0,n and y0,n are the coordinates of the center of the illumination region of the nth light source on the liquid crystal panel 106, and N is the total number of the light sources. The equation (2) defines that when acquiring the luminance of the backlight 105 at a target pixel, the emission intensities and luminance distributions of all light sources are used. However, the emission intensities and luminance distributions of the light sources that do not significantly influence the luminance of the target pixel can be omitted when the luminance of the target pixel is calculated.
Based on the luminance distribution calculated by the luminance distribution calculation unit 504 and an input video signal, the error calculation unit 501 calculates an error that will occur at each position on the display screen when display is performed in accordance with the input video signal under the calculated luminance distribution. More specifically, based on a predicted value for the luminance distribution at each position, and the input video signal, the error calculation unit 501 calculates the lightness of a display video image that will be assumed at each position when the light sources are lit with their respective emission intensities. Further, based on the calculated lightness and an ideal lightness corresponding to the input video signal, the error calculation unit 501 calculates an error at each position.
L=(S/255)γ (3)
where S is the value of the video signal assumed at each position before the gamma transformation, and L is the value assumed after the gamma transformation.
The error calculation unit 501 comprises adders 702 and 703, a minimum value calculation unit 704, a maximum value calculation unit 705, and absolute value calculation units 706 and 707. More specifically, the error calculation unit 501 calculates, at each pixel position using the calculation units 704 and 706, an error (804) occurring on the brighter side (of a display image) by subtracting the value of a video signal from the value of the luminance distribution of the backlight 105, using the adder 702. Similarly, the error calculation unit 501 calculates, at each pixel position using the calculation units 705 and 707, an error (805) occurring on the darker side (of the display image) by subtracting, using the adder 703, the value of a video signal from the value obtained by multiplying the value of the luminance distribution of the backlight 105 by 1/D. Assume here that if the value of the video signal falls within the range between the value of the luminance distribution and the value obtained by multiplying the value of the luminance distribution by 1/D, it is considered that there is no error in display, and the error is set to 0. Namely, at each pixel position (x, y), the error calculation unit 501 calculates an error eU that will occur on the brighter side, and an error eL that will occur on the darker side, as given by the following equations (4):
where lBL is the value of the luminance distribution calculated by the luminance distribution calculation unit 504, Iin is the corresponding value of the video signal, min(a, b) is an operation for selecting a lower one of the values a and b, and max(a, b) is an operation for selecting a higher one of the values a and b.
Based on the error calculated by the error calculation unit 501, and the emission intensity of each light source received from the memory 503, the emission intensity update unit 502 updates the emission intensity of each light source so that the error calculated by the error calculation unit 501 will be reduced, and outputs the updated value. Referring to
The emission intensity update unit 502 comprises a maximum error position specify unit 901, a change calculation unit 902 and an update unit 903.
The maximum error position specify unit 901 determines a position (specifically, it determines the coordinates of the position, and whether the position is on the brighter or darker side) at which the maximum error occurs, from the error (including the error on the brighter or darker side) with respect to each position coordinates calculated by the error calculation unit 501.
The change calculation unit 902 calculates a change in the emission intensity of each light source, based on the position, determined by the maximum error position specify unit 901, at which the maximum error occurs, and the luminance distribution data of the light sources.
The update unit 903 updates the emission intensity of each light source based on the change therein calculated by the change calculation unit 902, and outputs the updated value.
Based on the error calculated for each position (each pair of coordinates) by the error calculation unit 501, the maximum error position specify unit 901 specifies the position at which the maximum error occurs, and whether the error is a brighter side error or a darker side error. Assume here that the position coordinates at which the maximum error occurs, calculated by the maximum error position specify unit 901, are set as xmax and ymax.
Based on the position at which the maximum error occurs calculated by the maximum error position specify unit 901, and the luminance distribution data of each light source, the change calculation unit 902 calculates a change in the emission intensity of each light source. For instance, the change calculation unit 902 calculates a change ΔlSET,n in the emission intensity of the nth light source, using the following equations (5):
In the above equations (5), xmax and ymax are the coordinates of the position on the liquid crystal panel 106, at which the maximum error is detected by the maximum error position specify unit 901, x0,n and y0,n are the coordinates of the center of the illumination region of the nth light source on the liquid crystal panel 106, and lp,n is the emission intensity data of the nth light source.
The update unit 903 updates the emission intensity of each light source based on the change therein calculated by the change calculation unit 902, and outputs the updated value. Assuming that the emission intensity of the nth light source read from the memory 503 and obtained before the update process is lSET,n, and the emission intensity of the nth light source updated by the update unit 903 is lSET,n′, the update process is executed by the update unit 903 as shown in the following equation (6):
l
SET,n
′=l
SET,n
+τ·Δl
SET,n (6)
where ΔlSET,n is a change in the emission intensity of the nth light source calculated by the change calculation unit 902, τ is a preset parameter for update amount adjustment. It is desirable that τ is set to a positive value.
Alternatively, the update process of the update unit 903 may be executed by normalizing the change in the emission intensity of each light source by the square root of the sum of the squares of the changes in the emission intensities of all light sources, as is given by the following equation (7):
where N is the total number of light sources. This process enables the change in the emission intensities of all light sources to be set to a constant value whenever one update process is performed.
Yet alternatively, the update process of the update unit 903 may be executed by normalizing the change in the emission intensity of each light source by the sum of the squares of the changes in the emission intensities of all light sources, as is given by the following equation (8):
where N is the total number of light sources. This process enables the expected change in error to be set to a constant value whenever one update process is performed.
In the memory 503, the emission intensity of each light source updated by the emission intensity update unit 502 is written over the preceding emission intensity of said each light source, and is then referred to as preceding emission intensity data in a subsequent iteration process performed by the emission intensity calculation unit 101.
Since the emission intensity update unit 502 is constructed as the above, the emission intensity of each light source stored in the memory 503 is updated so as to reduce the maximum one of the errors calculated by the error calculation unit 501. For instance, if the maximum error occurs on the brighter side at certain position coordinates, this means that the value of the luminance distribution of the backlight 105 at the certain position coordinates is significantly lower than the corresponding value of the input video signal. In this case, the change in the emission intensity of each light source calculated by the change calculation unit 902 assumes a positive value, with the result that the update unit 903 adds a positive value to the emission intensity of each light source, and the emission intensity of each light source is updated to a value corresponding to a higher luminance. Thus, the target value of the luminance distribution of the backlight 105 is adjusted to a higher luminance value to thereby reduce the error occurring on the brighter side. In contrast, if the maximum error occurs on the darker side, the emission intensity update unit 502 updates the emission intensity of each light source to a value corresponding to a lower luminance, whereby the error is reduced. Since the emission intensity update unit 502 is constructed as the above, the emission intensity of each light source stored in the memory 503 is updated so as to reduce the maximum one of the errors calculated by the error calculation unit 501.
<Signal Correction Unit>
The signal correction unit 102 corrects the value of an input video signal corresponding to each pixel on the liquid crystal panel 106, based on the emission intensity of each light source calculated by the emission intensity calculation unit 101, and the input video signal, and outputs the correction result to the liquid crystal controller 104. Referring now to
The signal correction unit 102 comprises a luminance distribution calculation unit 1001, a gamma correction unit 1002 and a divider 1003.
The luminance distribution calculation unit 1001 calculates, at each position on the display screen, a predicted value for the luminance distribution of the light entering the liquid crystal panel 106 when the light sources are lit with the respective emission intensities calculated by the emission intensity calculation unit 101. The light entering the liquid crystal panel 106 when the light sources are lit has an emission distribution corresponding to the actual hardware structure of the light sources of the backlight 105, since the light sources each have an emission distribution corresponding to the hardware structure. The intensity of the light entering the liquid crystal panel 106 will hereinafter be referred to simply as the luminance of the backlight 105 or that of the light sources.
l
BL(ξn,ψn)=lSET,n·lP,n(ξn,ψn) (9)
where ξn and ψn are the coordinates of each position relative to the center of the illumination region of the nth light source, and lp,n is the relative luminance of the nth light source at the relative coordinates.
The relative luminance at each pixel position, assumed when each light source of the backlight 105 is lit with the emission intensity lSET,n, is calculated as the sum of the values obtained by multiplying the relative luminance of each light source corresponding to said each pixel position by the emission intensity of said each light source. Namely, the luminance distribution lBL(x, y) of the backlight 105 is given by the following equation (10), using the luminance distribution data lP,n corresponding to each light source:
where x and y are the coordinates of each pixel on the liquid crystal panel 106, x0,n and y0,n are the coordinates of the center of the illumination region of the nth light source on the liquid crystal panel 106, and N is the total number of the light sources. The equation (10) defines that when acquiring the luminance of the backlight 105 at a target pixel, the emission intensities and luminance distributions of all light sources are used. However, the emission intensities and luminance distributions of the light sources that do not significantly influence the luminance of the target pixel can be omitted when the luminance of the target pixel is calculated.
The gamma correction unit 1002 executes gamma correction on the predicted value calculated for luminance distribution by the luminance distribution calculation unit 1001, and converts the resultant value into a signal correction coefficient. Supposing that the output signal correction coefficient falls within a range of [0, 1], the gamma correction is executed using, for example, the following equation:
S
BL
l
BL
1/γ (11)
where lBL is the predicted value calculated for luminance distribution by the luminance distribution calculation unit 1001, and SBL is the signal correction coefficient. The gamma correction is not limited to this transformation, but may be replaced with a known transformation method, or inverse transformation based on the gamma transformation table of the liquid crystal panel 106, when necessary. These transformations may be directly executed using, for example, a multiplier, or be executed using a lookup table.
The dividing unit 1003 divides the input video signal by the signal correction coefficient calculated by the gamma correction unit 1002, thereby calculating a video signal output to the liquid crystal controller 104. Alternatively, the dividing unit 1003 may hold a lookup table that stores the relationship between values corresponding to inputs and outputs, and may calculate the video signal output to the liquid crystal controller 104 with reference to the lookup table.
As described above, in the first embodiment, the emission intensity calculation unit calculates the luminance distribution of the light entering the liquid crystal panel, the error calculation unit calculates the error corresponding to an increase in the luminance of the darker portion of a display image or a reduction in the luminance of the brighter portion of the display image, and the emission intensity update unit updates the luminance of each light source so as to reduce the error, whereby the reproduction performance of the darker portion can be enhanced, and the luminance of the brighter portion can be appropriately adjusted. As a result, consumption of power can be reduced.
An image display apparatus according to a second embodiment differs from the first embodiment in that in the former, an emission intensity calculation unit 1100 as an information processing apparatus estimates the error in terms of a numerical value proportional to the lightness.
The image display apparatus of the second embodiment comprises a backlight, a backlight controller, a liquid crystal panel, a liquid crystal controller, and a signal correction unit, which are similar to those of the first embodiment. Since these elements are similar to those of the first embodiment, no detailed description will be given thereof.
<Emission Intensity Calculation Unit>
The emission intensity calculation unit 1100 of the second embodiment will be described referring to
The emission intensity calculation unit 1100 of the second embodiment comprises a luminance distribution calculation unit 504, an error calculation unit 1101, an emission intensity update unit 1102, and a memory 503.
The emission intensity calculation unit 1100 of the second embodiment calculates the emission intensity of each light source suitable for display based on a video signal, as in the emission intensity calculation unit of the first embodiment. More specifically, based on the emission intensity of each light source stored in the memory 503, the luminance distribution calculation unit 504 calculates the luminance distribution of the light entering the liquid crystal panel 106 when each light source of the backlight 105 emits light of the intensity corresponding to that stored in the memory 503.
The error calculation unit 1101 calculates an error that will occur at each position on the display screen when display is performed in accordance with an input video signal based on the luminance distribution calculated by the luminance distribution calculation unit 504 and the input video signal.
The emission intensity update unit 1102 updates the emission intensity of each light source stored in the memory 503, so as to reduce the error calculated by the error calculation unit 1101.
A description will now be given of each element incorporated in the emission intensity calculation unit 1100 that is configured to calculate the error in terms of a numerical value proportional to the lightness, and updates the emission intensity of each light source so as to reduce the maximum error that occurs on the display screen. Since the luminance distribution calculation unit 504 of the second embodiment is similar to the luminance distribution calculation unit of the first embodiment, it will not be described in detail.
Based on the luminance distribution calculated by the luminance distribution calculation unit 504, and an input video signal, the error calculation unit 1101 calculates the error that occurs when display corresponding to the input video signal is executed under the calculated luminance distribution. Referring to
The error calculation unit 1101 comprises luminance-to-lightness transformation units 1201, 1202 and 1203, adders 702 and 703, a minimum value calculation unit 704, a maximum value calculation unit 705, and absolute value calculation units 706 and 707. More specifically, the error calculation unit 1101 calculates, at each pixel position using the calculation units 704 and 706, an error 1303 occurring on the brighter side (of a display image) by subtracting, using the adder 702, the value of a video signal, transformed proportional to the lightness by the luminance-to-lightness transformation unit 1201, from the value of the lightness distribution of the backlight 105 obtained by the luminance-to-lightness transformation unit 1202. Similarly, the error calculation unit 1101 calculates, at each pixel position using the calculation units 705 and 707, an error 1304 occurring on the darker side (of the display image) by subtracting, using the adder 703, the value of a video signal, transformed proportional to the lightness by the luminance-to-lightness transformation unit 1201, from the value (i.e., the value of the backlight luminance distribution×1/D) transformed proportional to the lightness by the luminance-to-lightness transformation unit 1203. Assume here that if the value of the video signal, which is transformed proportional to the lightness, falls within the range between the value of the lightness distribution and the value (i.e., the value of the luminance distribution×1/D) transformed proportional to the lightness, it is considered that there is no error in display, and the error is set to 0. Namely, at each pixel position (x, y), the error calculation unit 1101 calculates an error e*U that will occur on the brighter side, and an error e*L that will occur on the darker side, as given by the following equations (12):
where lBL is the value of the luminance distribution calculated by the luminance distribution calculation unit 504, Iin is the corresponding value of the video signal, and γ*(l) is an operation for transforming the value l, which is proportional to the luminance, into a value proportional to the lightness.
Based on the error calculated by the error calculation unit 1101, the luminance distribution of the backlight 105 calculated by the luminance distribution calculation unit 504, and the emission intensity of each light source received from the memory 503, the emission intensity update unit 1102 updates the emission intensity of each light source so that the error calculated by the error calculation unit 1101 will be reduced, and outputs the updated value. Referring then to
The emission intensity update unit 1102 comprises a maximum error position specify unit 901, a change calculation unit 1501 and an update unit 903.
The maximum error position specify unit 901 determines a position (specifically, it determines the coordinates of the position, and whether the position is on the brighter or darker side) at which the maximum error occurs, from the error (including the error on the brighter or darker side) with respect to each position coordinates calculated by the error calculation unit 1101.
The change calculation unit 1501 calculates a change in the emission intensity of each light source, based on the position, determined by the maximum error position specify unit 901, at which the maximum error occurs, the luminance distribution of the backlight 105, and the luminance distribution data of the light sources.
The update unit 903 updates the emission intensity of each light source based on the change therein calculated by the change calculation unit 1501, and outputs the updated value.
Based on the error calculated for each position (each pair of coordinates) by the error calculation unit 1101, the maximum error position specify unit 901 specifies the position at which the maximum error occurs, and whether the error is a brighter side error or a darker side error. Assume here that the position coordinates at which the maximum error occurs, calculated by the maximum error position specify unit 901, are set as xmax and ymax.
Based on the position at which the maximum error occurs calculated by the maximum error position specify unit 901, and the luminance distribution data of each light source, the change calculation unit 1501 calculates a change in the emission intensity of each light source. For instance, the change calculation unit 902 calculates a change ΔlSET,n in the emission intensity of the nth light source, using the following equations (13):
In the above equations (13), xmax and ymax are the coordinates of the position on the liquid crystal panel 106, at which the maximum error is detected by the maximum error position specify unit 901, x0,n and y0,n are the coordinates of the center of the illumination region of the nth light source on the liquid crystal panel 106, lBL is the value of the luminance distribution of the backlight 105, lp,n is the emission intensity data of the nth light source, and γ*′(l) is a transformation having such a transformation characteristic as shown in
The update unit 903 of the second embodiment may have the same structure as that of the first embodiment.
In the memory 503, the emission intensity of each light source updated by the emission intensity update unit 1102 is written over the preceding emission intensity of said each light source, and is then referred to as preceding emission intensity data in a subsequent iteration process performed by the emission intensity calculation unit 1100.
Since the emission intensity update unit 1102 is constructed as the above, the emission intensity of each light source stored in the memory 503 is updated so as to reduce the maximum one of the errors calculated by the error calculation unit 1101. For instance, if the maximum error occurs on the brighter side at certain position coordinates, this means that the value of the lightness distribution of the backlight 105 at the certain position coordinates is significantly lower than the corresponding lightness value of the input video signal. In this case, the change in the emission intensity of each light source calculated by the change calculation unit 1501 assumes a positive value, with the result that the update unit 903 adds a positive value to the emission intensity of each light source, and the emission intensity of each light source is updated to a value corresponding to a higher luminance. Thus, the target value of the lightness distribution of the backlight 105 is adjusted to a higher lightness value to thereby reduce the error occurring on the brighter side. In contrast, if the maximum error occurs on the darker side, the emission intensity update unit 1102 updates the emission intensity of each light source to a value corresponding to a lower lightness, whereby the error is reduced. Since the emission intensity update unit 1102 is constructed as the above, the emission intensity of each light source stored in the memory 503 is updated so as to reduce the maximum one of the errors calculated by the error calculation unit 1101.
Further, since the emission intensity calculation unit 1100 is constructed as the above, the emission intensity of each light source held by the memory 503 is updated by the emission intensity update unit 1102 to reduce the error estimated in terms of the value proportional to the lightness. Lightness is a measure substantially proportional to the subjective brightness, and hence if the emission intensity calculation unit 1100 is constructed as the above, the emission intensity of each light source held by the memory 503 is updated by the emission intensity update unit 1102 to uniformly reduce, for the viewers, the errors that will occur on the brighter and darker sides.
<Modification of Emission Intensity Calculation Unit>
The emission intensity calculation unit may be modified as follows:
The emission intensity calculation unit according to the modification calculates the error e*U that will occur on a brighter side, and an error e*L that will occur on a darker side, using the following equations (12-2):
where lBL is the value of the luminance distribution calculated by the luminance distribution calculation unit, lin is the value of an input video signal, τL is a parameter preset for reproduction adjustment, and γ*(l) is an operation for transforming a value l proportional to the luminance into a value proportional to the lightness.
Further, the change calculation unit of the modification calculates a change ΔlSET,n in the emission intensity of the nth light source, using the following equations (13-2):
where xmax and ymax are the coordinates of the position on the liquid crystal panel 106, at which the maximum error is detected by the maximum error position specify unit, x0,n and y0,n are the coordinates of the center of the illumination region of the nth light source on the liquid crystal panel 106, lBL is the value of the luminance distribution of the backlight 105, lp,n is the emission intensity data of the nth light source, τL is a parameter preset for reproduction adjustment, and γ*′(l) is a transformation having such a transformation characteristic as shown in
By modifying the error calculation unit and the change calculation unit as in this modification, the reproducibility of a display image can be adjusted.
Namely, if τL is set to a higher value, the reproducibility of the darker portion is enhanced, while if τL is set to a lower value, the reproducibility of the brighter portion is enhanced.
<Modification of Change Calculation Unit>
The change calculation unit may be modified as will now be described, in accordance with the purpose. The change calculation unit of this modification calculates a change ΔlSET,n in the emission intensity of the nth light source, using the following equations (13-3):
where xmax and ymax are the coordinates of the position on the liquid crystal panel 106, at which the maximum error is detected by the maximum error position specify unit, x0,n and y0,n are the coordinates of the center of the illumination region of the nth light source on the liquid crystal panel 106, lBL is the value of the luminance distribution of the backlight 105, lp,n is the emission intensity data of the nth light source, τPOW is a parameter preset for adjustment of the power consumption of the backlight 105, and γ*′(l) is a transformation having such a transformation characteristic as shown in
By modifying the change calculation unit as in this modification, the power consumption of the backlight 105 can be reduced.
As described above, the second embodiment employs lightness distribution instead of the luminance distribution of the first embodiment, which enables the emission intensity of each light source to be adjusted based on the subjective brightness. As a result, the reproducibility of the darker portion can be further enhanced than in the first embodiment, and that of the brighter portion can also be adjusted more appropriately.
An image display apparatus according to a third embodiment differs from the second embodiment in that in the former, the emission intensity calculation unit updates the emission intensity of each light source to reduce the sum of the errors.
The entire structure of the image display apparatus of the third embodiment is similar to that of the second embodiment. Namely, it comprises a backlight, a backlight controller, a liquid crystal panel, a liquid crystal controller and a signal correction unit, which are similar to those of the second embodiment. No detailed description will be given of the similar elements of the third embodiment.
<Emission Intensity Calculation Unit>
The emission intensity calculation unit calculates the emission intensity of each light source suitable for display, based on a video signal, as in the emission intensity calculation unit 1100 of the second embodiment. Since the entire structure of the emission intensity calculation unit is similar to that of the emission intensity calculation unit 1100 of the second embodiment, no detailed description will be given thereof. The emission intensity update unit of the third embodiment updates the emission intensity of each light source stored in the memory 503 so as to reduce the sum of the errors calculated by the error calculation unit. A detailed description will be given of each element of the emission intensity calculation unit that calculates each error in terms of a numerical value proportional to the lightness, and updates the emission intensity of each light source so that the sum of the errors occurring on the display screen will be reduced. Since the luminance distribution calculation unit of the third embodiment is similar to the luminance distribution calculation unit 504 of the first embodiment, no detailed description will be given thereof. Further, since the error calculation unit of the third embodiment is similar to the error calculation unit 1101 of the second embodiment, no detailed description will be given thereof.
In the third embodiment, the emission intensity update unit 1700 updates the emission intensity of each light source stored in the memory 503 so as to reduce each error calculated by the error calculation unit 1101, based on said each error calculated by the error calculation unit 1101, the luminance distribution of the backlight 105 calculated by the luminance distribution calculation unit 504, and the emission intensity of each light source read from the memory 503. Referring to
The emission intensity update unit 1700 comprises a change calculation unit 1701 and an update unit 903.
The change calculation unit 1701 calculates a change in the emission intensity of each light source based on the error calculated by the error calculation unit 1101, the luminance distribution of the backlight 105 and the luminance distribution data of each light source.
Based on the change in the emission intensity of each light source calculated by the change calculation unit 1701, the update unit 903 updates the emission intensity of each light source, and outputs the updated value. Since the update unit 903 of the third embodiment is similar to that of the first embodiment, it will not be described in detail.
The change calculation unit 1701 calculates a change ΔlSET,n in the emission intensity of the nth light source, using, for example, the following equation (14):
where x and y are the coordinates of each pixel, x0,n and y0,n are the coordinates of the center of the illumination region of the nth light source on the liquid crystal panel 106, e*U and e*L are the errors that will occur on the brighter side and darker side of a display image, respectively, lBL is the value of the luminance distribution of the backlight 105, lp,n is the luminance distribution data of each light source, and K is a natural number preset to adjust the degree to which the influence of the errors is reduced. Further, in the equation (14), Σx,y{ } means the sum of the values { } corresponding to the respective pixels in the display region, and γ*′(l) is a transformation having such a transformation characteristic as shown in
In the memory 503, the emission intensity of each light source updated by the emission intensity update unit 1700 is written over the preceding emission intensity of said each light source, and is then referred to as preceding emission intensity data in a subsequent iteration process performed by the emission intensity calculation unit 1100.
Since the emission intensity update unit 1700 is constructed as the above, the emission intensity of each light source stored in the memory 503 is updated so as to reduce the sum of the errors calculated by the error calculation unit 1101.
As described above, the third embodiment can provide the same advantage as the second embodiment by calculating the sum of the errors.
The image display apparatus of the fourth embodiment differs from the first and second embodiments in that in the former, the emission intensity calculation unit performs calculation using a coordinate space of a lower resolution than the resolution of the input video signal.
Since the image display apparatus of the fourth embodiment is similar to the first and second embodiments in the schematic structure of the entire apparatus, namely, in the structures of the backlight, the backlight controller, the liquid crystal panel, the liquid crystal controller and the signal correction unit, no detailed description will be given thereof.
<Emission Intensity Calculation Unit>
An emission intensity calculation unit 1100 according to the fourth embodiment differs from those of the first and second embodiments in that the former performs calculation using a coordinate space of a lower resolution than the resolution of the input video signal. Since the schematic structure of the entire emission intensity calculation unit is similar to that of the first and second embodiments, it will not be described in detail.
The luminance distribution calculation unit 504 of the fourth embodiment calculates, at each position on the display screen, a predicted value for the luminance distribution of the light entering the liquid crystal panel 106 when the light sources are lit with the respective emission intensities stored in the memory 503. The luminance distribution calculation unit 504 of the fourth embodiment differs from those of the first and second embodiments in that the former performs calculation using a coordinate space of a lower resolution than the resolution of the input video signal. Since the other structure of the luminance distribution calculation unit 504 is similar to that of the first and second embodiments, it will not be described in detail.
An error calculation unit 1800 according to the fourth embodiment calculates an error that will occur at each position on the display screen when display is performed in accordance with the input video signal based on the luminance distribution calculated by the luminance intensity calculation unit 504. Referring now to
The gamma transformation by the gamma transformation unit is given by, for example, the above-mentioned equation (3). When the video signal is transformed into a numerical value proportional to the luminance, transformation with γ in the equation (3) set to, for example, 2.5 (y=2.5) is executed on the signal. In the equation (3), S is the value of the video signal assumed before the gamma transformation, and L is the value of the video signal assumed after the gamma transformation.
The error calculation unit 1800 of the fourth embodiment differs from the error calculation unit 1101 in that the former comprises a resolution transformation unit (maximum value) 1801 and a resolution transformation unit (minimum value) 1802. The resolution transformation unit (maximum value) 1801 and the resolution transformation unit (minimum value) 1802 transform the resolution of the video signal already transformed proportional to the lightness. More specifically, the resolution transformation unit (maximum value) 1801 and the resolution transformation unit (minimum value) 1802 transform the resolution of a video signal by re-sampling the video signal in a space sampling of a rougher pitch than the space sampling of the input video signal.
The resolution transformation unit (maximum value) 1801 re-samples the video signal by calculating the maximum value of the video signal near the re-sampling point. Namely, the video signal is re-sampled using the following equation (15):
The resolution transformation unit (minimum value) 1802 re-samples the video signal by calculating the minimum value of the video signal near the re-sampling point. Namely, the video signal is re-sampled using the following equation (16):
In the equations (15) and (16), (x, y) are the coordinates of the sampling point of the input video signal, lin(x, y) are the values, at the sampling point (x, y), of the video signal input to the resolution transformation unit (maximum value) 1801 and the resolution transformation unit (minimum value) 1802, (X, Y) are the coordinates of the re-sampling point of each of the resolution transformation unit (maximum value) 1801 and the resolution transformation unit (minimum value) 1802, px and py are re-sampling pitches that are employed by the resolution transformation unit (maximum value) 1801 and the resolution transformation unit (minimum value) 1802 in accordance with the resolution of the input video signal, and lin
The error calculation unit 1800 comprises the aforementioned resolution transformation unit (maximum value) 1801 and resolution transformation unit (minimum value) 1802, luminance-to-lightness transformation units 1803, 1804, 1202 and 1203, adders 702 and 703, a minimum value calculation unit 704, a maximum value calculation unit 705, and absolute value calculation units 706 and 707.
The error calculation unit 1800 calculates, at each pixel position, an error occurring on a brighter side by subtracting, using the adder 702, the value of a video signal from the corresponding value of the lightness distribution of the backlight 105 obtained by the luminance-to-lightness transformation unit 1202. At this time, the video signal is already transformed in resolution by the resolution transformation unit (maximum value) 1801, and already transformed proportional to the lightness by the luminance-to-lightness transformation unit 1803. Similarly, the error calculation unit 1800 calculates, at each pixel position, an error occurring on a darker side by subtracting, using the adder 703, the value of a video signal from the value that is obtained by multiplying the value of the luminance distribution of the backlight 105 by 1/D, and then transforming this value in proportion to the lightness by the luminance-to-lightness transformation unit 1203. At this time, the value of the video signal is already transformed in resolution by the resolution transformation unit (minimum value) 1802, and already transformed proportional to the lightness by the luminance-to-lightness transformation unit 1804. However, if the value of the video signal transformed proportional to the lightness falls between the value of the lightness distribution and the value that is obtained by multiplying the value of the luminance distribution of the backlight 105 by 1/D, and then transforming this value in proportion to the lightness, it is assumed that there is no error on display, and the error is set to 0. Namely, the error calculation unit 1800 calculates, for each pixel position (X, Y), an error e*U occurring on a brighter side and an error e*L occurring on a darker side, using the following equations (17):
where lBL is the value of the luminance distribution calculated by the luminance distribution calculation unit 504, lin
The emission intensity update units 1102 and 1700 update the emission intensity of each light source stored in the memory 503 so as to reduce each error calculated by the error calculation unit 1800, based on said each error calculated by the error calculation unit, the luminance distribution of the backlight 105 calculated by the luminance distribution calculation unit, and the emission intensity of each light source read from the memory. The emission intensity update units 1102 and 1700 of the fourth embodiment differ from the first to third embodiments in that these update units perform operations in a coordinate space of a lower resolution than the resolution of the input video signal. Since the structures of these update units are similar to those in the second and third embodiments, they will not be described in detail.
In the fourth embodiment, since the emission intensity calculation unit 110 is constructed as the above, its calculation amount can be reduced to thereby increase its operation speed and reduce its circuit scale.
An image display apparatus according to a fifth embodiment differs from the first to fourth embodiments in that in the former, the emission intensity calculation unit includes an initial value calculation unit.
Since the image display apparatus of the fifth embodiment is similar to the first to fourth embodiments in the schematic structure of the entire apparatus, namely, in the structures of the backlight, the backlight controller, the liquid crystal panel, the liquid crystal controller and the signal correction unit, no detailed description will be given thereof.
<Emission Intensity Calculation Unit>
An emission intensity calculation unit 1900 incorporated in the fifth embodiment differs from the emission intensity calculation units of the first to fourth embodiments, since it includes an initial value calculation unit 1901. Referring to
The initial value calculation unit 1901 calculates, from an input video signal, an emission intensity set as an initial value in the emission intensity calculation unit 1900 for the iteration process concerning a certain frame video signal included in the input video signal. For the certain frame video signal, the emission intensity calculation unit 1900 iterates the luminance distribution calculation, the error calculation and the emission intensity updating, using the luminance distribution calculation unit 504, the error calculation units 1101 and 1800, and the emission intensity update units 1102 and 1700, respectively, thereby calculating the emission intensity of each light source. Hereinafter, the emission intensity of each light source serving as the initial value of the iteration process concerning the certain frame video signal will be referred to simply as the (emission intensity) initial value.
The initial value calculation unit 1901 of the fifth embodiment sets the emission intensity of each light source calculated by the initial value calculation unit as the initial value of the emission intensity of said each light source. For instance, the initial value calculation unit 1901 calculates, as the emission intensity of each light source, the maximum luminance of a video signal in the corresponding one of the divisions into which the display region is divided in accordance with the arrangement of the illumination regions of all light sources.
In the fifth embodiment, since the emission intensity calculation unit is constructed as the above, the number of iterations of luminance distribution calculation by the luminance distribution calculation unit, the error calculation by the error calculation units, and the emission intensity updating by the emission intensity update units, which are necessary to obtain an appropriate image corresponding to a certain frame video signal, can be reduced.
An image display apparatus according to a sixth embodiment differs from the first to fifth embodiments in that in the former, an emission intensity calculation unit 2100 includes an initial value calculation unit 2102 and a cut point detection unit 2101.
Since the image display apparatus of the sixth embodiment is similar to the first to fifth embodiments in the schematic structure of the entire apparatus, namely, in the structures of the backlight, the backlight controller, the liquid crystal panel, the liquid crystal controller and the signal correction unit, no detailed description will be given thereof.
<Emission Intensity Calculation Unit>
Referring to
The cut point detection unit 2101 detects a cut point in an input video image based on an input video signal. The cut point is where one successive scene is switched to another successive scene.
The initial value calculation unit 2102 calculates, from the video signal, the emission intensity of each light source that serves as the initial value of the emission intensity of said each light source. Upon detection of the cut point at the cut point detection unit 2101, the initial value calculation unit 2102 of the sixth embodiment updates the emission intensity of each light source in a memory to the emission intensity of said each light source calculated by the initial value calculation unit 2102 itself. Namely, when the cut point detection unit 2101 detects the cut point, the emission intensity of each light source calculated by the initial value calculation unit 2102 is used as the initial emission intensity for said each light source. In contrast, when no cut point is detected, the emission intensity of each light source calculated by the emission intensity calculation unit 2100 based on a prior frame video signal is used as the initial emission intensity of said each light source for a posterior frame video signal. The luminance distribution calculation unit, the error calculation units and the emission intensity update units are similar to those of the second to fifth embodiments, and are not described in detail.
The cut point detection unit 2101 detects the cut point of the input video image from the input video signal, using a known cut point detector.
When the cut point is detected, the initial value calculation unit 2102 calculates, from the video signal, the initial value of the emission intensity of each light source.
In a general moving picture, two successive frame images may well be similar to each other. Accordingly, to realize appropriate image display by a small number of iterations of the above-mentioned calculation, it is desirable that the calculation result, corresponding to the prior frame, of the emission intensity of each light source at the emission intensity calculation unit 2100 be set as the initial emission intensity of said each light source corresponding to the posterior frame. Actually, however, two successive frame images with the cut point interposed therebetween may often significantly differ from each other. Therefore, for the frames after the cut point, it is desirable to set, as the initial value of each light source, the emission intensity of said each light source calculated by the initial value calculation unit 2102.
As described above, in the sixth embodiment, since the emission intensity calculation unit 2100 is constructed as the above, the number of iterations of the luminance distribution calculation by the luminance distribution calculation unit, the error calculation by the error calculation units, and the emission intensity updating by the emission intensity update units, which are necessary to obtain an appropriate image corresponding to a certain frame video signal, can be reduced.
In an image display apparatus according to a seventh embodiment, the backlight may comprise a plurality of backlight components of different emission colors (spectral characteristics). In this case, for each backlight component, the emission intensity calculation unit iterates the luminance distribution calculation by the luminance distribution calculation unit, the error calculation by the error calculation units, and the emission intensity updating by the emission intensity update units, as in the first to sixth embodiments.
For instance, if the backlight 105 comprises backlight components 105 of three colors, i.e., red (R), green (G) and blue (B), the emission intensity calculation unit of the seventh embodiment performs the following processes for each color of a video signal, i.e., calculates the luminance distribution of the light entering the liquid crystal panel 106 when each light source of each backlight component 105 is lit at the corresponding emission intensity stored in a memory, calculates errors on display that occur when display is performed in accordance with an input video signal under the calculated luminance distribution, and updates the emission intensity of each light source stored in the memory so as to reduce the calculated errors.
Further, if the backlight 105 comprises backlight components of colors different from those of the input video signal, each color of the input video signal is converted into a color corresponding to a combination of the emission colors of the backlight components 105, and then the emission intensity calculation unit is constructed as mentioned above for each backlight component.
As described above, since in the seventh embodiment, the emission intensity calculation unit constructed as in the first to sixth embodiments is used for each of the backlight components of different emission colors, the image display apparatus comprising backlight components of different emission colors can provide the same advantage as the image display apparatuses of the first to sixth embodiments.
As described above, the first to seventh embodiments can provide image display apparatuses and information processing apparatuses of low consumption of power capable of displaying the darker portions of images with high reproducibility.
The flow charts of the embodiments illustrate methods and systems according to the embodiments of the invention. It will be understood that each block of the flowchart illustrations, and combinations of blocks in the flowchart illustrations, can be implemented by computer program instructions. These computer program instructions may be loaded onto a computer or other programmable apparatus to produce a machine, such that the instructions which execute on the computer or other programmable apparatus create means for implementing the functions specified in the flowchart block or blocks. These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable apparatus to function in a particular manner, such that the instruction stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart block or blocks. The computer program instructions may also be loaded onto a computer or other programmable apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer programmable apparatus which provides steps for implementing the functions specified in the flowchart block or blocks.
While certain embodiments have been described, these embodiments have been presented by way of example only, and are not intended to limit the scope of the inventions. Indeed, the novel embodiments described herein may be embodied in a variety of other forms; furthermore, various omissions, substitutions and changes in the form of the embodiments described herein may be made without departing from the spirit of the inventions. The accompanying claims and their equivalents are intended to cover such forms or modifications as would fall within the scope and spirit of the inventions.
Number | Date | Country | Kind |
---|---|---|---|
2010-200212 | Sep 2010 | JP | national |