The present invention relates to a liquid crystal display apparatus capable of changing an emission brightness of a backlight module and to a control method thereof.
Higher contrasts are required in display apparatuses for displaying images with relatively wide dynamic ranges that are referred to as HDR (High Dynamic Range) images or the like. Representative display apparatuses include an OLED (Organic Light Emitting Diode) display apparatus and a liquid crystal display apparatus (LCD apparatus). While an organic EL (Electro Luminescence) element emits light for each pixel in an OLED display apparatus, a liquid crystal panel adjusts a transmission amount of light irradiated from a backlight module for each pixel in an LCD apparatus. In an LCD apparatus, since the light irradiated from the backlight module cannot be completely blocked, black floating due to light leakage occurs. Therefore, in an LCD apparatus, contrast of display is lower than in an OLED display apparatus that is a self-luminous display apparatus.
When reducing black floating and improving contrast with an LCD apparatus, generally, a technique referred to as local dimming is used. Local dimming is a technique for reducing black floating by controlling emission brightness of a backlight module for each divided region. However, reducing the emission brightness of the backlight module also lowers display brightness of parts other than a dark part at the same time. In this case, the display brightness can be compensated by correcting an image to be displayed on the LCD apparatus. As a technique for compensating display brightness having been lowered by local dimming by image correction, Japanese Patent No. 5456050 discloses a technique of multiplying a gradation value of an image by an inverse of brightness (backlight brightness; intensity) of light from the backlight module which a liquid crystal panel is irradiated with.
However, with the conventional technique of multiplying a gradation value of an image by an inverse of backlight brightness creates a specific brightness error (error of display brightness).
The present invention provides a technique that enables display in which a specific brightness error has been suppressed to be performed.
The present invention in its first aspect provides a liquid crystal display apparatus comprising: a liquid crystal panel; an input interface for inputting data of a first image; a backlight module which is configured to irradiate light to the liquid crystal panel and of which emission brightness is changeable; and at least one memory and at least one processor which function as: an estimating unit configured to estimate brightness of light to be irradiated from the backlight module to the liquid crystal panel; a correcting unit configured to correct the first image to a second image based on the brightness estimated by the estimating unit, a contrast of the liquid crystal panel, and a target contrast so that a brightness error with respect to a display brightness in a case where the first image is displayed with the target contrast is suppressed; and a control unit configured to control transmittance of the liquid crystal panel based on data of the second image.
The present invention in its second aspect provides a control method of a liquid crystal display apparatus including a liquid crystal panel, an input interface for inputting data of a first image, and a backlight module which is configured to irradiate light to the liquid crystal panel and of which emission brightness is changeable, the control method comprising: an estimating step of estimating brightness of light to be irradiated from the backlight module to the liquid crystal panel; a correcting step of correcting the first image to a second image based on the brightness estimated in the estimating step, a contrast of the liquid crystal panel, and a target contrast so that a brightness error with respect to a display brightness in a case where the first image is displayed with the target contrast is suppressed; and a control step of controlling transmittance of the liquid crystal panel based on data of the second image.
The present invention in its third aspect provides a non-transitory computer readable medium that stores a program, wherein the program causes a computer to execute a control method of a liquid crystal display apparatus including a liquid crystal panel, an input interface for inputting data of a first image, and a backlight module which is configured to irradiate light to the liquid crystal panel and of which emission brightness is changeable, the control method comprising: an estimating step of estimating brightness of light to be irradiated from the backlight module to the liquid crystal panel; a correcting step of correcting the first image to a second image based on the brightness estimated in the estimating step, a contrast of the liquid crystal panel, and a target contrast so that a brightness error with respect to a display brightness in a case where the first image is displayed with the target contrast is suppressed: and a control step of controlling transmittance of the liquid crystal panel based on data of the second image.
Further features of the present invention will become apparent from the following description of exemplary embodiments with reference to the attached drawings.
Hereinafter, an embodiment of the present invention will be described with reference to the drawings. It is to be understood that the technical scope of the present invention is to be defined by the scope of claims and is not intended to be limited by the embodiment exemplified below. Furthermore, not all of the combinations of features described in the embodiment are essential to the present invention. Contents described in the present specification and in the drawings are exemplary and are not intended to limit or restrict the present invention. Various modifications can be made based on the spirit of the present invention and such modifications are not to be excluded from the scope of the invention. In other words, all configurations that combine the embodiment and modifications thereof are to be included in the present invention.
As will be described later, the inventors of the present invention found that a specific brightness error occurs in conventional techniques in which a gradation value of an image is multiplied by an inverse of brightness (backlight brightness; intensity) of light from a backlight module which a liquid crystal panel is irradiated with. In this case, the specific brightness error refers to an error with respect to a display brightness when the image is displayed with a target contrast and, at the same time, an error related to a backlight brightness and a panel contrast (a contrast of the liquid crystal panel). Display brightness refers to brightness on a display surface on which the image is to be displayed. A contrast of a display refers to a ratio between an upper limit and a lower limit of the display brightness. A contrast of the liquid crystal panel refers to a contrast of a display on the liquid crystal panel when the backlight brightness is set uniform within the display surface. The contrast of the liquid crystal panel can also be described as a ratio between an upper limit and a lower limit of transmittance of the liquid crystal panel.
If white brightness is 1000 nit when display is performed with a contrast of 1 million to 1, black brightness is 0.001 nit and a brightness dynamic range (a dynamic range of brightness) is 0.001 to 1000 nit. In addition, when a gradation value of an image is 0.0025, as expressed by the following calculation formula, normalization to the brightness dynamic range of 0.001 to 1000 nit results in display brightness corresponding to the gradation value 0.0025 of 2.5009975 nit. In this case, the contrast of 1 million to 1 will be considered a target contrast (an ideal contrast) and a display brightness (2.5009975 nit) thereof will be considered a target display brightness.
0.0025×(1000 nit−0.001 nit)+0.001 nit=2,499998 nit+0.001 nit=2.5009975 nit [Math. 1]
In a liquid crystal display apparatus (LCD apparatus), the contrast of a liquid crystal panel (a panel contrast) is often around 1000 to 1. If white brightness is 1000 nit when the panel contrast is 1000 to 1, then black brightness is 1 nit and the brightness dynamic range is 1 to 1000 nit. In addition, when an image is not corrected, as expressed by the following calculation formula, normalization to the brightness dynamic range of 0.001 to 1000 nit results in display brightness corresponding to the gradation value 0.0025 of 3.4975 nit.
0.0025×(1000 nit−1 nit)+1 nit=3.4975 nit [Math. 2]
Now, let us assume that the backlight brightness having been normalized to 0 to 1 (0% to 100%) is 1 (100%). When an image is to be corrected using the conventional technique described above, the gradation value 0.0025 is multiplied by an inverse (1/1=1 time) of the backlight brightness and the display brightness corresponding to the gradation value 0.0025 remains 3.4975 nit.
(0.0025×1 time)×(1000 nit−1 nit)+1 nit=2.4975 nit+1 nit=3.4975 nit [Math. 3]
When the backlight brightness is lowered to 0.5 (50%), the white brightness and the black brightness are respectively lowered by 50% and the brightness dynamic range becomes 0.5 to 500 nit. In addition, when an image is not corrected, as expressed by the following calculation formula, normalization to the brightness dynamic range of 0.5 to 500 nit results in display brightness corresponding to the gradation value 0.0025 of 1.74875 nit.
0.0025×(500 nit−0.5 nit)+0.5 nit=1.74875 nit [Math. 4]
When an image is to be corrected using the conventional technique described above, the gradation value 0.0025 is multiplied by an inverse (1/0.5=2 times) of the backlight brightness and the display brightness corresponding to the gradation value 0.0025 becomes 2.9975 nit.
(0.0025×2 times)×(500 nit−0.5 nit)+0.5 nit=2.4975 nit+0.5 nit=2.9975 nit [Math. 5]
When the panel contrast is changed to 2000 to 1, black brightness is brightness that is 1/2000 of white brightness. When the backlight brightness is 0.5 (50%), since the white brightness is 500 nit, the black brightness is 0.25 nit and the brightness dynamic range is 0.25 to 500 nit. In addition, when an image is not corrected, as expressed by the following calculation formula, normalization to the brightness dynamic range of 0.25 to 500 nit results in display brightness corresponding to the gradation value 0.0025 of 1.499375 nit.
0.0025×(500 nit−0.25 nit)+0.25 nit=1.499375 nit [Math. 6]
When an image is to be corrected using the conventional technique described above, the gradation value 0.0025 is multiplied by an inverse (1/0.5=2 times) of the backlight brightness and the display brightness corresponding to the gradation value 0.0025 becomes 2.74875 nit.
(0.0025×2 times)×(500 nit−0.25 nit)+0.25 nit=2.49875 nit+0.25 nit=2.74875 nit [Math. 7]
As described above, with the conventional technique in which an image is corrected using an inverse of backlight brightness, an increase in black floating in conjunction with an increase in the backlight brightness and a decrease in the panel contrast results in an increase in a brightness error with respect to a target display brightness. While the brightness error due to black floating relatively decreases in a bright part, the brightness error due to black floating relatively increases in a dark part. Therefore, with the conventional technique described above, a brightness error related to the backlight brightness and the panel contrast increases particularly in dark regions and black floating becomes more visible.
Hereinafter, a first example of the present invention will be described.
The image input/converting unit 101 acquires image data (data of an image) from the outside. Specifically, the image input/converting unit 101 has an input interface such as an SDI (Serial Digital Interface) and inputs the image data to the liquid crystal display apparatus 100 from the outside via the input interface. In addition, the image input/converting unit 101 applies conversion processing such as gradation conversion or signal format conversion to the acquired (input) image data and outputs image data after the conversion processing.
The gradation conversion is, for example, gradation conversion using a one-dimensional lookup table (1D-LUT) which is gradation conversion in accordance with a gamma value (panel gamma) of the liquid crystal panel 107. Let us now consider a case where gamma characteristics (a correspondence relationship between a gradation value and brightness: gradation characteristics) of image data acquired from the outside are linear characteristics in which the brightness linearly increases with respect to an increase in the gradation value and panel gamma is 2.0. In this case, gradation conversion using an inverse gamma (in other words, 1/2.0) of the panel gamma is performed. Accordingly, the acquired image data (image data having linear characteristics) is converted into image data having gamma characteristics in which brightness is proportional to 1/2.0 power of the gradation value. It should be noted that the conversion processing by the image input/converting unit 101 is not limited to gradation conversion using a 1 D-LUT and may include conversion processing using a three-dimensional lookup table (3D-LUT), gain adjustment, offset adjustment, matrix conversion, or the like.
Signal format conversion is, for example, processing of converting a signal format of the image data from YCbCr or XYZ into RGB. It should be noted that signal formats before and after the conversion are not limited to YCbCr, XYZ, and RGB.
The backlight control value generating unit 102 generates a backlight control value for controlling the backlight module 109 based on image data (input image data; data of the input image) output from the image input/converting unit 101. In addition, the backlight control value generating unit 102 outputs the generated backlight control value. Emission brightness (emission intensity) of the backlight module 109 can be changed. Specifically, the backlight module 109 emits light with emission brightness in accordance with the backlight control value. In the first example, a plurality of divided regions that constitute a display surface are set in advance, and the backlight module 109 has a plurality of light sources that respectively correspond to the plurality of divided regions and enables emission brightness to be changed for each divided region. While the light sources of the backlight module 109 are not particularly limited, for example, the light sources are LEDs (Light Emitting Diodes). In addition, the backlight control value generating unit 102 generates the backlight control value for each divided region. For example, the backlight control value is determined in accordance with a characteristic value (a statistic) such as a maximum gradation value or an average gradation value of image data of a region that corresponds to the backlight control value (in the first example, a divided region that corresponds to the backlight control value). The emission brightness of the backlight module 109 may be controlled so that the emission brightness of the backlight module 109 is a uniform brightness across the entire display surface. In this case, for example, the backlight control value generating unit 102 generates a backlight control value that is uniform across the entire display surface. In addition, the region in which a characteristic value of image data is acquired may be either narrower or wider than the region corresponding to the backlight control value.
The backlight brightness estimating unit 103 performs an estimation calculation of brightness (backlight brightness; intensity) of light from the backlight module 109 which the liquid crystal panel 107 is irradiated with based on the backlight control value output from the backlight control value generating unit 102. In addition, the backlight brightness estimating unit 103 outputs the estimated backlight brightness. Various proposed methods can be used for the estimation calculation of a backlight brightness. For example, based on a backlight control value of each light source (each divided region) and a brightness distribution model of light emitted from the light source (a portion corresponding to the divided region among the backlight module 109), backlight brightness can be estimated (calculated) for each position (each region) of the display surface. The backlight brightness may be estimated (detected) using a brightness sensor or the like.
Based on the backlight brightness output from the backlight brightness estimating unit 103, the correction coefficient generating unit 104 generates a correction coefficient to be applied to the input image data output from the image input/converting unit 101. In addition, the correction coefficient generating unit 104 outputs the generated correction coefficient.
The image correcting unit 105 generates (calculates) a pixel value of corrected image data (data of a corrected image) by multiplying the pixel value of the input image data output from the image input/converting unit 101 by a correction coefficient Gt output from the correction coefficient generating unit 104. In the first example, an RGB value (R value, G value, B value)=(Vr, Vg, Vb) that is the pixel value of the input image data is multiplied by the correction coefficient Gt according to expression (1) below to generate an RGB value=(Vrc, Vgc, Vbc) that is a pixel value of the corrected image data. In addition, the image correcting unit 105 outputs the generated corrected image data.
[Math. 8]
Vrc=Vr×Gt
Vgc=Vg×Gt
Vbc=Vb×Gt (1)
The liquid crystal panel control unit 106 controls transmittance (a transmittance distribution within the display surface) of the liquid crystal panel 107 based on (in accordance with) the corrected image data output from the image correcting unit 105 so that an image based on the corrected image data is displayed on the liquid crystal panel 107.
The liquid crystal panel 107 is controlled by the liquid crystal panel control unit 106 and displays an image on the display surface.
The backlight control unit 108 controls emission brightness of the backlight module 109 (a light source of the backlight module 109) in accordance with the backlight control value output from the backlight control value generating unit 102. For example, the backlight control unit 108 determines a duty ratio of PWM (Pulse Width Modulation) control in accordance with the backlight control value and controls the emission brightness of the backlight module 109 by performing PWM control with the determined duty ratio. In the first example, the backlight control unit 108 performs such processing (control) for each divided region.
The backlight module 109 irradiates a rear surface of the liquid crystal panel 107 with light. As described above, the emission brightness of the backlight module 109 can be changed. In the first example, a plurality of divided regions that constitute the display surface are set in advance, and the backlight module 109 has a plurality of light sources that respectively correspond to the plurality of divided regions and enables emission brightness to be changed for each divided region.
The maximum value acquiring unit 10401 acquires, for each pixel of the input image data output from the image input/converting unit 101, a gradation value of the input image data as an input value Vin. In addition, the maximum value acquiring unit 10401 outputs the acquired input value Vin. In the first example, the maximum value acquiring unit 10401 acquires a maximum value among an R value, a G value, and a B value of an RGB value that is the pixel value of the input image data as the input value Vin. Alternatively, a minimum value, an average value, an intermediate value, or the like of the R value, the G value, and the B value may be acquired as the input value Vin. A Y value of YCbCr, XYZ, or the like may be acquired as the input value Vin. Hereinafter, the input value Vin is assumed to be a value normalized to 0 to 1.
The target display brightness calculating unit 10402 calculates a display brightness (a target display brightness) Lt in a case where the input image is displayed with the target contrast from the input value Vin output from the maximum value acquiring unit 10401 or the like in accordance with expression (2) below. In addition, the target display brightness calculating unit 10402 outputs the calculated target display brightness Lt. In expression (2), pg denotes panel gamma By raising Vin to the power of pg, an output value corresponding to the display brightness when the input value Vin is displayed by the liquid crystal panel 107 is obtained. In addition, in expression (2), the backlight brightness is assumed to be 100%, the target contrast is assumed to be Ct to 1, and a maximum display brightness is denoted by Lmax. In this case, a minimum display brightness is expressed as Lmax/Ct and a brightness dynamic range is expressed as Lmax/Ct to Lmax. Therefore, as shown in expression (2), by normalizing, using the brightness dynamic range Lmax/Ct to Lmax, an output value obtained by converting the input value Vin using the panel gamma pg, the target display brightness Lt is calculated. In this case, the minimum display brightness is display brightness obtained by measuring a display of, for example, an entirely black image and the maximum display brightness is display brightness obtained by measuring a display of, for example, an entirely white image.
The black brightness estimating unit 10403 calculates black brightness Lbk (the minimum display brightness in a case where a backlight brightness Le is output from the backlight brightness estimating unit 103) based on the backlight brightness Le or the like in accordance with expression (3) below. In addition, the black brightness estimating unit 10403 outputs the calculated black brightness Lbk. In this case, the backlight brightness Le is normalized to 0 to 1 (0% to 100%). The maximum display brightness in a case of the backlight brightness Le is Lmax Le. In addition, when the contrast (panel contrast) of the liquid crystal panel 107 is expressed as Cp to 1, the minimum display brightness is 1/Cp of the maximum display brightness. Therefore, as shown in expression (3), the black brightness Lbk (the minimum display brightness in a case of the backlight brightness Le) is 1/Cp of Lmax×Le.
The panel display brightness estimating unit 10404 calculates a panel display brightness Lp from the input value Vin output from the maximum value acquiring unit 10401, the backlight brightness Le output from the backlight brightness estimating unit 103, and the like in accordance with expression (4) below. In addition, the panel display brightness estimating unit 10404 outputs the calculated panel display brightness Lp. The panel display brightness Lp is display brightness when the input image is displayed with the panel contrast. As described above, the maximum display brightness in a case of the backlight brightness Le is Lmax×Le and the minimum display brightness in a case of the backlight brightness Le is 1/Cp of Lmax×Le. In other words, the brightness dynamic range is expressed as (Lmax×Le)/Cp to Lmax×Le. Furthermore, by raising Vin to the power of pg, an output value corresponding to the display brightness when the input value Vin is displayed by the liquid crystal panel 107 is obtained. Therefore, as shown in expression (4), the panel display brightness Lp is calculated by normalizing, using the brightness dynamic range (Lmax×Le)/Cp to Lmax×Le, an output value obtained by converting the input value Vin using the panel gamma pg.
The first subtracting unit 10405 calculates a first brightness difference Dt by subtracting the black brightness Lbk (the output value of the black brightness estimating unit 10403) from the target display brightness Lt (the output value of the target display brightness calculating unit 10402) in accordance with expression (5) below. In addition, the first subtracting unit 10405 outputs the calculated first brightness difference Dt.
[Math. 12]
Dt=Lt−Lbk (5)
The second subtracting unit 10406 calculates a second brightness difference Dp by subtracting the black brightness Lbk (the output value of the black brightness estimating unit 10403) from the panel display brightness Lp (the output value of the panel display brightness estimating unit 10404) in accordance with expression (6) below. In addition, the second subtracting unit 10406 outputs the calculated second brightness difference Dp.
[Math. 13]
Dp=Lp−Lbk (6)
The dividing unit 10407 calculates a brightness ratio Lratio according to expression (7) below by dividing the first brightness difference Dt (the output value of the first subtracting unit 10405) by the second brightness difference Dp (the output value of the second subtracting unit 10406). In addition, the dividing unit 10407 outputs the calculated brightness ratio Lratio.
The gamma conversion unit 10408 calculates a correction coefficient Gt according to expression (8) below by applying an inverse gamma of the panel gamma pg to the brightness ratio Lratio output from the dividing unit 10407. In addition, the gamma conversion unit 10408 outputs the calculated correction coefficient Gt.
Expression (9) below can be obtained by combining expressions (2) to (8) described above. In other words, it can also be considered that the correction coefficient generating unit 104 calculates the correction coefficient Gt in accordance with expression (9). In expression (9), when the input value Vin is 0, a zero division (division by zero) occurs. Therefore, when the input value Vin is 0, the correction coefficient Gt is set to 0 so as to disable image correction. In addition, when a dividend of expression (9) is a negative value, the dividend is limited to 0.
A specific example of a calculation of the correction coefficient Gt by the correction coefficient generating unit 104 will be described with reference to
The target display brightness Lt that is calculated by the target display brightness calculating unit 10402 in accordance with expression (2) is 2.5009975 nit (described as 2.501 nit in
The black brightness Lbk that is calculated by the black brightness estimating unit 10403 in accordance with expression (3) is 1.0 nit as represented by the following calculation formula.
The panel display brightness Lp that is calculated by the panel display brightness estimating unit 10404 in accordance with expression (4) is 3.4975 nit (described as 3.498 nit in
The first brightness difference Dt that is calculated by the first subtracting unit 10405 in accordance with expression (5) is 1.5009975 nit (described as 1.501 nit in
Dt=2.5009975 nit−1.0 nit=1.5009975 nit [Math. 20]
The second brightness difference Dp that is calculated by the second subtracting unit 10406 in accordance with expression (6) is 2.4975 nit (described as 2.498 nit in
Dp=3.4975 nit−1.0 nit=2.1975 nit [Math. 21]
The brightness ratio Lratio that is calculated by the dividing unit 10407 in accordance with expression (7) is 0.601 as represented by the following calculation formula.
The correction coefficient Gt that is calculated by the gamma conversion unit 10408 in accordance with expression (8) is 0.77524 (described as 0.775 in
In a case where the gradation value of the input image data is 0.05, the gradation value Vc of the corrected image data that is generated by the image correcting unit 105 in accordance with expression (1) is 0.038762 (described as 0.039 in
Vc=0.05×0.77524=0.038762 [Math. 24]
A display brightness Lc (a panel display brightness) corresponding to the gradation value Vc is calculated by subjecting the gradation value Vc to a conversion by a panel gamma of 2.0 and normalization by a brightness dynamic range of 1 to 1000 nit. As represented by the following calculation formula, display brightness Lc=2.50099 nit is calculated from gradation value Vc=0.038762. In this manner, display brightness Lc that is approximately the same as the display brightness generated with the method according to the first example or, in other words, the target display brightness Lt can be obtained.
Lc=(0.0387622.0×(1000 nit−1.0 nit)+1.0 nit)≈2.50099 nit [Math. 25]
The target display brightness Lt that is calculated by the target display brightness calculating unit 10402 in accordance with expression (2) is 2.5009975 nit (described as 2.501 nit in
The black brightness Lbk that is calculated by the black brightness estimating unit 10403 in accordance with expression (3) is 0.5 nit as represented by the following calculation formula.
The panel display brightness Lp that is calculated by the panel display brightness estimating unit 10404 in accordance with expression (4) is 1.74875 nit (described as 1.749 nit in
The first brightness difference Dt that is calculated by the first subtracting unit 10405 in accordance with expression (5) is 2.0009975 nit (described as 2.001 nit in
Dt=2.5009975 nit−0.5 nit=2.0009975 nit [Math. 29]
The second brightness difference Dp that is calculated by the second subtracting unit 10406 in accordance with expression (6) is 1.24875 nit (described as 1.249 nit in
Dp=1.74875 nit−0.5 nit=1.24875 nit [Math. 30]
The brightness ratio Lratio that is calculated by the dividing unit 10407 in accordance with expression (7) is 1.6024 (described as 1.602 in
The correction coefficient Gt that is calculated by the gamma conversion unit 10408 in accordance with expression (8) is 1.26586 (described as 1.266 in
Gt=1.60241/2.0≈1.26586 [Math. 32]
In a case where the gradation value of the input image data is 0.05, the gradation value Vc of the corrected image data that is generated by the image correcting unit 105 in accordance with expression (1) is 0.063293 (described as 0.063 in
Vc=0.05×1.26586≈0.063293 [Math. 33]
A display brightness Lc (a panel display brightness) corresponding to the gradation value Vc is calculated by subjecting the gradation value Vc to a conversion by a panel gamma of 2.0 and normalization by a brightness dynamic range of 0.5 to 500 nit. As represented by the following calculation formula, display brightness Lc=2.50099 nit is calculated from gradation value Vc=0.063293. In other words, display brightness Lc that is approximately the same as the target display brightness Lt can be obtained.
Lc=(0.0632932.0×(500 nit−0.5 nit)+0.5 nit)≈2.50099 nit [Math. 34]
The target display brightness Lt that is calculated by the target display brightness calculating unit 10402 in accordance with expression (2) is 2.5009975 nit (described as 2.501 nit in
The black brightness Lbk that is calculated by the black brightness estimating unit 10403 in accordance with expression (3) is 0.25 nit as represented by the following calculation formula.
The panel display brightness Lp that is calculated by the panel display brightness estimating unit 10404 in accordance with expression (4) is 1.499375 nit (described as 1.499 nit in
The first brightness difference Dt that is calculated by the first subtracting unit 10405 in accordance with expression (5) is 2.2509975 nit (described as 2.251 nit in FIG. 5) as represented by the following calculation formula.
Dt=2.5009975 nit−0.25 nit=2.2509975 nit [Math. 38]
The second brightness difference Dp that is calculated by the second subtracting unit 10406 in accordance with expression (6) is 1.24875 nit (described as 1.249 nit in
Dp=1.499375 nit−0.25 nit=1.249375 it [Math. 39]
The brightness ratio Lratio that is calculated by the dividing unit 10407 in accordance with expression (7) is 1.8017 (described as 1.802 in
The correction coefficient Gt that is calculated by the gamma conversion unit 10408 in accordance with expression (8) is 1.34227 (described as 1.342 in
In a case where the gradation value of the input image data is 0.05, the gradation value Vc of the corrected image data that is generated by the image correcting unit 105 in accordance with expression (1) is 0.0671135 (described as 0.067 in
Vc=0.05×1.34227≈0.0671135 [Math. 42]
A display brightness Lc (a panel display brightness) corresponding to the gradation value Vc is calculated by subjecting the gradation value Vc to a conversion by a panel gamma of 2.0 and normalization by a brightness dynamic range of 0.25 to 500 nit. As represented by the following calculation formula, display brightness Lc=2.50098 nit is calculated from gradation value Vc=0.0671135. In other words, display brightness Lc that is approximately the same as the target display brightness Lt can be obtained.
Lc=(0.06711352.0×(500 nit−0.25 nit)+0.25 nit)≈2.50098 nit [Math. 43]
In this manner, using the correction coefficient Gt generated with the method according to the first example enables display brightness Lc that is approximately the same as the target display brightness Lt to be obtained and enables a brightness error (an error with respect to the target display brightness) related to the backlight brightness and the panel contrast to be suppressed. For example, the brightness error (the error with respect to the target display brightness) can be prevented from increasing in conjunction with an increase in the backlight brightness and a decrease in the panel contrast.
Specific examples of an effect of the first example will be described with reference to
First, with reference to
By converting, with the panel gamma pg, a value (a gradation value of a corrected image) which is obtained by multiplying the input value Vin (a 12-bit integer) by a correction coefficient Gi calculated with expression (10), an output value corresponding to the display brightness Lc of a corrected image is obtained. In addition, the brightness dynamic range of a display with the panel contrast is expressed as (Lmax×Le)/Cp to Lmax×Le. Therefore, as shown in expression (11) below, the display brightness Lc is calculated by normalizing the output value described above to the brightness dynamic range (Lmax×Le)/Cp to Lmax×Le.
However, in a case where the input value Vin is 0, as shown in expression (12) below; image correction is disabled and the display brightness Lc is determined in accordance with the panel contrast and the backlight brightness Le.
As shown in
Next, with reference to
By converting, with the panel gamma pg, a value (a gradation value of a corrected image) which is obtained by multiplying the input value Vin (a 12-bit integer) by the correction coefficient Gt calculated with expression (9), an output value corresponding to the display brightness Lc of a corrected image is obtained. In addition, the brightness dynamic range of a display with the panel contrast is expressed as (Lmax×Le)/Cp to Lmax×Le. Therefore, as shown in expression (13) below, the display brightness Lc is calculated by normalizing the output value described above to the brightness dynamic range (Lmax×Le)/Cp to Lmax×Le.
However, in a case where the input value Vin is 0, as shown in expression (14) below, image correction is disabled and the display brightness Lc is determined in accordance with the panel contrast and the backlight brightness Le.
As shown in
As is apparent from expression (12) or expression (14), when the input value Vin is 0 or, in other words, when a color of a pixel is black, an effect of image correction cannot be obtained. In this case, the black brightness Lbk in accordance with the panel contrast and the backlight brightness Le is adopted as the display brightness Lc. In other words, as shown in
First, with reference to
As shown in
Expression (11) can be expanded as represented by Expression (15). In the example shown in
Next, with reference to
As shown in
As described above, in the first example, an image is corrected based on a backlight brightness Le, a panel contrast, and a target contrast so as to suppress a newly-found brightness error that is a brightness error related to the backlight brightness and the panel contrast. As a result, since accuracy of display brightness is improved and black floating is suppressed, display that imparts a sense of higher contrast as is conventional can be realized. It should be noted that a correction method of an image is not limited to the method using the correction coefficient Gt based on expression (9). Image can be corrected using any method as long as the brightness error related to the backlight brightness and the panel contrast can be suppressed.
A second example of the present invention will be described below. In the second example, an example will be described in which a parameter related to a target contrast used to calculate the correction coefficient Gt is input from the outside.
The parameter input unit 110 inputs a parameter related to the target contrast from the outside. For example, the parameter related to the target contrast is a value Ct corresponding to a maximum brightness of the target contrast and is input from the outside of the liquid crystal display apparatus 100 in accordance with a user operation with respect to an OSD (On Screen Display) menu. The parameter input unit 110 outputs the parameter (the target contrast) having been input in accordance with a user operation to the correction coefficient generating unit 104. It should be noted that the parameter related to the target contrast may be any kind of parameter as long as the target contrast can be comprehended (determined) from the parameter. For example, instead of the value Ct, the parameter related to the target contrast may be one or more setting values such as an identifier of the target contrast. The correction coefficient generating unit 104 may comprehend (determine) the target contrast based on the one or more setting values. The parameter input method is not limited to the method described above which involves using an OSD menu and other input methods may be adopted.
As described above, in the second example, a parameter related to a target contrast used to calculate the correction coefficient Gt is input (designated) from the outside. Accordingly, a brightness error with respect to a display brightness with an arbitrary target contrast (a brightness error related to a backlight brightness and a panel contrast) can be suppressed and accuracy of display brightness can be improved.
A third example of the present invention will be described below. In the third example, an example will be described in which an input image is corrected so that blocked-up shadows are not created.
The correction coefficient adjusting unit 111 limits the correction coefficient Gt generated by the correction coefficient generating unit 104 so as to suppress blocked-up shadows due to the application of the correction coefficient Gt. Specifically, the image input/converting unit 101 outputs a minimum value among an R value, a G value, and a B value of an RGB value that is the pixel value of input image data to the correction coefficient adjusting unit 111. The correction coefficient adjusting unit 111 limits a lower limit value of the correction coefficient Gt to an inverse of the minimum value output from the image input/converting unit 101. In other words, the correction coefficient adjusting unit 111 limits the correction coefficient Gt to a value equal to or larger than the minimum value output from the image input/converting unit 101. It should be noted that processing by the correction coefficient adjusting unit 111 (adjustment of the correction coefficient Gt) is not limited to the processing described above and may be other processing for adjusting the correction coefficient Gt so that blocked-up shadows are suppressed. The inverse for limiting the correction coefficient Gt may be an inverse of a maximum value, an average value, an intermediate value, or the like of an R value, a G value, and a B value or an inverse of a Y value of YCbCr, XYZ, or the like.
A specific example of correction coefficient adjustment processing by the correction coefficient adjusting unit 111 will be described with reference to
Vrc=20×0.02=0.4
Vgc=15×0.02=0.3
Vbc=5×0.02=0.1 [Math. 50]
Therefore, in order to suppress the blocked-up shadows in the corrected image, the correction coefficient adjusting unit 111 limits the correction coefficient Gt generated by the correction coefficient generating unit 104 using an inverse of a minimum value output from the image input/converting unit 101 (a minimum value among the R value Vr, the G value Vg, and the B value Vb) as a lower limit value. From
When the minimum value among the R value Vr, the G value Vg, and the B value Vb is 0, a zero division occurs. In such a case, an inverse of the minimum value among the R value Vr, the G value Vg, and the B value Vb excluding zero may be adopted as the lower limit value of the correction coefficient Gt so as to prevent a zero division from occurring. For example, in a case where the RGB value (Vr, Vg, Vb)=(20, 15, 0), 1/15 may be adopted as the correction coefficient Gt.
Vrc=20×0.2=4
Vgc=15×0.2=3
Vbc=5×0.2=1 [Math. 51]
As described above, in the third example, since an input image is corrected so that blocked-up shadows do not occur, an image in which blocked-up shadows are suppressed can be displayed.
A fourth example of the present invention will be described below. In the first example, blocked-up shadows may occur in a portion corresponding to a low gradation part (dark part) of an input image among a corrected image. Such blocked-up shadows will now be described in detail with reference to
The offset gain calculating unit 10410 performs an addition of an offset value and a multiplication by a gain value with respect to the target display brightness Lt calculated by the target display brightness calculating unit 10402 and outputs a calculation result to the first subtracting unit 10405.
A calculation method of the offset gain calculating unit 10410 will now be described in detail.
First, the offset gain calculating unit 10410 determines a reference brightness Kt. For example, for each divided region, the offset gain calculating unit 10410 determines the reference brightness Kt of the divided region based on an average gradation value (an average pixel value) of an input image in the divided region. In the example shown in
Next, the offset gain calculating unit 10410 determines an offset value OFT. For example, the offset value OFT is black brightness Lbk which is 1.0 nit in the example shown in
Next, the offset gain calculating unit 10410 determines a gain value GAIN. For example, the gain value GAIN is calculated by dividing the black brightness Lbk by the reference brightness Kt. In the example shown in
Finally, the offset gain calculating unit 10410 changes the target contrast by performing an addition of the offset value OFT and a multiplication by the gain value GAIN with respect to the target display brightness Lt. For example, the brightness range of 0.001 to 2.0 nit is convened into a brightness range of 1.0 to 2.0 nit and the target contrast depicted by a solid line in
As described above, in the fourth example, by changing the target contrast as shown in
A fifth example of the present invention will be described below. In the fifth example, an example will be described in which blocked-up shadows in a corrected image (blocked-up shadows in a portion corresponding to a low gradation part (dark part) of an input image) are suppressed using a method that differs from the fourth example.
The gain calculating unit 10411 multiplies the panel display brightness Lp calculated by the panel display brightness estimating unit 10404 by a gain value and outputs a calculation result (a multiplied brightness) to the second subtracting unit 10406.
A calculation method of the gain calculating unit 10411 will now be described in detail.
First, the gain calculating unit 10411 determines a gain value GAIN. For example, the gain value GAIN is determined in accordance with the second brightness difference Dp as shown in
Next, the gain calculating unit 10411 obtains a multiplied brightness LpG (=Lp×GAIN) by multiplying the panel display brightness Lp by the gain value GAIN.
Finally, the gain calculating unit 10411 changes the target contrast by changing the target display brightness Lt. For example, the target contrast depicted by a solid line in
As described above, in the fifth example, by changing the target contrast as shown in
A sixth example of the present invention will be described below. In the sixth example, an example will be described in which black floating is suppressed by image correction when a decline in brightness due to image signal processing is compensated by backlight brightness.
The brightness adjustment coefficient calculating unit 112 calculates a brightness adjustment coefficient Ladj based on a brightness reduction rate attributable to image signal processing in the image input/converting unit 101 and outputs the brightness adjustment coefficient Ladj to the backlight control value generating unit 102 and the correction coefficient generating unit 104. In the backlight control value generating unit 102, a backlight control value is adjusted based on the brightness adjustment coefficient Ladj calculated by the brightness adjustment coefficient calculating unit 112. In addition, in the correction coefficient generating unit 104, a correction coefficient is adjusted based on the brightness adjustment coefficient Ladj calculated by the brightness adjustment coefficient calculating unit 112. While examples of image signal processing that causes a decline in brightness include processing for displaying overly-white of a limited range signal and processing for changing a color balance by color temperature adjustment or the like, processing is not limited thereto and includes all types of processing attributable to image signal processing. Hereinafter, an example of displaying overly-white of a limited range signal will be described with reference to
A solid line in
In the example depicted by the solid line in
On the other hand, in the example depicted by the dashed-dotted line in
Now, let us consider a case where local dimming control and image correction are performed using a target contrast of 200 thousand: 1 and a maximum display brightness of 1000 nit by the method according to the first example. In this case, gradation values of 64 to 1023 of an HLG signal is displayed with a brightness dynamic range of 0.005 to 1000 nit. Therefore, as depicted by the dashed-dotted line in
In expression (16), γ denotes a system gamma, Vext denotes a value obtained by normalizing an HLG signal with a limited range (64 to 940) to 0.000 to 1.000, and L denotes a brightness level (1.000=1 time). In the example shown in
Furthermore, when the HLG signal (a gradation value of an input image) is 1023, Vext is calculated as 1.095 using the calculation formula below.
From expression (16), a brightness level L in a case where the HLG signal is 940 is calculated as 1.000 and the brightness level L in a case where the HLG signal is 1023 is calculated as approximately 1.870. In other words, when displaying overly-white of an HLG signal, the brightness level L ranges from approximately 0.000 to 1.870. Using expression (17), the brightness level L can be approximated and calculated to a brightness level (hereinafter, a normalized brightness level) Ln having been normalized to 0.000 to 1.000.
Therefore, when the gradation value of the input image is 940, from expression (16) and expression (17), the normalized brightness level Ln is approximately 0.535. In addition, when the gradation value of the input image is 1023, from expression (16) and expression (17), the normalized brightness level Ln is 1.000.
As described earlier, in the example shown in
As described above, even when performing display in a same brightness dynamic range, in a case where overly-white is displayed (the dashed-dotted line in
A dashed line in
As described earlier, the normalized brightness level Ln of the gradation value 940 when displaying overly-white of an HLG signal is approximately 0.535. Therefore, the display brightness of the gradation value 940 in the brightness dynamic range 0.009 to 1870 nit is approximately 1000 nit as depicted by the dashed line in
In a similar manner, as described earlier, the normalized brightness level Ln of the gradation value 1023 when displaying overly-white of an HLG signal is approximately 1.000. Therefore, the display brightness of the gradation value 1023 in the brightness dynamic range 0.009 to 1870 nit is approximately 1870 nit as depicted by the dashed line in
As described above, by increasing the backlight brightness, a decline in white brightness due to displaying overly-white can be compensated.
A two-dot chain line in
As described above, when increasing the backlight brightness in order to compensate for a reduction in white brightness due to image signal processing, expanding the target contrast in accordance with a rate of increase of the backlight brightness enables black floating to be suppressed.
The brightness adjustment coefficient calculating unit 112 shown in
The brightness adjustment coefficient Ladj is output to the backlight control value generating unit 102 and the correction coefficient generating unit 104. The backlight control value generating unit 102 outputs a value obtained by multiplying the backlight control value by the brightness adjustment coefficient Ladj to the backlight brightness estimating unit 103 and the backlight control unit 108. The correction coefficient generating unit 104 calculates a correction coefficient using the target contrast expanded by multiplying the target contrast (Ct) by the brightness adjustment coefficient Ladj.
As described above, in the sixth example, black floating can be suppressed while maintaining white brightness by respectively adjusting the backlight brightness and the target contrast in accordance with a reduction rate of white brightness. While an example in which white brightness declines due to overly-white display has been described in the sixth example, the sixth example is not limited thereto and is assumed to be applied to all cases where white brightness declines due to image signal processing such as color balance adjustment.
A seventh example of the present invention will be described below. In the seventh example, an example will be described in which a color gamut of a dark part region is expanded while displaying an input image with a desired display contrast.
The setting value input unit 113 inputs setting values related to local dimming control (image correction) from the outside. For example, a setting value related to local dimming control is for switching among display contrasts and states of dark part color gamut expansion and is input from the outside of the liquid crystal display apparatus 100 in accordance with a user operation with respect to an OSD menu such as that shown in
The parameter generating unit 114 generates a parameter related to local dimming control based on the setting value input by the setting value input unit 113. For example, the parameter related to local dimming control is a target contrast or a maximum value/minimum value of a backlight control value. The target contrast generated by the parameter generating unit 114 is output to the correction coefficient generating unit 104. In addition, the maximum value/minimum value of a backlight control value generated by the parameter generating unit 114 is output to the backlight control value generating unit 102. By limiting the backlight control value with the maximum value/minimum value, the backlight control value generating unit 102 can adjust a range of the backlight control value (BL control value) as shown in
It should be noted that the parameter to be output to the backlight control value generating unit 102 need not be the maximum value/minimum value of a backlight control value and may be another parameter such as a conversion table for converting a characteristic value of an input image into a backlight control value. For example, the conversion table has conversion characteristics such as those shown in
In S11, the parameter generating unit 114 acquires setting values input by the setting value input unit 113 from the outside of the liquid crystal display apparatus 100. In the flow chart shown in
In S12, the parameter generating unit 114 determines whether or not the setting value of the display contrast among the setting values acquired in S11 is “high” or “low”. When it is determined in S12 that the setting value of the display contrast is “high”, in S16, the parameter generating unit 114 generates parameters. The parameters generated in S16 include 100 as the maximum value of the backlight control value, 10 as the minimum value of the backlight control value, and 10000 as the target contrast.
When it is determined in S12 that the setting value of the display contrast is “low”, in S13, the parameter generating unit 114 determines whether or not the setting value of dark part color gamut expansion is “on” or “off”. When it is determined in S13 that the setting value of the dark part color gamut expansion is “on”, in S14, the parameter generating unit 114 generates parameters. The parameters generated in S14 include 100 as the maximum value of the backlight control value, 10 as the minimum value of the backlight control value, and 2000 as the target contrast. When it is determined in S13 that the setting value of the dark part color gamut expansion is “off, in S15, the parameter generating unit 114 generates parameters. The parameters generated in S15 include 100 as the maximum value of the backlight control value, 50 as the minimum value of the backlight control value, and 2000 as the target contrast.
In S17, among the parameters generated in S14 to S16, the parameter generating unit 114 outputs the maximum value/minimum value of the backlight control value to the backlight control value generating unit 102 and outputs the target contrast to the correction coefficient generating unit 104.
In the example shown in
When the backlight control value is 50, the maximum value of the display brightness is 1/2 of the maximum value of the display brightness when the backlight control value is 100. Therefore, when the backlight control value is 50, the maximum value of the display brightness is 500 nit as shown in
When the backlight control value is 10, the maximum value of the display brightness is 1/10 of the maximum value of the display brightness when the backlight control value is 100. Therefore, when the backlight control value is 10, the maximum value of the display brightness is 100 nit as shown in
As described above, when the setting value of the display contrast is “low”, the target contrast (a ratio of the target contrast; Ct) is 2000. In addition, when the setting value of dark part color gamut expansion is “off”, the range of the backlight control value is 50 to 100. Furthermore, the maximum value of the display brightness is 1000 nit when the backlight control value is 100 and the minimum value of the display brightness is 0.5 nit when the backlight control value is 50. Therefore, when the setting value of the display contrast is “low” and the setting value of dark part color gamut expansion is “off”, a ratio (maximum value/minimum value) between the maximum value and the minimum value of the display contrast is 2000 which is equal to the target contrast (Ct).
On the other hand, when the setting value of dark part color gamut expansion is “on”, the range of the backlight control value is 10 to 100. In addition, the maximum value of the display brightness is 1000 nit when the backlight control value is 100 and the minimum value of the display brightness is 0.1 nit when the backlight control value is 50. Therefore, when the setting value of the display contrast is “low” and the setting value of dark part color gamut expansion is “on”, the ratio (maximum value/minimum value) between the maximum value and the minimum value of the display contrast is 10000 which is larger than the target contrast (Ct) of 2000.
In addition, the RGB value after correction is R≈1, G≈1, and B≈1 as represented by the following calculation formula.
R=1×1.41≈1
G=1×1.41≈1
B=1×1.41≈1 [Math. 57]
When the backlight control value is 50, the brightness dynamic range of the display brightness of the liquid crystal display apparatus 100 is 0.5 to 500 nit as shown in
In addition, the RGB value after correction is R≈64, G≈64, and B≈64 as represented by the following calculation formula.
R=1×64.81≈64
G=1×64.81≈64
B=1×64.81≈64 [Math. 60]
When the backlight control value is 10, the brightness dynamic range of the display brightness of the liquid crystal display apparatus 100 is 0.1 to 100 nit as shown in
In addition, the RGB value after correction is R≈11, G≈11, and B≈11 as represented by the following calculation formula.
R=8×1.41≈11
G=8×1.41≈11
B=8×1.41≈11 [Math. 63]
When the backlight control value is 50, the brightness dynamic range of the display brightness of the liquid crystal display apparatus 100 is 0.5 to 500 nit as shown in
In addition, the RGB value after correction is R≈69, G≈69, and B≈69 as represented by the following calculation formula.
R=8×8.69≈69
G=8×8.69≈69
B=8×8.69≈69 [Math. 66]
When the backlight control value is 10, the brightness dynamic range of the display brightness of the liquid crystal display apparatus 100 is 0.1 to 100 nit as shown in
As shown in
In addition, the RGB value after correction is R≈11, G≈1, and B≈1 as represented by the following calculation formula.
R=8×1.41≈11
G=1×1.41≈1
B=1×1.41≈1 [Math. 69]
When the backlight control value is 50, the brightness dynamic range of the display brightness of the liquid crystal display apparatus 100 is 0.5 to 500 nit as shown in
In addition, the RGB value after correction is R≈69, G≈8, and B≈8 as represented by the following calculation formula.
R=8×8.69≈69
G=1×8.69≈8
B=1×8.69≈8 [Math. 72]
When the backlight control value is 10, the brightness dynamic range of the display brightness of the liquid crystal display apparatus 100 is 0.1 to 100 nit as shown in
As shown in
As described above, in the seventh example, the input image can be displayed with the target contrast even when the backlight brightness is adjusted. In addition, by respectively adjusting the target contrast and the backlight brightness, the color gamut of the dark part region can be expanded. While an example of expanding the color gamut of the dark part by reducing the backlight brightness while maintaining the target contrast has been described in the seventh example, a method of expanding the color gamut of the dark part is not limited thereto. For example, the color gamut of the dark part can also be expanded by increasing the target contrast while maintaining the backlight brightness.
According to the present disclosure, display in which a specific brightness error is suppressed can be performed.
Embodiment(s) of the present invention can also be realized by a computer of a system or apparatus that reads out and executes computer executable instructions (e.g., one or more programs) recorded on a storage medium (which may also be referred to more fully as a ‘non-transitory computer-readable storage medium’) to perform the functions of one or more of the above-described embodiment(s) and/or that includes one or more circuits (e.g., application specific integrated circuit (ASIC)) for performing the functions of one or more of the above-described embodiment(s), and by a method performed by the computer of the system or apparatus by, for example, reading out and executing the computer executable instructions from the storage medium to perform the functions of one or more of the above-described embodiment(s) and/or controlling the one or more circuits to perform the functions of one or more of the above-described embodiment(s). The computer may comprise one or more processors (e.g., central processing unit (CPU), micro processing unit (MPU)) and may include a network of separate computers or separate processors to read out and execute the computer executable instructions. The computer executable instructions may be provided to the computer, for example, from a network or the storage medium. The storage medium may include, for example, one or more of a hard disk, a random-access memory (RAM), a read only memory (ROM), a storage of distributed computing systems, an optical disk (such as a compact disc (CD), digital versatile disc (DVD), or Blu-ray Disc (BD)™), a flash memory device, a memory card, and the like.
While the present invention has been described with reference to exemplary embodiments, it is to be understood that the invention is not limited to the disclosed exemplary embodiments. The scope of the following claims is to be accorded the broadest interpretation so as to encompass all such modifications and equivalent structures and functions.
This application claims the benefit of Japanese Patent Application No. 2020-189430, filed on Nov. 13, 2020, and Japanese Patent Application No. 2021-140204, filed on Aug. 30, 2021, which are hereby incorporated by reference herein in their entirety.
Number | Date | Country | Kind |
---|---|---|---|
2020-189430 | Nov 2020 | JP | national |
2021-140204 | Aug 2021 | JP | national |
Number | Name | Date | Kind |
---|---|---|---|
10186209 | Shah | Jan 2019 | B1 |
20070273686 | Watanabe | Nov 2007 | A1 |
20100194777 | Yamano | Aug 2010 | A1 |
20110267379 | Kurabayashi | Nov 2011 | A1 |
20140292631 | Vasquez | Oct 2014 | A1 |
20180247609 | Joshi | Aug 2018 | A1 |
20200126512 | Amin | Apr 2020 | A1 |
20220068238 | Chappalli | Mar 2022 | A1 |
Number | Date | Country |
---|---|---|
5456050 | Mar 2014 | JP |
Entry |
---|
Schuchhardt, Matthew, User-aware System Design and Optimization, Northwestern University. ProQuest Dissertations Publishing, 2015. 3741317 (Year: 2015). |
Number | Date | Country | |
---|---|---|---|
20220157267 A1 | May 2022 | US |