The present invention relates to image processing, and particularly to an image processing technique for facilitating excellent white display.
In color television broadcasting such as NTSC/PAL (EBU), R, G, B chromaticity points and a standard white point are defined for each broadcasting system. A TV video image is adjusted in color based on those defined colors, and then broadcasted. Thus, a predetermined color (white) is expected to be displayed on a display device. When a video image is to be displayed on a display device, such as a liquid crystal display, based on digital RGB video data, a general practice is to cause the display device to perform color adjustment on white through γ correction, and to thereby display the predetermined white.
However, some display devices are not capable of performing hue adjustment (γ correction). In a display device described in Patent Literature 1 given below, RGB video signals are subjected to image processing before being inputted to the display device. Main constituents of this display device include an acquisition unit (an illuminance sensor), a converter (a controller), a correction unit (a color correction circuit), an output unit (a display device), and a storage unit (RAM).
The technique described above, however, has a problem that the luminance of white degrades because the GB lines do not rise up to their respective maximum values, as shown in
The present invention has an objective to prevent degradation in the maximum luminance, which would otherwise occur in correction processing, while maintaining the hue of white.
A video signal processing circuit according to the present invention maintains the maximum luminance by: calculating RGB correction coefficients for the purpose of outputting predetermined white; then by adjusting the correction coefficients so that the smallest correction coefficient among RGB may be almost 1; and by adjusting the correction coefficients so that input luminance and output luminance may match each other. For the rest of the color components, a component with a correction coefficient of 1 or larger is adjusted using an n(n>1)-degree curve, such as a quadratic curve, so that the input-output characteristic coefficient may not be saturated.
On the other hand, for a component with a correction coefficient of smaller than 1, the input-output characteristic is raised using a quadratic curve so that the output may reach the maximum value when the input is at the maximum value.
A first aspect of the present invention provides a video signal processing circuit that includes a video signal input-output conversion processor configured to convert an input value of each of RGB video signals into an output value of a corresponding one of the RGB video signals, and that outputs the output value of the video signal input-output conversion processor to a display unit. The video signal processing circuit is characterized by including a white corrector configured: to adjust initial correction values (initial correction coefficients) so that the smallest one of the initial correction values becomes substantially equal to 1 or larger, the initial correction values each represented by a linear line, defined by an inclination of a first input-output characteristic of a corresponding one of RGB colors, and used to display predetermined white; to correct the first input-output characteristic of each of the other colors by use of a corresponding one of the correction values of the respective RGB so that the ratio among the initial correction values (initial correction coefficients) of the respective RGB is substantially maintained; and to replace, in a high luminance region, the first input-output characteristic of a color, the correction value of which exceeds 1, with a second input-output characteristic curving upward and being represented by an n(n>1)-degree curve. The predetermined white is white generated based on any one of a standard white point defined by a video source side and a white point defined in a color space used for moving or still image content.
In other words, the “predetermined white” is white expected to be displayed on a display device through color adjustment based on the RGB chromaticity points and the standard white point defined for each broadcasting system. For example, the predetermined white is white generated based on a standard white point defined in color TV broadcasting system such as NTSC/PAL (EBU), or based on a white point defined in a color space, such as sRGB, sYCC, or AdobeRGB, used for video content delivered through the Internet or the like or still image content taken by a digital camera or the like.
An actual input-output characteristic can be obtained by suppressing a saturation region which appears in the high luminance region when the correction value exceeds 1.
Note that, although the linear line does not always have to be a complete linear line, the linear line is preferable for making processing simple. Further, making the smallest value of the correction values become substantially equal to 1 does not mean to make it become exactly equal to 1. The value “1” is just shown as an ideal value. The n-degree curve used to suppress the saturation is preferably a relatively simple curve, such as a quadratic curve or a cubic curve, to make the processing simple.
With the correction described above, all of the RGB colors have a correction value of 1 or larger, and therefore white can be displayed brightly. Note that, when the smallest value of the correction values exceeds 1, degradation in the maximum luminance due to correction processing can be suppressed while the hue of white is maintained in a practical luminance range (0 to 70%) for TV video images or the like. Further, as the smallest value among the correction values is closer to 1, the gradient in the high luminance region can be increased.
Since a video image actually broadcasted through TV broadcasting or the like, particularly a video image such as a natural image, has few extremely-bright scenes, the luminance range of most video images is roughly within a range of 0 to approximately 70% of the input luminance. Accordingly, in practice, it is sufficient that the predetermined white can be outputted in the range of 0 to approximately 70% of the input luminance.
It is desirable that: the first input-output characteristic and the second input-output characteristic should have a cross-point in the range of the input; and the first input-output characteristic should be switched to the second input-output characteristic at the cross-point. It is desirable that: the first input-output characteristic should cover the range of 0 to approximately 70% which is a practical luminance range; and the second input-output characteristic should cover the range exceeding the 70%.
In addition, provided is a video signal processing circuit that includes a video signal input-output conversion processor configured to convert an input value of each of RGB video signals into an output value of a corresponding one of the RGB video signals, and that outputs the output value of the video signal input-output conversion processor to a display unit. The video signal processing circuit is characterized by including a white corrector configured: to adjust initial correction values so that input luminance and output luminance become substantially equal to each other, the initial correction values each represented by a linear line, defined by an inclination of a first input-output characteristic of a corresponding one of RGB colors, and used to display predetermined white; to correct the first input-output characteristic of each of the other colors by a corresponding one of correction values of the respective RGB so that a ratio among the initial correction values of the respective RGB is substantially maintained; to replace, in a high luminance region, the first input-output characteristic of a color, the correction value of which exceeds 1, with a second input-output characteristic curving upward and being represented by an n(n>1)-degree curve; and to replace, in the high luminance region, the first input-output characteristic of a color, the correction value of which falls below 1, with a third input-output characteristic curving downward and being represented by an n(n>1)-degree curve.
For the color whose correction value exceeds 1, its first input-output characteristic is replaced, in the high luminance region, with the second input-output characteristic curving upward and being represented by an n(n>1)-degree curve. Thereby, an actual input-output characteristic is obtained by suppressing a saturation region which appears in the high luminance region when the correction value exceeds 1. Moreover, for the color whose correction value falls below 1, its first input-output characteristic is replaced, in the high luminance region, with the third input-output characteristic curving downward and being represented by an n(n>1)-degree curve. Thereby, an actual input-output characteristic is obtained by compensating a reduction in the luminance which appears in the high luminance region when the correction value falls below 1.
Note that terms “predetermined white,” “substantially,” and the like are used to mean the same as described above.
It is desirable that: the first input-output characteristic and each of the second and third input-output characteristics should have a cross-point in an input luminance range; and the first input-output characteristic should be switched to any one of the second and third input-output characteristics at the cross-point. It is desirable that: the first input-output characteristic should cover the range of 0 to approximately 70% which is a practical luminance range; and the second and third input-output characteristics should cover the range exceeding the 70% which is the practical luminance range. γ correction processing by a display device may stop once the white corrector is activated.
The present invention may be a display device including: the foregoing video signal processing circuit; and a display unit configured to display a video image based on a video signal processed by the video signal processing circuit. It is desirable that the display device should further include an operation unit configured to perform an operation of changing the above-described parameter (at least any one of the correction values and a curvature of the n(n>1)-degree curve). The present invention may be a mobile communications terminal including: the foregoing display device; and a communications unit for making communications.
Note that the present invention may be a method for implementing the functions described above, a program for causing a computer to execute the method, and a computer-readable storage medium for storing the program. The program may be that which is acquired through a transmission medium.
According to the present invention, degradation in the maximum luminance due to correction processing can be prevented while the hue of white is maintained in a practical luminance range (0 to 70%) for TV video images or the like. Moreover, the brightness of a displayed image can be maintained.
31 . . . video signal processing circuit, 33 . . . register, 35 . . . first image processing circuit, 37 . . . second image processing circuit, 41 . . . third image processing circuit, 45 . . . first arithmetic circuit, 47 . . . second arithmetic circuit.
In this description, “predetermined white” is defined as follows. Specifically, in color TV broadcasting such as NTSC/PAL (EBU), R, G, B chromaticity points and a standard white point are defined for each broadcasting system. A TV video image is adjusted in color based on those defined colors, and then broadcasted. Thus, a predetermined color (white) is expected to be displayed on a display device. A color expected as to white is called “predetermined white” herein. In other words, “predetermined white” is white expected to be displayed on a display device through color adjustment based on the RGB chromaticity points and the standard white point defined for each broadcasting system. Note that, other than the white point defined for the color TV broadcasting, a white point defined in a color space, such as sRGB, sYCC, or AdobeRGB, used for moving-image content delivered through the Internet or the like, or still image content taken by a digital camera or the like may be used for the “predetermined white.” In addition, “initial correction values (initial correction coefficients)” are correction values which, in a condition where white is displayed on a display device, are obtained by adjusting the respective RGB levels so that the chromaticities of displayed colors may coincide with that of the predetermined while by measuring the displayed colors by use of a measuring instrument such as a colorimeter.
Before describing embodiments of the present invention, consideration made by the inventors is briefly described. In the characteristics shown in
The inventors have come up with an idea that: the respective initial correction values (initial correction coefficients) AR, AG, AB for RGB, are calculated for outputting predetermined white; thereafter, inclinations are adjusted using linear curves so that, instead of the largest correction coefficient which is the largest among the correction coefficients AR, AG, AB, the smallest correction coefficient which is the smallest thereamong may be set equal to 1; and thereby the maximum luminance is maintained. Degradation in the maximum luminance due to correction processing is suppressed while the hue of white is maintained particularly in a practical luminance range (0 to 70%) of TV video images or the like. In the case of a color component having a correction coefficient of “1” or larger, when doing so, the input-output characteristic is saturated near beyond the practical range. For this reason, adjustment is made through replacement with a quadratic curve or the like smoothly continuous to the linear curve near beyond the practical range so as not to saturate the input-output characteristics. In other words, the linear curve and the quadratic curve are connected as smoothly as possible. Thereby, the display can be performed without awkwardness in a range beyond the practical luminance range, too, while the hue of white is maintained in the practical luminance range (0 to 70%).
In the display device 5, regardless of whether the display device 5 has no adjustment function 7 for γ correction and the like or the display device 5 has the adjustment function 7 but does not make use thereof, the inputted digital RGB video data is directly converted into an analog signal by a D/A converter 11, and the analog signal is given to a display panel such as a liquid crystal panel 15. Thus, proper correction can be made on white as well.
The embodiments of the present invention will be described below in detail based on the above consideration.
First, referring to the drawings, a color adjustment technique according to a first embodiment of the present invention is described.
Note that “1” mentioned here is not a strict value. To be more specific, in contrast to the conventional technique in which correction is performed with the largest value being made equal to about “1,” the present embodiments sets the smallest value at about “1.” This idea itself is a first point which makes the present embodiments different from the conventional technique. By doing so, all the correction coefficients become “1” or larger. Note that, if the smallest value among the correction values exceeds 1, degradation in the maximum luminance due to the correction processing can be suppressed while the hue of white is maintained in the practical luminance range (0 to 70%) for TV video images or the like. Further, as the smallest value among the correction values is closer to 1, the gradient in a high luminance region can be increased.
In a case where a correction coefficient is equal to “1” or larger, when the input is large, the output is saturated. To avoid the occurrence of the saturation, the saturation is suppressed using an n-degree curve (Xucurve), for example, a quadratic curve or a cubic curve. When such first video signal input-output conversion processing is performed, degradation in the maximum luminance due to the correction processing can be suppressed while the hue of white is maintained in the practical luminance range (0 to 70%) for video images of a television receiving set (TV), or the like.
A “parameter determination method” for color adjustment is described below by use of an example. Parameters shown below used in the present embodiment are set in a register or the like before starting the white processing.
A
x: magnification (1<Ax<∞)
C
x: curvature (0<Cx≦1)
(X=R,G,B) [Expression 1]
Here, the initial correction values (initial correction coefficients) of R, G and B, which are obtained by use of the conventional method for the purpose of displaying predetermined white, are denoted by ARI, AGI and ABI, respectively. In the present embodiment, correction coefficients obtained by the following equations are used as new correction coefficients for displaying the predetermined white and maintaining the luminance. In other words, magnifications (AR, AG, AB) are determined based on the following equations.
[Expression 2]
A
R
=A
RI×1/(min(min(ARI,AGI),ABI)) Equation 1-1
A
G
=A
GI×1/(min(min(ARI,AGI),ABI)) Equation 1-2
A
B
=A
BI×1/(min(min(ARI,AGI),ABI)) Equation 1-3
These equations will be described in a complement provided later.
Next, the curvature (Cx) of a quadratic curve is determined so that a straight-line portion obtained by the first video signal input-output conversion processing (this portion is called a first input-output characteristic herein) may be smoothly connected to a quadratic curve portion (this portion is called a second input-output characteristic herein). Here, a quadratic curve is used as an example of the n-degree curve (n>1).
A correction equation is described below. Correction on video data is performed using (Equation 1-4) given below, where Xin denotes a video input (input signal) and Xout denotes a video output (output signal). Note that, in (Equation 1-4) below, the same processing is performed on each of the RGB components by substituting X with R, G and B. Ax, Cx in the following equations can be obtained through parameter fitting. In the drawing shown in
It is preferable that second video signal input-output conversion processing should be performed in a way that: Xucurve is replaced with Xlinear at Xin before Xlinear is saturated; and Xout reaches about 255 when Xin reaches 255. Here, it is preferable that Xlinear and Xucurve should be connected together as smoothly as possible at their joint portion. For this reason, if linear curves (straight lines) are connected to each other, it is highly likely that smoothness is lost to cause awkward display at the joint portion.
[Expression 3]
X
out=min(Xlinear,Xucurve) Equation 1-4
X
linear
=A
x
·X
in Equation 1-5
X
ucurve=(1−Cx)·Xin2+Cx·Xin Equation 1-6
Y=min(a,b) described above operates as follows.
[Expression 4]
Y=min(a,b) operates as follows.
Y={
b(a≧b)
a(a<b)
[Expression 5]
Y=max(a, b) operates as follows.
Y={
b(a≦b)
a(a>b)
In the above-described example of the video signal input-output conversion processing, a quadratic curve is used for the saturation suppression method. Note, however, that other n-degree curves, such as a cubic curve, may be used instead. When a larger degree (n) is used for the portion to be suppressed from saturation, the straight line and the n-degree curve can be connected together more smoothly, thus improving the image quality. However, the representing of the saturation suppression portion by a line having a small n-degree, such as a linear line, has an advantage of reducing the circuit size.
However, the representing of the saturation prevention portion by a line having a low n-degree, such as a linear line, allows reduction in the circuit size. Basically, what degree to set for n is determined when designing the product. However, the n may be changed by a user while the user checks the image quality. Otherwise, the n may be controlled by a content provider in order that the image quality may match the content through a scheme in which the content provider provides the content as a package.
As described above, the image processing technique including the video signal input-output conversion processing according to the present embodiment offers an effect that degradation in the maximum luminance due to the correction processing can be suppressed while the hue of white is maintained in the practical luminance range (0 to 70%) for TV video images or the like.
Next, referring to the drawings, an image processing system according to a second embodiment of the present invention is described. The image processing technique using a video signal processing circuit according to the present embodiment is characterized in that the first video signal input-output conversion processing for adjusting correction coefficients is performed so that the luminance of an input video image based on an input signal of a white correction circuit may match the luminance of an output video image based on an output signal thereof, as shown in
The present embodiment offers the following effects in addition to the effects of the first embodiment. Specifically, the brightness of a displayed image can be maintained also on the high luminance side of the input.
A “parameter determination method” is described below. The following parameters to be used are set in a register or the like before starting the white processing.
A
x: magnification (1<Ax<∞)
C
x: curvature (0<Cx≦1)
D
x: downward curvature (0≦Dx<1)
(X=R,G,B) [Expression 6]
[Expression 7]
Y=0.3*R+0.6*G+0.1*B Equation 2-1
A correction coefficient (Ax) is determined for the purpose of keeping the luminance of the input and output. Here, R, G, and B are weighted with their respective weighting coefficients each determined based on the degree by which the color contributes to the luminance.
x indicates any of R, G, or B. Using (Equation 2-1) given above for the equation representing the conversion of RGB to luminance (Y), magnifications (AR, AG, AB) used in principle 2 can be determined as follows, where initial correction values (initial correction coefficients) coefficients obtained for outputting predetermined white are ARI, AGI, ABI.
[Expression 8]
A
R
=A
RI×1/(0.3*ARi+0.6*AGi+0.1*ABi) Equation 2-2
A
G
=A
GI×1/(0.3*ARi+0.6*AGi+0.1*ABi) Equation 2-3
A
B
=A
BI×1/(0.3*ARi+0.6*AGi+0.1*ABi) Equation 2-4
Curvatures (Cx, Dx) are determined for the purpose of smoothly connecting the straight line portion and the quadratic curve portion. Here, a known technique such as parameter fitting may be used.
[Correction Equation]
Video data is corrected using Equation (2-5), where Xin denotes a video input (input signal) and Xout denotes a video output (output signal). Note that the same processing is performed for each of the RGB components by substituting X with R, G and B.
[Expression 9]
X
out=min(max(Xlinear,Xlcurve),Xucurve) Equation 2-5
X
linear
=A
x
·X
in Equation 2-6
X
ucurve=(1−Cx)·Xin2+Cx·Xin Equation 2-7
X
lcurve=(Ex−Dx)·Xin2+Dx·Xin Equation 2-8
The parameters are read into the memory, and it is determined, using parameter fitting for example, which of Xlcurve and Xucurve is appropriate for Xlinear. Then, Xlinear is connected to one of the curves.
Note that the parameter shown below is generated automatically in the white correction circuit by using the magnification (Ax).
[Expression 10]
E
x={A
As described thus far, the present embodiment has an advantage that, because the process of raising an input-output characteristic so that the output reaches the maximum value when the input is at the maximum is performed by connecting a downward curve to a straight line with a correction coefficient smaller than 1, the display can be made smooth while maintaining high luminance.
A complementary, concrete description is given below of the image processing technique according to the first and second embodiments.
As
Specifically, arithmetic is performed on Ax=Axi×1.087 (x=r, g, b). The controller performs this processing.
Ar=1.16
Ag=1.09
Ab=1
In this way, the arithmetic is performed so that Ab may be “1.” As described above, the RGB correction values can be set up in a way that the ratio among the RGB correction values is substantially equal to the ratio among the RGB initial correction coefficients. Note that: the ratio among RGB only needs to be substantially equal to that among the RGB initial correction coefficients; and approximate, round values, for example, Ar=1.15, Ag=1.10, Ab=1.00 may be used.
Next, curvatures (Cx) are determined for the purpose of smoothly connecting the straight line portion with the quadratic curve portion (Step S3). This processing can be performed using parameter fitting, for example.
Cr=0.75
Cg=0.56
Cb=0
In Step S4, the parameters (Ax, Cx) thus calculated are stored in the storage unit.
Next, as shown in Step S5, when a video image is to be displayed, the parameters thus stored are read from the storage unit, and white correction processing is performed based on the input-output characteristics shown in
Ari=1.07
Agi=1
Abi=0.92
Coefficients (Ax) are generated so that the input luminance and the output luminance to match each other. The controller performs this processing (Step S12). Note that the correction coefficient of G is almost “1” here.
Ax=Axi×0.987 (x=r, g, b)
Ar=1.06
Ag=0.99
Ab=0.91
Curvatures (Cx, Dx) are determined using, for example, parameter fitting for the purpose of smoothly connecting the straight line portions and the quadratic curve portions (Step S13). This processing, too, is performed by the controller.
Cr=0.50
Cg=0
Cb=0
Dr=0
Dg=0
Db=0.25
The parameters (Ax, Cx, Dx) thus calculated are stored in the storage unit (Step S14). Next, when a video image is to be displayed, the parameters are read from the storage unit to perform white correction processing based on the input-output characteristics shown in
Next, a description is given of examples of how to implement the image processing according to the first embodiment and the image processing according to the second embodiment by using hardware (circuitry).
[Expression 11]
X
out=min(Xlinear,Xucurve) Equation 1-4
X
linear
=A
x
*X
in Equation 1-5
X
ucurve=(1−Cx)·Xin2+Cx·Xin Equation 1-6
[Expression 12])
(Xout=min(max(Xlinear,Xlcurve),Xucurve) Equation 2-5
X
linear
=A
x
*X
in Equation 2-6
X
ucurve=(1−Cx)·Xin2+Cx·Xin Equation 2-7
X
lcurve=(Ex−Dx)·Xin2+Dx·Xin Equation 2-8
E
X={A
Next, a description is given of an example where the video signal circuit according to the first or second embodiment is applied to a mobile terminal.
In this respect, the setting values, such as the correction coefficients, of the mobile terminal 100A can be sent to the mobile terminal 100B through the network 171, thus allowing the mobile terminal 100B to use the setting values. Thereby, the users can share their settings between themselves. In other words, the users can share the adjustment values obtained by one user through deduction of the correction values for white variance in the display device 131a, and the adjustment values obtained by the other user through deduction of the correction values for white variance in the display 131b, which have been described referring to
Moreover, broadcasting data (e.g., one-segment content itself) may be given the setting values. Further, the setting values may be used by being downloaded through the server 175. In this way, parameters combining the adjustment values that match the video content to be displayed and the white variance correction values may be set in the register of the white correction unit 125 (
Next,
Next,
If YES in Step S204, the processing proceeds to Step S205, where Xout=Xlinear is obtained. If NO in Step S204, the processing proceeds to Step S206, where Xout=Xlcurve is obtained.
Next, in Step S207, whether Xout<Xucurve or not is determined. If YES, the processing ends (a signal is outputted). If NO, Xout=Xucurve is obtained, and the processing ends (a signal is outputted).
As described above, the image processing techniques according to the present embodiments can be performed by either the hardware configuration or the software configuration.
The software processing described above is an example of software processing according to a hardware configuration.
Next, processing suitable for software processing is described.
A
x
·X
cross=(1−Cx)·Xcross2+Cx·Xcross
(1−Cx)·Xcross2+(Cx−Ax)·Xcross=0
(1−Cx)·Xcross=−(Cx−Ax)
Thus, the cross-point is obtained as Xcross=(Ax Cx)/(1−Cx).
More specifically, as shown in
Thus, the upper cross-point is Xucross=(Ax−Cx)/(1−Cx). A specific solving method for the lower cross-point is shown below.
A
x
·X
lcross=(Ex−Dx)·Xlcross2+Dx·Xlcross
(Ex−Dx)·Xlcross2+(Dx−Ax)·Xlcross=0
(Ex−Dx)·Xlcross=−(Dx−Ax)
Thus, the lower cross-point is Xlcross=(Ax−Dx)/(Ex−Dx).
As
If No the result in Step S401, the processing proceeds to Step S403, where Xout=(1−Cx)·Xin2+Cx·Xin is obtained. If Yes in Step S401, and if Yes in Step S402, the processing proceeds to Step S404, where Xout is obtained by use of Xout=Ax·Xin. If No in Step S402, the processing proceeds to Step S405, where Ex is obtained as Ex=1 (Ax<0) and Ex=Ax (Ax>=0). Then, the processing further proceeds to Step S406, where Xout=(Ex−Dx)·Xin2+Dx·Xin is obtained. Xout thus obtained is outputted to the display device.
The flowcharts described above show examples of the flows of the processes for simply pursuing, through software processing, the first embodiment and the second embodiment of the image processing techniques of the present embodiments. Such processing simplifies the software processing, and thus can reduce the processing load. Specifically, the scope of the present invention also includes the program for causing a computer to execute the functions of the video signal processing circuit described above.
As described above, according to the embodiments of the present invention, degradation in the maximum luminance due to correction processing can be suppressed while the hue of white is maintained in the practical luminance range (0 to 70%) for TV video images or the like. Furthermore, the brightness of a displayed image can be maintained as well.
The present invention is usable for an image display device.
Number | Date | Country | Kind |
---|---|---|---|
2008-103711 | Apr 2008 | JP | national |
Filing Document | Filing Date | Country | Kind | 371c Date |
---|---|---|---|---|
PCT/JP2009/057060 | 4/6/2009 | WO | 00 | 10/8/2010 |