This application is based upon and claims the benefit of priority from the prior Japanese Patent Application No. 2012-219675 filed on Oct. 1, 2012, the entire contents of which are incorporated herein by reference.
Embodiments relate to an image display apparatus and a method therefor, particularly to an image quality adjustment technique for adjusting image quality factors, such as lightness and chroma for example, so as to correct a display image.
There have been researches on image adjustment techniques for a user to correct an output image by adjustment of image quality factors for controlling the image quality of the output image on various kinds of image output devices. One conventional technique is to display a graph indicating the chroma characteristics of the individual hues of an output image on a screen so that the user adjusts the chroma characteristics of hues on the graph to thereby correct the chroma of a specified hue of the output image, for example. Another conventional technique is to display a window representing a three-dimensional color space on a screen for a pixel specified by the user in an input image and allow the user to adjust lightness, chroma, and hue while seeing changes in the color coordinates of the pixel.
However, these conventional techniques both have the drawback of the chroma and/or lightness of a particular hue being enhanced, resulting in imbalance of lightness and/or chroma among hues which causes an unnatural appearance, when the lightness and/or chroma of only a particular hue is corrected. Additionally, maintaining chroma and/or lightness balance among hues requires the user to finely adjust brightness and/or chroma of each hue, imposing heavy burden on the user.
According to some embodiments, there is provided an image display apparatus including: a setting unit, a correcting unit and a displaying unit.
The setting unit sets an amount of correction value for at least one of lightness and chroma for each hues, wherein the amount of correction values are determined so that a relative relationship of evaluation values among the hues is kept from varying before and after correction, the evaluation values being values defined depending on lightness and chroma for the hues.
The correcting unit obtains a corrected image by correcting at least one of the lightness and the chroma of the input image according to the amount of correction.
The displaying unit displays the corrected image.
Embodiments will now be described with reference to the drawings.
The image display apparatus 100 of the first embodiment includes a converting unit 102, a setting unit 104, an image quality adjusting unit 105, a correcting unit 108, and a displaying unit 110.
The displaying unit 110 is a device for displaying images, and assumed to be a liquid crystal display by way of example in present embodiment. The displaying unit 110 may instead be a plasma or CRT display, or a projective device such as a projector.
The converting unit 102 applies color conversion to an input image signal 101 to convert the signal into a converted signal 103 representing lightness, chroma, and hue, and sends the converted signal 103 to the setting unit 104. The image quality adjusting unit 105 displays an image quality adjustment screen on a display screen of the displaying unit 110, and sends an amount of image quality adjustment 106 input through user operation to the setting unit 104. The setting unit 104 calculates an amount of image quality correction 107 for the input image signal 101 from the converted signal 103 and amount of image quality adjustment 106, and sends it to the image quality adjusting unit 105 and the correcting unit 108. The image quality adjusting unit 105 automatically changes the amount of image quality adjustment 106 for displayed on the image quality adjustment screen in accordance with the amount of image quality correction 107 and displays the changed same. The correcting unit 108 corrects the converted signal 103 in accordance with the amount of image quality correction 107, and sends a corrected image signal 109 to the displaying unit 110. The displaying unit 110 displays the corrected image signal 109.
The detailed operation of the image display apparatus 100 in the first embodiment will be now described.
First, the converting unit 102 converts an input image signal 101 into a converted signal 103 representing lightness, chroma, and hue (S201). To be specific, the converting unit 102 first applies the gamma transform shown in Equation 1 to the gradation value of each of R, G, and B subpixels of each pixel included in the input image signal 101 inputted in RGB format.
In the equation, Rin′, Gin′, Bin′ are the gradation values of R, G, and B subpixels in the input video signal, where the gradation value is represented in 8 bits (0 to 255). Rin, Gin, Bin are gradation values after gamma transform on Rin′, Gin′, Bin′, represented as a relative value between 0 and 1. The letter “γ” represents gamma coefficient.
Although in the first embodiment gamma transform is achieved according to Equation 1, gamma transform operation may be performed by preparing and referencing a lookup table in which input gradation values are associated with gamma-transformed gradation values in advance.
The aforementioned conversion is applied to R, G, and B subpixel values of all the pixels in the input video signal.
The converting unit 102 further converts Rin, Gin, Bin into tristimulus values Xin, Yin, Zin. The tristimulus values Xin, Yin, Zin are determined from Rin, Gin, Bin according to Equation 2:
In the equation, “M” represents a 3×3 color conversion matrix and “M” is determined by the color reproduction range of the image to be displayed. The first embodiment employs a transformation matrix that converts the input video signal in accordance with the maximum color reproduction range that can be reproduced by the displaying unit.
The tristimulus values Xin, Yin, Zin may be calculated from Rin, Gin, Bin on a per-pixel basis by a preparing color conversion matrix as shown in Equation 2. Alternatively, Xin, Yin, Zin may be determined by storing correspondence between Xin, Yin, Zin, and Rin′, Gin′, Bin′ in terms of color conversion in a lookup table and making reference to the lookup table based on Rin′, Gin′, Bin′ for each pixel. When the input image signal is input in a format other than RGB, such as YUV, the XYZ tristimulus values may be determined by reference to a LUT that directly converts input signal values in YUV form or the like into XYZ tristimulus values.
Then, the tristimulus values Xin, Yin, Zin determined by color conversion are converted into L*in, a*in, b*in in CIE L*a*b* color space. L*in, a*in, and b*in are calculated according to Equation 3:
Here, f(Yin/Yw) is determined as shown in Equation 4, and f(Xin/Xw) and f(Zin/Zw) are determined in a similar manner.
Xw, Yw, and Zw represent tristimulus values for a Lambertian surface. Further, a*in and b*in are converted into chroma C*in and hue hin by Equation 5:
The lightness L*in, chroma C*in, and hue hin determined are sent to the setting unit 104 as the converted signal 103.
Then, the image quality adjusting unit 105 displays a screen for image quality adjustment on the display screen and the user uses the screen to adjust image quality (S202).
In
In the status shown in
In the charts 402 and 403 for adjusting lightness and chroma respectively, moving the slide bar outward in the radar chart sets a positive amount of adjustment, and moving the slide bar inward in the radar chart sets a negative amount of adjustment. On the chart 403 for hue adjustment, outward movement of the slide bar sets an amount of adjustment such that the hue changes clockwise on the chart 403 and inward movement sets an amount of adjustment such that the hue changes counterclockwise.
Although
By way of example,
The image quality adjusting unit 105 determines the hue chosen by the user and the amount of change in lightness, chroma, or hue in that hue from the amount of adjustment of image quality made by the user using the image quality adjustment screen 302, and sends them to the setting unit 104 as the amount of adjustment 106.
Then, the setting unit 104 sets the amounts of correction 107 for lightness and chroma for the input image on a per-hue basis from the converted signal 103 and the amount of adjustment 106 (S203). Specifically, it first calculates a corrected converted signal in the case that the lightness, chroma, or hue in the converted signal is corrected according to the amount of adjustment 106, for the hue indicated by the amount of adjustment 106.
Hereinbelow, the present embodiment assumes a case where the chroma of the red hue is varied by ΔC*in in the adjustment performed by the user. When a converted signal with the lightness of L*m and chroma of C*in in the red hue is represented as (L*in, C*in, hin(R)), a corrected converted signal corrected with the amount of adjustment 106 (L*in′, C*in′, hin(R)′) is calculated as in Equation 6:
L*
in
′=L*
in
C*
in
′=C*
in
+ΔC*
in
h
in(R)′=hin(R) (6)
The setting unit 104 then calculates perceived brightness for each of the converted signal (L*in, C*in, hin(R)) and the corrected converted signal (L*in′, C*in′, hin(R)′). The perceived brightness is described here. As known as the Helmholtz-Kohlrausch effect, when the lightness is the same, a chromatic color generally appears brighter than an achromatic to human eyes and it is perceived to be brighter as its vividness increases. Based on the Helmholtz-Kohlrausch effect, the embodiment assumes that the brightness B* perceived by human eyes is dependent on the lightness L*, chroma C*, and hue h of a target object, and defined by Equation 7:
B*=L*+(F(h)+k)×C* (7)
In the equation, “F” is a function that outputs different values depending on hue, and “k” is a constant. In accordance with Equation 7, perceived brightness B*in before adjustment for the hue adjusted by the user and perceived brightness B*in′ after adjustment are calculated as in Equation 8:
Further, the ratio P of perceived brightnesses before and after the adjustment for the hue adjusted by the user is calculated for each of lightness and chroma values. The ratio of perceived brightness with the lightness of L*in and chroma of C*in after the user adjustment, P(L*in, C*in, hin(R)), is calculated as in Equation 9:
Further, as shown in Equation 10, the ratio of perceived brightnesses P(L*in, C*in, hin(R)) before and after the adjustment for the hue hin(R) by the user is applied in common to all hues that have equal lightness and chroma. Thus, this ratio is defined as ratio Pmax(L*in, C*in)
P
max(L*in,C*in)=P(L*in,C*in,hin(R)) (10)
In the hue hin(R) for which the user adjusted chroma, the perceived brightness has increased by the ratio Pmax(L*in, C*1n) as the result of the user adjustment. Accordingly, by multiplying the perceived brightness of other hues for which the user did not adjust image quality by the ratio Pmax(L*in, C*in), the ratio of perceived brightness among all hues that have equal lightness and chroma can be kept the same as the ratio before the user adjustment. In other words, variation in the relative relationship of an evaluation value (perceived brightness herein) among hues before and after the adjustment can be kept from varying. The brightness B*out (L*in, C*in, hin) perceived when the perceived brightness B*in(L*in, C*in, hin) with the lightness L*in and chroma C*in in hue hin is multiplied by ratio Pmax(L*in, C*in) is determined according to Equation 11:
B*
out(L*in,C*in,hin)=B*in(L*in,C*in,hin)×Pmax(L*in,C*in) (11)
Further, the difference ΔB*out(L*in, C*in, hin) between the perceived brightnesses B*in(L*in, C*in, hin) and B*out(L*in, C*in, hin) is calculated according to Equation 12:
The difference of perceived brightness ΔB*out(L*in, C*in, hin) may also be approximated by setting the difference in perceived brightness in hue hin(R) before and after the user adjustment determined by Equation 8, as shown in Equation 13. Setting with Equation 13 has an advantage of low computational complexity.
Next, from the difference of perceived brightness ΔB*out(L*in, C*in, hin), the amounts of correction for lightness and chroma are established. For example, when the difference of perceived brightness is corrected entirely with lightness, the amount of lightness correction ΔL*nut and the amount of chroma correction ΔC*nut are determined as shown in Equation 14:
ΔL*out=ΔB*out(L*in,C*in,hin)
ΔC*out=0 (14)
In contrast, when the difference of perceived brightness is corrected entirely with chroma, the amount of lightness correction ΔL*out and the amount of chroma correction ΔC*out are determined as in Equation 15:
It is also possible to divide the amount of correction for perceived brightness between lightness and chroma at a certain ratio as in Equation 16, where “α” is a variable between 0 and 1. The variable “α” may be user-configurable.
The amounts of correction 107 for lightness and chroma are sent to the image quality adjusting unit 105 and the correcting unit 108.
In response to the amounts of image quality correction 107 sent from the setting unit 104, the image quality adjusting unit 105 moves the adjustment slide bars for lightness and chroma of the image quality adjusting unit 105 (S204). More specifically, it converts the amounts of image quality correction 107 into the amounts of slide bar movement, and moves the slide bars by the amounts. Thereby, the amounts of correction 107 for lightness and chroma determined by the setting unit 104 can be visualized.
In response to the chroma adjustment for the red hue performed by the user as shown in
The correcting unit 108 calculates the corrected image signal 109 from the amount of correction 107 and the converted signal 103 and sends it to the displaying unit 110 (S205).
First, from the amount of lightness correction ΔL*out, the amount of chroma correction ΔC*out, and converted signal (L*in, C*in, hin), the corrected converted signal (L*out, C*out, hout) is calculated according to Equation 17:
L*
out
=L*
in
+ΔL*
out
C*
out
=C*
in
+ΔC*
out
h
out
=h
in (17)
Further, C*out and hout are converted to a*out and b*out according to Equation 18:
a*
out
=C*
out×cos(hout)
b*
out
=C*
out×sin(hout) (18)
Further, L*out, a*out, b*out are converted into tristimulus values Xout, Yout, Zout according to Equation 19:
Xout and Zout are calculated in a similar manner to Yout. Here, f(X/Xw), f(Y/Yw), f(Z/Zw) are determined as in Equation 20:
Further, Xout, Yout, Zout are converted into output signals Rout, Gout, Bout in RGB format as shown in Equation 21 according to the color reproduction range of the displaying unit, and the corrected image signal 109 is sent to the displaying unit 110.
where “N” is a 3×3 matrix determined by the color reproduction range of the displaying unit.
Finally, the displaying unit 110 displays the output image signal 110 on the display screen (S206).
As described, in the present embodiment, when the user adjusts lightness, chroma, or hue, lightness and/or chroma of each hue is corrected so that the relative relationship of perceived brightnesses among the hues of the original image is maintained or so that the relative relationship is kept from varying. This enables natural image display that maintains perceived brightnesses among hues while achieving image quality adjustment desired by the user.
A second embodiment will be described. The second embodiment is similar to the first embodiment in overall configuration and different in the adjusting unit. Thus, the adjusting unit will be described in detail.
The second embodiment illustrates a case where the user increases the chroma of all hues at one time using the image quality adjustment screen 901. When the user moves a chroma slide bar 902 for controlling all hues together in increasing direction, the image quality adjusting unit 105 sends an amount of adjustment 106 indicating that the chroma of all hues has increased by the amount specified by the user, to the setting unit 104.
In response to it, the setting unit 104 determines a corrected converted signal in the case that the lightness, chroma, or hue in the converted signal 103 is corrected with the amount of adjustment 106 for all hues. Denoting the amount of chroma adjustment made by the user for all hues as ΔC*in, the corrected converted signal (L*in′, C*in′, hin′) is determined from the converted signal (L*in, C*in, hin) and the amount of adjustment ΔC*in as in Equation 22:
L*
in
′=L*
in
C*
in
′=C*
in
+ΔC*
in
h
in
′=h
in (22)
The perceived brightness B*in(L*in, C*in, hin) before correction with the amount of adjustment 106 in hue hin and the perceived brightness after correction B*in′(L*in, C*in, hin) are determined as in Equation 23:
Further, the ratio P of perceived brightnesses before and after correction with the amount of adjustment 106 in each hue is calculated for each lightness and chroma value. The ratio of perceived brightness P(L*in, C*in, hin) after the user adjustment with the lightness of L*in and chroma of C*in in hue hin are calculated as in Equation 24:
The Helmholtz-Kohlrausch effect acts to varying degrees depending on hue; for example, colors like red and magenta have a greater effect of appearing bright, while yellow and green have a smaller effect of appearing bright. Therefore, the ratio of perceived brightness P(L*in, C*in, hin) assumes different values depending on hue hin. Thus, as shown in Equation 25, the ratio of the hue that has the largest ratio P(L*in, C*in, hin) of perceived brightnesses before and after correction with the amount of adjustment 106 among all hues is defined as the maximum value Pmax(L*in,C*in) of the ratio of perceived brightness for all hues having equal lightness and chroma. Although the maximum value is employed in the illustrated case, the minimum value, or a representative value between the minimum and maximum values, such as a mean value or median, may be adopted.
P
max(L*in,C*in)=max{P(L*in,C*in,hin)} (0≦hin≦2π) (25)
The brightness B*out(L*in, C*in, hin) perceived when the brightness B*in(L*in, C*in, hin) perceived with the lightness L*in, chroma C*in, and hue hin is multiplied by the ratio Pmax(L*in, C*in) is calculated as shown in Equation 26, such that the relative relationship of perceived brightness among hues remains the same before and after the correction with the amount of adjustment 106.
B*
out(L*in,C*in,hin)=B*in(L*in,C*in,hin)×Pmax(L*in,C*in) (26)
The difference ΔB*out(L*in, C*in, hin) between the perceived brightnesses B*in(L*in, C*in, hm) and B*out(L*in, C*in, hin) is calculated as in Equation 27:
Alternatively, ΔB*out(L*in, C*in, hin) may be determined by calculating the difference of perceived brightness ΔB*in(L*in, C*in, hin) before and after the correction with the amount of adjustment 106 according to Equation 28 and defining the maximum difference of perceived brightness ΔB*in(L*in, C*in, hin) among all hues as ΔB*out(L*in, C*in, hin) as shown by Equation 29. Although the maximum value is employed in the illustrated case, the minimum value, or a representative value between the minimum and maximum values, such as a mean value or median, may be adopted.
Further, as in the first embodiment, the amount of lightness correction ΔL*out and the amount of chroma correction ΔC*out are set as the amount of correction 107 based on the difference of perceived brightness ΔB*out(L*in, C*in, hin), and the amount of correction 107 is sent to the adjusting unit 105 and the correcting unit 108. The adjusting unit 105 automatically changes the indication of amount of adjustment on the adjustment screen 302 in accordance with the amount of correction 107. The correcting unit 108 corrects the converted signal 103 in accordance with the amount of correction 107 to obtain the corrected image signal 109, and sends it to the displaying unit 110. The displaying unit 110 displays the corrected image signal 109 on the display screen.
As described, in the present embodiment, when the user adjusts lightness, chroma, or hue, lightness and/or chroma of each hue is corrected so that the relative relationship of perceived brightness among hues of the original image is maintained or so that the relative relationship is kept from varying. This enables image display that maintains perceived brightnesses among hues while achieving image quality adjustment desired by the user.
A third embodiment will be now described. The third embodiment is similar to the second embodiment in overall configuration and different in the adjusting unit. Thus, the adjusting unit will be described in detail.
The third embodiment illustrates a case where the user increases chroma by ΔC*in in the screen 901 for a pixel specified with the pointer 1001. When the user moves the chroma slide bar 902 in increasing direction, the image quality adjusting unit 105 sends an amount of adjustment 106 indicating that the chroma of the hue exhibited by the pixel indicated by the pointer 1001 has increased by the amount specified by the user, to the setting unit 104.
When the hue of the pixel specified by the user with the pointer 1001 is hp, the setting unit 104 converts a converted signal with the lightness L*in, chroma C*in, and hue hp into a corrected converted signal (L*in′, C*in′, hp′) according to the amount of adjustment 106 as in Equation 30:
L*
in
′=L*
in
C*
in
′=C*
in
+ΔC*
in
h
p
′=h
p (30)
The setting unit 104 further calculates perceived brightness for each of the converted signal (L*in, C*in, hp) and the corrected converted signal (L*in′, hp′). The perceived brightness B*in(L*in, C*in, hp) before adjustment of the hue hp exhibited by the pixel specified by the user with the pointer 1001 and the perceived brightness after adjustment B*in′(L*in, C*in, hp) are calculated as in Equation 31:
Further, the ratio P of perceived brightnesses before and after the adjustment of the hue exhibited by the pixel specified by the user with the pointer 1001 is calculated for each of lightness and chroma values. The ratio of perceived brightness P(L*in, C*in, hp) after the user adjustment with the lightness L*in and chroma C*in is calculated as in Equation 32:
Further, as shown in Equation 33, the ratio of perceived brightness P(L*in, C*in, hp) before and after the adjustment of the hue hp exhibited by the pixel specified by the user with the pointer 1001 is defined as the ratio to be applied in common to all hues that have equal lightness and chroma. Thus, this ratio is defined as Pmax(L*in, C*in)
P
max(L*in,C*in)=P(L*in,C*in,hp) (33)
Since the perceived brightness of the pixel specified by the user with the pointer 1001 has increased by the ratio Pmax(L*in, C*in) as a result of the user adjustment, by multiplying the perceived brightness of the other colors by the ratio Pmax(L*in, C*in), the ratio of perceived brightness among all hues that have equal lightness and chroma can be kept the same as before the user adjustment.
The brightness B*out(L*in, C*in, hin) perceived when the perceived brightness B*in(L*in, C*in, hin) with the lightness of L*in and chroma of C*in in hue hin is multiplied by ratio Pmax(L*in, C*in) is calculated as in Equation 34:
B*
out(L*in,C*in,hin)=B*in(L*in,C*in,hin)×Pmax(L*in,C*in) (34)
Further, the difference ΔB*out(L*in, C*in, hin) between the perceived brightnesses B*in(L*in, C*in, hin) and B*out(L*in, C*in, hin) is calculated according to Equation 35:
Alternatively, ΔB*out(L*in, C*in, hin) may be set as the difference in perceived brightness in the hue hp of the pixel specified by the user with the pointer 1001, as shown in Equation 36:
Further, as in the first embodiment, the amount of lightness correction ΔL*out and the amount of chroma correction ΔC*out are set as the amount of correction 107 from the difference of perceived brightness ΔB*out(L*in, C*in, hin), and the amount of correction 107 is sent to the adjusting unit 105 and the correcting unit 108. The adjusting unit 105 automatically changes the indication of amount of adjustment on the adjustment screen 302 in accordance with the amount of correction 107. The correcting unit 108 corrects the converted signal 103 in accordance with the amount of correction 107 to obtain the corrected image signal 109, and sends it to the displaying unit 110. The displaying unit 110 displays the corrected image signal 109 on the display screen.
As described, in the present embodiment, when the user adjusts lightness, chroma, or hue, lightness and/or chroma of each hue is corrected so that the relative relationship of perceived brightnesses among the hues of the original image is maintained or so that the relative relationship is kept from varying. This enables image display that maintains perceived brightnesses among hues while achieving image quality adjustment desired by the user.
A fourth embodiment will be described. The fourth embodiment is similar to the first embodiment in overall configuration and different in the adjusting unit. Thus, the adjusting unit will be described in detail.
The fourth embodiment illustrates a case where the user increases the perceived brightness in the red hue by ΔB*in in the image quality adjustment screen 1101. When the user moves a slide bar 1102 for the perceived brightness of the red hue in increasing direction, the image quality adjusting unit 105 sends an amount of adjustment 106 indicating that the perceived brightness of the red hue has increased by ΔB*in to the setting unit 104. The perceived brightnesses before and after the user's adjustment in terms of lightness L*in and chroma C*in in the red hue are respectively represented as in Equation 37:
B*
in(L*in,C*in,hin(R))=L*in+(F(hin(R))+k)×C*in
B*
in′(L*in,C*in,hin(R))=L*in+(F(hin(R))+k)×C*in+ΔB*in (37)
Further, the ratio P of perceived brightnesses before and after the adjustment of the hue hin(R) by the user is calculated for each of lightness and chroma values. The ratio of perceived brightness P(L*in, C*in, hin(R)) after the user adjustment with the lightness of L*in and chroma of C*in in hue hin(R) are calculated as in Equation 38:
Further, as shown in Equation 39, the ratio of perceived brightness P(L*in, C*in, hin(R)) before and after the adjustment of the hue hin(R) adjusted by the user is defined as the ratio for application in common to all hues that have equal lightness and chroma. Thus, the ratio is defined as Pmax(L*in, C*in):
P
max(L*in,C*in)=P(L*in,C*in,hin(R)) (39)
The perceived brightness of the hue hin(R) has increased by the ratio Pmax(L*in, C*in) as a result of the user adjustment. Thus, by multiplying the perceived brightness of the other hues for which the user does not adjust image quality by the ratio Pmax(L*in, C*in) as shown in Equation 40, the ratio of perceived brightness among all hues having equal lightness and chroma can be kept the same as the ratio before the user adjustment.
The brightness B*out (L*in, C*in, hin) perceived when the perceived brightness B*in(L*in, C*in, hin) with the lightness L*in and chroma C*in in hue hin is multiplied by ratio Pmax(L*in, C*in) is calculated as in Equation 40:
B*
out(L*in,C*in,hin)=B*in(L*in,C*in,hin)×Pmax(L*in,C*in) (40)
Further, the difference ΔB*out(L*in, C*in, hin) between the perceived brightnesses B*in(L*in, C*in, hin) and B*out(L*in, C*in, hin) is calculated according to Equation 41:
Alternatively, the difference in perceived brightness ΔB*out(L*in, C*in, hin) may be set as the difference in perceived brightness in the hue hin(R) adjusted by the user, as shown in Equation 42:
ΔB*out(L*in,C*in,hin)=ΔB*in (42)
Further, as in the first embodiment, the amount of lightness correction ΔL*out and the amount of chroma correction ΔC*out are set as the amount of correction 107 from the difference of perceived brightness ΔB*out(L*in, C*in, hin), and the amount of correction 107 is sent to the adjusting unit 105 and the correcting unit 108. The adjusting unit 105 automatically changes the indication of amount of adjustment on the adjustment screen 302 in accordance with the amount of correction 107. The correcting unit 108 corrects the converted signal 103 in accordance with the amount of correction 107 to obtain the corrected image signal 109, and sends it to the displaying unit 110. The displaying unit 110 displays the corrected image signal 109 on the display screen.
As described, in the present embodiment, when the user adjusts the perceived brightness, lightness and/or chroma of each hue is corrected so that the relative relationship of perceived brightnesses between different hues of the original image is maintained or so that the relative relationship is kept from varying. This enables image display that maintains perceived brightnesses among hues while achieving image quality adjustment desired by the user.
A fifth embodiment will be described. The fifth embodiment is similar to the fourth embodiment in overall configuration and different in the adjusting unit. Thus, the adjusting unit will be described in detail.
The fifth embodiment illustrates a case where the user increase the perceived brightness by ΔB*in of all hues at one time in the image quality adjustment screen 1201. When the user moves a slide bar 1102 for controlling the perceived brightness of all hues together in increasing direction, the image quality adjusting unit 105 sends an amount of adjustment 106 indicating that the perceived brightness of all hues has increased by ΔB*in to the setting unit 104.
The perceived brightnesses before and after the user adjustment in terms of lightness L*in and chroma C*in in hue hin are respectively represented as in Equation 43:
B*
in(L*in,C*in,hin)=L*in+(F(hin)+k)×C*in
B*
in′(L*in,C*in,hin)=L*in+(F(hin)+k)×C*in+ΔB*in (43)
Further, the ratio P of perceived brightnesses of all hues before and after the adjustment is calculated for each of lightness and chroma values. The ratio of perceived brightness P(L*in, C*in, hin) after the user adjustment with the lightness of L*in and chroma of C*in in hue hin is calculated as in Equation 44:
Further, as shown in Equation 45, the ratio of the hue that has the largest ratio P(L*in, C*in, hin) of perceived brightnesses before and after correction of all hues among all hues is defined as the maximum value Pmax(L*in,C*in) of the ratio of perceived brightness for all hues having equal lightness and chroma. Although the maximum value is employed in the illustrated case, the minimum value, or a representative value between the minimum and maximum values, such as a mean value or median, may be adopted.
P
max(L*in,C*in)=max{P(L*in,C*in,hin)} (0≦hin≦2π) (45)
The Helmholtz-Kohlrausch effect acts to varying degrees depending on hue; for example, colors like red and magenta have a greater effect of appearing bright, while yellow and green have a smaller effect of appearing bright. Therefore, the ratio of perceived brightness P(L*in, C*in, hin) assumes different values depending on hue hin, and the maximum ratio among all hues is defined as Pmax(L*in, C*in) The brightness B*out(L*in, C*in, hin) perceived when the brightness B*in(L*in, C*in, hin) perceived with the lightness L*in, chroma C*in in hue hin is multiplied by the ratio Pmax(L*in, C*in) is calculated as shown in Equation 46:
B*
out(L*in,C*in,hin)=B*in(L*in,C*in,hin)×Pmax(L*in,C*in) (46)
Further, the difference ΔB*out(L*in, C*in, hin) between perceived brightnesses B*in(L*in, C*in, hin) and B*out(L*in, C*in, hin) is calculated as in Equation 47:
Alternatively, the difference of perceived brightness ΔB*out(L*in, C*in, hin) may be set to the amount of adjustment of perceived brightness ΔB*1n.
Further, as in the first embodiment, the amount of lightness correction ΔL*out and the amount of chroma correction ΔC*nut are set as the amount of correction 107 from the difference of perceived brightness ΔB*out(L*in, C*in, hin), and the amount of correction 107 is sent to the adjusting unit 105 and the correcting unit 108. The adjusting unit 105 automatically changes the indication of amount of adjustment on the adjustment screen 302 in accordance with the amount of correction 107. The correcting unit 108 corrects the converted signal 103 in accordance with the amount of correction 107 to obtain the corrected image signal 109, and sends it to the displaying unit 110. The displaying unit 110 displays the corrected image signal 109 on the display screen.
As described, in the present embodiment, when the user adjusts the perceived brightness, lightness and/or chroma of each hue is corrected so that the relative relationship of perceived brightnesses among the hues of the original image is maintained or so that the relative relationship is kept from varying. This enables image display that maintains perceived brightnesses among hues while achieving image quality adjustment desired by the user.
A sixth embodiment will be described. The sixth embodiment is similar to the fifth embodiment in overall configuration and different in the adjusting unit. Thus, the adjusting unit will be described in detail.
The sixth embodiment illustrates a case where the user increases the perceived brightness of the pixel specified with the pointer 1301 by ΔB*in in the screen 1201. When the user moves the brightness slide bar in increasing direction, the image quality adjusting unit 105 sends an amount of adjustment 106 indicating that the brightness of the hue exhibited by the pixel indicated by the pointer 1301 has increased by ΔB*in to the setting unit 104.
When the hue of the pixel specified by the user with the pointer 1301 is hp, the setting unit 104 calculates the perceived brightness B*in before adjustment and the perceived brightness after adjustment B*in′ of the converted signal with lightness L*in, chroma C*in, and hue hp, as in Equation 48:
B*
in(L*in,C*in,hp)=L*in+(F(hp)+k)×C*in
B*
in′(L*in,C*in,hp)=L*in′+(F(hp′)+k)×C*in+ΔB*in (48)
Further, the ratio P of perceived brightnesses before and after the adjustment of hue hp represented by the pixel specified by the user with the pointer 1301 is calculated for each of lightness and chroma values. The ratio of perceived brightness P(L*in, C*in, hp) after the user adjustment with the lightness of L*in and chroma of C*in is calculated as in Equation 49:
Further, as shown in Equation 50, the ratio of perceived brightness P(L*in, C*in, hp) before and after the adjustment of the hue hp of the pixel specified by the user with the pointer 1301 is defined as the ratio for application in common to all hues that have equal lightness and chroma. Thus, this ratio is defined as Pmax(L*in, C*in).
P
max(L*in,C*in)=P(L*in,C*in,hp) (50)
Since the perceived brightness of the pixel specified by the user with the pointer 1301 has increased by the ratio Pmax(L*in, C*1n) as a result of the user adjustment, by multiplying the perceived brightness of the other hues by the ratio Pmax(L*in, C*in), the ratio of perceived brightness among all hues having equal lightness and chroma can be kept the same as the ratio before the user performed adjustment.
The brightness B*out(L*in, C*in, hin) perceived when the perceived brightness B*in(L*in, C*in, hin) with the lightness of L*in and chroma of C*in in hue hin is multiplied by ratio Pmax(L*in, C*in) is calculated as in Equation 51:
B*
out(L*in,C*in,hin)=B*in(L*in,C*in,hin)×Pmax(L*in,C*in) (51)
Further, the difference ΔB*out(L*in, C*in, hin) between the perceived brightnesses B*in(L*in, C*in, hin) and B*out(L*in, C*in, hin) is calculated according to Equation 52:
Alternatively, the difference of perceived brightness ΔB*out(L*in, C*in, hin) may be set as the difference in perceived brightness ΔB*in of the pixel specified by the user with the pointer 1301, as shown in Equation 53:
ΔB*out(L*in,C*in,hin)=ΔB*in (53)
Further, as in the first embodiment, the amount of lightness correction ΔL*out and the amount of chroma correction ΔC*out are set as the amount of correction 107 from the difference of perceived brightness ΔB*out(L*in, C*in, hin), and the amount of correction 107 is sent to the adjusting unit 105 and the correcting unit 108. The adjusting unit 105 automatically changes the indication of amount of adjustment on the adjustment screen 302 in accordance with the amount of correction 107. The correcting unit 108 corrects the converted signal 103 in accordance with the amount of correction 107 to obtain the corrected image signal 109, and sends it to the displaying unit 110. The displaying unit 110 displays the corrected image signal 109 on the display screen.
As described, in the present embodiment, when the user adjusts perceived brightness, lightness and/or chroma of each hue is corrected so that the relative relationship of perceived brightnesses among the hues of the original image is maintained or so that the relative relationship is kept from varying. This enables image display with perceived brightnesses among hues maintained while achieving image quality adjustment desired by the user.
A seventh embodiment will be described. As the seventh embodiment is similar to the first embodiment in overall configuration, differences from the first embodiment will be described in detail.
The converting unit 102 receives color gamut information of BT.709, which is the reference color reproduction range, from the color-gamut information holder, and determines tristimulus values (X709, Y709, Z709) converted according to the color reproduction range defined by BT.709 and tristimulus values (Xd, Yd, Zd) converted according to the color reproduction range of the image displaying unit from the input image signal 101, according to Equation 54:
In the equation, “M” represents a 3×3 color conversion matrix depending on the color reproduction range of the image displaying unit, and “L” represents a 3×3 color conversion matrix depending on the color reproduction range defined by ITU-R BT.709. “L” is maintained in the color-gamut information holder 1401. “M” is maintained in the converting unit 102 or a storage accessible to the converting unit 102.
The converting unit further calculates the lightnesses, chromas, and hues in CIEL*a*b* space (L*709, C*709, h709) and (L*d, C*d, hd) respectively from (X709, Y709, Z709) and (Xd, Yd, Zd). As conversion from XYZ tristimulus values to the lightness, chroma, and hue in CIEL*a*b* space is similar to the first embodiment, description of how to calculate them is omitted.
The image quality adjusting unit 105 can adjust the amount of adjustment of lightness, chroma, or hue on a per-hue basis as in the first embodiment, and sends the amount of adjustment 106 made by the user to the setting unit 104. The seventh embodiment illustrates a case where the user adjusts the chroma of the red hue by ΔC*in.
First, the setting unit 104 calculates the perceived brightness of the red hue B*d′ (L*d, C*d, hd(R)) in an image as displayed on the image displaying unit reflecting amount of adjustment ΔC*in, and the perceived brightness in the BT.709 color reproduction range, i.e., the reference color reproduction range, B*709(L*709, C*709, h709(R)), respectively as in Equation 55:
B*
d′(L*d,C*d,hd(R))=L*d+(F(hd(R))+k)×(C*d+ΔC*in)
B*
709(L*709,C*709,h709(R))=L*709+(F(h709(R))+k)×C*709 (55)
The ratio P(L*709, C*709, h709(R)) between the perceived brightness in the reference color gamut BT.709 in the red hue and the perceived brightness on the display screen with the amount of adjustment ΔC*in reflected is represented as Equation 56:
For a given hue h709 other than red whose chroma was adjusted by the user, the ratio P(L*709, C*709, h709) between the perceived brightness in the reference color gamut BT.709 and the perceived brightness on the display screen is represented as in Equation 57:
Then, as shown in Equation 58, the largest ratio P (L*709, C*709, h709) between the perceived brightness in the reference color gamut BT.709 and the perceived brightness on the display screen with the amount of adjustment ΔC*in reflected among all hues including red, for which the user adjusted chroma, is defined as Pmax(L*709, C*709). Although the maximum value is employed in the illustrated case, the minimum value, or a representative value between the minimum and maximum values, such as a mean value or median, may be adopted.
P
max(L*709,C*709=max{P(L*709,C*709,h709)} (0≦h709≦2π) (58)
The brightness B*out(L*709, C*709, h709) perceived when the perceived brightness B*709(L*709, C*709, h709) with lightness L*709 and chroma C*709 in hue h709 by the ratio Pmax(L*709, C*709) is calculated as in Equation 59 such that the relative relationship of perceived brightness among hues is the same between the BT.709 color reproduction range (i.e., the reference color gamut) and the color reproduction range of the display screen reflecting the amount of adjustment ΔC*in:
B*
out(L*709,C*709,h709)=B*709(L*709,C*709,h709)×Pmax(L*709,C*709) (59)
Further, the difference ΔB*out(L*709, C*709, h709) between the perceived brightnesses B*709(L*709, C*709, h709) and B*out(L*709, C*709, h709) is calculated as in Equation 60:
Alternatively, the difference in perceived brightness ΔB*out(L*709, C*709, h709) may be set as the difference in perceived brightness in the hue h709(R) adjusted by the user, as shown in Equation 61:
Further, as in the first embodiment, the amount of lightness correction ΔL*out and the amount of chroma correction ΔC*out are set as the amount of correction 107 from the difference of perceived brightness ΔB*out(L*709, C*709, h709), and the amount of correction 107 is sent to the adjusting unit 105 and the correcting unit 108. The adjusting unit 105 automatically changes the indication of amount of adjustment on the adjustment screen 302 in accordance with the amount of correction 107. The correcting unit 108 corrects (L*709, C*709, h709), representing the converted signal 103, in accordance with the amount of correction 107 to obtain the corrected image signal 109, and sends it to the displaying unit 110. The displaying unit 110 displays the corrected image signal 109 on the display screen.
As described, in the present embodiment, when the user adjusts lightness, chroma, or hue, lightness and/or chroma of each hue is corrected so that the relative relationship of perceived brightnesses among the hues of the original image is maintained or so that the relative relationship is kept from varying. This enables image display that maintains perceived brightnesses among hues while achieving the image quality adjustment desired by the user.
An eighth embodiment will be described.
The converting unit 102 receives color gamut information 1402 of BT.709, which is the reference color reproduction range, from the color-gamut information holder 1401. The converting unit 102 calculates (L*709, C*709, h709) and (L*d, C*d, hd), which are the lightness, chroma, and hue converted in accordance with the BT.709-defined color reproduction range and the color reproduction range of the image displaying unit respectively, from the input image signal 101. The converting unit 102 sends (L*709, C*709, h709) and (L*d, C*d, hd) to the setting unit 104 as the converted signal 103. As conversion to lightness, chroma, and hue is similar to the first embodiment, description of how to calculate them is omitted.
The setting unit 104 first calculates the perceived brightness B*d (L*d, C*d, hd) perceived when the input image signal value (Rin, Gin, Bin) is displayed by the image displaying unit and the perceived brightness B*709(L*709, C*709, h709) in the BT.709 color reproduction range, i.e., the reference color reproduction range, as in Equation 62:
B*
d(L*d,C*d,hd)=L*d+(F(hd)+k)×C*d
B*
709(L*709,C*709,h709)=L*709+(F(h709)+k)×C*709 (62)
The ratio P(L*709, C*709, h709) between the perceived brightness in the reference color gamut BT.709 and the perceived brightness on the display screen is represented as in Equation 63:
Then, as shown in Equation 64, the largest ratio P (L*709, C*709, h709) between the perceived brightness in the reference color gamut BT.709 and the perceived brightness on the display screen among all hues is defined as Pmax(L*709, C*709). Although the maximum value is employed in the illustrated case, the minimum value, or a representative value between the minimum and maximum values, such as a mean value or median, may be adopted.
P
max(L*709,C*709)=max{P(L*709,C*709,h709)} (0≦h709≦2π) (64)
The brightness B*out(L*709, C*709, h709) perceived when the brightness B*709(L*709, C*709, h709) perceived with the lightness L*709, chroma C*709, and hue h709 is multiplied by the ratio Pmax(L*709,C*709) is calculated as shown in Equation 65, such that the relative relationship of perceived brightness among hues is the same in the reference BT.709 color reproduction range and the color reproduction range of the display screen:
B*
out(L*709,C*709,h709)=B*709(L*709,C*709,h709)×Pmax(L*709,C*709) (65)
Further, the difference ΔB*out(L*709, C*709, h709) between the perceived brightnesses B*709(L*709, C*709, h709) and B*out(L*709, C*709, h709) is calculated as in Equation 66:
Alternatively, ΔB*out(L*709, C*709, h709) may be determined by calculating the difference ΔB*709(L*709, C*709, h709) between B*d (L*d, C*d, hd) and B*709(L*709, C*709, h709), which were determined by Equation 62, as shown in Equation 67, and defining the largest difference ΔB*709(L*709,C*709,h709) among all hues as ΔB*out(L*7o9,C*709,h709), as shown by Equation 68. Although the maximum value is employed in the illustrated case, the minimum value, or a representative value between the minimum and maximum values, such as a mean value or median, may be adopted.
Further, as in the first embodiment, the amount of lightness correction ΔL*out and the amount of chroma correction ΔC*out are set as the amount of correction 107 based on the difference of perceived brightness ΔB*out(L*709, C*709, h709), and the amount of correction 107 is sent to the correcting unit 108. The correcting unit 108 corrects (L*709, C*709, h709), representing the converted signal 103, in accordance with the amount of correction 107 to obtain the corrected image signal 109, and sends it to the displaying unit 110. The displaying unit 110 displays the corrected image signal 109 on the display screen.
As described above, according to the eighth embodiment, by correcting the lightness or chroma of each hue so that the relative relationship of perceived brightness among hues in the color reproduction range of the display screen is the same as the relative relationship of perceived brightness among hues in the reference color gamut, it is possible to achieve image display that maintains the relative relationship of perceived brightness among hues of the reference color reproduction range even on a display device having a different color reproduction range.
A ninth embodiment will be described.
In the eighth embodiment, corrected image signal values obtained by applying correction to input image signal values (Rin, Gin, Bin) with the amount of correction 107 ΔB*out(L*709, C*709, h709) for perceived brightness is represented as (Rout, Gout, Bout). In the eighth embodiment, since image quality adjustment by the user is not performed, if reference color gamut information (specifically, transformation matrix M) and color gamut information for the display screen (specifically, transformation matrix L) are known, the amount of brightness correction 107 ΔB*out(L*709, C*709, h709) for the input image signal values (Rin, Gin, Bin) is uniquely determined and further the corrected image signal values (Rout, Gout, Bout) are uniquely determined.
Thus, from the reference color gamut information and color gamut information of the display screen, the corrected image signal values (Rout, Gout, Bout) for the input image signal values (Rin, Gin, Bin) is calculated in advance, and the relationship between (Rin, Gin, Bin) and (Rout, Gout, Bout) is kept in an LUT. By referencing the LUT, the corrected image signal values (Rout, Gout, Bout) are directly calculated from the input image signal value (Rin, Gin, Bin).
Here, corrected image signal values may be calculated for all possible input image signal values (for example, 256×256×256 signal values when RGB subpixels is each represented in 8 bits) and an LUT storing their correspondence may be used to determine the corrected image signal values. Alternatively, an LUT that holds the correspondence between representative values of input image signal values and corresponding corrected image signal values may be prepared, and the final corrected image signal value may be determined by interpolating plural corrected image signal values obtained by reference to the LUT.
As the processing for determining the corrected image signal values from the input image signal values is similar to the eighth embodiment, detailed description of how to calculate corrected image signal values is omitted. The difference of the ninth embodiment from the eighth embodiment is that the corrected image signal values are determined by referencing a prepared LUT contrary to the eighth embodiment which determines the corrected image signal values by calculation.
The correcting unit 108 calculates the corrected image signal 109 from the input image signal 101 with reference to the LUT 1602, and sends it to the displaying unit 110. The displaying unit 110 displays the corrected image signal 109 on the display screen.
As described, according to the ninth embodiment, by maintaining corrected image information with perceived brightness corrected in an LUT in advance in association with an input image, image display is enabled that maintains the relative relationship of perceived brightness among hues of the reference color reproduction range even on a display device having a different color reproduction range without involving complicated processing.
While certain embodiments have been described, these embodiments have been presented by way of example only, and are not intended to limit the scope of the inventions. Indeed, the novel embodiments described herein may be embodied in a variety of other forms; furthermore, various omissions, substitutions and changes in the form of the embodiments described herein may be made without departing from the spirit of the inventions. The accompanying claims and their equivalents are intended to cover such forms or modifications as would fall within the scope and spirit of the inventions.
Number | Date | Country | Kind |
---|---|---|---|
2012-219675 | Oct 2012 | JP | national |