The present invention relates to a color conversion processor and a control method thereof.
Recently, there have been increasing image display devices each provided with a display panel (e.g., liquid crystal panel, plasma display panel, organic EL panel, and so on) having a wider displayable color range (hereinafter also referred to as “color gamut”) than that of conventional display panels. The color gamuts have been defined by various standards; for example, BT2020 and BT709 have been respectively known as a wide color gamut standard and a narrow color gamut standard. When a color signal exceeding the displaying capability of the display panel is inputted, such an image display device attenuates the color signal exceeding the displaying capability and performs color conversion processing for adapting the color signal to the dynamic range of the display panel.
When only some parts of color signal values of RGB color signals exceed the acceptable value and only these parts of the color signal values are clipped within the acceptable value range, a ratio of the RGB color signal values is changed. As a result, the hue of a picture expressed by input RGB color signals and the hue of a picture expressed by output RGB color signals may be different from each other. In order to solve such a problem, a color signal converter of Japanese Patent Laid-Open No. 2008-271248 (PTL 1) performs offset processing using the minimum color signal value detected from the RGB color signal values and gain adjustment using a luminance correction value derived from the RGB color signal values. With such a configuration, the color signal converter of PTL 1 can perform color conversion processing to adapt color signals to the color gamut of a display panel while maintaining the hue and luminance of a picture expressed by input RGB color signals.
However, the color conversion technique disclosed in PTL 1 has a problem of an increase in computation. More specifically, the color conversion processing on input RGB color signals with maintaining the hue and the luminance of the picture expressed by the input RGB color signals additionally involves computation for especially preventing change of the luminance.
The present invention has been made in view of the above problem and has an object to reduce computation for color conversion processing on input RGB color signals with maintaining the hue of a picture expressed by the input RGB color signals.
A color conversion processor of the present invention includes: a conversion unit that converts color data including a plurality of color components, which are displayable in a first color gamut, to corresponding color data in a second color gamut, which is narrower than the first color gamut; a first color correction unit that corrects the converted color data by using a first color correction value; a first derivation unit that derives a first luminance correction value by multiplication using the first color correction value; and a first luminance correction unit that corrects the color data, corrected by the first color correction unit, by using the first luminance correction value.
Further features of the present invention will become apparent from the following description of exemplary embodiments with reference to the attached drawings.
Hereinafter, embodiments of the present invention are described with reference to the drawings. It should be noted that configurations described in the embodiments are only examples and are not intended to limit the range of the present invention to those configurations.
(Configuration Example of Image Signal Converter)
An input image signal 1 is compatible with the HDR standard, for example, and the gamma standard thereof is ST2084 while the color standard thereof is BT2020. On the other hand, an output image signal 4 is compatible with the SDR standard, for example, and the gamma standard thereof is gamma 2.2 while the color standard thereof is BT709. The image signal converter 10 performs conversion processing on both or either of the gamma standard and the color standard of the input image signal 1. Image signals used by the image signal converter 10 are image signals that indicate values of multiple color components (in specific, RGB).
The degamma corrector 100 performs correction of the inverse-gamma properties on the gamma standard of the input image signal 1 and outputs luminance-linear RGB gradation data obtained by the correction as color conversion input data 2 (pre-color-converted data). Here, the term, luminance-linear, means that the relationship between gradation data and luminance expressed by the gradation data is linear. An example in which multiple color components are RGB is described; however, the embodiment is not limited thereto.
The color conversion processor 200 converts the color standard of the luminance-linear color conversion input data 2 from, for example, BT2020 to BT709 and outputs luminance-linear color-converted output data 3 (post-color-converted data) obtained by the conversion. Details of configuration of the color conversion processor 200 is described later.
The gamma corrector 300 corrects the gamma properties of the color-converted output data 3 and outputs an output image signal 4 obtained by the correction. The thus-generated output image signal 4 is outputted to a display device (e.g., display provided with display panel) directly or after being converted into a predetermined digital image transmission format. The input image signal 1, the color conversion input data 2, the color-converted output data 3, and the output image signal 4 are gradation data in which each of the color components R (red), G (green), and B (blue) is expressed by gradation of, for example, 8-bit (0 to 255) width. However, such a bit width depends on the configuration of the image signal converter 10 and the accuracy of computation performed on the color components. Thus, in this specification, the RGB gradation data is expressed by real numbers standardized as 0.0 to 1.0 without considering about the bit width. In the following descriptions, the data of R, and B is collectively referred to as the RGB gradation data or simply as “RGB data (color data).”
(Hardware Configuration Example of Color Conversion Processor)
(Color Conversion Processing Procedure)
Hereinafter, details of the color conversion processing of this embodiment is described with reference to the functional block diagram of
The color conversion input data 2 to be inputted to the color conversion processor 200 is, as described above, the luminance-linear RGB data compatible with the BT2020 standard. On the other hand, the color-converted output data 3 outputted from the color conversion processor 200 is the luminance-linear RGB data compatible with the BT709 standard, on which color conversion is performed by the color conversion processor 200.
In S401, the color conversion unit 211 performs color conversion using matrix computation on the color conversion input data 2 (subscript: data2) and outputs color-converted data obtained by the computation. Note that, because the RGB data will be further changed after S401, the converted data is described as provisional color-converted data 11 (subscript: data11) outputted from the color conversion unit 211. A specific example of a computing equation for obtaining the provisional color-converted data 11 from the color conversion input data 2 is expressed by Equation 1:
For example, when the color conversion input data 2 is the pure color of G (green), Rdata2=0, Gdata2=1.0, and Bdata2=0, and as a result of the computation according to Equation 1, Rdata11=−0.588, Gdata11=1.133, and Bdata11=−0.101 are obtained.
Therefore, in the color gamut conversion of this embodiment, the hue is saved by performing the following computation.
In S402, the minimum value extraction unit 212 extracts the negative minimum color component value from the RGB data of the provisional color-converted data 11 and outputs the minimum value obtained by the extraction as a minimum value 12 (hereinafter referred to as “MINdata12”). For example, when the color conversion input data 2 is the pure color of Rdata11=−0.588 is the negative minimum color component value; thus, MINdata12=−0.588 is extracted as the minimum value 12. This minimum value is varied depending on a value of the provisional color-converted data 11 and is used as a variable in the following computation. When no negative value is in the provisional color-converted data 11, the minimum value 12 is set as MINdata12=0, and processing of S403 to S404 may be skipped.
In S403, the color correction unit 213 uses the minimum value 12 to correct the provisional color-converted data 11. Specifically, the color correction unit 213 performs offset processing on the provisional color-converted data 11 and obtains color-corrected data 13 (subscript: data13) obtained by the offset processing. A specific example of a computing equation for obtaining the color-corrected data 13 from the provisional color-converted data 11 is expressed by Equation 2:
For example, when the color conversion input data 2 is the pure color of G, of the following color-corrected data 13 is obtained by the computation according to Equations 1 and 2. That is, Rdata13=−0.588−(−0.588)=0, Gdata13=1.133−(−0.588)=1.721, and Bdata13=−0.101−(−0.588)=0.487.
As described above, subtraction of the minimum negative value of the RGB data from the provisional color-converted data 11 makes it possible to eliminate the range over on the negative side, which is generated due to the color conversion (S401). This processing can be said as offsetting of the color component values of the RGB data by the same degree of gradation. More specifically, this offset processing corresponds to adding of a white (or gray) shade to all the color component values of the RGB data, and this achieves an effect of desaturation while maintaining the hue of the provisional color-converted data 11. However, it should be noted that, since this offset processing increases the luminance of the picture expressed by the RGB data, it is required to reduce this luminance increase.
In S404, based on the minimum value 12, the luminance correction value derivation unit 214 derives a luminance correction value 14 (ALPHAdata14) corresponding to the color-corrected data 13. Here, calculation for obtaining the luminance correction value 14 is described. First, an example of a computing equation using the minimum value 12 as a correction value for the RGB data that can reduce the luminance increase is expressed by Equation 3:
In Equation 3, Wy is a parameter for the luminance correction and is a value greater than 0. Multiplication of the computing equation expressed by Equation 3 on the RGB data makes it possible to increase the luminance while maintaining the hue. In this embodiment, Wy=1.0. However, as indicated by Equation 3, division is required for deriving the luminance correction value 14. Computational complexity of division is greater than that of addition and subtraction or multiplication. Especially when the configurations of this embodiment are implemented by the electronic circuit, division is likely to make a circuit size large. Thus, this embodiment employs a quadratic function approximation value to simplify the computation according to Equation 3. A specific example of a computing equation for obtaining the quadratic function approximation value is expressed by Equation 4:
ALPHAdata14=(ALPHAa·(−MINdata12)+ALPHAb)·(−MINdata12)+ALPHAc. (Equation 4)
ALPHAa, ALPHAb, and ALPHAc are coefficients used for obtaining the quadratic function approximation value. The coefficients ALPHAa, ALPHAb, and ALPHAc that can be approximated with Equation 4 are adjusted in advance. Equation 4 includes only addition and multiplication. Thus, the computational complexity of Equation 4 is less than that of Equation 3. Here,
In S405, the luminance correction unit 215 obtains luminance-corrected data 15 (subscript: data15) by multiplying the color-corrected data 13 by the luminance correction value 14. A specific example of a computing equation for obtaining the luminance-corrected data 15 is expressed by Equation 5:
For example, when the color conversion input data 2 is the pure color of G, the following luminance-corrected data 15 is obtained by the computation according to Equation 5. That is, Rdata15=0×0.626=0, Gdata15=1.721×0.626=1.077, and Bdata15=0.487×0.626=0.305. Each color component value of the RGB data is multiplied by the luminance correction value 14; however, since any one of these color component values is certainly 0 (in the above, Rdata15=0), color component values except the color component value with the color-corrected data 13 of 0 may be multiplied by the luminance correction value 14.
In S406, the clipping unit 216 clips each color component value of the luminance-corrected data 15 so as to set each color component value to a value equal to or smaller than (or equal to or greater than) a predetermined threshold, and outputs the color-converted output data 3 obtained by the clipping. In this embodiment, in order to eliminate the range over of the luminance-corrected data 15, a value equal to or greater than 1.0 is limited to be 1.0 and a negative value smaller than 0.0 is limited to be 0.0. For example, when the color conversion input data 2 is the pure color of G, the color-converted output data 3 obtained by the clipping is Rdata3=0, Gdata3=1.0, and Bdata3=0.305.
(Properties of Color Conversion Processing)
Next, color change and luminance change in this embodiment are described.
Meanwhile, for the color component values (RGB values), when the luminance of the color conversion input data 2 is calculated based on the Y value of the tristimulus values (XYZ), 0×0.263+1.0×0.678+0×0.060=0.678 is obtained. On the other hand, for the color component values (RGB values), when the luminance of the color-converted output data 3 is calculated based on the Y value of the tristimulus values (XYZ), 0×0.213+1.0×0.715+0.305×0.072=0.737 is obtained. As it can be seen, the color conversion processing of this embodiment has properties that the luminance is increased according to the amount of movement of the chromaticity point indicated by the color conversion input data 2 toward the chromaticity point indicated by the color-converted output data 3. Such properties can be adjusted using Wy (parameter of luminance correction).
As described above, the color conversion processor of this embodiment derives the luminance correction value 14 on which the function approximation is performed using the minimum value 12 as the variable, and uses the derived luminance correction value 14 to correct the color-corrected data 13. Thus, the color conversion processor of this embodiment can reduce the computation for the color conversion processing is performed on the color conversion input data 2 with maintaining the hue of the picture expressed by the color conversion input data 2.
In this embodiment, an example in which the linear function approximation is applied for simplifying the computation according to Equation 4 in the luminance correction value derivation (S404) is described. Descriptions of the parts common to Embodiment 1 are simplified or omitted, and unique points of this embodiment are mainly described below.
In this embodiment, a specific example of a computing equation for obtaining a linear function approximation value is expressed by Equation 6:
ALPHAdata14=ALPHAa·(−MINdata12)+ALPHAb. (Equation 6)
ALPHAa and ALPHAb are coefficients used for obtaining the linear function approximation value.
A linear function approximation value A is for a case in which the linear function approximation is performed such that the entire region of ALPHAdata14 is approximated with the theoretical value, and the coefficients in this case are ALPHAa=0.65 and ALPHAb=1.0. A linear function approximation value B is for a case in which the linear function approximation is performed such that ALPHAdata14 is approximated with the theoretical value around MINdata12 of 0, and the coefficients in this case are ALPHAa=0.8 and ALPHAb=1.0. When the color component value to be limited is small in the clipping of the color conversion input data 2, the value of MINdata12 is a value close to 0, and this improves the approximation accuracy. A linear function approximation value C is for a case in which the approximation coefficients are varied in corresponding sections of MINdata12, and this achieves approximation using a combination of multiple linear functions. In this case, in a section where MINdata12 is (−0.3<MINdata12≤0), the coefficients are ALPHAa=0.85 and ALPHAb=1.0. In a section where MINdata12 is (MINdata12≤0.3), the coefficients are ALPHAa=0.4 and ALPHAb=0.87. As it can be seen, even when obtaining the linear function approximation value, the combination of multiple linear functions improves the accuracy of approximation with the theoretical values in the entire region of ALPHAdata14. However, when the linear function approximation value C is applied, the amount of conditional branching and coefficient data is increased; thus, the computation cost is higher than the case of applying the linear function approximation value A or B.
As described above, the color conversion processor of this embodiment derives the luminance correction value 14 using the linear function. Thus, in addition to the effects of the above embodiment, the color conversion processor of this embodiment can further reduce computational complexity and can also adjust the balance between the accuracy of the luminance correction value 14 (that is, accuracy of the color conversion processing) and the computation cost.
In this embodiment, an example in which a color matching capability is adjusted by revising the value of the minimum value 12. Descriptions of the parts common to Embodiment 1 are simplified or omitted, and unique points of this embodiment are mainly described below.
In S402, the minimum value extraction unit 212 extracts the negative minimum color component value from the RGB data in the provisional color-converted data 11. Then, the minimum value extraction unit 212 multiplies the extracted minimum value by minimum value gain and outputs the value obtained by the multiplication as the minimum value 12. For example, when the color conversion input data 2 is the pure color of G and the minimum value gain is 0.5, MINdata12=−0.588×0.5=−0.294. If no negative value is in the provisional color-converted data 11, the minimum value 12 is set as MINdata12=0, and processing of S403 to S404 may be skipped.
When the minimum value gain is 0.5, the color-corrected data 13, the luminance correction value 14, the luminance-corrected data 15, and the color-converted output data 3 are set as the following.
The color-corrected data 13 is Rdata13=−0.588−(−0.294)=−0.294, Gdata13=1.133−(−0.294)=1.427, and Bdata13=−0.101+−(−0.294)=0.193.
The luminance correction value 14 is ALPHAdata14=(0.45×(−0.294)+0.9)×(−0.294)+1.0=0.774.
The luminance-corrected data 15 is Rdata15=−0.294×0.774=−0.228, Gdata15=1.427×0.774=1.104, and Bdata15=0.193×0.774=0.149.
The color-converted output data 3 is Rdata3=0, Gdata3=1.0, and Bdata3=0.149.
(Properties of Color Conversion Processing)
Next, color change in this embodiment is described.
The color conversion processing of Embodiment 1 is a use case when the minimum value gain is 1.0. In this case, the chromaticity point indicated by the luminance-corrected data 15 (triangle in the drawing) is moved to be close to the interunit point of the line connecting the chromaticity point indicated by the color conversion input data 2 and the white point (cross in the drawing) and the outermost shell of the BT709 color gamut. When the minimum value gain is greater than 1.0, the chromaticity point indicated by the luminance-corrected data 15 (triangle in the drawing) is positioned within the BT709 color gamut and is moved closer to the white point (cross in the drawing) as the value of the minimum value gain is greater. When the minimum value gain is smaller than 1.0, the chromaticity point indicated by the luminance-corrected data 15 (triangle in the drawing) is positioned outside the BT709 color gamut and is moved closer to the chromaticity point of the color conversion input data 2 (circle in the drawing) as the value of the minimum value gain is smaller.
As describe above, the color conversion processor of this embodiment can adjust the minimum value 12 with the minimum value gain. Thus, in addition to the effect of the above embodiment, the color conversion processor of this embodiment can adjust the hue (i.e., color matching capability) of the picture expressed by the color-converted output data 3.
Since the hue is not maintained before and after the clipping processing, the chromaticity point of the color-converted output data 3 illustrated in
In this embodiment, an example in which the color conversion processing is performed to the color conversion input data 2 while taking into consideration gain that is already applied. Descriptions of the parts common to Embodiment 1 are simplified or omitted, and unique points of this embodiment are mainly described below.
As already described in Embodiment 1, the luminance and the gradation of the color conversion input data 2 and the provisional color-converted data 11 have the linear relationship, and there may be a case in which the gain is applied to such gradation data. For example, it may be a case in which gradation data having RGB multiplied by the common constant is inputted for preventing generation of quantized noises in the image expressed by the gradation data. When the image processing is performed by inputting the gradation data like the image signal conversion in this embodiment, the fact that the inputted gradation data is already multiplied by the gain has to be considered.
A specific example of a computing equation for obtaining the luminance correction value 14 based on the minimum value 12 and the input data gain 5 is described below. For example, the luminance correction value derivation unit 214 multiplies the minimum value 12 by a reciprocal number of the input data gain 5 and further performs computation according to Equation 4 and the like on the value obtained by the multiplication to derive the luminance correction value 14. When the input data gain 5 is GAINdata5=2, MINdata12=−0.588×(½)=−0.294 is obtained. In this embodiment, the luminance correction value 14 is derived by further applying −0.294, which is obtained by the above computation, to the computation according to Equation 4.
As described above, the color conversion processor of this embodiment derives the luminance correction value 14 based on the minimum value 12 and the input data gain 5. Thus, in addition to the effects of the above embodiment, the color conversion processor of this embodiment can perform the color conversion processing while taking into consideration the gain that is already applied to the color conversion input data 2.
The configurations described in the above embodiments are only examples, and various modifications may be considered. For example, the color conversion input data 2 is compatible with the BT2020 and the color-converted output data 3 is compatible with the BT709; however, the color gamut standard is not limited thereto and it may be AdobeRGB, BT601, and so on. It should be noted that, in order to obtain the effects of the color conversion processing of this embodiment, the color gamut of the color gamut standard of the color conversion input data 2 has to be wider than the color gamut of the color gamut standard of the color-converted output data 3.
In the above embodiments, the minimum value 12 of the provisional color-converted data 11 is referred in the computation process for obtaining the luminance correction value 14 and the luminance-corrected data 15. However, when the color expressed by the input image signal is limited or when the accuracy of the color expressed by the output image signal can be allowed for a certain degree, the luminance correction value derivation (S404) and the luminance correction (S405) may be performed with reference to a predetermined value (fixed value) that is determined in advance.
The luminance correction value 14 is not necessarily be calculated using Equation 4 and the like, and processing corresponding to Equation 3 may be achieved by table reference and the like. In addition, a function for deriving the luminance correction value 14 may be a high-dimensional function other than the above-described linear and quadratic functions. In a color conversion processor having the same configuration as the above embodiments, it is possible to adjust the color matching properties by varying the matrix value used in the color conversion (S401).
In the above embodiments, only the clipping is performed on the color component value of the provisional color-converted data 11 exceeding 1.0 (when range over occurs in positive side); however, processing similar to that for the negative side case may be performed for the case of range over in the positive side. In this case, the color conversion processor 200 includes a maximum value extraction unit that extracts the maximum value from the luminance-corrected data 15, a second color correction unit that performs color correction processing using the maximum value, and a second luminance correction value derivation unit that derives a second luminance correction value to which the function approximation is performed with the maximum value as the variable. The color conversion processor 200 in this modification further includes a second luminance correction unit that performs the luminance correction processing based on second color-corrected data corrected by the second color correction unit and the second luminance correction value. Any of the maximum value extraction unit, the second color correction unit, the second luminance correction value derivation unit, and the second luminance correction unit is not illustrated.
In addition, in the above embodiments, various configurations may be appropriately combined with each other.
Embodiment(s) of the present invention can also be realized by a computer of a system or apparatus that reads out and executes computer executable instructions (e.g., one or more programs) recorded on a storage medium (which may also be referred to more fully as a ‘non-transitory computer-readable storage medium’) to perform the functions of one or more of the above-described embodiment(s) and/or that includes one or more circuits (e.g., application specific integrated circuit (ASIC)) for performing the functions of one or more of the above-described embodiment(s), and by a method performed by the computer of the system or apparatus by, for example, reading out and executing the computer executable instructions from the storage medium to perform the functions of one or more of the above-described embodiment(s) and/or controlling the one or more circuits to perform the functions of one or more of the above-described embodiment(s). The computer may comprise one or more processors (e.g., central processing unit (CPU), micro processing unit (MPU)) and may include a network of separate computers or separate processors to read out and execute the computer executable instructions. The computer executable instructions may be provided to the computer, for example, from a network or the storage medium. The storage medium may include, for example, one or more of a hard disk, a random-access memory (RAM), a read only memory (ROM), a storage of distributed computing systems, an optical disk (such as a compact disc (CD), digital versatile disc (DVD), or Blu-ray Disc (BD)™), a flash memory device, a memory card, and the like.
The color conversion processor of the present invention can reduce computation for color conversion processing on input RGB color signals with maintaining the hue of a picture expressed by the input RGB color signals.
While the present invention has been described with reference to exemplary embodiments, it is to be understood that the invention is not limited to the disclosed exemplary embodiments. The scope of the following claims is to be accorded the broadest interpretation so as to encompass all such modifications and equivalent structures and functions.
This application claims the benefit of Japanese Patent Applications No. 2018-004340, filed Jan. 15, 2018, and No. 2018-241351, filed Dec. 25, 2018, which are hereby incorporated by reference wherein in their entirety.
Number | Date | Country | Kind |
---|---|---|---|
JP2018-004340 | Jan 2018 | JP | national |
JP2018-241351 | Dec 2018 | JP | national |
Number | Name | Date | Kind |
---|---|---|---|
20030020974 | Matsushima | Jan 2003 | A1 |
20070013622 | Stoops | Jan 2007 | A1 |
20070171421 | Ochi | Jul 2007 | A1 |
20080068405 | Kumakura | Mar 2008 | A1 |
20090304274 | Yoshii | Dec 2009 | A1 |
20110293147 | Utsumi | Dec 2011 | A1 |
20140218386 | Tatsuno | Aug 2014 | A1 |
20180205919 | Nakagawa | Jul 2018 | A1 |
Number | Date | Country |
---|---|---|
2006148605 | Jun 2006 | JP |
2008271248 | Nov 2008 | JP |
Entry |
---|
Aihara, JP-2006148605-A English Translation, pp. 1-8 (Year: 2006). |
Number | Date | Country | |
---|---|---|---|
20190221188 A1 | Jul 2019 | US |