Patent Grant
10089913
The present invention relates to a picture conversion method for, when displaying a picture obtained from identical video data on a display device at different display luminances, converting the picture so that the appearances of the picture visually come close to each other, a picture conversion device, a computer program for picture conversion, and a picture display system. In the present specification, the term “picture” includes both a moving picture and a still picture.
There are cases in which a display device is installed outdoors and an advertisement or the like is displayed on the display device. A display device used for such a purpose typically displays a picture at a high display luminance so that high viewability is obtained even outdoors. A picture displayed on such a display device is typically created using a display device that is installed indoors and has a low display luminance. Hereafter, a display device used to create a picture is referred to as a “creation display device,” and a display device that displays a picture created using a creation display device, at a high display luminance is referred to as a “showing display device.”
When a picture created using a creation display device was displayed on a showing display device, the inventors found: although the same video data was used and the gammas of the two display devices were the same, the “appearance” was not reproduced as intended by the creator; and, for example, a picture that was mostly blackish and had a calm atmosphere, as shown in
If the display luminances of a creation display device and a showing display device are the same, the appearance can be reproduced. However, the creation display device may have difficulty in exhibiting a high display luminance, or the creator may have difficulty in knowing the display luminance of the showing display device when creating a picture. For this reason, it is difficult to make the display luminances of these display devices the same.
The present invention has been made in view of the foregoing, an object of the present invention is to provide a picture conversion method that when displaying a picture obtained from identical video data on a display device at different display luminances, can convert the picture so that the appearances of the picture visually come close to each other.
The present invention provides a picture conversion method for, when displaying a picture obtained from identical video data on a display device at different display luminances, converting the picture so that appearances of the picture visually come close to each other. The method includes a step of converting the picture by setting gradation characteristics when displaying the picture at a second luminance, so that an inter-close gradation JND corresponding value difference at the second display luminance comes close to an inter-close gradation JND corresponding value difference at a first display luminance in a target gradation range which is at least part of an entire gradation range.
The present inventors investigated the cause of the different “appearances” and then found that even when the two display devices had the same gamma, the difference between adjacent (or close) JND indices (the inter-adjacent (close) gradation JND index difference) significantly varied between these display devices, particularly at low gradations, as shown in
The present inventors then set gradation characteristics when showing a picture on the showing display device, using video data of a picture created using the creation display device so that the inter-adjacent gradation JND index difference of the showing display device came close to the inter-adjacent gradation JND index difference of the creation display device. Then, as shown in
Further, the present inventors found that when the display luminances during creation and during showing on the same display device were different, a similar problem occurred and that this problem could be solved using a similar method.
While a JND index conforming to the DICOM standard is based on the Barten Model for visual recognition, data that is derived using a method other than the Barten Model and corresponds to the minimum luminance difference recognizable by an observer may be used in place of a JND index. Hereafter, a JND index difference based on the Barten Model employed in the DICOM standard or a data difference that is derived using a method other than the Barten Model and corresponds to a minimum luminance difference recognizable by an observer is referred to as a “JND corresponding value difference.”
The present inventors found that according to the method of the present invention, when displaying a picture obtained from identical video data on display devices at different display luminances, the picture could be converted so that appearances of the picture visually came close to each other, and then completed the present invention.
Various embodiments of the present invention are illustrated below. Any of the embodiments below can be combined with each other.
Preferably, the gradation characteristics are set in such a manner that the inter-close gradation JND corresponding value difference at the second display luminance is a value obtained by multiplying the inter-close gradation JND corresponding value difference at the first display luminance by a correction factor.
Preferably, the target gradation range includes a gradation range of 12.5% or less of a maximum gradation.
Preferably, the inter-close gradation JND corresponding value difference is an inter-adjacent gradation JND corresponding value difference.
Preferably, the second display luminance is higher than the first display luminance.
Preferably, the correction factor is calculated by dividing an inter-distant gradation JND corresponding value difference at the second display luminance by an inter-distant gradation JND corresponding value difference at the first display luminance.
Preferably, the inter-distant gradation JND corresponding value difference is calculated by subtracting a JND corresponding value at a minimum gradation from a JND corresponding value at a maximum gradation.
Preferably, the inter-close gradation JND corresponding value difference is an inter-close gradation JND index difference.
Preferably, the gradation characteristics are set by changing a luminance gradation value of the video data.
Preferably, the gradation characteristics are set by changing a luminance gradation value of an illumination light component of the video data.
Preferably, the display device includes a first display device that displays the picture at the first display luminance and a second display device that displays the picture at the second display luminance.
Another aspect of the present invention provides a picture conversion device for, when displaying a picture obtained from identical video data on a display device at different display luminances, converting the picture so that appearances of the picture visually come close to each other. The device includes a controller configured to perform control to convert the picture by setting gradation characteristics when displaying the picture at a second luminance, so that an inter-close gradation JND corresponding value difference at the second display luminance comes close to an inter-close gradation JND corresponding value difference at a first display luminance in a target gradation range which is at least part of an entire gradation range.
Yet another aspect of the present invention provides a computer program for, when displaying a picture obtained from identical video data on a display device at different display luminances, converting the picture so that appearances of the picture visually come close to each other. The computer program causes a computer to perform a step of converting the picture by setting gradation characteristics when displaying the picture at a second luminance, so that an inter-close gradation JND corresponding value difference at the second display luminance comes close to an inter-close gradation JND corresponding value difference at a first display luminance in a target gradation range which is at least part of an entire gradation range.
Still yet another aspect of the present invention provides a picture display system for, when displaying a picture obtained from identical video data on a display device at different display luminances, displaying the picture so that appearances of the picture visually come close to each other. The system includes a controller configured to perform control to display the picture on the display device by setting gradation characteristics when displaying the picture at a second luminance, so that an inter-close gradation JND corresponding value difference at the second display luminance comes close to an inter-close gradation JND corresponding value difference at a first display luminance in a target gradation range which is at least part of an entire gradation range.
Preferably, the controller is included in the display device.
Preferably, the controller is included in a picture conversion device disposed separately of the display device.
Now, embodiments of the present invention will be described. Features described in the embodiments below can be combined with each other. Elements or the like that are not described in second or later embodiments are similar to those described in a first embodiment. In the embodiments below, a JND index difference will be used as a JND corresponding value difference. However, the embodiments can also be applied to cases in which a JND corresponding value difference other than a JND index difference is used.
1. First Embodiment
The display devices 3a, 3b include liquid crystal panels 9a, 9b, picture processing circuits 11a, 11b, backlights 13a, 13b, backlight control circuits 15a, 15b, controllers 17a, 17b, and storage 19a, 19b, respectively. Hereafter, reference signs a, b will be omitted where differentiation is not necessary.
The picture processing circuit 11 converts video data (a picture signal) received from outside into a signal most suitable for the liquid crystal panel 9 and outputs the signal as a liquid crystal panel picture signal. The backlight control circuit 15 applies a backlight drive voltage to the backlight 13 and outputs a current to be passed through the backlight 13, in accordance with a backlight control signal received from the controller 17. In PWM dimming, a backlight control signal is a signal that controls the duty ratio for turning on or off the current passing through the backlight 13. In DC dimming, a backlight control signal is a signal that controls the amount of the current passing through the backlight 13. The backlight 13 is driven by the backlight drive current outputted from the backlight control circuit 15 and thus outputs visible light. The user can adjust the luminance of the backlight 13 by operating a luminance setting value operation unit (not shown) to set a luminance setting value and then causing the backlight control circuit 15 to adjust the output current in accordance with the luminance setting value. The liquid crystal panel 9 displays a picture on the basis of the liquid crystal panel picture signal received from the picture processing circuit 11 and the visible light outputted by the backlight 13. The controller 17 consists of a CPU and memories and controls the entire display device 3. The operation of the controller 17 is stored in the storage 19 in the form of a program, and predetermined processing is performed when the CPU reads and executes this program. A luminance measurement device 21 is disposed adjacent to the liquid crystal panel 9 so that it can measure the luminance of screen light outputted from the liquid crystal panel 9.
The creation display device 3a is a display device used to create pictures, whereas the showing display device 3b is a display device for showing the pictures created using the creation display device 3a to many people. Typically, the display luminance (the luminance at the maximum gradation) of the creation display device 3a is lower than that of the showing display device 3b. For this reason, when the same video data is inputted to the picture processing circuits 11a, 11b and then pictures obtained from the video data are displayed on the liquid crystal panels 9a, 9b, the pictures show different appearances. In the present embodiment, gradation characteristics are set using a method described below so that the appearances come close to each other.
The picture conversion device 25 is, for example, a computer having a predetermined computer program installed therein. It includes a controller 26, a storage 27, data output units 29a, 29b, a JND operation unit 31, and an output adjustment unit 33. These components can communicate with each other. The controller 26 consists of a CPU and memories and controls the entire picture conversion device 25. The operation of the controller 26 is stored in the storage 27 in the form of a program, and predetermined processing is performed when the CPU reads and executes this program. The storage 27 stores video data for pictures to be displayed on the liquid crystal panel 9. The data output unit 29 outputs the video data for the pictures to be displayed on the liquid crystal panel 9, to the display device 3. Instead of outputting the video data stored in the storage 27, the data output unit 29 may output video data inputted from outside to the picture conversion device 25. Also, instead of the data output unit 29, another device may output video data to the display device 3. The JND operation unit 31 creates a target JND table indicating target JND indices corresponding to the respective gradations on the basis of the luminance of screen light at a predetermined gradation obtained from the luminance measurement device 21. The output adjustment unit 33 creates a target output value table indicating target output values corresponding to the gradations on the basis of the target JND table and then outputs the target output value table to the controller 17b of the showing display device 3b.
Referring now to a flowchart in
In step S1, as shown in column (1) of Table 1, the JND operation unit 31 measures luminances corresponding to the gradations of the creation display device 3a at a particular display luminance using the luminance measuring device 21a. Specifically, the data output unit 29a sequentially outputs pictures indicating gradations 0 to255, and the JND operation unit 31 measures the luminances of the pictures of the gradations displayed on the liquid crystal panel 9a using the luminance measuring device 21a. The luminance at the maximum gradation (gradation 255) is the display luminance of the creation display device 3a and is about 80 cd/m2. Even at gradation 0, the luminance is not 0 due to leak light. As shown in
In step S2, as shown in column (2) of Table 1, the JND operation unit 31 calculates the JND indices of the gradations of the creation display device 3a. A luminance L is converted into a JND index j(L) on the basis of a conversion formula (1) below defined in the DICOM standard.
[Formula 1]
LUMINANCE→JND INDEX
j(L)=A+B·Log10(L)+C·(Log10(L))2+D·(Log10(L))3+E·(Log10(L))4+F·(Log10(L))5+G·(Log10(L))6+H·(Log10(L))7+I·(Log10(L))8 (1)
In step S3, as shown in column (3) of Table 1, the JND operation unit 31 calculates the inter-adjacent gradation JND index differences of the creation display device 3a. For example, the inter-adjacent gradation JND index difference of gradation 1 is calculated by subtracting the JND index (13.05) of gradation 0 from the JND index (15.74) of gradation 1.
In step S4, as shown in column (4) of Table 2, the JND operation unit 31 measures luminances corresponding to the gradations of the showing display device 3b at a particular display luminance using the measuring device 21b. Specifically, the data output unit 29b sequentially outputs pictures indicating gradations 0 to 255, and the JND operation unit 31 measures the luminances of the pictures of the gradations displayed on the liquid crystal panel 9b using the luminance measuring device 21b. The luminance at the maximum gradation (gradation 255) is the display luminance of the showing display device 3b and is about 400 cd/m2. Even at gradation 0, the luminance is not 0 for leak light. As shown in
In step S5, as shown in column (5) of Table 2, the JND operation unit 31 calculates the JND indices of the maximum gradation (gradation 255) and minimum gradation (gradation 0) of the showing display device 3b. The luminance L is converted into the JND index j(L) on the basis of the conversion formula (1) above. Note that column (5) of Table 2 also shows the calculation results of the JND indices of gradations 1 to 5 for reference.
In step S6, the JND operation unit 31 calculates a correction factor C. The correction factor C is calculated by dividing the inter-distant gradation JND index difference of the showing display device 3b by the inter-distant gradation JND index difference of the creation display device 3a. The inter-distant gradation JND index difference is the difference in JND index between distant gradations (preferably, gradations distant by 50% or more in the entire gradation range; more preferably, gradations distant by 75% or more in the entire gradation range). Preferably, the inter-distant gradation JND index difference is a value calculated by subtracting the JND index at the minimum gradation from the JND index at the maximum gradation. In this case, the correction factor C is calculated as (672.80−38.87)/(447.61−13.05)≈1.46. Note that the correction factor C may be determined using a method other than the method presented here. One such method involves changing the correction factor C while actually seeing pictures displayed on the display devices 3a, 3b and then using a value at which the appearances of these pictures come close to each other. The correction factor C need not be constant in the entire gradation range, and different correction factors C may be set for different gradation ranges. For example, a correction factor C of 1.2 is set for a gradation range of 0 to 25% in the entire gradation range; a correction factor C of 1.3 is set for a gradation range of 25 to 50%; and a correction factor C of 1.4 is set for a gradation range of 50 to 100%. As seen above, the correction factor C may be reduced as the gradation is reduced. Such settings of the correction factor C is particularly effective in improving the appearance, since the inter-adjacent gradation JND index differences of the display devices 3a, 3b in lower gradation ranges come close to each other. Also, there may be a gradation range in which the correction factor C is 1. In such a gradation range, the inter-adjacent gradation JND index differences of the display devices 3a, 3b are equal.
In step S7, as shown in column (7) of Table 2, the JND operation unit 31 calculates the inter-target adjacent gradation JND index difference. The inter-target adjacent gradation JND index difference is calculated by multiplying the inter-adjacent gradation JND index difference of the creation display device 3a by the correction factor C.
In step S8, the JND operation unit 31 calculates the target JND indices of the respective gradations of the showing display device 3b, as shown in column (8) of Table 2, and creates a target JND table indicating the target JND indices corresponding to the gradations. The target JND indices may be calculated by subtracting each inter-target adjacent gradation JND index difference from the JND index (672.80) at the maximum gradation.
In step S9, the output adjustment unit 33 converts the JND indices of the gradations in the target JND table into luminances, as shown in column (9) of Table 2, and creates a target luminance table indicating the target luminances of the gradations of the showing display device 3b. A JND index j is converted into a luminance L(j) on the basis of a conversion formula (2) below defined in the DICOM standard.
In step S10, the output adjustment unit 33 converts the luminances of the gradations in the target luminance table into target output values, creates a target output value table indicating the target output values of the gradations of the showing display device 3b, and outputs the table to the controller 17b of the showing display device 3b. The controller 17b changes a lookup table (LUT; a table indicating the output signal values corresponding to the gradations) included in the showing display device 3b using the target output value table. In this way, the gradation characteristics of the showing display device 3b are changed so that the appearance of the picture displayed on the showing display device 3b comes close to the appearance of the picture displayed on the creation display device 3a.
By changing the LUT, the output luminance values corresponding to the gradations are changed. As a result, as shown in
As the graphs indicating the gradation versus inter-adjacent gradation JND index difference of the creation display device 3a and showing display device 3b, as shown in
As shown in
As seen above, in the present embodiment, the picture displayed on the showing display device 3b can be converted by changing the output luminance values corresponding to the gradations of the showing display device 3b.
One of the advantages of the picture conversion method of the present embodiment is that there is no need to use a special display device, such as a display device conforming to the DICOM standard, as the creation display device 3a, but rather a common display device commercially available as a monitor for PCs can be used. A display device conforming to the DICOM standard has a constant inter-adjacent gradation JND index difference in the entire gradation range, and a graph indicating the gradation versus inter-adjacent gradation JND index difference thereof is as shown in
The present invention may be carried out in the following aspects.
In the above embodiment, the controller 17b changes the LUT on the basis of the target output value table outputted by the output adjustment unit 33. Alternatively, the LUT may be changed as follows: the output adjustment unit 33 outputs the target luminance table indicating the target luminances of the gradations of the showing display device 3b, and the controller 17b changes the LUT by performing calibration on the basis of the target luminance table.
In the above embodiment, the gradation characteristics of the showing display device 3b are set by using the same correction factor C in the entire gradation range. However, depending on a picture to be displayed, particular importance may be given to the appearance of the picture at a low gradation range. Specifically, as shown in
In the above embodiment, the inter-adjacent gradation JND index differences of the display devices 3a, 3b are calculated, and gradation characteristics are set so that the inter-adjacent gradation JND index differences come close to each other. Alternatively, the following method may be used: the difference in JND index between close gradations (the inter-close gradation JND index difference) of each of the display devices 3a, 3b is calculated, and gradation characteristics are set so that the inter-close gradation JND index differences come close to each other. Even in this case, the appearances of pictures displayed on the display devices 3a, 3b can be brought close to each other, although the accuracy is reduced. As used herein, the term “close gradations” means, for example, gradations having a difference of 5 or less, preferably 3 or less, more preferably 2 or less.
While, in the above embodiment, the creation display device 3a and showing display device 3b are different display devices, a single display device may be used for both production and showing by changing the display luminance. Specifically, a certain display device may be used as the creation display device 3a by setting the display luminance to, for example, 80 cd/m2, as well as may be used as the showing display device 3b by setting the display luminance to, for example, 400 cd/m2. This usage also has a problem similar to that when the creation display device 3a and showing display device 3b are different display devices, but this problem can also be solved by the picture conversion method of the present invention.
In the above embodiment, the luminances corresponding to the respective gradations are actually measured. Instead of actually measuring the luminances, the following method may be used: the luminances of gradations including the minimum gradation are calculated from a luminance setting value (e.g., 400 cd/m2), a contract value (e.g., 1000:1), and a set gamma value (e.g., 2.2); and JND indices are obtained from the calculated luminances. By using such a method, the system can be simplified, although the accuracy is reduced. If the luminance setting value is provided in the form of a relative value (80%, etc.), the luminance setting value may be estimated from the maximum luminance in the specification. The contract value may also be a specification value.
While, in the above embodiment, the display devices using the liquid crystal panels are used, display devices including another type of display panels such as organic EL panels, or projection-display devices such as projectors may be used. Also, the creation display device and showing display device may be different types of display devices.
In the above embodiment, the inter-target adjacent gradation JND index difference is calculated by multiplying the inter-adjacent gradation JND index difference of the creation display device 3a by the correction factor C and thus the inter-adjacent gradation JND index difference of the showing display device 3b is brought close to the inter-adjacent gradation JND index difference of the creation display device 3a. However, other methods may be used to bring the inter-adjacent gradation JND index difference of the showing display device 3b close to the inter-adjacent gradation JND index difference of the creation display device 3a. For example, the following method may be used: instead of using the correction factor C, a correction function F (gradation) having a gradation as an argument is set; and the inter-target adjacent gradation JND index difference is calculated by multiplying the inter-adjacent gradation JND index difference of the creation display device 3a by the correction function F (gradation). In this case, bringing the inter-adjacent gradation JND index difference of the showing display device 3b close to the inter-adjacent gradation JND index difference of the creation display device 3a in a gradation range including a gradation range of 12.5% or less of the maximum gradation is particularly effective in bringing the appearances close to each other.
In the above embodiment, the luminance based on screen light from the liquid crystal panel 9 is measured, and the luminance is converted into a JND index as it is. Alternatively, a JND index may be calculated considering the luminance based on the ambient light of the place in which the display device 3 is installed. In this case, for example, the luminance based on ambient light is calculated by multiplying the illumination of ambient light on the liquid crystal panel 9 by a diffuse reflection coefficient on the liquid crystal panel 9, and the total luminance of the luminance based on screen light and the luminance based on ambient light is converted into a JND index. In this case, the display luminance refers to the total luminance of the luminance based on screen light and the luminance based on ambient light.
While, in the above embodiment, gradation characteristics of the showing display device 3b are set under the control of the controller 26 included in the picture conversion device 25, the controller 17 included in the display device 3 may perform a similar function.
While, in the above embodiment, the picture conversion device 25 is a single device, two or more picture conversion devices may perform a similar function. For example, since the display devices 3a, 3b are typically disposed in different places, picture conversion devices may be disposed so as to be close to the respective display devices and provided with required functions. The picture conversion device 25 may be a general-purpose computer such as a workstation or personal computer, or may be a dedicated device disposed between a general-purpose computer and the display devices.
2. Second Embodiment
Referring now to
As shown in
Video data is also inputted to the data conversion unit 35. Assume that the luminance gradation value of a certain pixel P contained in the video data is A (e.g., gradation 192). When this video data is inputted to the showing display device 3b as it is, the pixel P emits light at a luminance LA in accordance with the gradation-luminance characteristics shown in
A data output unit 29b outputs the video data converted by the data conversion unit 35 to a picture processing circuit 11b.
According to the present embodiment, the gradation-luminance characteristics of the showing display device 3b are not changed, but rather the luminance gradation value of video data is changed. Thus, the appearances of pictures displayed on the display devices 3a, 3b can be brought close to each other.
3. Third Embodiment
Referring now to
In the second embodiment, video data is converted each time a picture is displayed and therefore the conversion process is a heavy load. In the present embodiment, on the other hand, once video data is converted, pictures can be displayed using the converted video data from then on. Also, in the present embodiment, the conversion and display of a picture can be performed separately. Thus, the following is possible: a picture is only converted; the converted video data is stored in a storage 27; the converted video data is read from the storage 27 at a required timing; and the read video data is displayed on a showing display device 3b.
4. Fourth Embodiment
Referring now to
In the present embodiment, first, a data separation unit 37 separates video data into illumination light components and reflectance components on the basis of the Retinex theory. Examples of the separation method include methods disclosed in Japanese Patent Nos. 5247910 and 5470415. Then, an illumination light component conversion unit 35a performs data conversion similar to that of the second embodiment on the illumination light components and outputs the resulting illumination light components. On the other hand, a reflectance component conversion unit 35b converts the reflectance components in such a manner that the reflectance components are emphasized by a value determined by a gloss emphasis degree determination unit 39 and then outputs the resulting reflectance components. Note that the reflectance components may be left intact by omitting the reflectance component conversion unit 35b.
Then, a data combination unit 41 combines the converted illumination light components and reflectance components and outputs the combined video data. A data output unit 29b outputs the video data combined by the data combination unit 41 to a picture processing circuit 11b.
In the second embodiment, all the components of video data are converted in accordance with a target luminance table. This causes a problem that reflectance components related to the gloss of an object may also be converted, which may result in a change in the glossy appearance of the object. In the present embodiment, on the other hand, after separating video data into illumination light components and reflectance components, data conversion is performed only on the illumination light components in accordance with a target luminance table. Thus, the glossy appearance of the object can be maintained.
| Filing Document | Filing Date | Country | Kind |
|---|---|---|---|
| PCT/JP2014/069757 | 7/25/2014 | WO | 00 |
| Publishing Document | Publishing Date | Country | Kind |
|---|---|---|---|
| WO2016/013125 | 1/28/2016 | WO | A |
| Number | Name | Date | Kind |
|---|---|---|---|
| 6310650 | Johnson | Oct 2001 | B1 |
| 20090027558 | Mantiuk | Jan 2009 | A1 |
| 20100026702 | Herbert | Feb 2010 | A1 |
| 20110285608 | Shen | Nov 2011 | A1 |
| 20120154355 | Kawai | Jun 2012 | A1 |
| 20120314129 | Mertens | Dec 2012 | A1 |
| 20140198316 | Chen | Jul 2014 | A1 |
| 20150117775 | Abe et al. | Apr 2015 | A1 |
| 20150269882 | Kimpe | Sep 2015 | A1 |
| 20170047022 | Ikeda | Feb 2017 | A1 |
| Number | Date | Country |
|---|---|---|
| 2005-070080 | Mar 2005 | JP |
| 2011-112961 | Jun 2011 | JP |
| 2011-133877 | Jul 2011 | JP |
| 2013-210773 | Oct 2013 | JP |
| Entry |
|---|
| International Search Report dated Oct. 14, 2014 in corresponding Application No. PCT/JP2014/069757; 2 pgs. |
| Number | Date | Country | |
|---|---|---|---|
| 20170221405 A1 | Aug 2017 | US |
