The present invention relates to a display method that displays an image on a display device including a display unit that is enabled to adjust luminance on a per area basis of multiple areas, a control program that causes a computer to function as the display device, a computer readable recording medium that has recorded the control program, and a television receiver that includes the display device.
A technique disclosed herein is to adjust luminance of an image displayed on a display device.
Patent Literature 1 describes an image processing device that performs a compression operation on luminance gradation of an input image by using at least one of a maximum value and an average value of luminance signals of the input image and by comparing at least one of the maximum value and the average value with a saturation level, serving as a reference. The saturation level is obtained by accumulating light for a predetermined period of time in the case that the input image is captured.
Patent Literature 2 describes a light emitting device that controls an amount of light emitted by a light emitter in response to values from a luminance sensor and a temperature sensor. The light emitter includes multiple control blocks that are independently enabled to control light emission.
PTL 1: Japanese Unexamined Patent Application Publication No. 2015-139082 (published Jul. 30, 2015)
PTL 2: Japanese Unexamined Patent Application Publication No. 2015-197605 (published Nov. 9, 2015)
The technique disclosed in PTL 1 may control degradation of images but may not possibly display an image having appropriate luminance (such as a high-contrast image). The technique disclosed in PTL 2 may display an image of appropriate luminance, but has a complex configuration because a luminance sensor and a temperature sensor need to be used.
The present invention has been developed in view of these problems, and the object thereof is to provide a technique that displays an image at appropriate luminance using a configuration simpler than those of the related art.
According to an aspect of the present invention, there is provided a display device that solves the above-described problems. The display device includes a display unit, an image processing unit, a display control unit, and a process information generation unit. The display unit is partitioned into multiple areas, and is configured such that luminance of an image to be displayed is adjustable on a per area basis of the areas. The image processing unit generates an output image by modifying a signal level of an input image. The display control unit determines outputtable maximum luminance in response to the output image, adjusts luminance on a per area basis of the areas in response to the output image and the maximum luminance, and displays the output image on the display unit at the adjusted luminance. The process information generation unit generates process information responsive to the maximum luminance and luminance at which the display unit is enabled to display. The image processing unit generates the output image by modifying the signal level of the input image in a current frame by referencing the process information concerning a preceding frame generated by the process information generation unit in the preceding frame.
According to another aspect of the present invention, there is provided a display method of displaying an image on a display device including a display unit. The display method includes an image processing step, a display control step, and a process information generation step. The display unit is partitioned into multiple areas, and is configured such that luminance of an image to be displayed is adjustable on a per area basis of the areas. The image processing step includes generating an output image by modifying a signal level of an input image. The display control step includes determining outputtable maximum luminance in response to the output image, adjusting luminance on a per area basis of the areas in response to the output image and the maximum luminance, and displaying the output image on the display unit at the adjusted luminance. The process information generation step includes generating process information responsive to the maximum luminance and luminance at which the display unit is enabled to display. The image processing step includes generating the output image by modifying the signal level of the input image in a current frame by referencing the process information concerning a preceding frame generated in the process information generation step in the preceding frame.
According to an aspect of the present invention, an image of appropriate luminance is displayed in a configuration that is simpler than those of the related art.
A first embodiment of the present invention is described in detail below. In the first embodiment, a display unit includes a liquid-crystal panel and an LED backlight. The present invention is not limited to this configuration. For example, in accordance with the present invention, the display unit may include an organic electroluminescence (EL) display.
(Display Device 1)
The image signal acquisition unit 10 acquires an image signal. An example of the image signal acquired by the image signal acquisition unit 10 includes a tuner signal acquired via a tuner, a high-definition multimedia interface (HDMI (registered trademark)) signal acquired via HDMI, or a composite video, blanking, and sync (CVBS) signal.
The display device control unit 20 generally controls each element of the display device 1 and is implemented by a central processing unit (CPU).
The display unit 40 is a device that displays an image, and includes a liquid crystal panel 42 and an LED backlight 44.
The liquid crystal panel 42 is a display device that displays an output image.
The LED backlight 44 includes multiple LED elements, and the multiple LED elements emit light onto the back surface of the liquid crystal panel 42.
The display image generation unit 30 generates an output image to be displayed. The display image generation unit 30 displays the generated output image by controlling the liquid crystal panel 42 and the LED backlight 44. Referring to
The image processing unit 32 modifies the signal level of an input image by referencing process information.
The process information generation unit 34 acquires information from the display control unit 36, and generates process information in response to the information and maximum display luminance at which the display unit 40 is able to display. The “maximum display luminance at which the display unit 40 is able to display” is naturally determined by the characteristics of the display unit 40, and is not a value that changes in response to an image displayed.
The display control unit 36 (1) determines outputtable maximum luminance responsive to the output signal, (2) adjusts the luminance on a per area basis of the multiple areas of the LED backlight 44 in response to the output signal and the maximum luminance, and (3) displays the output signal on the display unit 40 at the adjusted luminance. The “outputtable maximum luminance responsive to the output signal” is configured in the case that panel is controlled from the standpoint of power consumption and heat, and is different depending on an image displayed. The “outputtable maximum luminance responsive to the output signal” is described below with reference to
(External View of Display Device 1)
(Process of Display Device 1)
(Step S2)
The display device control unit 20 acquires the input signal via the image signal acquisition unit 10. The display device control unit 20 outputs the acquired input signal to the display image generation unit 30. The image processing unit 32 in the display image generation unit 30 acquires the input signal output from the display device control unit 20.
(Step S4: Image Processing Step)
The image processing unit 32 modifies the signal level of the input image by referencing the process information generated by the process information generation unit 34. The image processing unit 32 may reference the process information once every several frames. If the image processing unit 32 does not reference the process information, the image processing unit 32 modifies the signal level of the input image in accordance with information concerning a preceding frame value. The process of the process information generation unit 34 to generate the process information in step S12 is described in detail below with reference to related figures.
An example of the signal level modified by the image processing unit 32 is described with reference to
By referencing the process information, the image processing unit 32 modifies the input signal level such that the output signal levels illustrated in the graphs of FIG. 4(a) through
The image processing unit 32 outputs an image with the signal level thereof modified as an output image to the display control unit 36.
(Step S6: Display Control Step)
Upon acquiring the output image, the display control unit 36 determines maximum luminance by referencing the output image. The display control unit 36 may reference the output image once every several frames. If the display control unit 36 does not reference the output image, the display control unit 36 determines the maximum luminance in accordance with information concerning a preceding frame value.
Referring to
In step S6, the display control unit 36 determines the maximum luminance by referencing the graph of
(Step S8: Display Control Step)
The display control unit 36 determines luminance of each area. More specifically, the display control unit 36 determines luminance of each area such that the output image is higher in contrast. To this end, the display control unit 36 determines the luminance of each area to cause a bright area in the output image to be brighter, and a dark area in the output image to be darker.
(Step S10: Display Control Step)
The display control unit 36 controls the LED backlight 44 such that the luminance of each area determined in step S8 is obtained, and displays on the liquid crystal panel 42 the output image obtained in step S6.
(Step S12: Process Information Generation Step)
The process information generation unit 34 acquires information from the display control unit 36, thereby generating the process information. The process information generation unit 34 may acquire the information once every several frames. If the process information generation unit 34 does not acquire the information, the process information generation unit 34 generates the process information in accordance with information concerning a preceding frame. The process the process information generation unit 34 to generate the process information is described below in detail.
(Process of Process Information Generation Unit 34)
(Step S22)
The process information generation unit 34 acquires PeakLum that is information indicating maximum display luminance as luminance at which the display unit 40 is enabled to display. A value responsive to the display unit 40 is stored as PeakLum on a memory (not illustrated), and the process information generation unit 34 acquires PeakLum from the memory.
(Step S24)
The process information generation unit 34 acquires from the display control unit 36 MAX_GS_ORIG and MAX_GS. Here, MAX_GS_ORIG is a normalized value of outputtable luminance. MAX_GS is a value indicating a ratio of the maximum luminance determined in step S6 to MAX_GS_ORIG. For example, if, as illustrated in
MAX_GS_ORIG may not necessarily be 1. The display control unit 36 may limit the maximum luminance of the output more than the characteristics illustrated in
(Step S26)
The process information generation unit 34 calculates peak luminance (PeakW) in accordance with the following formula.
PeakW=PeakLum·MAX GS/MAX_GS_ORIG
For example, if PeakLum=1500 cd/m2, MAX_GS=0.5, and MAX GS ORIG=1, PeakW is 1500·0.5/1=750 cd/m2. If MAX GS ORIG=1, the process information generation unit 34 may reference only the value of MAX GS. In other words, the process information generation unit 34 references outputtable luminance (MAX GS/MAX_GS_ORIG), and generates the process information responsive to the outputtable luminance and PeakLum.
(Step S28)
The process information generation unit 34 generates the process information in response to the calculated peak luminance. For example, if the calculated peak luminance is 500 cd/m2, the process information generation unit 34 generates the process information such that the relationship between the input signal and the output signal is as illustrated in
In other words, as the calculated peak luminance becomes lower, the process information generation unit 34 configures the gain of output signal to the input signal (gradient of the graph of
The process information generation unit 34 outputs the generated process information to the image processing unit 32, and processing to be performed by the display device 1 returns to step S2. In step S4, the image processing unit 32 references the acquired process information, and modifies the signal level of the input image. In other words, with respect to the input image with the signal level thereof to be modified, the image processing unit 32 modifies the signal level of the input image in the current frame by referencing the process information in a preceding frame generated by the process information generation unit in the preceding frame.
In this way, the display device 1 of the first embodiment includes the display unit 40, the image processing unit 32, and the display control unit 36. The display unit 40 is partitioned into multiple areas, and is configured such that luminance of an image to be displayed is adjustable on a per area basis of the multiple areas. Also, the image processing unit 32 modifies the signal level of the input image. In response to the output image, the display control unit 36 determines the maximum luminance outputtable, adjusts luminance on a per area basis of the multiple areas in response to the output image and the maximum luminance, and displays the output image on the display unit 40 at the adjusted luminance.
In that configuration, the display device 1 modifies the signal level of the input image to a higher level (a lower level) even if the maximum luminance that the display control unit 36 has determined for the image in the current frame is lower (higher) than the maximum luminance that the display control unit 36 has determined for the image in the preceding frame. For this reason, even if the display control unit 36 configures different maximum luminance values for the images in the current frame and the preceding frame, the display device 1 is enabled to display an image having a smaller difference between luminance values. The display device 1 thus displays an image of appropriate luminance. Without using a sensor or the like, the display device 1 may display an image of appropriate luminance with a configuration simpler than those of the related art.
The display device 1 includes the display unit 40 that includes the LED backlight 44 that is enabled to adjust luminance on a per area basis of the multiple areas. The display control unit 36 adjusts the luminance on a per area basis of the multiple areas by controlling the LED backlight 44. In that configuration, the display unit 40 adjusts the luminance appropriately and the display device 1 then displays an image of appropriate luminance.
The display device 1 includes the process information generation unit 34 that generates the process information in response to the maximum luminance determined by the display control unit 36 and the luminance at which the display unit 40 is enabled to display. The image processing unit 32 generates the output image by modifying the signal level of the input image in the current frame by referencing the process information related to the preceding frame generated by the process information generation unit 34 in the preceding frame. In that configuration, the display device 1 generates the output image in a feedback operation. The display device 1 may thus display an image of appropriate luminance in view of the difference between the images in the preceding frame and the current frame.
If information concerning luminance is included in the input image (such as in a high dynamic range (HDR) signal), the display device 1 may display an image of more appropriate luminance. More specifically, the display device control unit 20 converts the information included in the input image into information concerning luminance in the display device 1 (for example, converts information of PQ curve into a gamma curve). By performing the process described above, the display device 1 may display an image of more appropriate luminance even if the information concerning luminance is included in the input image.
A second embodiment of the present invention is described with reference to
(Step S42)
The process information generation unit 34 acquires an IIR coefficient from a memory (not illustrated). The IIR coefficient relates to an infinite impulse response (IIR) filter, and indicates how much the image processing unit 32 modifies the input signal (how much the image processing unit 32 modifies the gain). More specifically, if the image processing unit 32 excessively modifies the input signal, the luminance of the displayed output image varies unnaturally. In order to naturally vary the luminance of the displayed output image, the process information generation unit 34 is preferably configured such that the process information generation unit 34 outputs to the image processing unit 32 in the current frame a value that gradually varies from a preceding value to a target value instead of directly outputting the target value to the image processing unit 32. In that configuration, the filter that the process information generation unit 34 uses to calculate a value varying from the preceding value to the target value is the IIR filter.
(Step S44)
The process information generation unit 34 determines whether the output image in the current frame output from the display control unit 36 is an image scene-changed from the image in the preceding frame. In a specific determination method available to determine whether the image is scene-changed, APL of the image in the current frame is compared with APL of the image in the preceding frame and if the difference therebetween is larger than a threshold value, the image is determined to be scene-changed. In another determination method available to determine whether the image is scene-changed, luminance histogram information of the image in the current frame is compared with luminance histogram information of the image in the preceding frame, and if the difference therebetween is larger, the image is determined to be scene-changed.
(Step S46)
If the image is determined to be “scene-changed” in step S44 (yes from step S44), the process information generation unit 34 outputs the target value as the process information to the image processing unit 32. More specifically, if the image has been scene-changed, the process information generation unit 34 outputs to the image processing unit 32 the gain corresponding to the scene-changed image if the image has been scene-changed.
(Step S48)
If the image is determined to be “not scene-changed” (no from step S44), the process information generation unit 34 determines whether the absolute value of a difference between the target value and the preceding value is smaller than a threshold value.
(Step S50)
If the process information generation unit 34 has determined that “the absolute value of the difference between the target value and the preceding value is smaller than the threshold value” (yes from step S48), the process information generation unit 34 outputs the preceding value as the process information to the image processing unit 32. More specifically, if the absolute value of the difference between the target value and the preceding value is smaller than the threshold value (in other words, a difference between the image in the current frame and the image in the preceding frame is smaller), the process information generation unit 34 outputs to the image processing unit 32 the gain calculated in the process of the preceding frame instead of the gain calculated in the process of the current frame.
(Step S52)
If the process information generation unit 34 has determined that “the absolute value of the difference between the target value and the preceding value is not smaller than the threshold value” (no from step S48), the process information generation unit 34 performs IIR filtering calculation. More in detail, the process information generation unit 34 calculates the gain value in the current frame using an IIR filter. It is notable that the process information generation unit 34 may calculate an amount of change between the target value and the preceding value, and may calculate the IIR coefficient in response to the amount of change.
In this way, the display device 1 of the second embodiment includes the process information generation unit 34 that generates the process information, based on the maximum luminance determined by the display control unit 36 and the luminance at which the display unit 40 is enabled to display. The display device 1 selects, as the process information that the image processing unit 32 references to generate the output image, the process information concerning the current fame or the process information concerning the preceding frame. If in that configuration, the difference between the gain calculated in the current frame and the gain calculated in the preceding frame is smaller, the display device 1 selects as the process information the gain calculated in the preceding frame, and thus controls the oscillation of luminance.
In the configuration described above, the process information generation unit 34 performs the process of
(Implementation Examples by Software)
A control block (the display image generation unit 30 in particular) in the display device 1 may be implemented with a logic circuit (hardware) formed on an integrated circuit (IC chip) or the like, or may be implemented with software by using a central processing unit (CPU).
In the latter case, the display device 1 includes a CPU that executes the control program that is software implementing each functionality, a read only memory (ROM) or a storage device (these are referred to as “recording media”) that has recorded the control program and a variety of data in a computer-readable fashion, and a random access memory (RAM) that expands the control program. The object of the present invention is thus accomplished by a computer (or the CPU) that reads the control program from the recording medium and executes the read control program. The recording media may include a “non-transitory and tangible medium”, such as a tape, a disk, a card, a semiconductor memory, or a logic circuit that is programmable. The control program may be delivered to the computer via any transmission media (such as a communication network or radio-broadcasting wave) that carries the control program. The present invention may be embodied by electronic transmission of the control program, for example, in the form of a data signal that is embedded in a carrier wave.
According to a first aspect of the present invention, the display device 1 includes the display unit 40, the image processing unit 32, and the display control unit 36. The display unit is partitioned into multiple areas, and is configured such that luminance of an image to be displayed is adjustable on a per area basis of the multiple areas. The image processing unit generates the output image by modifying the signal level of the input image. The display control unit determines the outputtable maximum luminance in response to the output image, adjusts luminance on a per area basis of the multiple areas in response to the output image and the maximum luminance, and displays the output image on the display unit at the adjusted luminance.
In that configuration, the display device of the first aspect modifies the signal level of the input image to a higher level (a lower level) even if the maximum luminance that is determined for the image in the current frame is lower (higher) than the maximum luminance that is determined for the image in the preceding frame. For this reason, even if different maximum luminance values are configured to be the images in the current frame and the preceding frame, the display device is enabled to display an image having a smaller difference between luminance values. The display device thus displays an image of appropriate luminance. Without using a sensor or the like, the display device may display an image of appropriate luminance with a configuration simpler than those of the related art.
According to a second aspect of the present invention, in view of the first aspect, the display device may further include the luminance oscillation restricting unit (the process information generation unit 34) that selects, as the process information that the image processing unit references to generate the output image, the process information concerning the current frame or the process information concerning the preceding frame.
In that configuration, the display device of the second aspect restricts the oscillation of luminance by selecting the process information of the preceding frame if the difference between the information concerning the current frame and the information concerning the preceding frame is smaller.
According to a third aspect of the present invention, in the display device of one of the first and second aspects, the display unit may include the backlight that is enabled to adjust luminance on a per area basis of the multiple areas, and the display control unit may adjust the luminance on a per area basis by controlling the backlight.
In that configuration, the display device of the third aspect appropriately adjusts the luminance of the display unit.
According to a fourth aspect of the present invention, the display device of one of the first through third aspects may further include the process information generation unit that generates the process information responsive to the maximum luminance and the luminance at which the display unit is enabled to display. The image processing unit generates the output image by modifying the signal level of the input image in the current frame by referencing the process information concerning the preceding frame generated by the process information generation unit in the preceding frame.
In that configuration, the display device of the fourth aspect generates the output image in accordance with the feedback operation, and thus displays the image of more appropriate luminance in response to the difference between the images of the current frame and the preceding frame.
According to a fifth aspect of the present invention, there is provided the display method of displaying the image on the display device including the display unit. The display method includes the image processing step, the display control step, and the process information generation step. The display unit is partitioned into multiple areas, and is configured such that luminance of the image to be displayed is adjustable on a per area basis of the multiple areas. The image processing step includes generating the output image by modifying the signal level of the input image. The display control step includes determining the outputtable maximum luminance in response to the output image, adjusting the luminance on a per area basis of the multiple areas in response to the output image and the maximum luminance, and displaying the output image on the display unit at the adjusted luminance.
In that configuration, the display method of the fifth aspect provides the same advantageous effects as those of the display device of the first aspect.
According to a sixth aspect of the present invention, there is provided the television receiver 2. The television receiver 2 includes the display device according to one of the first through fourth aspects.
In that configuration, the television receiver of the sixth aspect provides the same advantageous effects as those of the display device according to one of the first through fourth aspect.
The display device of each aspect of the present invention may be implemented by a computer. In such a case, a control program that causes the computer to function as the display device by causing the computer to function as each element (software element) of the display device and a computer readable recording medium having recorded the control program fall within the scope of the present invention.
The present invention is not limited to the embodiments described above. A variety of modification is possible without departing from the scope of the present invention defined by the claims. An embodiment that is implemented by adequately combining technical means disclosed in the different embodiments falls within the scope of the present invention. Furthermore, a new technical feature may be formed by combining technical means disclosed in each of the embodiments.
Display device
10 Image signal acquisition unit
20 Display device control unit
30 Display image generation unit
32 Image processing unit
34 Process information generation unit (luminance oscillation restricting unit)
36 Display control unit
40 Display unit
42 Liquid crystal panel
44 LED backlight
Number | Date | Country | Kind |
---|---|---|---|
2016-007471 | Jan 2016 | JP | national |
Filing Document | Filing Date | Country | Kind |
---|---|---|---|
PCT/JP2016/088970 | 12/27/2016 | WO | 00 |