This application claims the benefit of Japanese Priority Patent Application JP 2014-042857 filed Mar. 5, 2014, and Japanese Priority Patent Application JP 2014-245564 filed Dec. 4, 2014, the entire contents of each of which are incorporated herein by reference.
A technology which is disclosed in the present disclosure relates to an image processing device and an image processing method which perform a luminance dynamic range conversion process of an image, and an image display device.
In recent years, a technology of high dynamic range (HDR) imaging is progressing due to a high bit of an imaging element (image sensor), or the like. The HDR is a technology which aims to express an image which is closer to the real world, and there is an advantage that it is possible to realistically express a shade, to simulate an exposure, to express glare, or the like. Meanwhile, since in a standard dynamic range (SDR) image, high brightness information is compressed using photographing or editing, the dynamic range becomes small, and it is difficult to say that it is expressing the real world.
For example, an imaging apparatus in which an HDR image composed from a plurality of imaged images of which exposure amounts are different is presented (for example, refer to PTL 1).
A camera which is used in contents production usually has an ability to photograph an HDR image. However, the reality is that an image is converted into an image of which a dynamic range is compressed into standard luminance of approximately 100 nit, is edited, and then is provided to a content user. Forms of providing contents are various, and there are digital broadcasting, a streaming delivery through the Internet, media selling, and the like. For a content producer, white luminance of a master monitor which is used in editing of contents is approximately 100 nit, high luminance signal information at a time of original producing is compressed, gradation thereof is damaged, and realistic sensation is lost.
In addition, it is possible to perform a luminance dynamic range conversion in which an image is converted from an HDR image into an SDR image using Knee compression. The Knee compression is a process in which a high luminance portion of a signal is suppressed so that luminance of an image falls within a predetermined dynamic range (here, dynamic range of SDR). The Knee compression is a method in which a dynamic range is compressed with respect to a luminance signal which exceeds a predetermined luminance signal level which is referred to as a Knee point by decreasing an inclination of input-output characteristics (for example, refer to PTL 2). The Knee point is set so as to be lower than a desired maximum luminance signal level.
In recent years, a high luminance display with a maximum luminance of 500 nit or 1000 nit has been commercially available. However, as described above, since an image is provided after being compressed into a dynamic range of an SDR image, regardless of the fact that the image is produced as an HDR Image, originally, there is waste of viewing an SDR image using a high luminance display which is brighter than a master monitor of which white luminance is 100 nit.
In order to enjoy an SDR image which is provided in a form of television broadcasting, streaming, or media as the original HDR Image using a high luminance display, a Knee extension process may be performed. When performing Knee extension, a reverse process to a Knee compression process may be performed. A method of the Knee compression can be defined using an input luminance position and an output luminance position at which a suppression of a Knee point, that is, suppressing of a signal level is started, and a maximum luminance level which is suppressed. However, when definition information of Knee compression is delivered only as an incomplete form, or is not delivered at all from a broadcasting station (or supply source of image), it is not possible to ascertain an accurate method of performing Knee extension on the receiver side. When the extension process of the luminance dynamic range is performed in an inaccurate method, there is a problem in that it is not possible to restore the compressed high luminance signal information, and not to restore Knee compression when performing editing.
It is desirable to provide an excellent image processing device and an image processing method which can convert an image which is compressed so as to be in a low dynamic range or a standard dynamic range into the original high dynamic range image, and an image display device.
According to an embodiment of the present disclosure, an image processing apparatus may include a processing device that determines a degree of degeneracy of high luminance signal information of an input image, and obtains a luminance signal curve based on the degree of degeneracy.
According to an embodiment of the present disclosure, an image processing method may include determining, by a processing device, a degree of degeneracy of high luminance signal information of an input image, and obtaining, by the processing device, a luminance signal curve based on the degree of degeneracy.
According to an embodiment of the present disclosure, a non-transitory storage medium may be recorded with a program for image processing, and the program may include determining a degree of degeneracy of high luminance signal information of an input image, and obtaining a luminance signal curve based on the degree of degeneracy.
According to an embodiment of the present disclosure, a display apparatus may include a processing device that determines a degree of degeneracy of high luminance signal information of an input image, and obtains a luminance signal curve based on the degree of degeneracy; and a display device including a backlight configured by a plurality of light emission units, where the processing device controls power of the individual light emission units, in accordance with the luminance signal curve.
According to an embodiment of the present disclosure, there is provided an image processing device which includes a determination unit which determines a degree of degeneracy of high luminance signal information of an input image; and an adjusting unit which adjusts the input image based on a determination result using the determination unit.
In the image processing device, the adjusting unit may include a luminance correction unit which corrects luminance based on the determination result using the determination unit; a luminance signal correction unit which corrects a luminance signal according to gradation; and a color signal correction unit which corrects a change in hue which is associated with the correction of the luminance signal as necessary.
In the image processing device, the luminance correction unit may improve luminance in all gradations according to a degree of degeneracy of high luminance signal information which is determined by the determination unit.
In the image processing device, the luminance signal correction unit may optimize a signal curve with respect to gradation which is degenerated, and gradation which is not degenerated.
In the image processing device, the color signal correction unit may maintain original hue by performing a reverse correction with respect to a change when the hue is changed associated with the correction of the luminance signal which is performed using the luminance signal correction unit.
In the image processing device, the color signal correction unit may correct a chroma signal so that a ratio of a luminance signal to the chroma signal becomes constant before and after correcting the luminance signal.
In the image processing device, the determination unit may determine a degree of degeneracy of the high luminance signal information thereof based on a luminance level of an input image.
In the image processing device, the determination unit may determine the degree of degeneracy of the high luminance signal information based on at least one of a maximum luminance signal level in an input image, an amount in the vicinity of a value of the maximum luminance signal level in the input image, a mean value of the luminance signal in the input image, and an amount in the vicinity of a value of a black (low luminance signal) level in the input image.
According to another embodiment of the present disclosure, there is provided an image processing method which includes determining a degree of degeneracy of high luminance signal information of an input image; and adjusting the input image based on a determination result in the determining.
According to still another embodiment of the present disclosure, there is provided an image display device which includes a determination unit which determines a degree of degeneracy of high luminance signal information of an input image; an adjusting unit which adjusts the input image based on a determination result using the determination unit; and a display unit which displays the image which is adjusted.
According to a technology which is disclosed in the present disclosure, it is possible to provide excellent image processing device and image processing method which can reproduce brightness in real space by converting an image which is compressed so as to be in a low dynamic range or a standard dynamic range into the original high dynamic range image, and an image display device.
In addition, an effect which is described in the present disclosure is merely an example, and an effect of the technology is not limited to this. In addition, there is a case in which an additional effect is exerted, in addition to the above described effect in the technology.
Further another object, characteristics, or advantage of the technology which is disclosed in the present disclosure may become clear using further detailed descriptions based on embodiments which will be described later, or accompanying drawings.
Hereinafter, embodiments of the technology which is disclosed in the present disclosure will be described in detail with reference to drawings.
A transmission radio wave of terrestrial wave digital broadcast, satellite digital broadcast, or the like, is input to an antenna 101. A tuner 102 selectively amplifies a desired radio wave among signals which are supplied from the antenna 101, and performs a frequency conversion. A digital demodulation unit 103 detects a received signal which is subjected to the frequency conversion, demodulates the signal using a method corresponding to a digital modulation method at a time of transmitting (broadcasting station side), and also performs a transmission error correction. A digital decoding unit 104 outputs image signals of Y, Cb, and Cr to a display unit 105 by decoding the digital demodulation signal.
In addition,
In addition,
A video decoder 202 performs a signal process such as a chroma process with respect to an image signal which is input from the digital decoding unit 104 through an input terminal 201, converts the signal into an RGB image signal with resolution which is appropriate for driving of a liquid crystal display panel 207, and outputs the signal to a control signal generation unit 203 along with a horizontal synchronization signal H and a vertical synchronization signal V.
The control signal generation unit 203 generates image signal data based on the RGB data which is supplied from the video decoder 202, and supplies the data to a video encoder 204 along with the horizontal synchronization signal H and the vertical synchronization signal V. According to the embodiment, the control signal generation unit 203 also performs a process (which will be described later) of converting an image in a low dynamic range or a standard dynamic range into an image in a high dynamic range.
The video encoder 204 supplies each control signal for causing a data driver 205 and a gate driver 206 to be operated in synchronization with the horizontal synchronization signal H and the vertical synchronization signal V. In addition, the video encoder 204 generates a light intensity control signal which individually controls a light emission diode unit of a backlight 208 according to brightness of an image signal, and supplies the light intensity control signal to a backlight driving control unit 209.
The data driver 205 is a driving circuit which outputs a driving voltage based on an image signal, generates a signal to be applied to a data line, based on a timing signal and an image signal which are transmitted from the video encoder 204, and outputs the signal. In addition, the gate driver 206 is a driving circuit which generates a signal for sequential driving, and outputs a driving voltage to a gate-bus line which is connected to each pixel in the liquid crystal display panel 207 according to a timing signal which is transmitted from the video encoder 204.
The liquid crystal display panel 207 has a plurality of pixels which are arranged in a grid shape, for example. Liquid crystal molecules in a predetermined aligning state are enclosed between transparent plates such as glass, and an image is displayed according to application of a signal from the outside. As described above, application of a signal to the liquid crystal display panel 207 is performed using the data driver 205 and the gate driver 206.
The backlight 208 is a surface lighting device which is arranged on the rear side of the liquid crystal display panel 207, irradiates the liquid crystal display panel 207 with light from the rear side, and makes an image which is displayed on the liquid crystal display panel 207 visible. The backlight 208 may have a direct-type structure in which a light source is arranged immediately below the liquid crystal display panel 207, or an edge light-type structure in which the light source is arranged at the periphery of the light guiding plate. As the light source of the backlight 208, it is possible to use a light emitting diode (LED) of R, G, or B, a white LED, or a laser light source.
The backlight driving control unit 209 individually controls brightness in each of the light emission diode units of the backlight 208 according to a light intensity control signal which is supplied from the control signal generation unit 203. The backlight driving control unit 209 can control the light intensity of each of the light emission diode units according to an amount of power which is supplied from the power source 210. In addition, a technology of partial driving (which will be described later) in which a screen is divided into a plurality of lighting regions, and the backlight driving control unit 209 controls brightness of the backlight 208 in each region according to a location of a lighting region and a display signal may be applied.
The liquid crystal display panel 207 includes a display region 11 in which total pixels of M0*N0, that is, of M0 pixels along a first direction, and of N0 pixels along a second direction are arranged in a matrix. Specifically, for example, the display region satisfies an HD-TV standard, as a resolution for image displaying, and for example, (1920, 1080), when the number of pixels M0*N0 which are arranged in a matrix is denoted by (M0, N0). In addition, when performing partial driving, the display region 11 which is configured of pixels arranged in a matrix (denoted using dot and dash line in
Each pixel is configured as one set of a plurality of sub-pixels which emit a different color, respectively. More specifically, each pixel is configured of three sub-pixels of a red light emitting sub-pixel (sub-pixel R), a green light emitting pixel (sub-pixel G), and a blue light emitting pixel (sub-pixel B). The illustrated display unit 105 is subjected to line-sequential driving. More specifically, the liquid crystal display panel 207 includes a scanning electrode (extending in the first direction) and a data electrode (extending in the second direction) which intersect each other in a matrix, selects the scanning electrode by inputting a scanning signal to the scanning electrode, scans the scanning electrode, displays an image based on a data signal (signal based on control signal) which is input to the data electrode, and configures one screen.
The backlight 208 is a surface light device which is arranged on the rear side of the liquid crystal display panel 207, and illuminates the display region 11 from the rear surface, and may have the direct-type structure in which a light source is arranged immediately below the liquid crystal display panel 207, or the edge light-type structure in which the light source is arranged at the periphery of the light guiding plate. In addition, when performing partial driving, the backlight 208 is configured of P*Q light source units 42 (refer to
In addition, the backlight 208 is arranged immediately below the liquid crystal display panel 207 in reality; however, in
As illustrated in
The backlight driving control unit 209 is configured of an operation circuit 71, and a storage unit (memory) 72. In addition, when partial driving is performed, a light emitting state of the light source unit 42 which corresponds to a corresponding display region unit 12 is controlled based on a maximum input signal in the display region unit which has a maximum value xU-max in an input signal corresponding to each display region unit 12.
In addition, the light source unit driving circuit 80 is configured of an operation circuit 81, a storage unit (memory) 82, an LED driving circuit 83, a photodiode control circuit 84, switching elements 85R, 85G, and 85B which are formed of an FET, and light emitting diode driving power source (constant current source) 86.
In addition, the liquid crystal display panel driving circuit 90 is configured of a well-known circuit which is a timing controller 91. In the liquid crystal display panel 207, a gate driver, a source driver, or the like (none of them are illustrated), for driving a the switching element which is formed of a TFT configuring a liquid crystal cell are provided. A feedback mechanism is formed in which a light emitting state of each light emitting diode of 41R, 41G, and 41B in a certain image display frame is respectively measured using the photodiodes 43R, 43G, and 43B, outputs from the photodiodes 43R, 43G, and 43B are input to the photodiode control circuit 84, the outputs are set to data (signal) as luminance and chromacity, for example, of the light emitting diodes 41R, 41G, and 41B in the photodiode control circuit 84 and the operation circuit 81, the data is transmitted to the LED driving circuit 83, and light emitting states of the light emitting diodes 41R, 41G, and 41B in the subsequent image display frame are controlled. In addition, resistive elements for detecting currents rR, rG, and rB are respectively inserted in series with the light emitting diodes 41R, 41G, and 41B on the downstream side of the light emitting diodes 41R, 41G, and 41B. In addition, currents which flow in the resistive elements rR, rG, and rB cause voltage changes, and operations of the light emitting driving power source 86 are controlled under a control of the LED driving circuit 83 so that a voltage drop in the resistive elements rR, rG, and rB becomes a predetermined value. Here, in
When performing partial driving, the display region which is configured of pixel which are arranged in a matrix are divided into display region units of P*Q. When this state is expressed using a “row” and a “column”, it can be said that the display region is divided into display region units of Q rows*P columns. In addition, the display region unit 12 is configured of a plurality of (M*N) pixels; however, when this state is expressed using a “row” and a “column”, it can be said that the display region unit is configured of N rows*M columns.
Each pixel is configured of a set of three sub-pixels of a sub-pixel (R) (red light emitting sub-pixel), a sub-pixel (G) (green light emitting sub-pixel), and a sub-pixel (B) (blue light emitting sub-pixel). It is possible to perform a gradation control with respect to respective luminance of the sub-pixels (R, G, B), for example, in stages of 28 of 0 to 255. In this case, values xR, xG, xB of input signals (R, G, B) which are input to the liquid crystal display panel driving circuit 90 have values of 28 stages, respectively. In addition, values SR, SG, SB of pulse width modulation output signals for controlling light emitting times of the red light emitting diode 41R, the green light emitting diode 41G, and the blue light emitting diode 41B which configure each light source unit also have values of 28 stages of 0 to 255. However, there is no limitation to this, and, for example, it is also possible to perform controlling of light emitting times in stages of 210 of 0 to 1023 by setting a 10 bit control (expression using numerical values of 8 bit may become, for example, 4 times).
A control signal for controlling light transmittance Lt is supplied to each pixel from the driving unit. Specifically, control signals (R, G, B) for controlling each light transmittance Lt are supplied to sub-pixels (R, G, B) from the liquid crystal display panel driving circuit 90. That is, in the liquid crystal display panel driving circuit 90, control signals (R, G, B) are generated from the input signals (R, G, B) which are input, and the control signals (R, G, B) are supplied (output) to the sub-pixels (R, G, B). In addition, since light source luminance Y of the backlight 208 or the light source unit 42 is changed in each one pixel display frame, basically, the control signals (R, G, B) have values in which a correction (compensation) based on the change in the light source luminance Y is performed with respect to values in which the values of the input signals (R, G, B) are subjected to a gamma correction. In addition, control signals (R, G, B) are transmitted to the gate driver and the source driver of the liquid crystal display panel 207 from the timing controller 91 which configures the liquid crystal display panel driving circuit 90, and the light transmittance (aperture ratio) Lt of each sub-pixel is controlled when a switching element which configures each sub-pixel is driven based on the control signal (R, G, B), and a desired voltage is applied to a transparent electrode which configures a liquid crystal cell. Here, the larger the value of the control signal (R, G, B), the higher the light transmittance (aperture ratio of sub-pixel) Lt of sub-pixels (R, G, B), and the higher the luminance (display luminance y) value of the sub-pixel (R, G, B). That is, an image (usually, one type, and is dot shape) which is configured using light which passes through the sub-pixel (R, G, B) becomes bright.
The controls of the display luminance y and the light source luminance Y are performed in each one image display frame in an image display of the display unit 105, in each display region unit, and in each light source unit. In addition, operations of the liquid crystal display panel 207 and operations of the backlight 208 in one image display frame are synchronized.
In addition, the technology which is disclosed in the present disclosure is not limited to a specific pixel arrangement structure such as a three primary color pixel structure of RGB. For example, the structure may be a pixel structure including colors of one or more in addition to the three primary color pixels of RGB, specifically, the structure may be a four color pixel structure of RGBW including a white pixel in addition to the three primary color pixels of RGB, or a four color pixel structure of RGBY including a yellow pixel in addition to the three primary color pixels of RGB.
In
In addition, the backlight 208 may have an edge light-type structure in which a light source is arranged at the periphery of the light guiding plate, in addition to the direct-type structure (as described above) in which a light source is arranged immediately below the liquid crystal display panel 207. When the backlight is the edge light type which is the latter, it is possible to make the backlight 208 thin easily. An edge light-type backlight (refer to PTL 6) in which a multilayered light guiding plate which executes a brightness control in each display region is used by being overlappingly arranged with a plurality of light guiding plates of which positions of maximum luminance of output light are different from each other may be used.
The backlight 2400 includes a three layered light guiding plates of 2402, 2404, and 2406 which are overlappingly arranged, diffusion reflection patterns 2403, 2405, and 2407, a reflecting sheet 2409, light sources 2412, 2413, 2414, 2415, 2416, and 2417 (hereinafter, also referred to as “light source 2410”, collectively) which are formed of LEDs, an interlayer reflecting sheet 2430, and an optical sheet 2440. In addition, members for supporting each unit, or the like, are necessary; however, they are omitted in order to simplify drawings.
The light guiding plates 2402, 2404, and 2406 are overlappingly arranged on the light emitting face in this order. As illustrated in
According to the embodiment, it is assumed that the image display device 100 which is used as the display unit 105 in
Meanwhile, an image which is input to the image display device 100 is basically an SDR image by taking into consideration the fact that most of home televisions only corresponds to a general luminance display. For example, in an SDR image in which a luminance dynamic range of contents which are produced as an HDR image, originally, is edited by being compressed, gradation deteriorates, and a sense of reality is lost. When the display unit 105 of the image display device 100 corresponds to a high luminance display, in order to view the input SDR image as an HDR image, a process of getting closer to brightness in a real space may be performed by performing an extension process with respect to the luminance dynamic range.
However, when definition information of compression is delivered only as an incomplete form, or is not delivered at all from a contents supply source, it is not possible to ascertain an accurate method of extension on the receiver side. For example, when Knee extension is performed in a state in which definition information of Knee compression is not accurate, or is unknown, there is a problem in that it is not possible to restore compressed high luminance signal information, and to restore Knee compression when performing editing. In addition, also in a case in which contents which are originally produced using a low luminance dynamic range or a standard luminance dynamic range are converted into a high dynamic range image, it is difficult to express natural high luminance signal information.
Therefore, in the present disclosure, a method in which a low dynamic range image or a standard dynamic range image is converted into a high dynamic range image while expressing natural high luminance signal information will be presented.
A process of restoring high luminance signal information of an input image is configured of a determination process 310, and an adjusting process 320. In the determination process 310, a degree of degeneracy of high luminance signal information of an input image is determined. In addition, in the adjusting process 320, brightness of an input image is adjusted so as to be close to brightness in a real space based on a determination result due to the determination process 310. The adjusting process 320 includes a luminance correction process 321, a luminance signal correction process 322, and a color signal correction process 323. Hereinafter, each process will be described.
For example, when metadata in which information on luminance compression is described is added to an input image, a degree of degeneracy of high luminance signal information of the input image may be determined based on contents of the metadata. However, hereinafter, a method in a determination process in a case in which there is not information such as metadata at all will be described.
In the determination process 310, a degree of degeneracy of high luminance signal information is determined based on a luminance signal level of an input image.
For example, in a case in which the input image is edited on a master monitor of which white luminance is 100 nit will be assumed. In a case in which the original image is a dark image of approximately 0 nit to 20 nit, compression is not performed in order to suppress the white luminance to 100 nit, and the original image remains in the original dynamic range. On the other hand, in a case in which the original image is a bright image of approximately 0 nit to 1000 nit, a high luminance component is compressed, and the original image is included in a dynamic range of 0 nit to 100 nit.
On the contrary, it is possible to assume that compression is not performed with respect to a dark input image of approximately 0 nit to 20 nit in the process of editing. In addition, it is possible to assume that an input image of approximately 0 nit to 90 nit which is close to the dynamic range of the master monitor is slightly compressed. In addition, it is assumed that a high luminance component of an input image of 0 nit to 100 nit which is equal to a limit of the dynamic range of the master monitor is considerably compressed, and it is necessary to remarkably improve a luminance level in order to restore the original high dynamic range.
Accordingly, in the determination process 310, brightness of the original image of the input image is assumed by setting any one of the following (1) to (4), or a combination of two or more as an index, for example, and a degree of degeneracy of the high luminance signal information is determined.
(1) maximum luminance signal level in input image
(2) amount in vicinity of maximum luminance signal level value in input image
(3) mean value of luminance signal in input image
(4) amount in vicinity of black (low luminance signal) level value in input image
In each determination process of the above described (1) to (4), for example, it is possible to perform determination using a luminance signal histogram of an input image. Alternatively, it is also possible to perform the above described determination processes of (1) to (4) using input signals of R, G, B, and the like, or, for example, a histogram such as V/L/I such as HSV/HSL/HSI which are obtained by processing thereof. Here, descriptions will be made by assuming an input image of a luminance signal histogram as illustrated in
The maximum luminance signal in an input image in (1) means a luminance signal value of a predetermined level (for example, 90%) with respect to the maximum luminance signal value in the input image. In the luminance signal histogram which is exemplified in
In addition, the amount in the vicinity of a maximum luminance signal level value in an input image in (2) means an amount of pixels in the vicinity of the maximum luminance signal in an input image (for example, pixel with luminance signal value of 80% of maximum luminance signal or more). In the luminance signal histogram which is exemplified in
In addition, the mean value of the luminance signal in an input image in (3) means arithmetic mean of a luminance signal value which pixels in an input image have. In the luminance signal histogram which is exemplified in
In addition, the amount in the vicinity of a black (low luminance signal) level value in an input image in (4) means an amount of pixels in the vicinity of the black in an input image (for example, pixels of which luminance signal value is predetermined value or less). In the luminance signal histogram which is exemplified in
In addition, in the example illustrated in
In the adjusting process 320, a luminance correction 321, a luminance signal correction 322, and a color signal correction 323 are performed in order.
First, as the luminance correction 321, luminance is improved in all gradations according to the degree of degeneracy (K1, K2, K3, and K4) of the high luminance signal information which are determined in the determination process 310. For example, when the display unit 105 is configured of the liquid crystal display panel 207 as illustrated in
However, when the calculated gain amount is provided as is, there is a concern that the gain amount may exceed the maximum luminance (limit of hardware) of the display unit 105. Therefore, at a time of the process of the luminance correction 321, a gain amount K which does not exceed information denoting the maximum luminance of the display unit 105 is output to the backlight driving control unit 209 with reference to the information.
In addition, in the display unit 105, when partial driving of the backlight 208 and a technology of thrusting are applied, it is possible to make luminance in a case in which power which is suppressed at a dark portion is distributed to a region with high luminance, is intensively emitted, and a white display is partially performed higher than the maximum luminance when the partial driving and the technology of thrusting are not applied (which will be described later). Therefore, at a time of the process of the luminance correction 321, the gain amount K of the backlight 208 may be determined based on the maximum luminance when the partial driving and the technology of thrusting are performed, by analyzing the input image.
As the process of the luminance correction 321, when the gain amount K of the backlight 208 is improved, luminance of an input image is improved in all gradations.
In the input image, since information on the high luminance signal side is compressed, it is desired that luminance on the high luminance side is restored. In the process of luminance correction 321, basically, only the gain amount K of the backlight 208 is improved. Accordingly, as illustrated in
Specifically, in the luminance signal correction 322, a signal process of degenerating a luminance signal is performed according to a degree of luminance correction (according to gain amount of backlight 208) on the low luminance side and the intermediate luminance side.
As illustrated in
In
In the luminance signal correction 322, a luminance signal Y after performing the luminance correction 321 due to an improvement in gain, or the like, of the backlight 208 is input, and a luminance signal Y+deltaY is output.
In addition, in the color signal correction 323, input chroma signals Cb and Cr are corrected so that a ratio of the luminance signal Y to a chroma signal C becomes constant by inputting the luminance signal Y, the chroma signals Cb and Cr, and the luminance signal correction deltaY. Specifically, according to the following expressions (1) and (2), the input chroma signals Cb and Cr are corrected so as to be output chroma signals Cb′ and Cr′.
[Math. 1]
C
b
′=C
b×(1+ΔY/Y) (1)
[Math. 2]
C
r
′=C
r×(1+ΔY/Y) (2)
The functional configuration illustrated in
In the luminance signal correction 322, a process of optimizing a signal curve of a luminance signal is performed after calculating a luminance signal Y from an RGB image signal according to the following expression (3), as described with reference to
[Math. 3]
Y=aR+bG+cB (3)
In addition, in the color signal correction 323, a color signal correction is performed by multiplying correction coefficients wr, wg, wb by each color component of RGB based on the luminance signal Y′ after correction.
In this manner, it is possible to realize brightness which is almost close to that in a real space by converting an image which is compressed into a low dynamic range or a standard dynamic range into a high dynamic range image as if it were an image in a high dynamic range. In addition, it is possible to express natural high luminance signal information by performing the luminance signal correction process and the color signal correction process which are illustrated in
It is possible to further improve a dynamic range by combining partial driving and a thrusting technology with a technology of realizing brightness which is close to brightness in a real space by restoring high luminance signal information of an image. The partial driving is a technology which controls a lighting location of a backlight, and it is possible to improve luminance contrast by lighting a backlight corresponding to a region with a high signal level brightly, and on the other hand, by lighting a backlight corresponding to a region with a low signal level darkly (for example, refer to PTL 3). In addition, it is possible to execute higher contrast by causing power which is suppressed at a dark portion to be intensively emitted by distributing the power to a region with a high signal level, for example, by performing luminance thrusting in which luminance is increased when partially performing a white display (in a state in which overall output power of backlight is constant) (for example, refer to PTL 4).
In order to make descriptions simple, descriptions will be made with reference to
In the example illustrated in
In the example illustrated in
The power of the backlight 208 may be maximum 400 W or less in total. Accordingly, as illustrated in
Hitherto, the technology which is disclosed in the present disclosure has been described in detail with reference to specific embodiments. However, it is clear that those skilled in the art can perform a correction or substitution of the embodiment without departing from the scope of the technology which is disclosed in the present disclosure.
According to the technology which is disclosed in the present disclosure, it is possible to convert an image which is subjected to Knee compression so as to be in a low dynamic range or a standard luminance dynamic range into an image with a high dynamic range which is close to brightness in a real space without the definition information of the Knee compression. In addition, the technology which is disclosed in the present disclosure can also be applied to a case in which contents which are originally produced in a low dynamic range or a standard luminance dynamic range are converted into a high dynamic range image, and it is possible to express natural high luminance signal information.
The technology which is disclosed in the present disclosure can be applied to various devices which can display or output an HDR image, for example, a monitor display which is used in an information device such as a television receiver, a personal computer, or the like, and a multifunction terminal such as a game machine, a projector, a printer, a smart phone, and a tablet.
In addition, in the technology which is disclosed in the present disclosure, it is possible to make brightness to be close to that in a real space by restoring compressed high luminance signal information of an input image, by being applied to both a still image and a moving image.
In brief, the technology which is disclosed in the present disclosure has been described in a form of exemplification, and described contents of the present disclosure are not to be restrictively interpreted. In order to determine the scope of the technology which is disclosed in the present disclosure, claims should be considered.
The present technology may also be configured as below.
(1) An image processing apparatus including:
a processing device that determines a degree of degeneracy of high luminance signal information of an input image, and obtains a luminance signal curve based on the degree of degeneracy.
(2) The apparatus according to (1),
wherein the degree of degeneracy is determined based on a luminance signal level of the input image.
(3) The apparatus according to (1) or (2),
wherein the processing device controls luminance of individual light emission units, in accordance with the luminance signal curve.
(4) The apparatus according to any of (1) to (3),
wherein the luminance is controlled according to gradation.
(5) The apparatus according to any of (1) to (4),
wherein the luminance is controlled according to all gradations.
(6) The apparatus according to any of (1) to (5)
wherein at least one of the light emission units is a light emitting diode.
(7) The apparatus according to any of (1) to (6),
wherein the processing device controls power of a backlight of a display device, in accordance with the luminance signal curve.
(8) The apparatus according to any of (1) to (7),
wherein the power of individual light emission units of the backlight is controlled, in accordance with the luminance signal curve, by reducing power of a first light emission unit of the light emission units by a first power amount and increasing power of a second light emission unit of the light emission units by a portion of the first power amount.
(9) The apparatus according to any of (1) to (8),
wherein the power of the second light emission unit is increased by the portion of the first power amount, such that the power of the second light emission unit is greater than a power at which each of the light emission units is set when the backlight is 100% lit on the screen in accordance with a luminance signal level set to 100%.
(10) The apparatus according to any of (1) to (9),
wherein the processing device controls a chroma signal, in accordance with the luminance signal curve.
(11) The apparatus according to any of (1) to (10),
wherein the chroma signal is determined using a luminance signal correction value, the luminance signal correction value being in accordance with the luminance signal curve.
(12) The apparatus according to any of (1) to (11),
wherein the chroma signal is controlled so a ratio of a luminance signal, in accordance with the luminance signal curve, to the chroma signal is same as a ratio of a luminance signal indicating luminance of the input image to a chroma signal indicating hue of the input image.
(13) The apparatus according to any of (1) to (12),
wherein the chroma signal is controlled to maintain an original hue of the input image.
(14) An image processing method including:
determining, by a processing device, a degree of degeneracy of high luminance signal information of an input image, and obtaining, by the processing device, a luminance signal curve based on the degree of degeneracy.
(15) A non-transitory storage medium on which is recorded a program for image processing, the program including:
determining a degree of degeneracy of high luminance signal information of an input image, and obtaining a luminance signal curve based on the degree of degeneracy.
(16) A display apparatus including:
a processing device that determines a degree of degeneracy of high luminance signal information of an input image, and obtains a luminance signal curve based on the degree of degeneracy; and
a display device including a backlight configured by a plurality of light emission units, wherein the processing device controls power of the individual light emission units, in accordance with the luminance signal curve.
(17) The display apparatus according to (16),
wherein the processing device controls luminance of the individual light emission units, in accordance with the luminance signal curve.
(18) The display apparatus according to (16) or (17),
wherein the luminance is controlled according to gradation.
(19) The display apparatus according to any of (16) to (18), wherein
the degree of degeneracy is determined based on a luminance signal level of the input image.
(20) The display apparatus according to any of (16) to (19), wherein
the light emission units include light emitting diodes.
In addition, it is also possible to adopt the following configuration in the technology which is disclosed in the present disclosure.
(1) An image processing device including:
a determination unit which determines a degree of degeneracy of high luminance signal information of an input image; and
an adjusting unit which adjusts the input image based on a determination result using the determination unit.
(2) The image processing device which is described in (1), in which the adjusting unit includes a luminance correction unit which corrects luminance based on the determination result using the determination unit; a luminance signal correction unit which corrects a luminance signal according to gradation; and a color signal correction unit which corrects a change in hue which is associated with the correction of the luminance signal.
(3) The image processing device which is described in (2), in which the luminance correction unit improves luminance in all gradations according to a degree of degeneracy of high luminance signal information which is determined by the determination unit.
(4) The image processing device which is described in (2), in which the luminance signal correction unit optimizes a signal curve with respect to gradation which is degenerated, and gradation which is not degenerated.
(5) The image processing device which is described in (2), in which the color signal correction unit maintains original hue by performing a reverse correction with respect to a change when the hue is changed associated with the correction of the luminance signal which is performed using the luminance signal correction unit.
(6) The image processing device which is described in (2), in which the color signal correction unit corrects a chroma signal so that a ratio of a luminance signal to the chroma signal becomes constant before and after correcting the luminance signal.
(7) The image processing device which is described in (1), in which the determination unit determines a degree of degeneracy of high luminance signal information thereof based on a luminance signal level of an input image.
(8) The image processing device which is described in (1), in which the determination unit determines the degree of degeneracy of the high luminance signal information based on at least one of a maximum luminance signal level in an input image, an amount in the vicinity of a value of the maximum luminance signal level in the input image, a mean value of a luminance signal in the input image, and an amount in the vicinity of a value of a black level in the input image.
(9) An image processing method including:
determining a degree of degeneracy of high luminance signal information of an input image; and
adjusting the input image based on a determination result in the determining.
(10) An image display device including:
a determination unit which determines a degree of degeneracy of high luminance signal information of an input image;
an adjusting unit which adjusts the input image based on a determination result using the determination unit; and
a display unit which displays the image which is adjusted.
Number | Date | Country | Kind |
---|---|---|---|
2014-042857 | Mar 2014 | JP | national |
2014-245564 | Dec 2014 | JP | national |
Filing Document | Filing Date | Country | Kind |
---|---|---|---|
PCT/JP2015/001081 | 3/2/2015 | WO | 00 |