Patent Application
20200092527
The present invention relates to a transmission apparatus, a method of transmitting image data in a high dynamic range, a reception apparatus, a method of receiving the image data in the high dynamic range, and a program, and more particularly to a transmission apparatus and the like for transmitting image data in a high dynamic range for displaying an image in the high dynamic range.
In recent years, for example, a High Definition Multimedia Interface (HDMI) has spread as a communication interface through which a digital picture signal, that is, a non-compressed (baseband) picture signal (image data) and a digital voice signal (voice data) associated with the picture signal, is transmitted at a high speed from a Digital Versatile Disc (DVD) recorder, a set top box, or other Audio Visual (AV) Source to a television receiver, a projector, or other displays. For example, HDMI specifications are described in detail in NPL 1.
For example, an AV system and the like are considered in which a disk player as a source apparatus and a television receiver as a synchronized apparatus are HDMI-connected to each other, but luminance is luminance-adjusted on the assumption that the image data recorded on the disk player is displayed on a display apparatus with a specification such as maximum luminance of 100 cd/m2.
On the other hand, with advances in the technology, the maximum luminance of the display apparatus has been extended in practice to 1,000 cd/m2, exceeding 100 cd/m2 in the related art, and the ability of the display apparatus to perform high-luminance outputting is not put to good use.
Then, High Dynamic Range (HDR) processing is proposed in which luminance dynamic range processing is performed such that processing of the image data with maximum luminance is performed exceeding 100 cd/m2 is proposed and has been extended in practice in terms of capturing of a static image and of post-processing. For example, proposals for a method of recording HDR image data and processing of the HDR image data are put forward in PTL 1.
No proposal as to transmission specifications for a high dynamic range in digital interfaces, such as the HDMI, has been put forward in the related art.
An object of the present technology is to satisfactorily enable transmission of image data in a high dynamic range between apparatuses to be performed.
A concept of the present technology lies in a transmission apparatus including: a data transmission unit that transmits image data in a high dynamic range to an external apparatus over a transmission path; and an information transmission unit that transmits information on a transmission method for and/or information on gamma correction for the image data in the high dynamic range that is transmitted in the data transmission unit, to the external apparatus over the transmission path.
In the present technology, the data transmission unit transmits the image data in the high dynamic range to the external apparatus over the transmission path. For example, the data transmission unit may transmit the image data in the high dynamic range to the external apparatus over the transmission path using a differential signal.
For example, the image data in the high dynamic range may include first data and second data, and the data transmission unit may configure the first data and the second data into a picture format stipulated for a stereoscopic image, and may transmit the picture format to the external apparatus over the transmission path. Furthermore, for example, the image data in the high dynamic range may include first data and second data, and the data transmission unit may transmit the first data, as a first frame image, to the external apparatus over the transmission path and may transmit the second data, as a second frame image, to the external apparatus over the transmission path.
For example, the image data in the high dynamic range may include first data and second data, and the first data may be low-order 8-bit data of the image data in the high dynamic range and the second data may be high-order bit data of the image data in the high dynamic range, or the first data may be high-order 8-bit data of the image data in the high dynamic range and the second data may be low-order bit data of the image data in the high dynamic range.
The information transmission unit transmits the information on the transmission method for and/or the information on the gamma correction for the image data in the high dynamic range that is transmitted in the data transmission unit, to the external apparatus over the transmission path. For example, the information transmission unit may insert the information on the transmission method for and/or the information on the gamma correction for the image data in the high dynamic range that is transmitted in the data transmission unit, during a blanking period of the image data in the high dynamic range, and thus may transmit the inserted information to the external apparatus. Furthermore, the information transmission unit may transmit the information on the transmission method for and/or the information on the gamma correction for the image data in the high dynamic range that is transmitted in the data transmission unit, to the external apparatus over a control data line that makes up the transmission path.
Furthermore, for example, the information transmission unit may transmit the information on the transmission method for and/or the information on the gamma correction for the image data in the high dynamic range that is transmitted in the data transmission unit, to the external apparatus over a bidirectional communication path that is configured from a predetermined line of the transmission path. In this case, for example, the bidirectional communication path may be a pair of differential communication paths, and at least one of the differential communications paths in the pair may have a function of receiving a connection state notification from the external apparatus using direct-current bias potential.
Furthermore, for example, the information on the transmission method for and the information on the gamma correction for the image data in the high dynamic range that is transmitted in the data transmission unit may include at least one, among information at a maximum white level exceeding 100%, of the image data in the high dynamic range, a bit value at the time of expression at a black level, a bit value at the time of expression at a 100% white level, a flag indicating whether or not processing for the high dynamic range is performed, a luminance level of a reception apparatus that is assumed at the time of the 100% white level, a luminance input level that is necessary for a luminance increase in an image in the high dynamic range, and an increase luminance output level that is necessary for the luminance increase in the image in the high dynamic range.
In the present technology, in this manner, the image data in the high dynamic range is transmitted to the external apparatus over the transmission path, and the information on the transmission method for and/or the information on the gamma correction for the image data in the high dynamic range are transmitted to the external apparatus over the same transmission path. For this reason, in the external apparatus, for example, it can be easily understood which transmission method and which gamma correction method the image data in the high dynamic range is transmitted with, and thus the transmission of the image data in the high dynamic range can be satisfactorily performed.
Moreover, in the present technology, for example, an information reception unit that receives the pieces of information on the transmission method for and/or the gamma correction method for the image data in the high dynamic range that the external apparatus is able to support, which are transmitted from the external apparatus over the transmission path, and a method selection unit that, based on the information on the transmission method and/or the information on the gamma correction method that are received in the information reception unit, selects a predetermined transmission method and/or a predetermined gamma correction method from among the transmission methods for and/or the gamma correction methods for the image data in the high dynamic range which the external apparatus is able to support may further be included, and the data transmission unit may transmit the image data in the high dynamic range in accordance with the transmission method and/or the gamma correction method that are selected in the method selection unit, to the external apparatus over the transmission path.
In this case, the external apparatus can satisfactorily support the transmission method for and/or the gamma correction method for the image data in the high dynamic range that is transmitted to the external apparatus. For this reason, the transmission of the image data in the high dynamic range can be satisfactorily performed.
Furthermore, another concept of the present technology lies in a reception apparatus including: a data reception unit that receives image data in a high dynamic range for displaying an image in the high dynamic range from an external apparatus over a transmission path; an information reception unit that receives information on a transmission method for and/or information on gamma correction for the image data in the high dynamic range which is received in the data reception unit, from the external apparatus; and a data processing unit that, based on the information on the transmission method and/or the information on the gamma correction that are received in the information reception unit, processes the image data in the high dynamic range that is received in the data reception unit.
In the present technology, the data reception unit receives the image data in the high dynamic range for displaying the image in the high dynamic range from the external apparatus over the transmission path. For example, the data reception unit may receive the image data in the high dynamic range from the external apparatus over transmission path using a differential signal.
For example, the image data in the high dynamic range may include first data and second data, and the data transmission and reception unit may receive the first data and the second data, which are configured into a picture format stipulated for a stereoscopic image, from the external apparatus over the transmission path. Furthermore, for example, the image data in the high dynamic range may include first data and second data, and the data transmission and reception unit may receive a first frame image that is configured from the first data and a second frame image that is configured from the second data, from the external apparatus over the transmission path.
For example, the image data in the high dynamic range may include first data and second data, and the first data may be low-order 8-bit data of the image in the high dynamic range and the second data may be high-order bit data of the image in the high dynamic range, or the first data may be high-order 8-bit data of the image data in the high dynamic range and the second data may be low-order bit data of the image data in the high dynamic range.
The information reception unit receives the information on the transmission method for and/or the information on the gamma correction for the image data in the high dynamic range that is received in the data reception unit, from the external apparatus. Then, the data processing unit processes the image data in the high dynamic range that is received in the data reception unit, based on the information on the transmission method and/or the information on the gamma correction that are received in the information reception unit.
For example, the information reception unit may extract the information on the transmission method for and/or the information on the gamma correction for the image data in the high dynamic range from a blanking period of the image data in the high dynamic range that is received in the data reception unit. Furthermore, for example, the information reception unit may receive the information on the transmission method for and/or the information on the gamma correction for the image data in the high dynamic range that is received in the data reception unit, from the external apparatus over a control data line that makes up the transmission path.
Furthermore, for example, the information reception unit may receive the information on the transmission method for and/or the information on the gamma correction for the image data in the high dynamic range that is received in the data reception unit, from the external apparatus over a bidirectional communication path that is configured from a predetermined line of the transmission path. Then, in this case, the bidirectional communication path may be a pair of differential communication paths, and at least one of the differential communications paths in the pair may have a function of notifying the external apparatus of a connection state using direct-current bias potential.
In the present technology, in this manner, the image data in the high dynamic range that is transmitted from a transmitting side is processed based on the information on the transmission method and/or the information on the gamma correction that are transmitted from the same transmitting side, and thus the appropriate processing can be easily performed on the image data in the high dynamic range that is received.
Moreover, in the present technology, for example, a display control unit may further be included that performs a display of whether or not to cancel an energy saving mode, on a display unit, when the information on the transmission method for the image data in the high dynamic range that is transmitted from the external apparatus is received in the information reception unit, if the energy saving mode is selected. Accordingly, it is possible to check a user's intention to confirm whether or not to cancel the energy saving mode.
Furthermore, in the present technology, for example, an information storage unit in which the pieces of information on the transmission method for and/or the gamma correction for the image data in the high dynamic range that the information storage unit itself is able to support are stored, and an information transmission unit that transmits the information on the transmission method and/or the information on the gamma correction method that are stored in the information storage unit, to the external apparatus over the transmission path may further be included. The pieces of information on the transmission method for and/or the gamma correction method for the image data in the high dynamic range that the information storage unit itself can support are transmitted to the transmitting side and thus it is possible to receive the image data in the high dynamic range in accordance with the transmission method and/or the gamma correction method that the information storage unit itself can support, from the transmitting side.
For example, at least one, among information on maximum luminance at which a display is possible, information on a maximum increase luminance level at which processing for the high dynamic range is possible, and a flag for prohibiting increase processing, may further be stored in the information storage unit.
Furthermore, for example, a storage control unit may further be included that rewrites a flag for prohibiting the increase processing as invalid, which is stored in the information storage unit, if the flag for prohibiting increase processing is stored in the information storage unit and an energy saving mode is selected. Furthermore, for example, a storage control unit may further be included that rewrites information on a maximum luminance at which a display is possible and information on a maximum increase luminance level at which the processing for the high dynamic range is possible, which are stored in the information storage unit, if the information on the maximum luminance at which the display is possible and the information on the maximum increase luminance level at which processing for the high dynamic range is possible are stored in the information storage unit and an energy saving mode is selected.
According to the present technology, the transmission of image data in a high dynamic range can be satisfactorily performed between apparatuses. Moreover, effects described in the present specification are merely examples and thus are not limited to these examples, and additional effects may be present.
Embodiments for reduction to practice of the invention (hereinafter referred to as “embodiments”) are described below. Moreover, descriptions are provided as follows.
[Configuration Example of an AV System]
An HDMI terminal 11a, to which an HDMI transmission unit (HDMITX) 11b and a high-speed bus interface (high-speed bus I/F) 11c are connected, is provided to the disk player 11. An HDMI terminal 12a, to which an HDMI reception unit (HDMI RX) 12b and a high-speed bus interface (high-speed bus I/F) 12c are connected, is provided to the television receiver 12. One end of the HDMI cable 13 is connected to the HDMI terminal 11a of the disk player 11, and the other end of HDMI cable 13 is connected to the HDMI terminal 12a of the television receiver 12.
In the AV system 10 illustrated in
That is, the HDMI transmission unit 11b has an HDMI transmitter 21. The transmitter 21, for example, converts non-compressed image pixel data into the corresponding differential signal, and serial-transmits the result of the conversion to the HDMI reception unit 12b in the multiple channels, three Transition Minimized Differential Signaling (TMDS) channels #0, #1, and #2, in one direction.
Furthermore, the transmitter 21 converts the voice data associated with a non-compressed image, the necessary control data, other items of auxiliary data, and the like into the corresponding differential signal and serial-transmits the result of the conversion to the HDMI reception unit 12b in one direction in the three TMDS channels #0, #1, and #2. Additionally, the transmitter 21 transmits a pixel clock that is synchronized with the pixel data that is transmitted in the three TMDS channels #0, #1, and #2, to the HDMI reception unit 12b in a TMDS clock channel. At this point, 10-bit pixel data is transmitted at one clock that is the pixel clock in one TMDS channel #i (i=0, 1, 2).
During the active video period 14 (refer to
That is, the HDMI reception unit 12b has an HDMI receiver 22. In the TMDS channels #0, #1, and #2, the receiver 22 receives the differential signal that is received in one direction from the HDMI transmission unit 11b that is connected over the HDMI cable 13 and that corresponds to the pixel data, and the differential signal that corresponds to the voice data or the control data. On this occasion, the differential signals are synchronized with the pixel clock that is similarly transmitted in the TMDS clock channel from the HDMI transmission unit 11b and thus is received.
In addition to the three TMDS channels #0 to #2 as transmission channels for transmitting the pixel data and the voice data and the TMDS clock channel as transmission channels for transmitting the pixel clock, transmission channels for an HDMI system that is configured from the HDMI source transmission unit 11b and the HDMI reception unit 12b include a transmission channel called a Display Data Channel (DDC) 23 or a Consumer Electronic Control (CEC) line 24.
The DDC 23 is made from two signal lines that are included in the HDMI cable 13. The HDMI transmission unit 11b uses the DDC 23 in order to read Enhanced Extended Display Identification Data (E-EDID) from the HDMI reception unit 12b that is connected over the HDMI cable 13. That is, in addition to the HDMI receiver 22, the HDMI reception unit 12b has an EDID Read Only Memory (ROM) in which E-EDID that is capability information relating to its own configuration capability is stored.
The HDMI transmission unit 11b reads, over the DDC 23, the E-EDID on the HDMI reception unit 12b from the HDMI reception unit 12b that is connected over the HDMI cable 13. Then, based on the E-EDID, the HDMI transmission unit 11b recognizes setting of configuration capability of the HDMI reception unit 12b, that is, for example, a format of an image (profile), such as RGB, YCbCr 4:4:4, YCbCr 4:2:2, that an electronic apparatus having the HDMI reception unit 12b supports.
The CEC line 24 is made from one signal line that is included in the HDMI cable 13, and is used to perform bidirectional control data communication between the HDMI transmission unit 11b and the HDMI reception unit 12b. Furthermore, a line (HPD line) 25 that is connected to a pin called Hot Plug Detect (HPD) is included in the HDMI cable 13.
The source apparatus uses the line 25 and thus can detect the connection to the synchronized apparatus using direct-current bias potential. In this case, from the perspective of the source apparatus, the HPD line has a function of receiving a connection state notification from the synchronized apparatus using the direct-current bias potential. On the other hand, from the perspective of the synchronized apparatus, the HPD line has a function of notifying the source apparatus of the connection state using the direct-current bias potential.
Furthermore, a line (power source line) 26 that is used to supply electric power from the source apparatus to the synchronized apparatus is included in the HDMI cable 13. Additionally, a reserve line 27 is included in the HDMI cable 13. In some cases, a pair of differential transmission paths is configured from the HPD line 25 and the reserve line 27 and is used as a bidirectional transmission path.
At this point, the video field period is a period from an active edge of a certain vertical synchronization signal to an active edge of the next vertical synchronization signal, and is divided into a horizontal blanking period 15, a vertical blanking period 16, and the effective pixel period 14 (active video) that is a period that results from excluding the horizontal blanking period and the vertical blanking period from the video field period.
The video data period 17 is assigned to the effective pixel period 14. During the video data period 17, data on the effective pixel (Active Pixel) for 1920 pixels×1080 lines that makes up non-compressed image data for one image is transmitted. The data island period 18 and the control period 19 are assigned to the horizontal blanking period 15 and the vertical blanking period 16. During the data island period 18 and the control period 19, the auxiliary data is transmitted.
That is, the data island period 18 is assigned to one portion of the horizontal blanking period 15 and of the vertical blanking period 16. During the data island period 18, for example, a voice data packet and the like that are data not relating to the control, among the items of auxiliary data, are transmitted. The control period 19 is assigned to another portion of the horizontal blanking period 15 and of the vertical blanking period 16. During the control period 19, for example, a vertical synchronization signal and a horizontal synchronization signal, a control packet, and the like that are data relating to the control, among the items of auxiliary data, are transmitted.
According to the embodiment, over the HDMI cable 13 the disk player 11 receives, from the television receiver 12, pieces of information on a transmission method for and a gamma correction method for the image data in a high dynamic range that the television receiver 12 can support. The high dynamic range is hereinafter suitably shortened to “HDR”. In this case, the television receiver 12 stores in a storage unit pieces of information on the transmission method for and the gamma correction method for HDR image data that the television receiver 12 itself supports, and transmits the information on the transmission method and the information on the gamma correction method to the disk player 11 over the HDMI cable 13. Moreover, in the related art, there is no transmission specification for the HDR image and no compatibility among cameras.
Based on the information on the transmission method and the information on the gamma correction method that are received from the television receiver 12, the disk player 11 selects a predetermined transmission method and a gamma correction method from among transmission methods for the HDR image data that the television receiver can support. In this case, for example, if each of the transmission methods for and the gamma correction methods for the HDR image data that the television receiver 12 can support are two or more in number, the disk player 11 selects the transmission method that is small in image deterioration and the gamma correction method with which the easiest approximation is possible.
The disk player 11 transmits the HDR image data in accordance with the selected transmission method and gamma correction method to the television receiver 12 over the HDMI cable 13. On this occasion, the disk player 11 transmits the information on the method of transmitting the HDR image data to be transmitted and the information on the gamma correction to the television receiver 12 over the HDMI cable 13.
Over the HDMI cable 13, the television receiver 12 receives the HDR image data and receives the information on the transmission method for and the information on the gamma correction for the HDR image data from the disk player 11. The television receiver 12 processes the received HDR image data based on the received information on the transmission method and the information on the gamma correction, and generates the HDR image data for display. Maximum luminance of an object in the natural world is equal to or more than 2,000 cd/m2.
In the related art, for example, luminance is adjusted on the assumption that the image data that is recorded in the disk player is displayed on a display apparatus with a specification of a maximum luminance of 100 cd/m2. In other words, in the related art, the image data is greatly compressed in luminance, compared to a luminance value available in the natural world. Furthermore, the maximum luminance of the display apparatus has been extended in practice to 1,000 cd/m2, exceeding 100 cd/m2 in the related art. When processing that raises a luminance value of the image data originally adjusted to 100 cd/m2 to 1,000 cd/m2 is performed in the display apparatus, a problem of image quality occurs.
The HDR image is proposed in order to realize a high-luminance image in which a white level of luminance is 100% or more. The 100% white level of luminance is normally expressed as a bit value of 235 or 255 in an 8-bit system. 8 or more bits are necessary for gray scale in order to express luminance exceeding the 100% white level of luminance. In other words, the HDR image data is image data that is 10 bits, 12 bits, 16 bits, and the like in length.
[Configuration Example of the Disk Player]
Furthermore, the disk player 11 has a Serial Advanced Technology Attachment (SATA) interface 110, a Blu-Ray Disc (BD) drive 111, an Ethernet interface (I/F) 112, and a network terminal 113. Furthermore, the disk player 11 has a Moving Picture Expert Group (MPEG) decoder 115, a graphics generation circuit 116, a picture output terminal 117, a voice output terminal 118, and a HDR processing circuit 114.
Furthermore, the disk player 11 may have a display control unit 121, a panel drive circuit 122, a display panel 123, and a power source unit 124. Moreover, “Ethernet” is a registered trademark. The high-speed bus interface 11c, the CPU 104, the flash ROM 106, the SDRAM 107, the remote control reception unit 108, the SATA interface 110, the Ethernet interface 112, and the MPEG decoder 115 are connected to the internal bus 105.
The CPU 104 controls operation of each unit of the disk player 11. The flash ROM 106 retains control software and stores the data. The SDRAM 107 makes up a work area of the CPU 104. The CPU 104 deploys on the SDRAM 107 the software or the data that is read from the flash ROM 106, starts the software and controls each unit of the disk player 11.
The remote control reception unit 108 receives a remote control signal (remote control code) that is transmitted from the remote control transmission unit 109 and supplies the received remote control signal to the CPU 104. The CPU 104 controls each unit of the disk player 11 according to the remote control code. Moreover, according to the embodiment, the remote control unit is illustrated as the user instruction input unit, but the user instruction input unit may have different configurations, such as a touch panel unit that performs an instruction input using a switch, a wheel, and a proximity/touch, a gesture input unit that detects the instruction input using a mouse, a keyboard, and a camera, and a voice input unit that performs the instruction input using voice.
The BD drive 101 records content data on a BD disc (not illustrated) as a disk-shaped recording media, or reproduces the content data from the BD. The BD drive 111 is connected to the internal bus 105 through the SATA interface 110. The MPEG decoder 115 performs coding processing on an MPEG 2 stream reproduced in the BD drive 111 and thus obtains image data and voice data.
The graphics generation circuit 116 performs convolution processing of graphics data and the like on the image data that is obtained in the MPEG decoder 115, whenever necessary. The picture output terminal 117 outputs the image data that is output from the graphics generation circuit 116. The voice output terminal 118 outputs the voice data that is obtained in the MPEG decoder 115.
The panel drive circuit 122 drives the display panel 123, based on picture (image) data that is output from the graphics generation circuit 260. The display control unit 121 controls the graphics generation circuit 116 or the panel drive circuit 122 and thus controls displaying on the display panel 123. The display panel 123, for example, is configured from a Liquid Crystal Display (LCD), a Plasma Display Panel (PDP), an Organic Electro-Luminescence (EL) panel, or the like.
Moreover, according to the embodiment, the example in which the display control unit 121 is provided outside of the CPU 104 is illustrated, but the CPU 104 may directly control the displaying on the display panel 123. Furthermore, the CPU 104 and the display control unit 121 may be integrated into one chip, and may be multiple cores. The power source unit 124 supplies electric power to each unit of the disk player 11. The power source unit 124 may be an AC power source and a battery (a storage battery or a dry cell battery).
With communication in compliance with HDMI, the HDMI transmission unit (HDMI source) 11b outputs the image (picture) data or the voice data with a baseband from the HDMI terminal 11a. The high-speed bus interface 11c is an interface for the bidirectional communication path that is configured from predetermined lines (a reserve line and a HPD line according to the embodiment) that make up the HDMI cable 13.
The high-speed bus interface 11c is inserted between the Ethernet interface 112 and the HDMI terminal 101. The high-speed bus interface 11c transmits the transmission data that is supplied from the CPU 104, from the HDMI terminal 101 to the other party's apparatus over the HDMI cable 13. Furthermore, the high-speed bus interface 11c supplies reception data received from the other party's apparatus through the HDMI terminal 11a from the HDMI cable 13 to the CPU 104.
When the HDR image data for displaying the HDR image, among the items of the image data that are obtained in the MPEG decoder 115, is transmitted in the TMDS channel of HDMI, the HDR processing circuit 114 processes the HDR image data into a state in accordance with the transmission method. At this point, the HDR image data is configured in compliance with a deep color image format, or is configured in compliance with a stereoscopic image data format, or is configured in compliance with a high frame graphics format. The HDR processing circuit 114 and the HDMI transmission unit 11b, although integrated into one chip, may be multiple cores. Types of the transmission methods for the HDR image data, selection of the transmission method, a packet formation of each method, and the like are described in detail below.
Operation of the disk player 11 illustrated in
At the time of the reproducing, the content data (MPEG stream) that is reproduced from the BD by the BD drive 111 is supplied to the MPEG decoder 115 through the SATA interface 110. In the MPEG decoder 115, decoding processing is performed on the reproduced content data, and the image data or the voice data with the baseband. The image data is output to the picture output terminal 117 through the graphics generation circuit 116. Furthermore, the voice data is output to the voice output terminal 118.
Furthermore, at the time of the reproducing, according to a user's operation, the image data obtained in the MPEG decoder 115 is supplied to the panel drive circuit 122 through the graphics generation circuit 116, and a reproduction image is displayed on the display panel 123. Furthermore, according to the user's operation, the voice data obtained in the MPEG decoder 115 is supplied to a speaker not illustrated, and voice that corresponds to the reproduction image is output.
Furthermore, at the time of the reproducing, if the image data or the voice data obtained in the MPEG decoder 115 are transmitted in the TMDS channel of HDMI, the image data and the voice data are supplied to the HDMI transmission unit 11b, and thus are packed and are output from the HDMI transmission unit 11b to the HDMI terminal 11a.
Moreover, if the image data is the HDR image data, the HDR image data is processed, by the HDR processing circuit 114, into the state in accordance with the selected transmission method and then is supplied to the HDMI transmission unit 11b. Furthermore, at the time of the reproducing, when the content data reproduced in the BD drive 111 is sent to a network, the content data is output to the network terminal 113 through the Ethernet interface 112. In the same manner, at the time of the reproducing, when the content data reproduced in the BD drive 111 is sent to the bidirectional communication path of the HDMI cable 13, the content data is output to the HDMI terminal 11a through the high-speed bus interface 11c. At this point, before outputting the image data, the image data may be encoded using a copyright protection technology, such as HDCP, DTCP, and DTCP+, and thus be transmitted.
[Configuration Example of the Television Receiver]
Furthermore, the television receiver 12 has a voice signal processing circuit 212, a voice amplification circuit 213, a speaker 214, an internal bus 220, a CPU 221, a flash ROM 222, and a synchronous random access memory (SDRAM) 223. Furthermore, the television receiver 12 has an Ethernet interface (I/F) 224, a network terminal 225, a remote control reception unit 226, and a remote control transmission unit 227. Furthermore, the television receiver 12 has a display control unit 231 and the power source unit 232. Moreover, “Ethernet” is a registered trademark.
The antenna terminal 205 is a terminal into which to input a television broadcasting signal received in a reception antenna (not illustrated). The digital tuner 206 processes the television broadcasting signal that is input into the antenna terminal 205 and thus extracts a partial Transport Stream (TS) (TS packets of the picture image, and TS packets of the voice data) from a predetermined transport stream that corresponds to a channel selected by the user.
Furthermore, the digital tuner 206 takes Program Specific Information/Service Information (PSI/SI) out of the obtained transport stream, and outputs the PSI/SI to the CPU 221. Processing that extracts the partial TS in an arbitrary channel from the multiple transport streams obtained in the digital tuner 206 is possible by obtaining information on a packet ID (PID) in the arbitrary channel from the PSI/SI (PAT/PMT).
The MPEG decoder 207 performs the decoding processing on a picture packetized Elementary Stream (PES) that is configured from the TS packets of the picture data that are obtained in the digital tuner 206, and thus obtains the image data. Furthermore, the MPEG decoder 207 performs the decoding processing on a voice PED packet that is configured from the TS packet of the voice data that is obtained in the digital tuner 206, and thus obtains the voice data.
The picture signal processing circuit 208 and the graphics generation circuit 209 perform scaling processing (resolution conversion processing), convolution processing of the graphics data, the gamma correction of the HDR image data, and the like on the image data obtained in the MPEG decoder 207 or the image data received in an HDMI reception unit 202, whenever necessary.
The panel drive circuit 210 drives the display panel 211, based on the picture (image) data that is output from the graphics generation circuit 209. The display control unit 231 controls the graphics generation circuit 209 or the panel drive circuit 210 and thus controls the displaying on the display panel 211. The display panel 211, for example, is configured from a Liquid Crystal Display (LCD), a Plasma Display Panel (PDP), an Organic Electro-Luminescence (EL) panel, or the like.
Moreover, according to the embodiment, the example in which the display control unit 231 is provided in addition to the CPU 221 is illustrated, but the CPU 221 may directly control the displaying on the display panel 211. Furthermore, the CPU 221 and the display control unit 231 may be integrated into one chip, and may be multiple cores. The power source unit 232 supplies electric power to each unit of the television receiver 12. The power source unit 232 may be an AC power source and a battery (a storage battery or a dry cell battery).
The voice signal processing circuit 212 performs necessary processing, such as D/A conversion, on the voice data obtained in the MPEG decoder 207. The voice amplification circuit 213 amplifies a voice signal that is output from the voice signal processing circuit 212, and thus supplies the amplified voice signal to a speaker 214. Moreover, the speaker 214 may be monophonic or stereophonic. Furthermore, there may be one or there may be two or more speakers 214. Furthermore, the speaker 214 may be earphones or headphones. Furthermore, the speaker 214 may correspond to 2.1 channels, 5.1 channels, and the like. Furthermore, the speaker 214 may be connected to the television receiver 12 in a wireless manner. Furthermore, the speaker 214 may be another apparatus.
The CPU 221 controls operation of each unit of the television receiver 12. The flash ROM 222 retains control software and stores the data. The DRAM 223 makes up a work area of the CPU 221. The CPU 221 deploys on the SDRAM 223 software and data that are read from the flash ROM 222, and thus starts the software and controls each unit of the television receiver 12.
The remote control reception unit 226 receives the remote control signal (remote control code) that is transmitted from the remote control transmission unit 227 and supplies the received remote control signal to the CPU 221. The CPU 221 controls each unit of the television receiver 12, based on the remote control code. Moreover, according to the embodiment, the remote control unit is illustrated as the user instruction input unit, but the user instruction input unit may have different configurations, such as a touch panel unit that performs an instruction input using proximity/touch, a gesture input unit that detects an instruction input using a mouse, a keyboard, and a camera, and a voice input unit that performs the instruction input using voice.
The network terminal 225 is a terminal that is connected to the network, and is connected to the Ethernet interface 224. The high-speed bus interface 12c, the CPU 221, the flash ROM 222, the SDRAM 223, the Ethernet interface 224, the MPEG decoder 207, and the display control unit 231 are connected to the internal bus 220.
With the communication in compliance with HDMI, the HDMI reception unit (HDMI synchronization) 12b receives the image (picture) data or the voice data with the baseband, which is supplied to the HDMI terminal 12a over the HDMI cable 13. Like the high-speed bus interface 11c of the disk player 11 described above, the high-speed bus interface 12c is an interface for the bidirectional communication path that is configured from predetermined lines (the reserve line and the HPD line according to the embodiment) that make up the HDMI cable 13.
The high-speed bus interface 12c is inserted between the Ethernet interface 224 and the HDMI terminal 201. The high-speed bus interface 12c transmits the transmission data that is supplied from the CPU 221, from the HDMI terminal 12a to the other party's apparatus over the HDMI cable 13. Furthermore, the high-speed bus interface 12c supplies the reception data received from the other party's apparatus through the HDMI terminal 12a from the HDMI cable 13 to the CPU 221.
If the image data received in the HDMI reception unit 202 is the HDR image data, the HDR processing circuit 204 performs processing (decoding processing) that corresponds to the transmission method, on that HDR image data, and thus generates the HDR image data. That is, the HDR processing circuit 204 performs reverse processing to the processing by the HDR processing circuit 114 of the disk player 11 described above, and thus obtains data that makes up the HDR image data. The HDR processing circuit 204 and the HDMI reception unit 202, or the HDR processing circuit 204 and the picture signal processing circuit 208 may be integrated into one chip, or may be multiple cores.
Furthermore, the HDR processing circuit 204 performs an arithmetic operation that generates the HDR image data from first data that is configured from low-order 8-bit image data of the HDR image and second data that is configured from high-order 8-bit image data of the HDR image, or from first data that is configured from the high-order 8-bit image data of the HDR image and second data that is configured from the low-order 8-bit image data of the HDR image.
Moreover, for example, when the received content data is sent to a network, the content data is output to the network terminal 225 through the Ethernet interface 224. In the same manner, when the received content data is sent to the bidirectional communication path of the HDMI cable 13, the content data is output to the HDMI terminal 11a through the high-speed bus interface 12c. At this point, before outputting the image data, the image data may be encoded using the copyright protection technology, such as HDCP, DTCP, and DTCP+, and thus be transmitted.
Operation of the television receiver 12 illustrated in
In the MPEG decoder 207, the decoding processing is performed on a picture PES packet that is configured from the TS packet of the picture data, and thus the picture data is obtained. The scaling processing (resolution conversion processing), and the convolution processing of the graphics data are performed on the picture data, whenever necessary, in the picture signal processing circuit 208 and the graphics generation circuit 209, and then the picture data is supplied to the panel drive circuit 210. For this reason, the image that corresponds to the channel selected by the user is displayed on the display panel 211.
Furthermore, in the MPEG decoder 207, the decoding processing is performed on a voice PES packet that is configured from the TS packet of the voice data, and thus the voice data is obtained. Necessary processing such as the D/A conversion is performed on the voice data in the voice signal processing circuit 212, the voice data is additionally amplified by the voice amplification circuit 213, and then the voice data is supplied to the speaker 214. For this reason, the voice that corresponds to the channel selected by the user is output from the speaker 214.
Furthermore, the content data (the image data and the voice data), which is supplied from the network terminal 225 to the Ethernet interface 224, or which is supplied from the HDMI terminal 12a through the high-speed bus interface 12c, is supplied to the MPEG decoder 207. Subsequently, the same operation as when the television broadcasting signal is received is performed, and thus the image is displayed on the display panel 211 and the voice is output from the speaker 214.
Furthermore, in the HDMI reception unit 12b, the image data and the voice data are obtained that are transmitted from the disk player 11 that is connected to the HDMI terminal 12a over the HDMI cable 13. The image data is supplied to the picture signal processing circuit 208 through the HDR processing circuit 204. Furthermore, the voice data is supplied directly to the voice signal processing circuit 212. Subsequently, the same operation as when the television broadcasting signal is received is performed, and thus the image is displayed on the display panel 211 and the voice is output from the speaker 214.
Moreover, if the image data received in the HDMI reception unit 12b is the HDR image data, in the HDR processing circuit 204, the processing (decoding processing) that corresponds to the transmission method is performed on that HDR image data, and thus the HDR image data is generated. Then, the HDR image data is supplied from the HDR processing circuit 204 to the picture signal processing unit 208. Furthermore, in the picture signal processing circuit 208, if the HDR image data is supplied, the image data for displaying the HDR image is generated based on the HDR image data, and the gamma correction is performed based on the information on the gamma correction that is received in the HDMI reception unit 12b. For this reason, the HDR image is displayed on the display panel 211.
[Transmission Method for the HDR Image Data]
Next, the transmission method for the HDR image data is described. First, a case where the HDR image data on an original signal is configured from the image data that is 8 or more bits in length is described. At this point, as illustrated in
It is considered that when the original signal is transmitted with a baseband digital interface, for example, the following three transmission methods are used. These methods are the most desirable methods because the transmission is possible without decreasing a grade of an original signal. However, because a transmission band needs to be 1.2 times or more the image data in the 1,920×1,080p 8-bit pixel format, the transmission is possible when there is room in the transmission band.
The transmission method (1) is a method in which the transmission is performed using a deep color transmission format as illustrated in
In the transmission method (2), as illustrated in
Moreover, the description is provided above to the effect that the remaining high-order bits of the HDR image data are arranged in the left eye image data region in the stereoscopic picture format and thus are transmitted. That is, when the HDR image data is 10-bit image data, 12-bit image data, and 16-bit image data, the remaining high-order bits of the HD image data are 2 bits, 4 bits, and 8 bits, respectively. It is also considered that instead of the remaining high-order bits, the high-order 8 bits of the HDR image data are arranged in the right eye image data region in the stereoscopic picture format and thus are transmitted.
Furthermore, the description is provided above to the effect that the low-order 8 bits of the HDR image data are arranged in the left eye image data region in the stereoscopic picture format, and the remaining high-order bits of the HDR image data are arranged in a right eye image data region in the stereoscopic picture format, and thus the HDR image data is transmitted. However, it is also considered that the low-order 8 bits of the HDR image data are arranged in the left eye image data region in the stereoscopic picture format, and the remaining high-order bits of the HDR image data are arranged in a right eye image data region in the stereoscopic picture format, and the HDR image data is transmitted.
Furthermore, the description is provided above to the effect that the low-order 8 bits of the HDR image data are arranged in the left eye image data region in the stereoscopic picture format, and the remaining high-order bits of the HDR image data are arranged in a right eye image data region in the stereoscopic picture format, and thus the HDR image data is transmitted. However, it is also considered that the high-order 8 bits of the HDR image data are arranged in the left eye image data region in the stereoscopic picture format, and the remaining low-order bits of the HDR image data are arranged in the right eye image data region in the stereoscopic picture format, and thus the HDR image data is transmitted.
The transmission method (3) is a transmission method in which, as illustrated in
Moreover, the description is provided above to the effect that the remaining high-order bits of the HDR image data are arranged in the second frame image data region and thus are transmitted. That is, when the HDR image data is 10-bit image data, 12-bit image data, and 16-bit image data, the remaining high-order bits of the HD image data are 2 bits, 4 bits, and 8 bits, respectively. It is also considered that instead of the remaining high-order bits, the high-order 8 bits of the HDR image data is arranged in the second frame image data region and thus are transmitted.
Furthermore, the description is provided above to the effect that the low-order 8 bits of the HDR image data are arranged in the first frame image data region with the high frame rate, and the remaining high-order bits of the HDR image data are arranged in the second frame image data region, and thus the HDR image data is transmitted. However, it is also considered that the low-order 8 bits of the DR image data are arranged in the second frame image data region with the high frame rate, and the remaining high-order bits of the HDR image data are arranged in the first frame image data region, and thus the HDR image data is transmitted.
Furthermore, the description is provided above to the effect that the low-order 8 bits of the HDR image data are arranged in the first frame image data region with the high frame rate, and the remaining high-order bits of the HDR image data are arranged in the second frame image data region, and thus the HDR image data is transmitted. However, it is also considered that the high-order 8 bits of the HDR image data are arranged in the first frame image data region with the high frame rate, and the remaining low-order bits of the HDR image data are arranged in the second frame image data region, and thus the HDR image data is transmitted.
Moreover, in the cases of the transmission methods (2) and (3), the HDR processing circuit 204 of the television receiver 12, described above, performs processing that separately extracts the low-order 8 bits of the HDR image data and the high-order bits, or the high-order 8-bits and the low-order bits, from the stereoscopic picture format or from the picture format for the high frame rate, respectively.
[Gamma Correction Method for the HDR Image Data]
Next, a gamma correction method for HDR image data is described.
In the gamma correction method (1), as illustrated in
In the gamma correction method (2), as illustrated in
In the gamma correction method (3), as illustrated in
[Example of a Data Structure of the EDID]
Furthermore, in the basic block, subsequently to “2nd timing”, information indicating a name of the display apparatus that is expressed as “Monitor Name”, and information indicating the number of pixels that are available for display in the case of an aspect ratio of 4 to 3 or 16 to 9, which is expressed as “Monitor Range Limits” are sequentially arranged.
In a head of the extension block, an image size (resolution) that is available for display, a frame rate, information indicating whether the display is interlaced or progressive, data containing a description of information such as an aspect ratio, which are expressed as “Short Video Descriptor”, and a method of coding and decoding voice reproducible, a sampling frequency, a cut-off band, and data containing a description of information such as the number of codec bits, which are expressed as “Short Audio Descriptor”, and information relating to left and right speakers, which is expressed as “Speaker Allocation” are sequentially arranged.
Furthermore, in the extension block, subsequently to “Speaker Allocation”, data that is specifically defined for every maker, which is expressed as “Vender Specific”, timing information for maintaining compatibility with the previous EDID, which is expressed as “3rd timing”, and timing information for maintaining compatibility with the previous EDID, which is expressed as “4th timing”, are arranged.
[Example of the Data Structure of a Vendor Specific Data Block (VSDB) Region]
According to the embodiment, the data area that is extended to store the HDR image information is defined in the VSDB region.
A Data region of the HDR image information that the synchronized apparatus (the television receiver 12 according to the embodiment) has to store is defined in a fourth bit of an eighth byte and in (M+1)-th to (M+3)-th bytes subsequent to already-defined 0-th to M-th bytes.
First, 0-th to 8-th bytes are described. A header indicating a data region that is expressed as “Vender-specific tag code (=3)”, and information indicating a length of the VSDB data that is expressed as “Length (=N)” are arranged in the 0-th byte arranged in the head of the data, which is expressed as “Vendor Specific”. Furthermore, information indicating a number “0x0000C3” that is registered for HDMI (R), which is expressed as “24 bit IEEE Registration Identifier (0x0000C3) LSB first” is arranged in first to third bytes.
Additionally, information indicating a 24-bit physical address of the synchronized apparatus, which is expressed by each of “A”, “B”, “C” and “D” is arranged in fourth to fifth bytes. A flag indicating a function that the synchronized apparatus supports, which is expressed as “Supports-AI”, each piece of information assigning the number of bits per one pixel, which is expressed as each of “DC-48 bit”, “DC-36 bit”, and “DC-30 bit”, a flag indicating whether the synchronized apparatus supports the transmission of a 4:4:4: YCbCr image, which is expressed as “DCY 444”, and a flag indicating whether the synchronized apparatus supports a Digital Visual interface (DVI), which is expressed as “DVI-Dual”, are arranged in a sixth byte.
Furthermore, information indicating a maximum frequency of a pixel clock of the TMDS, which is expressed as “Max-TMDS-Clock” is arranged in a seventh byte. Flags of information assigning the presence of a latency field, information assigning the presence of an interlace latency field, information assigning the presence of extension of a 3D video format, and information assigning support of a function of a content type (CNC) are arranged in an eighth byte. In a fourth bit of the eighth byte, a flag indicating whether or not HDR information that the synchronized apparatus supports is present is newly arranged. If the flag is True, this indicates that information relating to HDR is present in in (15+M)-th to (18+M)-th bytes.
Next, the (15+M) to (18+M)-th bytes are described. Whether or not processing relating to an HDR function is prohibited in the source apparatus is indicated in a seventh bit of the (15+M)-th byte. Data indicating the three video formats (the transmission methods (1) to (3) described above) of the HDR image that the synchronized apparatus supports is written in each of sixth to fourth bits of the (15+M)-th byte.
If methods other than this are proposed, third to 0-th bits of the (15+M)-th byte are available for assignment. Data indicating the three methods of the gamma correction for the HDR image that the synchronized apparatus supports is written in each of seventh to fifth bits of the (16+M)-th byte. If gamma correction methods other this are proposed, fourth to 0-th bits of the (16+M)-th byte are available for assignment.
As an example, if a seventh bit is True, processing, such as increasing a luminance level of the HDR image or compressing bits, is prohibited in the source apparatus. A maximum luminance value that is available with the display panel unit 211 of the synchronized apparatus is assigned in a unit of cd/m2 to a (17+M)-th byte. A level of the maximum luminance increase that is possible with the processing by the picture signal processing circuit 208 of the synchronized apparatus is assigned denominated as a unit of percentage to the (18+M)-th byte. If “Raw” in a seventh bit of the (15+M)-th byte is False, these are used as pieces of information on the synchronized apparatus, necessary for the processing, such as the increase in the luminance of the HDR image or the bit compression, that is performed in the source apparatus.
A method of storing HDR transmission information using a VSDB region is proposed here, but the storing of the HDR transmission information is not limited to this method, because the storing is realizable, also in data regions other than this, with the data structure of the E-EDID, for example, such as with a Video Capability Data Block (VCDB).
In the AV system 10 illustrated in
In the AV system 10 illustrated in
In this case, the disk player 11 transmits the information to the television receiver 12 by inserting the information during the blanking period of the HDR image data (picture signal) that is transmitted to the television receiver 12. At this point, the disk player 11, for example, inserts the information relating to the image format that is currently transmitted, into the blanking period of the HDR image data by using a Vendor Specific InfoFrame (hereinafter referred to as “VSIF”) packet of HDMI and the like. The VSIF packet is arranged in the data island period 19 (refer to
[Example of the Data Structure of the VSIF Packet]
A flag indicating whether or not 3D data is present in fifth to (7+N)-th bytes subsequent to a fourth byte is assigned to a seventh bit of a fourth byte. A “HDR_Format” flag indicating whether or not transmission information on the HDR image data is present in (8+N)-th and later bytes is assigned to a succeeding sixth bit. If the “HDR_Format” flag is False, this indicates that there is no transmission of the HDR image data. If the “HDR_Format” flag is True, supplementary information relating to the HDR image is assigned to (8+N)-th to (11+M+N)-th bytes.
Information on whether or not the processing, such as the luminance increase or the luminance compression, is performed on the HDR image to be transmitted in the source apparatus is assigned to a seventh bit of a (8+N)-th byte. If “Raw” is true, this indicates that the processing, such as the luminance increase, is not performed on the source apparatus. If the “Raw” is False, this indicates that the processing, such as the luminance increase, is performed on the source apparatus.
Information on which one of the three methods (transmission methods (1) to (3)) (picture formats) of transmitting the HDR image is selected is assigned to succeeding sixth to fourth bits. In this case, for the sixth to fourth bits, the transmission method (1) is set to 0b001, the transmission method (2) to 0b010, and the transmission method (3) to 0b011. If methods other than this are proposed, 0b100 to 0b111 of the sixth to fourth bits, and third to 0-th bits are available for assignment.
Information on which one of three gamma correction methods (gamma correction methods (1) to (3) described above) for the HDR image is selected is assigned to seventh to fourth bits of a (9+N)-th byte. In this case, for the seventh to fourth bits, the gamma correction method (1) is set to 0b0001, the gamma correction method (2) to 0b0010, and the gamma correction method (3) to 0b0011. If methods other than this are proposed, 0b0100 to 0b1111 of the seventh to fifth bits, and fourth to 0-th bits are available for assignment. A byte length (M) of the data in the gamma correction method, which is assigned to (11+N)-th and later bytes, is assigned to a (10+N)-th byte.
A bit value of the image data indicating a 0% luminance level, “Nominal_Black_Level_Code_Value” is assigned to (15+N)-th byte. Normally, because values from 0 to 64 are assigned, the length is one byte. A bit value of the image data indicating the 100% luminance level, “Nominal_White_Level_Code_Value”, is assigned to (16+N)-th to (17+N)-th bytes. A bit value of the image data indicating the maximum white level that is expressed in the HDR image, “Extended_White_Level_Code_Value” is assigned to (18+N)-th to (19+N)-th bytes.
A dynamic range of the HDR image to be transmitted, “Dynamic_Range”, is assigned in units of 0.1% to (15+N)-th to (18+N)-th bytes. A luminance level in the maximum dynamic range, “Dynamic_Range_Luminance” is assigned in a unit of cd/m2 to (19+N)-th to (22+N)-th bytes.
If any one of sixth to fourth bits of a (8+N)-th byte is set to True, the synchronized apparatus (the television receiver 12 according to the embodiment) can determine that the HDR image data is transmitted. Additionally, the synchronized apparatus can determine the transmission method (picture format), depending to which one of the sixth to fourth bits is set to True.
That is, if the sixth to fourth bits are set to 0b001, it is understood that the picture format called 1,920×1,080p deep color is used, and thus the transmission of the HDR image data is performed (refer to
Furthermore, with values of seventh to fourth bits of (9+N)-th byte, the gamma correction method for the HDR image can be determined. That is, it is understood that if seventh to fourth bits are set to 0b0001, the gamma correction method (1) is used, and thus the transmission of the HDR image data is performed (refer to
A method of transmitting the HDR transmission information using the VSIF packet is proposed here, but the transmitting of the HDR transmission information is not limited to this method, because the transmission is realizable also with data packets other than this, for example, such as with an Auxiliary Video (AV) InfoFrame. However, if the information relating to HDR of the television receiver (synchronized apparatus) 12 is transmitted to the disk player (source apparatus) 11 using the VSDB region of an E-EDID data region, it is desirable that the information relating to HDR of the disk player 11 be transmitted with the VSIF packet.
[Example of Processing by the Source Apparatus at the Time of Connection to an Apparatus]
Next, processing by the disk player (source apparatus) 11 at the time of connection to the television receiver (synchronized apparatus) 12 in the AV system 10 illustrated in
The disk player 11 starts processing in Step ST1, and thereafter proceeds to processing in Step ST2. In Step ST2, the disk player 11 determines whether or not a HPD signal is at a high level “H”. When the HPD signal is not at the high level “H”, the television receiver (synchronized apparatus) 12 is not connected to the disk player 11. At this time, the disk player 11 proceeds to Step ST8, and the processing ends.
If the HPD signal is at the high level “H”, the disk player 11 reads the E-EDID of the television receiver 12 in Step ST3. Then, in Step ST4, the disk player 11 determines whether or not the HDR image information (HRD data) is present. When the HDR image information is not present, the disk player 11 sets data indicating non-transmission of the HDR image to be in the VSIF packet in Step ST7 and thereafter proceeds to Step ST8, and the processing ends. At this point, the setting of the data indicating the non-transmission of the HDR image means that a sixth bit of a fourth byte in the VSIF packet (refer to
Furthermore, when the HDR image information is present in Step ST4, the disk player 11 determines the transmission method for and the gamma correction method for the HDR image data in Step ST5. Then, the disk player 11 sets data indicating the transmission method for and the gamma correction method for the HDR image data to be in the VSIF packet in Step ST6, and thereafter proceeds to Step ST8, and the processing ends.
[Example of Selection Processing of the HDR Transmission Method in the Source Apparatus]
Next, determination processing (processing in Step ST5 in
The disk player 11 starts processing in Step ST11, and thereafter proceeds to Step ST12. In Step ST12, the disk player 11 determines whether or not a fourth bit of an eighth byte in the VSDB region in the television receiver (synchronized apparatus) 12 is at the high level “H”. When the fourth bit of the eighth byte is not at the high level “H”, the disk player 11 sets the data indicating the non-transmission of the HDR image to be in the VSIF packet in Step ST13 and thereafter proceeds to Step ST27, and the processing ends. At this point, the setting of the data indicating the non-transmission of the HDR image means that the sixth bit of the fourth byte in the VSIF packet (refer to
When in Step ST12, the fourth bit of the eighth byte is at the high level “H”, the disk player 11 proceeds to processing in Step ST14. In Step ST14, the disk player 11 determines whether or not a seventh bit of a (15+M)-th byte in the VSDB region in the television receiver 12 is at the high level “H”. When the seventh bit of the (15+M)-th byte is not at the high level “H”, the disk player 11 reads a (17+M)-th byte and a (18+M)-th byte in the VSDB region in Step ST15 and proceeds to the next Step ST16.
In Step ST16, the disk player 11 performs luminance compression processing of the HDR image to be transmitted, based on the data on the maximum luminance (cd/m2) of the display panel 211, stored in the (17+M)-th byte that is read, and on the data on the maximum luminance increase level (%) stored in the (18+M)-th byte, and proceeds to the next Step ST17. In Step ST17, the disk player 11 sets data indicating the performing of the luminance compression processing on the HDR image and the information on the gamma correction to be in the VSIF packet and thereafter proceeds to Step ST27, and the processing ends. At this point, the setting of the data indicating the performing of the luminance compression on the HDR image means that a seventh bit of a (8+N)-th byte in the VSIF packet (refer to
Furthermore, when in Step ST14, the seventh bit of the (15+M)-th byte is at the high level “H”, the disk player 11 proceeds to the next Step 19 without performing the luminance compression processing on the HDR image in Step ST18. In Step ST19, the disk player 11 determines whether or not a sixth bit of the (15+M)-th byte in the VSDB region is set to the high level “H”.
When the sixth bit of the (15+M)-th byte is at the high level “H”, the disk player 11 selects the method (1) from among the HDR image transmission methods in Step ST20, and proceeds to the next Step ST21. The disk player 11 sets data indicating the transmission method (1) for the HDR image to be in the VSIF packet in Step ST21, and thereafter proceeds to Step ST26-1. At this point, the setting of the data indicating the transmission method (1) for the HDR image means that sixth to fourth bits of a (8+N)-th byte in the VSIF packet (refer to
Furthermore, when in Step ST19, the sixth bit of the (15+M)-th byte is at the low level “L”, proceeding to the next Step ST22 takes place. In Step ST22, the disk player 11 determines whether or not a fifth bit of the (15+M)-th byte in the VSDB region is set to the high level “H”. When the fifth bit of the (15+M)-th byte is at the high level “H”, the disk player 11 selects the method (2) from among the HDR image transmission methods in Step ST23, and proceeds to the next Step ST24.
In Step ST24, the disk player 11 sets data indicating the transmission method (2) for the HDR image to be in the VSIF packet, and thereafter proceeds to Step ST26-1. At this point, the setting of the data indicating the transmission method (2) for the HDR image means that the sixth to fourth bits of the (8+N)-th byte in the VSIF packet (refer to
Furthermore, when the fifth bit of the (15+M)-th byte is not at the high level “H” in Step ST22, the disk player 11 selects the method (3) from among the HDR image transmission methods in Step ST25, and proceeds to the next Step 26. In Step ST26, the disk player 11 sets data indicating the transmission method (3) for the HDR image to be in the VSIF packet, and thereafter proceeds to Step ST26-1. At this point, the setting of the data indicating the transmission method (3) for the HDR image means that the sixth to fourth bits of the (8+N)-th byte in the VSIF packet (refer to
In Step ST26-1, the disk player 11 determines whether or not a sixth bit of a (16+M)-th byte in a VSDB packet is at the high level “H”. When the sixth bit of the (16+M)-th byte is at the high level “H”, in Step ST26-2, the disk player 11 sets seventh to fourth bits of a (9+N)-th byte in the VSIF region to “0b0010”, sets data on the gamma correction method (2) to be in (10+N)-th to (22+N)-th bytes, and proceeds to Step ST27, and the processing ends.
Furthermore, when in Step ST26-1, the sixth bit of the (16+M)-th byte in the VSDB packet is not at the high level “H”, the disk player 11 proceeds to Step ST26-3. In Step ST26-3, the disk player 11 determines whether or not a seventh bit of the (16+M)-th byte in the VSDB packet is at the high level “H”. When the seventh bit of the (16+M)-th byte is at the high level “H”, in Step ST 26-4, the disk player 11 sets the seventh to fourth bits of the (9+N)-th byte in the VSIF region to “0b0001”, sets data on the gamma correction method (1) to be in (10+N)-th to (19+N)-th bytes, and proceeds to Step ST27, and the processing ends.
Furthermore, when in Step ST26-3, the seventh bit of the (16+M)-th byte is not at the high level “H”, the disk player 11 proceeds to Step ST26-5. In Step ST26-5, the disk player 11 determines whether or not a fifth bit of the (16+M)-th byte in the VSDB packet is at the high level “H”. When the fifth bit of the (16+M)-th byte is at the high level “H”, in Step ST 26-6, the disk player 11 sets the seventh to fourth bits of the (9+N)-th byte in the VSIF region to “0b0011”, sets data on the gamma correction method (3) to be in (10+N)-th to (14+N)-th bytes, and proceeds to Step ST27, and the processing ends.
Furthermore, when in Step ST26-5, the fifth bit of the (16+M)-th byte in the VSDB packet is not at the high level “H”, the disk player 11 proceeds to Step ST26-7. In Step ST 26-7, seventh to fourth bits of a (9+N)-th byte in the VSIF region are set to “0b0000”, and a (10+N)-th byte is set to “L”, proceeding to Step ST27 takes place, and the processing ends.
[Example of Processing by the Synchronized Apparatus at the Time of Setting an Energy Saving Mode]
Next, processing by the television receiver (synchronized apparatus) 12 at the time of setting an energy saving mode in the AV system 10 illustrated in
When the setting to the energy saving mode is performed, from the perspective of the energy saving, it is not desirable that the television receiver 12 perform the HDR luminance increase more than is necessary, because the user selects an operation that suppresses power consumption by decreasing the luminance of the display panel 211 and thus displaying an image. For this reason, when the setting to the energy saving mode is performed, the television receiver 12 proceeds to processing in Step ST32.
In Step ST32, the television receiver 12 sets a seventh bit of a (15+M)-th byte that is present in the VSDB region of its own E-EDID to “False=‘L’”. Furthermore, in Step ST32, the television receiver 12 further sets values of the maximum luminance level of the display panel 211, stored in a (17+M)-th byte, and of a maximum luminance range, stored in a (18+M)-th byte, to values of the luminance level and a maximum luminance range that are set in the energy saving mode, respectively. Thereafter, the television receiver 12 proceeds to Step ST34, and the processing ends.
Furthermore, when the setting to the energy saving mode is not performed in Step ST31, the television receiver 12 proceeds to Step ST33. In Step ST33, the television receiver 12 sets the seventh bit of the (15+M)-th byte that is present in the VSDB region of its own E-EDID to “True=‘H’”. Furthermore, in Step ST33, the television receiver 12 further sets the values of the maximum luminance level of the display panel 211, stored in the (17+M)-th byte, and of the maximum luminance range, stored in the (18+M)-th byte, to values of its own maximum luminance level and maximum luminance range, respectively. Thereafter, the television receiver 12 proceeds to Step ST34, and the processing ends.
[Example in which Processing by the Synchronized Apparatus Cancels the Energy Saving Mode]
Next, processing that the television receiver (synchronized apparatus) 12 performs when the HDR image begins to be transmitted from the disk player (source apparatus) 11 at the time of setting the energy saving mode in the AV system 10 illustrated in
The television receiver 12 starts processing in Step ST40, and thereafter proceeds to Step ST41. In Step ST41, the television receiver 12 determines whether or not a sixth bit of a fourth byte in the VSIF packet (refer to
If the sixth bit of the fourth byte is set to the high level “H” in Step ST41, the television receiver 12 proceeds to Step ST42. In Step ST42, the television receiver 12 determines whether or not the television receiver 12 itself is set to the energy saving mode. If the setting to the energy saving mode is not performed, the television receiver 12 determines that the reception of the HDR image is possible, then proceeds to Step ST47 without being set to the energy saving mode and the processing ends.
If the setting to the energy saving mode is performed in Step ST42, the television receiver 12 proceeds to the next Step ST43. In Step ST43, the television receiver 12 displays on the display panel 211 a selection screen through which the user gives an instruction as to whether or not to cancel the energy saving mode and thus perform reception of the HDR image, thus alerts the user to the selection screen, and when the user makes a selection, proceeds to the next Step ST44.
In Step ST44, the television receiver 12 determines whether or not the user gives an instruction to cancel the energy saving mode and thus select the performing of the reception of the HDR image. If the user does not desire to cancel the energy saving mode, the energy saving mode is not canceled, proceeding to Step ST47 then takes place and the processing ends.
If the user desires to cancel the energy saving mode in Step ST44, the television receiver 12 proceeds to the next Step ST45. In Step ST45, in order to cancel the energy saving mode and thus perform the reception of the HDR image, the television receiver 12 sets a seventh bit of a (15+M)-th byte in the VSDB region (refer to
As described above, in the AV system 10 illustrated in
Furthermore, in the AV system 10 illustrated in
Moreover, according to the embodiment described above, the disk player 11 inserts the information on the transmission method for and the information on the gamma correction for the HDR image data during the blanking period of the image data (picture signal) using the VSIF packet, and thus these pieces of information are transmitted to the television receiver 12.
For example, the disk player 11 may transmit the information on the transmission method for and the information on the gamma correction for the HDR image data to the television receiver 12 over the CEC line 24 that is a control data line of the HDMI cable 13. Furthermore, for example, the disk player 11 may transmit the information on the transmission method for and the information on the gamma correction for the HDR image data to the television receiver 12 over the bidirectional communication path that is configured from the reserve line 27 and the HPD line 25 of the HDMI cable 13.
Furthermore, according to the embodiment described above, the pieces of information on the transmission method for and the gamma correction method for the HDR image data that the television receiver 12 supports are included in the E-EDID of the television receiver 12, and the disk player 11 reads the E-EDID over the DDC 23 of the HDMI cable 13 and thus obtains the pieces of information on the transmission method for and the gamma correction method for the HDR image data that the television receiver 12 supports.
However, the disk player 11 may receive the pieces of information on the transmission method for and the gamma correction method for the HDR image data that the television receiver 12 supports, from the television receiver 12 over the CEC line 24 that is the control data line of the HDMI cable 13, or over the bidirectional communication path that is configured from the reserve line 27 and the HPD line 25 of the HDMI cable 13.
Furthermore, according to the embodiment described above, the example is illustrated in which the disk player 11 transmits both of the information on the transmission method for and the information on the gamma correction for the HDR image data to the television receiver 12. However, a configuration is also considered in which either of these two pieces of information is transmitted.
Furthermore, according to the embodiment described above, it is illustrated that an HDMI transmission path is used. However, in addition to the HDMI, as baseband digital interfaces, there are a Mobile High-definition Link (MHL), a Digital Visual Interface (DVI) interface, a Display Port (DP) interface, a wireless interface using 60 GHz millimeter waves and the like. The present technology can be applied in the same manner to a case where the HDR image data is transmitted with these digital interfaces.
[Example of a Structure of a DP System]
The DP cable 303 is configured from a main link 304, an AUX channel 305, and a hot plug detection 306. The main link 304 is configured from one, two, or four duplex terminal differential signal pairs (pair lines), does not have a dedicated clock signal, and a clock is instead embedded in an 8B/10B coded-data stream.
Unlike in the HDMI, in the DP interface, a transmission speed and a pixel frequency are independent of each other, and a pixel depth or resolution, a frame frequency, and the presence or absence of voice data or additional data such as DRM information within a transmission stream and an amount of the voice data or the additional data can be freely adjusted. The transmission of the HDR image data, the information on the transmission method for and the information on the gamma correction for the HDR image data is performed using the main link 304.
For a transmission data structure of the DP interface, the TMDS transmission data structure (refer to
The DP transmitter 301 checks a connection to the DP receiver 307 with a hot plug detection 306. Thereafter, using the AUX channel 305, the DP transmitter 301 reads the HDR image information in the E-EDID from the storage unit 309 of the DP receiver 307 and recognizes the transmission method for the HDR image that the DP receiver 307 supports. The data structure of the HDR image information in E-EDID in the DP receiver 307 may be the same in
Furthermore, in addition to the main link 304, the DP interface has the half duplex bidirectional AUX channel 305 with a bandwidth of 1 Mbit/s or a bandwidth of 720 Mbit/s, and exchanging of information relating to a function between a transmitter and a receiver is performed by such bidirectional communication. The transmission of the information on the transmission method for and the information on the gamma correction method for the HDR image data can be performed using the AUX channel 305.
[Example of a Data Structure of the AUX Channel]
The information on the transmission method for and the information on the gamma correction method for the HDR image data are inserted into the payload. When the information on the transmission method for and the information on the gamma correction method for the HDR image data are transmitted from the DP transmitter 301 to the DP receiver 307, “0b1000” is set to be in the command section of the header. Syntax Data that is expressed as “Metadata_tx”, as illustrated in
“Continuation_flag” is a bit that indicates continuity when data length of the payload section of one packet is smaller than those of the information on the transmission method for and the information on the gamma correction method for the HDR image data that have to be transmitted and thus these pieces of information are divided into multiple packets and are transmitted. “Metadata_type” indicates a method that the DP receiver 307 selects, based on the pieces of information on the transmission method for and the gamma correction method for HDR image data that the DP transmitter 301 supports. “Metadata” sets the information on the transmission method for and the information on the gamma correction method for the HDR image data that are transmitted.
Furthermore, when the pieces of information on the transmission method for and the gamma correction method for the HDR image data that the DP receiver 307 supports are obtained, the DP transmitter 301 assigns “0b1001” to the command section of the header section. Syntax Data that is expressed as “EDID-read”, as illustrated in
[Example of a Structure of an MHL System]
The MHL cable 404 is configured from a TMDS channel 405, an MHL Link Control Bus (CBUS)/enhanced MHL Link Control Bus (eCBUS) line 406, and a power supply MHL Voltage Bus (VBUS) line 407. The TMDS channel 405 is configured from one pair of differential signal pairs, and the transmission of the HDR image data, the information on the transmission method for and the information on the gamma information for the HDR image data is performed.
For a transmission data structure of the MHL interface, the TMDS transmission data structure (refer to
In the CBUS/eCBUS line 406, when a data section of packet data in
Thereafter, using the CBUS/eCBUS line 406, the MHL transmitter 401 reads the HDR image information in the E-EDID from the MHL receiver 408 and recognizes the transmission method for the HDR image that the MHL receiver 408 supports. The data structure of the HDR image information in E-EDID in the MHL receiver 408 may be the same in
[Example of a Data Structure of the CBUS Line]
The information on the transmission method for and the information on the gamma correction for the HDR image data are inserted into the 256-byte payload section. Syntax data that is expressed as “Metadata_tx”, as illustrated in
Furthermore, according to the embodiment, the example is illustrated in which the disk player 11 is used as the transmission apparatus (source apparatus) and the television receiver 12 is used as the reception apparatus (synchronized apparatus) but, of course, even though other transmission apparatuses and reception apparatuses are used, the present technology can be applied in the same manner.
Furthermore, the present technology can be configured as follows.
(1) A transmission apparatus including: a data transmission unit that transmits image data in a high dynamic range to an external apparatus over a transmission path; and an information transmission unit that transmits information on a transmission method for and/or information on gamma correction for the image data in the high dynamic range that is transmitted in the data transmission unit, to the external apparatus over the transmission path.
(2) The transmission apparatus according to (1), in which the data transmission unit transmits the image data in the high dynamic range to the external apparatus over the transmission path using a differential signal.
(3) The transmission apparatus according to (2), in which the information transmission unit inserts the information on the transmission method for and/or the information on the gamma correction for the image data in the high dynamic range that is transmitted in the data transmission unit, during a blanking period of the image data in the high dynamic range, and thus transmits the inserted information to the external apparatus.
(4) The transmission apparatus according to (2), in which the information transmission unit transmits the information on the transmission method for and/or the information on the gamma correction for the image data in the high dynamic range that is transmitted in the data transmission unit, to the external apparatus over a control data line that makes up the transmission path.
(5) The transmission apparatus according to (2), in which the information transmission unit transmits the information on the transmission method for and/or the information on the gamma correction for the image data in the high dynamic range that is transmitted in the data transmission unit, to the external apparatus over a bidirectional communication path that is configured from a predetermined line of the transmission path.
(6) The transmission apparatus according to (5), in which the bidirectional communication path is a pair of differential communication paths, and at least one of the differential communications paths in the pair has a function of receiving a connection state notification from the external apparatus using direct-current bias potential.
(7) The transmission apparatus according to any one of (1) to (6), in which the image data in the high dynamic range includes first data and second data, and in which the data transmission unit configures the first data and the second data into a picture format stipulated for a stereoscopic image, and transmits the picture format to the external apparatus over the transmission path.
(8) The transmission apparatus according to any one of (1) to (6), in which the image data in the high dynamic range includes first data and second data, and in which the data transmission unit transmits the first data, as a first frame image, to the external apparatus over the transmission path and transmits the second data, as a second frame image, to the external apparatus over the transmission path.
(9) The transmission apparatus according to any one of (1) to (6), in which the image data in the high dynamic range includes first data and second data, and in which the first data is low-order 8-bit data of the image data in the high dynamic range and the second data is high-order bit data of the image data in the high dynamic range, or the first data is high-order 8-bit data of the image data in the high dynamic range and the second data is low-order bit data of the image data in the high dynamic range.
(10) The transmission apparatus according to any one of (1) to (9), in which the information on the transmission method for and the information on the gamma correction for the image data in the high dynamic range that is transmitted in the data transmission unit include at least one, among information at a maximum white level exceeding 100%, of the image data in the high dynamic range, a bit value at the time of expression at a black level, a bit value at the time of expression at a 100% white level, a flag indicating whether or not processing for the high dynamic range is performed, a luminance level of a reception apparatus that is assumed at the time of the 100% white level, a luminance input level that is necessary for a luminance increase in an image in the high dynamic range, and an increase luminance output level that is necessary for the luminance increase in the image in the high dynamic range.
(11) The transmission apparatus according to any one of (1) to (10) further including: an information reception unit that receives the pieces of information on the transmission method for and/or the gamma correction method for the image data in the high dynamic range that the external apparatus is able to support, which are transmitted from the external apparatus over the transmission path; and a method selection unit that, based on the information on the transmission method and/or the information on the gamma correction method that are received in the information reception unit, selects a predetermined transmission method and/or a predetermined gamma correction method from among the transmission methods for and/or the gamma correction methods for the image data in the high dynamic range which the external apparatus is able to support, in which the data transmission unit transmits the image data in the high dynamic range in accordance with the transmission method and/or the gamma correction method that are selected in the method selection unit, to the external apparatus over the transmission path.
(12) A method of transmitting image data in a high dynamic range, including: a data transmission step of transmitting the image data in the high dynamic range to an external apparatus over a transmission path, and an information transmission step of transmitting information on a transmission method for and/or information on gamma correction for the image data in the high dynamic range which is transmitted in the data transmission step, to the external apparatus over the transmission path.
(13) A program for causing a computer to function as: data transmission means that transmits image data in a high dynamic range to an external apparatus over a transmission path; and information transmission means that transmits information on a transmission method for and/or information on gamma correction for the image data in the high dynamic range that is transmitted in the data transmission means, to the external apparatus over the transmission path.
(14) A reception apparatus including: a data reception unit that receives image data in a high dynamic range for displaying an image in the high dynamic range from an external apparatus over a transmission path; an information reception unit that receives information on a transmission method for and/or information on gamma correction for the image data in the high dynamic range that is received in the data reception unit, from the external apparatus; and a data processing unit that, based on the information on the transmission method and/or the information on the gamma correction that are received in the information reception unit, processes the image data in the high dynamic range that is received in the data reception unit.
(15) The reception apparatus according to (14), in which the data reception unit receives the image data in the high dynamic range from the external apparatus over the transmission path using a differential signal.
(16) The reception apparatus according to (15), in which the information reception unit extracts the information on the transmission method for and/or the information on the gamma correction for the image data in the high dynamic range from a blanking period of the image data in the high dynamic range that is received in the data reception unit.
(17) The reception apparatus according to (15), in which the information reception unit receives the information on the transmission method for and/or the information on the gamma correction for the image data in the high dynamic range that is received in the data reception unit, from the external apparatus over a control data line that makes up the transmission path.
(18) The reception apparatus according to (15), in which the information reception unit receives the information on the transmission method for and/or the information on the gamma correction for the image data in the high dynamic range that is received in the data reception unit, from the external apparatus over a bidirectional communication path that is configured from a predetermined line of the transmission path.
(19) The reception apparatus according to (18), in which the bidirectional communication path is a pair of differential communication paths, and at least one of the differential communications paths in the pair has a function of notifying the external apparatus of a connection state using direct-current bias potential.
(20) The reception apparatus according to any one of (14) to (19), in which the image data in the high dynamic range includes first data and second data, and in which the data transmission and reception unit receives the first data and the second data, which are configured into a picture format stipulated for a stereoscopic image, from the external apparatus over the transmission path.
(21) The reception apparatus according to any one of (14) to (19), in which the image data in the high dynamic range includes first data and second data, and in which the data transmission and reception unit receives the first frame image that is configured from the first data and the second frame image that is configured from the second data, from the external apparatus over the transmission path.
(22) The reception apparatus according to any one of (14) to (19), in which the image data in the high dynamic range includes first data and second data, and in which the first data is low-order 8-bit data of the image in the high dynamic range and the second data is high-order bit data of the image in the high dynamic range, or the first data is high-order 8-bit data of the image data in the high dynamic range and the second data is low-order bit data of the image data in the high dynamic range.
(23) The reception apparatus according to any one (14) to (22), further including: a display control unit that performs a display of whether or not to cancel an energy saving mode, on a display unit, when the information on the transmission method for the image data in the high dynamic range that is transmitted from the external apparatus is received in the information reception unit, if the energy saving mode is selected.
(24) The reception apparatus according to any one of (14) to (23), further including: an information storage unit in which the pieces of information on the transmission method for and/or the gamma correction method for the image data in the high dynamic range that the information storage unit itself is able to support are stored; and an information transmission unit that transmits the information on the transmission method and/or the information on the gamma correction method that are stored in the information storage unit, to the external apparatus over the transmission path.
(25) The reception apparatus according to (24), in which at least one, among information on maximum luminance at which a display is possible, information on a maximum increase luminance level at which processing for the high dynamic range is possible, and a flag for prohibiting increase processing, is further stored in the information storage unit.
(26) The reception apparatus according to (24) or (25), further including: a storage control unit that rewrites a flag for prohibiting increase processing, as invalid, which is stored in the information storage unit, if the flag for prohibiting the increase processing is stored in the information storage unit and an energy saving mode is selected.
(27) The reception apparatus according to any one of (24) to (26), further including: a storage control unit that rewrites information on maximum luminance at which the display is possible and information on a maximum increase luminance level at which processing for the high dynamic range is possible, which are stored in the information storage unit, if the information on the maximum luminance at which the display is possible and the information on the maximum increase luminance level at which the processing for the high dynamic range is possible are stored in the information storage unit and an energy saving mode is selected.
(28) A method of receiving image data in a high dynamic range, including: a data reception step of enabling a data reception unit to receive the image data in the high dynamic range from an external apparatus over a transmission path; an information reception step of receiving information on a transmission method for and/or information on gamma correction for the image data in the high dynamic range that is received in the data reception step, from the external apparatus and a data processing step of processing the image data in the high dynamic range that is received in the data reception step, based on the information on the transmission method for and/or the information on the gamma correction that are received in the information reception step.
(29) A program for causing a computer to function as: data reception means that receives image data in a high dynamic range for displaying an image in the high dynamic range from an external apparatus over a transmission path; information reception means that receives information on a transmission method for and/or information on gamma correction for the image data in the high dynamic range that is received in the data reception unit, from the external apparatus; and a data processing means that processes the image data in the high dynamic range that is received in the data reception means, based on the information on the transmission method and/or the information on the gamma correction that are received in the information reception means.
| Number | Date | Country | Kind |
|---|---|---|---|
| 2013-131183 | Jun 2013 | JP | national |
| 2013-246876 | Nov 2013 | JP | national |
| 2014-100011 | May 2014 | JP | national |
| Number | Date | Country | |
|---|---|---|---|
| Parent | 14374059 | Jul 2014 | US |
| Child | 15233567 | US |
| Number | Date | Country | |
|---|---|---|---|
| Parent | 16260789 | Jan 2019 | US |
| Child | 16690641 | US | |
| Parent | 15493639 | Apr 2017 | US |
| Child | 16260789 | US | |
| Parent | 15233567 | Aug 2016 | US |
| Child | 15493639 | US |
