Patent Application
20170078739
The present invention is related to a device and a method for transmitting and receiving data using HDMI (High Definition Multimedia Interface) and more specifically, a device and a method for transmitting and receiving data using HDMI, controlling a multi-stream audio output through a remote controller of an HDMI sink device in case multi-stream audio-enabled content is played.
HDMI is an interface/standard that develops a Digital Visual Interface (DVI) which is an interface standard of personal computers and displays for a use of AV electronic products. Since the HDMI transmits video/audio from a player to a display device without compressing it, there is very little latency between a source device and a sink device. And the HDMI has high format compatibility since the HDMI does not require separate decoder chip or software. In addition, the HDMI is available to make wirings between AV devices be simplified, which were complicated because video signals, audio signals and control signals are transmitted on only one cable, and the HDMI provides a High-bandwidth Digital Content Protection (HDCP) technique, thereby providing the copyright protection function.
HDMI can support multi-stream audio transmission when a source device transmits video/audio data. However, a CEC message/operation for a sink device to control selecting/changing the aforementioned multi-stream audio data by using a remote controller has not been proposed yet. Therefore, although multi-stream audio data can be transmitted from a source device to a sink device through HDMI, there is still an inconvenience/disadvantage that a remote controller of the sink device is incapable of controlling the multi-stream audio data.
To solve the technical problem above, a method for transmitting and receiving data of a sink device by using HDMI according to the present invention comprises receiving at least one of video data or audio data from a source device through HDMI wherein the audio data include multi-stream audio data; transmitting a CEC message requesting multi-stream audio information to the source device; and receiving a response CEC message including multi-stream audio information from the source device.
Also, in a method for transmitting and receiving data of a sink device by using HDMI according to the present invention, the multi-stream audio information can include at least one of channel information or attribute information of multi-stream audio.
Also, a method for transmitting and receiving data of a sink device by using HDMI according to the present invention can further comprise providing a UI showing the multi-stream audio information; and in case a user input selecting one audio stream from the multi-stream audio, transmitting a CEC message requesting change of a multi-stream audio channel to the source device.
Also, in a method for transmitting and receiving data of a sink device by using HDMI according to the present invention, a CEC message requesting change of the multi-stream audio channel can include channel information of at least one audio among the multi-stream audio, and the multi-stream audio can include four audio channels.
A sink device transmitting and receiving data by using HDMI according to the present invention comprises an HDMI receiver; and a controller controlling transmission and reception of data of the HDMI receiver, wherein the sink device receives at least one of video data or audio data through HDMI from a source device, wherein the audio data include multi-stream audio; transmits a CEC message requesting multi-stream audio information to the source device; and receives a response CEC message including multi-stream audio information from the source device.
To solve the technical problem above, a method for transmitting and receiving data of a source device by using HDMI according to the present invention comprises transmitting at least one of video data or audio data to a sink device through HDMI, wherein the audio data include multi-stream audio; receiving a CEC message requesting multi-stream audio information from the sink device; and transmitting a response CEC message including multi-stream audio information to the sink device.
Also, in a method for transmitting and receiving data of a source device by using HDMI according to the present invention, the multi-stream audio information can include at least one of channel information or attribute information of multi-stream audio.
Also, a method for transmitting and receiving data of a source device by using HDMI according to the present invention can further comprise receiving a CEC message requesting change of a multi-stream audio channel from the sink device; and controlling transmission of the multi-stream audio according to the received CEC message.
Also, in a method for transmitting and receiving data of a source device by using HDMI according to the present invention, the CEC message requesting change of a multi-stream audio channel can include channel information of at least one audio among the multi-stream audio, and the multi-stream audio can include four audio channels.
In a source device transmitting and receiving data by using HDMI according to the present invention, a source device transmitting and receiving data by using HDMI comprises an HDMI transmitter transmitting and receiving data through HDMI; and a controller controlling data transmission and reception of the HDMI transmitter, wherein the source device transmits at least one of video data or audio data through HDMI to a sink device, wherein the audio data include multi-stream audio; receives a CEO message requesting multi-stream audio information from the sink device; and transmits a response CEC message including multi-stream audio information to the source device.
According to the present invention, the user can control multi-stream audio transmitted from a source device by using a remote controller that transmits commands to a sink device.
Also, according to the present invention, by newly defining CEO messages for controlling multi-audio streams, the user can control multi-audio stream outputs of a source device by entering commands to a sink device through a remote controller.
Also, according to the present invention, by requesting/receiving multi-audio stream information in the form of a CEO message, a sink device may show information about multi-stream audio that can be provided or that is currently provided through a UI.
Also, if an output audio is determined among multi-stream audio, a source device may stop other audio stream outputs, thereby improving efficiency of utilizing HDMI bandwidth.
In what follows, preferred embodiments of the present invention will be described in detail with reference to appended drawings. Detailed descriptions given below with reference to appended drawings are not limited only to those embodiments that can be realized according to the embodiments of the present invention, but they are intended to describe preferred embodiments of the present invention. The following descriptions include specific details to provide thorough understanding of the present invention. However, it should be clearly understood by those skilled in the art that the present invention can be implemented without employing the specific details.
Most terms used in this document are used widely in the corresponding technical field, but part of the terms have been chosen arbitrarily by the applicant, of which the meaning will be described in detail in the following description depending on the needs. Therefore, the present invention should be understood by the intended meaning of used terms rather than their apparent names or immediate implication.
Devices that transmit and receive video/audio/control data using HDMI can be called collectively an HDMI system, and the HDMI system can comprise a source device 1010, a sink device 1020, and a cable. In the HDMI system, a device that transmits video/audio data through HDMI corresponds to the source device 1010, a device that receives video/audio data through HDMI corresponds to the sink device 1020, and an HDMI cable supporting data transmission and reception connects the two devices.
Though illustrated briefly in
As shown in
Additionally, the HDMI system provides a VESA (Video Electronics Standards Association) DDC (Display Data Channel). The DDC is used for configuration of one source device and one sink device and exchange of status information between them. A CEC protocol can provide a high-level control function among various audio-visual products in a user environment and may be used optionally. Also, an optional HEAC (HDMI Ethernet and Audio Return Channel) may provide Ethernet-compatible data networking among an ARC (Audio Return Channel) and connected devices in the opposite direction from a TMDS.
Video data, audio data and supplementary data may be transmitted and received through three TDMS data channels. Commonly, a TMDS clock runs a video pixel rate, and is transmitted through a TMDS clock channel. The TMDS clock may be used as a reference frequency for data recovery in three TMDS data channels in an HDMI receiver. In a source device, the data of 8 bits per TMDS data channel may be transformed into a sequence of 10 bits of which transition is minimized, which is DC balanced, and transmitted in serial manner with a rate of 10 bits per TMDS clock period.
In order to transmit audio data and supplementary data through the TMDS channel, the HDMI uses a packet structure. In order to attain high reliability for audio data and control data, data may be transmitted in word of 10 bits which is generated by using a BCH error correction code and an error reduction coding.
The source device can figure out configuration information and available functions of the sink device by reading out E-EDID (Enhanced Extended Display Identification Data) of the sink device in the DDC (Display Data Channel).
A utility line can be used for an optional extension function such as HEAC.
CEC (Consumer Electronics Control) specifies interoperability between devices within the HDMI system and can include various features that reinforce functionality of the devices. By using the HDMI-CEC protocol, the user can control a source device connected to a sink device through HDMI as well as the sink device itself by using a control device of the sink device (for example, remote controller). In what follows, the HDMI-CEC protocol will be described in more detail.
Table 1 and 2 below illustrate the structure/features that the HDMI-CEC protocol provides.
Table 1 illustrates an end-user structure/features that the HDMI-CEC protocol provides.
Table 2 illustrates a structure/features that the HDMI-CEC protocol supports.
Devices of the HDMI system have physical addresses to perform addressing specific physical devices and to control switching by using the HDMI-CEC protocol. A physical address is determined by a physical address recovery operation, and the sink device can generate and utilize a unique physical address comprising 4 numbers, each of which consisting of 4 bits (n.n.n.n). In addition, CEC-enabled devices can have logical addresses according to their respective features.
In what follows, related to the HDMI CEC protocol, terms such as initiator and follower can be used in addition to the terms of source device and sink device. An initiator is a device that has transmitted or transmits a CEC message and depending on situations, indicates a device waiting for a response from a follower while the follower is a device that has received a CEO message and indicates a device that has to respond to the received message.
A physical address may refer to the address system for indicating positions of devices used on the CEC bus. As described in detail above, a physical address can comprise four number, each of which consists of 4 bits (n.n.n.n), and a source device can check the physical address through EDID (Extended Display Identification Data) of a sink device.
As shown in
As described with reference to
Table 3 illustrates an embodiment of a logical address assigned according to the features of a device.
In case one CEC line is used as shown in
The HDMI CEC performs control operations by transmitting and receiving a CEC message through a CEC line. The data by which the CEC messages are transmitted can be transmitted and received in the form of a frame format.
A CEC frame can include a start bit, header block, and at least one optional data block. As an embodiment, size of one block can be 10 bit, and size of the maximum message can be 16*10 bit (excluding the start bit). Table 4 provides a brief description of the blocks included in the CEC frame.
All of the header blocks and data blocks have 10 bit-length and can have a basic structure which is the same as shown in
The EOM (End of Message) bit indicates whether the corresponding block is the last one or a succeeding data block exists. As an example, in case there is a succeeding data block, the EOM bit can be set to 0 while a message is completed in the corresponding data block, the EOM can be set to 1.
The ACK (Acknowledge) bit can be used for a follower to check reception of data or a header block. As an example, reception of data or a header block can be checked by the initiator's sending the ACK bit by setting it to 1 and the follower's setting it to 0.
An opcode (operation code) is part of machine commands and describes an operation that has to be performed. In other words, an opcode is used as a name to identify a CEC message and can have a unique identifier/value. In addition to opcodes, commands can have the corresponding data values in the form of operands.
First, the source device and the sink device can check HDMI cable connection S5010. As shown in
And the source device and the sink device can transmit/receive information of connected devices S5020. As shown in
Next, the source device and the sink device can exchange keys required for encrypting data transmission for the purpose of security S5030. This step is optional, and the source device and the sink device can exchange HDCP keys through the DDC.
And data transmission status can be controlled through the sequence based on the HDMI CEC protocol according to the command that the user has entered S5040.
First, requesting and receiving deck status information, the sink device can check the deck status of the source device. And if the user inputs ‘play’ through an input device such as a remote controller, a play command (argument: “Forward”) can be transmitted to the source device. The source device can recognize the received CEC command and transmit video data and audio data to the sink device. Now, if the user additionally inputs ‘Next Chapter’, the sink device can transmit a deck control command (argument: “Skip Forward”) to the source device, and the source device can recognize this CEC command and transmit video data and audio data of the next chapter to the sink device.
In
In
In
In
In
In
As described above, in view of CEO communication, the HDMI system can be described as comprising an initiator 12020 that transmits a CEC message and a follower 12010 that receives a CEC message and responds to the received CEC message. In other words, an initiator 12020 can refer to a device which initiates a CEC command and delivers the CEO command to a follower, thereby controlling the follower while a follower 12010 can refer to a device that responds to the CEC command, performs a request, and informs the initiator of the performance result. Both devices comprise the same sub-modules by default, and thus descriptions about the same modules will not be repeated. A module refers to a logical or physical unit within a device performing a specific operation; one module may correspond to one or more components, or one or more modules may correspond to one component.
The bus interface module 12030 represents a physical device that enables transmission of a command between devices; a message such as request, action, or response; or data.
The micom module 12040 represents a physical device that generates a signal for data transmission; or manages priorities, retransmission for reliable transmission, and the like. The mode protocol 12050 refers to the protocol used for efficient resource management required for high speed/low speed data transmission. The high mode module 12060 represents a logical device responsible for processing high speed data transmission in a bus interface architecture. The low mode module 12070 represents a logical device responsible for processing low speed data transmission in the bus interface architecture.
The buffer module 12080 represents a physical device temporarily storing transmitted messages or data to improve reliability thereof.
The bus protocol layer module 12090 is a logical device processing data transmitted through a bus-based transmission method and delivering necessary information to an upper layer and can include a module determination component module 12100.
The upper layer module 12110 represents a logical/physical device actually processing commands.
In what follows, described will be a method for transmitting and receiving multi-stream audio and controlling the multi-stream audio in the HDMI system in which a source device and a sink device transmitting audio/video data by using HDMI are connected to each other.
Multi-Stream Audio (MSA) refers to a collection of audio streams related to at least one video stream. MSA is a data communication method defined for the HDMI system to support multi-view video streaming or multi-video streams. In particular, the HDMI 2.0 system is capable of transmitting up to four stereo audio streams simultaneously.
In an embodiment, content played in a source device such as an STB (Set-Top Box) can support multi-stream audio: for example, 1) English, 2) Korean, 3) English commentary, and 4) Korean commentary. In this case, although multi-stream audio is being received, a sink device or a remote controller in the current HDMI system that controls the sink device is unable to select/change the multi-stream audio. Therefore, the present invention proposes a method for selecting/changing multi-stream audio by using a remote controller of the sink device by newly defining/adding CEC commands in case multi-stream audio-enabled content is played.
In the embodiment of
TV can request information about multi-stream audio (MSA) of content to be played or being played in the set-top box S13010 <Request MSA info>. TV may perform this step automatically when content is played or when the user enters a multi-audio related function by using a TV remote controller.
The STB can transmit multi-stream audio information in response to the request for multi-stream audio information received from the TV S13020. In other words, TV can receive a multi-stream audio information response from the STB S13020. Multi-stream audio information is related to multi-stream audio of the content played in the STB and can include the number and attributes (or descriptions) of supported multi-stream audio, such as 1) Korean, 2) English, 3) Korean commentary, and 4) English commentary.
TV can provide information about received multi-stream audio; and output at least one of the received audio streams or provide a UI (User Interface) by which output audio can be changed S13030. TV can parse information about multi-stream audio received from the STB, inform the user about the parsed information by displaying the information or outputting the information as a sound output, and receive an input selecting at least one audio from among the multi-stream audio S13040. These steps (S13030 and S13040 ) may be performed optionally.
Receiving an audio selection/change input from a remote controller, TV can transmit a multi-stream audio change command to the set-top box S13050. The multi-stream audio change command, as a CEC command, can include a multi-stream audio ID (MSA chID). An audio ID may be identified as a channel number or channel ID of the corresponding audio.
According to the received multi-stream audio change command, the set-top box can change an audio output into the audio having an ID included in the received command S13060. At this time, the set-top box may stop other multi-stream audio outputs other than the audio having an ID included in the received CEC message. For example, if a CEC message commanding to output only one audio stream, the ID of which is 1, is received as shown in
As shown in
Although the embodiment of
As described above, an operator represents a CEC command, opcode represents a name by which a CEC message is identified, and operand represents data values corresponding to a CEO command/message. In particular, an operand can correspond to the data specific to a particular opcode.
First, opcodes of the operator of
<Request MSA Info>: opcode representing a CEC message/command requesting multi-stream audio information of current content <Report MSA Info>: opcode representing a CEC message/command reporting multi-stream audio information of current content. This opcode can be transmitted together with the operand [MSA Info].
<Change MSA ch>: opcode representing a CEO message/command changing a multi-stream audio channel. This opcode can be transmitted together with the operand [MSA ch].
Next, operands of
[MSA Info]: operand representing multi-stream audio information. This operand can be transmitted together with the opcode <Report MSA Info> and as a multi-stream audio parameter, can represent such information as language, commentary, or audio channel.
[MSA ch]: operand representing an audio channel selected for multi-stream audio. This operand can be transmitted together with the opcode <Change MSA ch> and can represent at least one of the provided multi-stream audio as a channel. A channel number/ID can correspond to at least one of the entire channel numbers provided by the [MSA Info] operand.
In the embodiment of
For example, TV can request multi-subtitle information from a set-top box, and in response to the request, TV can receive multi-subtitle information from the set-top box. Multi-subtitle information can include a plurality of subtitles that are transmitted/supported by current content and attribute information of the plurality of subtitles. TV can provide multi-subtitle information in the form of a UI and if receiving an input selecting/changing a particular subtitle from a remote controller, transmit a subtitle change command to the set-top box.
In this embodiment, opcode/operands of
It will be understood by those skilled in the art to which the present invention belongs that the present invention can be modified or changed in various ways without departing from the technical principles or scope of the present invention. Therefore, it is intended that the present invention includes modifications and changes of the present invention provided within the technical scope defined by appended claims and their equivalents.
In this document, the device and the method according to the present invention have been described fully, and descriptions for the device and method can be applied to each other in a complementary manner.
Various embodiments are described in Best mode for invention.
The present invention is used in a series of HDMI fields.
It is apparent to an ordinary skilled person in the art that various modifications and changes may be made without departing from the spirit and scope of the present invention. Accordingly, the present invention is intended to include the modifications and changes of the present invention within the attached claims and the equivalent scope.
| Filing Document | Filing Date | Country | Kind |
|---|---|---|---|
| PCT/KR2015/002343 | 3/11/2015 | WO | 00 |
| Number | Date | Country | |
|---|---|---|---|
| 61952109 | Mar 2014 | US |
