Embodiments described herein relate generally to a video sender and a video receiver.
High-Definition Multimedia Interface (HDMI) is an example of multimedia interfaces between a video sender such as a Blu-ray (registered trademark) disc (BD) player, a digital versatile disc (DVD) player, and a set-top box, and a video receiver such as a television set and a monitor. A device with an HDMI output port is referred to as a source device, while a device with an HDMI input port is referred to as a sink device. The video sender is a source device, while the video receiver is a sink device.
In HDMI communication equipment that performs communication compliant to the HDMI standards comprises a transition minimized differential signaling (TMDS) transmitter, a +5V power supply signal transmitter, a hot plug detect (HPD) signal transmitter, an extended display identification data (EDID) transmitter, a high-bandwidth digital content protection (HDCP) recognizer, and a consumer electronics control (CEC) transmitter. The TMDS transmitter transmits video, audio, and auxiliary information. The +5V power supply signal transmitter notifies the sink device of a coupling using a source ready signal when the source device is coupled to the sink device. The HPD signal transmitter transmits an HPD signal as a sink ready signal representing that the sink device is ready to receive video information. The EDID transmitter transmits EDID such as data of product information of the sink device coupled and a compatible video format. The HDCP recognizer recognizes the sink device. The CEC transmitter transmits an apparatus control signal and a CEC that is a control protocol. The EDID transmitter comprises a function as a sender that transmits the EDID through a display data channel (DDC).
In related art, before video contents are sent from the video sender to the video receiver, the video sender has made settings of image quality and a frame rate of the video contents transmitted. It is also publicly known that the function of the video receiver is sent to the video sender using EDID.
However, in the conventional technology, when the video sender cannot transmit all color signals for all frames of the video that can be output to the video receiver because, for example, the transmission path has a limited bandwidth, the video receiver cannot make a setting on which of the color signal or the frame rate takes precedence.
A general architecture that implements the various features of the invention will now be described with reference to the drawings. The drawings and the associated descriptions are provided to illustrate embodiments of the invention and not to limit the scope of the invention.
In general, according to one embodiment, a video sender comprises: a video processor configured to create video; and a communication module configured to communicate with a video receiver. The communication module comprises: a receiver; and a transmitter. The receiver is configured to receive, from the video receiver, specific information specifying which one of a color signal and a frame rate takes precedence over the other one in transmission. The transmitter is configured to convert the video created by the video processor into video in which one of the color signal and the frame rate takes precedence over the other one in accordance with the specific information, and transmit the video thus converted to the video receiver.
With reference to the accompanying drawings, embodiments of the video receiver and the video sender will now be described in detail.
The video receiver 10 is a digital television set, for example, having a resolution of 4K (4K by 2K) pixels. More specifically, the resolution of the video receiver 10 is 4096×2160 pixels, or quad full high definition (QFHD) (3840×2160 pixels), which is four times as many pixels as full high definition (FHD) (1920×1080 pixels). The video receiver 10 complies with the HDMI standards, and is referred to as a sink device having an HDMI input port. The video receiver 10 operates in accordance with signals that are input through a remote control 40.
The video sender 20 creates video having a resolution of 4K, and sends out the video thus created to the video receiver 10. The video sender 20 complies with the HDMI standards, and is referred to as a source device having an HDMI output port. The video sender 20 plays video recorded in a medium such as a Blu-ray (registered trademark) disc (BD) to be sent to the video receiver 10 through the HDMI cable 30.
The video sender 20 has a function that receives specific information specifying which one of the color signal and the frame rate takes precedence over other one of the color signal and the frame rate in data transmission from the video receiver 10, and converts the video created by reproduction, for example, into video in which one of the color signal and the frame rate takes precedence over other one of the color signal and the frame rate in accordance with the specific information described above to be transmitted to the video receiver 10. The specific information is information that uniquely specifies a combination of a video format (Y, Cb, Cr) and a frame rate transmitted from the video sender 20 to the video receiver 10. The specific information is, for example, a unique code value associated with each of combinations of the video format and the frame rate. For example, specific information in which a code value “1” is associated with a combination of the video format of 4:2:0 and the frame rate of 60 fps, while a code value “0” is associated with a combination of the video format of 4:4:4 and the frame rate of 30 fps can be used. The specific information may be information representing a user's preference such as “image quality is preferred” and “movement is preferred”. The video sender 20 converts the specific information received into the corresponding setting information using a conversion table or the like. The setting information comprises a combination of a value representing the video format (Y, Cb, Cr) and a value representing the frame rate for the video transmitted by the video sender 20 to the video receiver 10. The video sender 20 may receive the setting information itself from the video receiver 10 to set the video format and the frame rate in accordance with the setting information received. When the information representing which one of the color signal and the frame rate the user prefers in video transmission is sent to the video sender 20 through the video receiver 10, the video sender 20 sends the video in which one of the color signal and the frame rate takes precedence over other one of the color signal and the frame rate in accordance with the user's preference to the video receiver 10. The video receiver 10 can receive and display the video sent by the video sender 20. The video sender 20 outputs video in two or more operation modes comprising a combination of the color signal (Y, Cb, Cr) and the frame rate, such as a “4:2:2, 30 Hz” mode, a “4:2:0, 60 Hz” mode, and a “4:4:4, 30 Hz mode” to the HDMI cable 30.
The setting history stored in the storage module 130 is data in which each category of video is associated with the user's preference of which one of the color signal and the frame rate taking precedence over other one of the color signal and the frame rate, for example. Specifically, an example of the setting history is data representing a history in which a user made settings so that the video in which the frame rate takes precedence over the color signal (e.g., video in a “4:2:0, 60 Hz” mode) in transmission is sent for video of the category of sports or other active movements. Another example of the setting history is data representing a history in which the user made settings so that the video in which the color signal takes precedence over the frame rate (e.g., video in a “4:4:4, 30 Hz” mode) in transmission is sent for the category of BD movies at a frame rate of 24 fps. The storage module 130 may store therein specific information specifying which one of the color signal and the frame rate the user preferred for each category of video rather than store therein the setting history. The specific information may be information on which one of the color signal and the frame rate takes precedence over other one of the color signal and the frame rate is specified in transmission by selection from among some options.
The television function module 110 comprises a tuner 113 receiving the television broadcast signal using an antenna 112 coupled to a television (TV) input port 111 through an aerial cable 50 to extract the signal of a predetermined channel, and a signal processor 114 accepting a received signal that is output by the tuner 113 to be restored to a video signal V1 and an audio signal A1.
The first communication module 100 separates digital video signals of the HDMI standards received from a second communication module 200 of the video sender 20 coupled to a connector 121 through the HDMI cable 30 to a video component and an audio component to be output as a video signal V2 and an audio signal A2. The first communication module 100 comprises a micro computer (MC) 150 capable of communicating to and from the second communication module 200.
The selector 12 comprises a function selectively switches between a combination of the video signal V1 and the audio signal A1 output from the television function module 110 and a combination of the video signal V2 and the audio signal A2 output from the first communication module 100, and outputs the selected one of the combinations to display driver 13 and the audio driver 15.
The video sender 20 comprises the second communication module 200, a recorder and player 203, and a codec 204. The second communication module 200 is a communication apparatus coupled to the first communication module 100 of the video receiver 10 through the HDMI cable 30 to which a connector 201 is coupled. The recorder and player 203 performs recording and reproduction with respect to a recording medium 202 such as a Blu-ray (registered trademark) disc. The codec 204 performs mpeg-decoding encode data supplied from the recorder and player 203 to the video signal and the audio signal in a baseband, which in turn supplied to the second communication module 200. That is to say, the recording medium 202, the recorder and player 203, and the codec 204 constitute a video creator that creates video. The recorder and player 203 can also record the encode data that is output from the codec 204, the second the encode data that is output from the second communication module 200.
The second communication module 200 comprises a micro computer (MC) 250 capable of communicating with respect to the first communication module 100.
To the TMDS encoder 252, video created by the recording medium 202, the recorder and player 203, and the codec 204, for example, video data including RGB (red, blue, green) of 8 bits each is input. The TMDS encoder 252 converts the input video data into the video data (video) in which one of the color signal and the frame rate takes precedence over other one of the color signal and the frame rate in accordance with the specific information, and outputs a pixel clock created by this conversion. For example, when the specific information is a code value “1”, the TMDS encoder 252 converts the input video data into the video data with the video format of 4:2:0 and the frame rate of 60 fps. The difference amplifier (not illustrated) converts the pixel clock that has been output from the TMDS encoder 252 into the differential signal to be output to transmission lines ranged from CH0 to CH2 of the HDMI cable 30. The difference amplifiers are provided so as to correspond to each of the transmission lines ranged from CH0 to CH2. The differential signals are transmitted to the first communication module 100 through the transmission lines ranged from CH0 to CH2. The TMDS encoder 252 may perform converting the video data in accordance with the content information. For example, the TMDS encoder 252 may be determined in advance to perform converting movie contents having the frame rate of 24 fps so that the color signal takes precedence.
In the first communication module 100, the difference amplifiers (not illustrated) are provided for each of CH0 to CH2 respectively. After receiving the differential signals from CH0 to CH2, the difference amplifier converts the differential signals into data to be output to the TMDS decoder 152. The TMDS decoder 152 decodes the data into the video data of RGB of 8 bits each to be output to the selector 12.
The MC 250 of the video sender 20 is coupled to the MC 150 of the video receiver 10 through a CEC line and a HPD line. The MC 250 and the MC 150 transmit information to control devices to each other through the CEC line. The CEC line bidirectionally transmits a CEC command or a CEC command group or the like including the specific information. The MC 250 notifies the video sender 20 of completion of ready for transmitting a signal in response to completion of turning on the video receiver 10 through the HPD line. The bidirectional communication module 254 of the MC 250 is coupled to the EDID storage module 154 of the video receiver 10 through a DDC line. The bidirectional communication module 254 reads out EDID from the EDID storage module 154. The EDID comprises a format or the like that can be used by the video receiver 10 and is data representing capability of the video receiver 10.
In the same manner, luminance information Y02 represents the luminance of a pixel P3. First color difference information Cb02 represents the color difference Cb on four pixels: the pixel P3, a pixel P4 adjacent to the pixel P3, pixels P7 and P8 adjacent downward to the pixels P3 and P4. The first color difference information Cb02 may represent the color difference Cb on the pixel P3 only. Second color difference information Cr12 represents the color difference Cr on four pixels: the pixel P7, the pixel P8 adjacent to the pixel P7, the pixels P3 and P4 adjacent upward to the pixels P7 and P8. The second color difference information Cr12 may represent the color difference Cr on the pixel P7 only. Luminance information Y03 represents the luminance of the pixel P4, while luminance information Y12 represents the luminance of the pixel P7, and the luminance information Y13 represents the luminance of the pixel P8.
Operations of the video sender 20 sending video to the video receiver 10 will now be described.
Then, the video receiver 10 replies back to the video sender 20 by sending capability information (e.g., EDID) (S102).
Subsequently, the video sender 20 instructs the video receiver 10 (a sink side) for initial settings to start video transmission in accordance with the capability of the video receiver 10 (S104).
The video receiver 10 then sends data representing completion of settings instructed to the video sender 20 (S106). This processing at S106 may be omitted.
Next, the video sender 20 sends content information representing an attribute of video to be sent to the video receiver 10, to the video receiver 10 (S108). The content information comprises, for example, a category of video output by the video sender 20, a resolution, and a type of a medium from which the recorder and player 203 reproduces video. The content information may comprise information for a user to readily determine which one of the color signal and the frame rate takes precedence over other one of the color signal and the frame rate for the video transmitted from the video sender 20 to the video receiver 10 in accordance with the user's preference.
The video receiver 10 then sends the specific information corresponding to the content information sent in the processing at S108 to the video sender 20 (S110). For example, for video contents involving active movements, the specific information in which the frame rate takes precedence over the color signal is adopted, while for video contents involving few movements, the specific information in which the color signal takes precedence over the frame rate is adopted. The video receiver 10 may select the specific information corresponding to the content information from the selection history stored in the storage module 130, for example. Then, the video receiver 10 may send the specific information selected as information reflecting the user's preference to the video sender 20.
Subsequently, the video sender 20 sends the video converted by the second communication module 200 so that one of the color signal and the frame rate takes precedence over other one of the color signal and the frame rate in accordance with the specific information sent in the processing at S110 (S112).
The video receiver 10 then newly selects which one of the color signal and the frame rate should take precedence over other one of the color signal and the frame rate for the video sent from the video sender 20 in accordance with the input from the user accepted through the remote control 40, for example (S114).
With reference to
Then, the video sender 20 sends the video in which one of the color signal and the frame rate takes preference over other one of the color signal and the frame rate in accordance with the request to change video quality settings sent in the processing at S116, as AV stream with new settings to the video receiver 10 (S118).
For an example of operations illustrated in
For example, the video receiver 10 may be structured so that when the content information is sent in the processing at S108 the screen illustrated in
Another example of the screen displayed on the display 11 of when the video receiver 10 selects one of video in which the color signal takes precedence over the frame rate and video in which the frame rate takes precedence over the color signal to be sent to the video receiver 10, will now be described.
Each function of the first communication module 100 and the second communication module 200 may be provided in the form of either a computer program or the like, or hardware.
According to the embodiment described above, when video is sent from the video sender to the video receiver, the video receiver can make the setting on which one of the color signal and the frame rate takes precedence over other one of the color signal and the frame rate in video transmission.
In the embodiment described above, an example in which one of the color signal and the frame rate is preferred over other one of the color signal and the frame rate and in which the data corresponding to the one not preferred (the color signal (differential signal) or the frame rate) can be deleted has been explained. However, the embodiment is not limited to the example. Specifically, if an amount of data transmitted is contained within the limited bandwidth for transmission by the HDMI cable 30, a resolution, angle of view information, VIC information, color depth information, or color gamut can be changed, whereby the amount of data can be changed. Alternatively, if the amount of data transmitted is contained within the limited bandwidth for transmission by the HDMI cable 30, super-resolution can be performed in the sink device. In a series of descriptions above, an example of wired communication using the HDMI cable 30 (a cable for a display port may substitute) is used. However, the embodiment can be also applied to a wireless communication. In such a case, the HDMI cable 30 is not used and the first communication module 100 and the second communication module 200 respectively comprise a function for performing wireless communication.
Moreover, the various modules of the systems described herein can be implemented as software applications, hardware and/or software modules, or components on one or more computers, such as servers. While the various modules are illustrated separately, they may share some or all of the same underlying logic or code.
While certain embodiments have been described, these embodiments have been presented by way of example only, and are not intended to limit the scope of the inventions. Indeed, the novel embodiments described herein may be embodied in a variety of other forms; furthermore, various omissions, substitutions and changes in the form of the embodiments described herein may be made without departing from the spirit of the inventions. The accompanying claims and their equivalents are intended to cover such forms or modifications as would fall within the scope and spirit of the inventions.
Number | Date | Country | Kind |
---|---|---|---|
2012-131472 | Jun 2012 | JP | national |
This application is a continuation of U.S. patent application Ser. No. 14/595,482, filed Jan. 13, 2015, which is a continuation of U.S. patent application Ser. No. 13/774,325, filed Feb. 22, 2013, which is based on and claims the benefit of priority from Japanese Patent Application No. 2012-131472, filed Jun. 11, 2012, the entire contents of each of which are incorporated herein by reference.
Number | Name | Date | Kind |
---|---|---|---|
5654773 | Kajimoto et al. | Aug 1997 | A |
5835152 | Hori | Nov 1998 | A |
5847767 | Ueda | Dec 1998 | A |
7088398 | Wolf et al. | Aug 2006 | B1 |
7257163 | Hwang et al. | Aug 2007 | B2 |
7359437 | Hwang et al. | Apr 2008 | B2 |
7379121 | Suzuki et al. | May 2008 | B2 |
7636132 | Sakamoto | Dec 2009 | B2 |
8077243 | Morita et al. | Dec 2011 | B2 |
8190786 | Nakahama | May 2012 | B2 |
8200062 | Itani | Jun 2012 | B2 |
8290339 | Noritake | Oct 2012 | B2 |
8422553 | Fukuhara et al. | Apr 2013 | B2 |
8625666 | Bakke | Jan 2014 | B2 |
8625683 | Wu et al. | Jan 2014 | B2 |
8698956 | Kondo et al. | Apr 2014 | B2 |
8984181 | Minemura et al. | Mar 2015 | B2 |
9167293 | Hirayama et al. | Oct 2015 | B2 |
20020071052 | Itoh et al. | Jun 2002 | A1 |
20020171761 | Suzuki et al. | Nov 2002 | A1 |
20030151610 | Kuriakin et al. | Aug 2003 | A1 |
20030206242 | Choi | Nov 2003 | A1 |
20040208380 | Aoki et al. | Oct 2004 | A1 |
20050200630 | Evans et al. | Sep 2005 | A1 |
20060090141 | Loui et al. | Apr 2006 | A1 |
20070040810 | Dowe et al. | Feb 2007 | A1 |
20070081796 | Fredlund et al. | Apr 2007 | A1 |
20070091120 | Oura | Apr 2007 | A1 |
20070153918 | Rodriguez | Jul 2007 | A1 |
20070160153 | Sullivan | Jul 2007 | A1 |
20070188515 | Li | Aug 2007 | A1 |
20070262979 | Klebanov | Nov 2007 | A1 |
20070296859 | Suzuki | Dec 2007 | A1 |
20080024659 | Tanaka | Jan 2008 | A1 |
20080101467 | MacMullan | May 2008 | A1 |
20080101476 | Tian | May 2008 | A1 |
20080270635 | Nakahama | Oct 2008 | A1 |
20090103947 | Inoue et al. | Apr 2009 | A1 |
20090116970 | Inoue et al. | May 2009 | A1 |
20090141180 | Kondo | Jun 2009 | A1 |
20090174818 | Morita et al. | Jul 2009 | A1 |
20090213265 | Yamashita | Aug 2009 | A1 |
20090231487 | Nakagawa | Sep 2009 | A1 |
20090278984 | Suzuki | Nov 2009 | A1 |
20090290634 | Yamashita | Nov 2009 | A1 |
20090316779 | Fukuhara | Dec 2009 | A1 |
20100007787 | Yamashita | Jan 2010 | A1 |
20100033627 | Hayashi et al. | Feb 2010 | A1 |
20100066906 | Nakajima | Mar 2010 | A1 |
20100073574 | Nakajima et al. | Mar 2010 | A1 |
20100149412 | Yamashita | Jun 2010 | A1 |
20100182402 | Nakajima et al. | Jul 2010 | A1 |
20100214480 | Kitamori | Aug 2010 | A1 |
20110032272 | Noritake | Feb 2011 | A1 |
20110038596 | Noritake | Feb 2011 | A1 |
20110043701 | Kurita et al. | Feb 2011 | A1 |
20110134318 | Chang et al. | Jun 2011 | A1 |
20110134319 | Chang et al. | Jun 2011 | A1 |
20110135199 | Choi et al. | Jun 2011 | A1 |
20110198400 | Sano | Aug 2011 | A1 |
20110205428 | Yamashita | Aug 2011 | A1 |
20110273622 | Ngo | Nov 2011 | A1 |
20120069145 | Sugimura | Mar 2012 | A1 |
20120293710 | Yamashita | Nov 2012 | A1 |
20130055407 | Hirayama et al. | Feb 2013 | A1 |
20130100244 | Suzuki et al. | Apr 2013 | A1 |
20130141534 | Hattori | Jun 2013 | A1 |
20130208183 | Suzuki et al. | Aug 2013 | A1 |
20130251047 | Rodriguez | Sep 2013 | A1 |
20130271650 | Muto | Oct 2013 | A1 |
20130329138 | Minemura et al. | Dec 2013 | A1 |
20140092211 | Nakajima et al. | Apr 2014 | A1 |
20150124168 | Minemura et al. | May 2015 | A1 |
Number | Date | Country |
---|---|---|
1705379 | Dec 2005 | CN |
101106669 | Jan 2008 | CN |
101448123 | May 2011 | CN |
H09-200801 | Jul 1997 | JP |
2002-125207 | Apr 2002 | JP |
2002-290974 | Oct 2002 | JP |
2004-254133 | Sep 2004 | JP |
2004-343726 | Dec 2004 | JP |
2004-357012 | Dec 2004 | JP |
2005-514873 | May 2005 | JP |
2007-311929 | Nov 2007 | JP |
2007-312376 | Nov 2007 | JP |
2008-252819 | Oct 2008 | JP |
2008-271460 | Nov 2008 | JP |
2009-135726 | Jun 2009 | JP |
2009-147738 | Jul 2009 | JP |
2009-213110 | Sep 2009 | JP |
2009-213116 | Sep 2009 | JP |
2010011154 | Jan 2010 | JP |
2010-028261 | Feb 2010 | JP |
2011044868 | Mar 2010 | JP |
2010-193247 | Sep 2010 | JP |
2010-237726 | Oct 2010 | JP |
2011166198 | Aug 2011 | JP |
2013-031024 | Feb 2013 | JP |
2013-051606 | Mar 2013 | JP |
2015-029337 | Feb 2015 | JP |
WO 03058946 | Jul 2003 | WO |
WO 2008053851 | May 2008 | WO |
WO 2012029885 | Mar 2012 | WO |
Entry |
---|
Notification of Second Chinese Office Action, dated Aug. 22, 2016, in CN Appl No. 201310064522.3. |
U.S. Appl. No. 13/774,325, filed Feb. 22, 2013, Minemura et al. |
U.S. Appl. No. 14/595,482, filed Jan. 13, 2015, Minemura et al. |
The Extended European Search Report dated Sep. 10, 2013 issued by European Patent Office in European Patent Application No. 13153335.8—10 pages. |
Thomas Kugelstadt, “Support HDMI 1.3 12-Bit Deep Color With the TMDS341A,” Texas Instruments Incorporated, May 10, 2007, URL: http://www.ti.com/lit/an/slla263/slla263.pdf. |
Notice of Rejection mailed by Japan Patent Office dated May 21, 2013 in Japanese Patent Application 2012-131472—4 pages. |
Notice of Rejection mailed by Japan Patent Office dated Jul. 1, 2014 in Japanese patent application No. 2013-210165, which is a divisional application of JP. 2012-131472—5 pages. |
Decision to Grant a Patent mailed by Japan Patent Office dated Jan. 6, 2015 in the Japanese patent application No. 2013-210165, which is a divisional application for JP 2012-131472—5 pages. |
Japanese Office Action dated May 19, 2015 for JP Application No. 2015-010699. |
Japanese Office Action for corresponding Japanese Application No. 2012-111976, dated Nov. 13, 2012, 11 pages. |
Extended European Search Report for Corresponding European Application No. 12173573.2-1228, dated Jan. 24, 2013, 7 pages. |
Japanese Office Action Decision of Refusal for Correspondence Japanese Application No. 2013-055503 which is a divisional application of JP 2012-111976 to which this application claims priority, dated Jul. 1, 2014, 7 pages. |
Notice of Rejection mailed by Japan Patent Office dated May 19, 2015 in Japanese Patent Application No. 2015-010699. |
Number | Date | Country | |
---|---|---|---|
20160249102 A1 | Aug 2016 | US |
Number | Date | Country | |
---|---|---|---|
Parent | 14595482 | Jan 2015 | US |
Child | 15141702 | US | |
Parent | 13774325 | Feb 2013 | US |
Child | 14595482 | US |