Patent Application
20120008774
Today's television sets are no longer limited to display only broadcast programs. The users are willing to use the television screen to access the almost infinite resources provided by the Internet. However, the majority of already sold television sets is not equipped with Internet access and is unable to take advantage of these resources.
A solution was proposed in form of an external device connected at one side to the Internet via an Ethernet or a WiFi interface, and at the other side to an output providing data in a suitable format to a television set, for example a format according to HDMI (High-Definition Multimedia Interface) standard. This known external device has its own remote control, power supply and cable and tend to complicate and to clutter up the space around the television set.
Further solutions have been developed for accessing content provided by several sources such as:
Document EP2026558A1 discloses a module for supplying a transport stream to a digital television decoder apparatus. The module capable of receiving transport streams comprising multiplexed packets containing video and audio signals, comprises a packet multiplexer arranged to multiplex packets containing application data generated in the module into a received transport stream; and a transport stream interface capable of connection to a digital television decoder apparatus and of supplying a transport stream to the digital television decoder apparatus. The module is configured to supply a transport stream output from the packet multiplexer to the transport stream interface.
The module further includes a controller arranged to control the operation of the module which is capable of receiving commands indicating user-inputs. The controller is arranged to generate the application data for providing an on-screen display and to control the operation of the module in response to the commands, so as to implement a man-machine interface. According to an embodiment, the transport stream interface includes a connector in accordance either with DVB-CI standard, or PCMCIA standard or USB standard. According to a further embodiment, the module comprises a network interface for receiving data over a data network which may be a wired or a wireless network of type IP respectively WLAN. The module may also include a decryption circuit arranged to perform decryption of the received transport stream.
A converter circuit arranged to perform transcoding of the received transport stream from an encoding in accordance with a first encoding scheme into an encoding in accordance with a second, different encoding scheme may be provided as option. For example the module converts a MPEG-4 stream into a MPEG-2 stream or a HD video into a SD video stream
Document: US2008/250462A1 discloses an apparatus for connecting a multimedia portable electronic device capable of storing and playing and/or recording video in digital form, to at least one other electronic device. The apparatus comprises an interface for establishing continuity of at least one signal between said apparatus and the portable electronic device and/or for transferring energy to the portable electronic device; and at least one interface for establishing continuity of at least one signal between said apparatus and the at least one other electronic device; and at least one wireless communications interface; and means for implementing at least one function involving all or some of the resources implemented in said apparatus. Means to create an image on the display device resulting from a mixture of data provided by a broadcast channel and data collected from Internet are not included in the apparatus.
Document: US2008/0148335A1 describes an accessory device to be connected to a television receiver. The accessory device may be any associated television including, for example, a personal video recorder (PVR), an IPTV (Internet Protocol Television) module, a disc player, or other peripheral device such as devices that permit storage of information on flash memory. The television device may be connected to the accessory device be utilizing a common interface represented as video and command accessory interface such as HDMI, USB, IEEE 1394 or Ethernet. A PCMCIA interface connector capable of carrying video, power and command data may also be used as interface. The accessory device comprises a processor and a display generator that generates information passed across the interface to display interface. According to an embodiment, the accessory device further comprises a memory storing an application carried out at the accessory device along with a command processor handling commands passed from the television device to the accessory device. The latter does not include communication means necessary for accessing Internet or a local area network for collecting additional data to be combined with received audio video data.
An aim of the present invention is to provide a compact multifunction device for receiving audio/video content and additional data from an external network to be combined with the audio/video data and forwarded directly to a television set.
This aim is achieved by a multifunction device for television set to enhance video content comprising an input for receiving audio/video data from an audio/video content data source, an output for outputting audio/video data to a display device, and communication means for accessing Internet or a local area network for collecting additional data, the multifunction device being connected and powered by a common interface of the display device is characterized in that it further comprises image processing means configured for receiving first image data from the input, a converter configured for receiving additional data from Internet or a local area network and for converting said additional data into additional image data, an image merging module configured for combining said image additional data with all or part of the input first image data to obtain second image data to be forwarded to the output connected to the display device.
A further object of the present invention is a method for enhancing video content transmitted from an audio/video content data source to a television set via a multifunction device comprising an input for receiving audio/video data from an audio/video content data source, an output for outputting audio/video data to a display device, communication means for accessing Internet or a local area network for collecting additional data, and a common interface powering and connecting the multifunction device to the display device, the method is characterized in that it comprises step of:
The television set comprises mainly a receiver and inputs for receiving audio/video data from various sources, audio/video data processing means and a display device. The multifunction device is directly connected to the television set through a common interface compliant with CI+ standard incorporated in the housing of the television set. No cable is thus required to transport signals as well as to power the multifunction device. The input of the multifunction device receives audio/video data from an appropriate source, and the output transmits modified video or image data to a video input of the television set included in a HDMI interface for example. The input video data are modified thanks to a combination of the source audio/video data with data originating from the Internet or a local network.
Image data are defined here as comprising non-compressed data including frames and raw picture data able to form images on a screen of the display device.
The invention will be better understood with the following detailed description, which refers to the attached figures given as non-limitative examples.
The
The multifunction device comprises a second connection which is an input for audio/video data. This input is generally connected to a video source such as a DVD player, a set-top-box, a PVR, a game set, a computer i.e. any device that produces audio/video data to be displayed. One of the formats generally used is the HDMI but the present invention is not limited to this interface and can also comprise other image data formats.
The third connection is directed to the display device, and the audio/video data processed by the multifunction device are outputted toward the display device. The format used can be HDMI or any suitable video format.
The multifunction device comprises mainly three modes: the pass through mode, the overlay mode and the Internet/Network mode.
According to a preferred embodiment, illustrated by
The second image data Im2 thus obtained are forwarded to the output OUT of the multifunction device which is connected to an audio video input of the display device.
The image data (Im1) at the input (IN), the converted additional image data (ADc) and the image data (Im2) obtained at the output of the merging module (ADD) comprise non-compressed data including frames and raw picture data structured in such a way to form images on a screen of the display device.
Optionally the second image data Im2 may be compressed by an image compression module COMP before output to the display device.
According an embodiment represented by
It is to be noted that the merging operation performed by the image merging module ADD can take different forms, such as a superposition of images from the audio/video source and images from Internet, or each image takes a specific area of the full image display format, for example picture in picture mode, split screen, 3D-multi screen selection, etc.).
According to an example, the input audio video data may correspond to degraded or to low resolution images which may be modified to obtain standard or high resolution image data thanks to additional data collected from Internet or other network provider. A conditional control system may authorize access to the additional data also called control objects only if the user has purchased the necessary rights at the provider. Otherwise, the multifunction module acts in pass through mode by ignoring the additional data, the user watching thus low resolution images instead of high quality HD images.
According to a further example the input audio video data may be watermarked with patterns provided by a server on Internet before entering into the display device. The watermark is then used as identification and copy protection of the source image data.
According to a further example the source audio/video data may comprise subtitles in a given language which may be translated automatically in real time in another language thanks to an on-line translator made available on Internet. The image merging module (ADD) replaces the original language subtitles with the new language subtitle before forwarding to the output (OUT). Other data may be searched automatically or manually on Internet related or not to the input image data such as additional information to be displayed in superimposition or in a particular area of the image (top or bottom margins for example). Information such as stock exchange rates, short news or any special event information may be displayed in this way together with the source audio/video data.
In a further embodiment, the Internet interface is connected to a hub (or a local network) allowing accessing Internet as well as neighbor devices connected to the local network. Consequently, the audio/video source as described above, transmits the audio/video data through the hub and then to the Internet interface of the multifunction device.
The display device is controlled by a single remote control which is the same than the one controlling the television set. One particularity of the CI+ interface (Common Interface Plus) is to reroute the remote control user's commands received by the display device. The multifunction device comprises a command input to receive the user's commands allowing various actions in response to the received commands.
These commands can serve to specify the data collected via Internet (e.g. download a widget, access a weather forecast site), or to organize the data collected via Internet in view of the incoming audio/video input. This can be in the form of moving to the left corner a widget, activating it or defining a window with the Internet data and a different window with the incoming audio/video input.
In a further embodiment, these commands are then sent to the video source via the Internet interface. The video source can then reacts to the commands sent by the user as long as these commands refer to the video source. This is the case if the video source is a receiver/decoder in charge of receiving broadcast audio/video data (free to air or conditional access data). In this case the display device plays the role of a monitor only and the selection of the channels is made directly by the receiver/decoder. The multifunction device thus relays the commands up to the receiver/decoder. A single remote control can then control the display device as well as the receiver/decoder.
Several commands can be directed for the management of the multifunction device. This is the case for selecting one of the three modes (pass-through, overlay or Internet) or selecting the size of each window in the overlay mode. In case of accessing Internet data, the remote control can plays the role of a keyboard. The command sent by the remote control are received by the display device and then passed to the multifunction device. While accessing Internet, these commands allow the selection of web site, enter search criteria etc.
According to an embodiment of the invention, the receiver/decoder and the multifunction device share common secret keys to secure the communication between both devices. The output of the receiver/decoder is further encrypted according to this secret key and the multifunction device decrypts the encrypted audio/video data with the secret key stored in a memory of the multifunction device before passing the audio/video data thus decrypted to the merging module ADD. The secure connection between the receiver/decoder and the multifunction device creates a mating between both devices and only these two devices can work together.
The initialization of the secret keys can be done through various ways:
| Number | Date | Country | Kind |
|---|---|---|---|
| 10168949.5 | Jul 2010 | EP | regional |
| 10191105.5 | Nov 2010 | EP | regional |
This application claims priority under 35 U.S.C. Section. 119 to U.S. Provisional Application NO. 61/364,836, entitled “Multifunction device for television” filed Jul. 16, 2010, European Patent Application No 10168949.5 filed Jul. 8, 2010 and European Patent Application No 10191105.5 filed Nov. 12, 2010, the entire contents of each of the aforementioned documents being hereby incorporated herein by reference.
| Number | Date | Country | |
|---|---|---|---|
| 61364836 | Jul 2010 | US |
