Patent Application
20080187297
The present invention relates to a method of combining a signal comprising additional information with a broadcasted signal representing audio-video content in order to enhance a user experience of the broadcasted audio-video content according to the precharacterizing part of claim 1. This invention also relates to an end user system as described in the preamble of claim 12. This invention also relates to a corresponding transmission system as described in the preamble of claims 15. This invention also relates to signal corresponding to a broadcasted signal according to the precharacterizing part of claim 21. This invention also relates to a computer software product operative to implementing the said method of combining a signal comprising additional information with a broadcasted signal of claim 1.
New forms of consumer electronics are continually being developed. Many efforts have been focused on the convergence of computer technology and home entertainment systems that center on the television (TV) set. Important areas are interactive television and enhanced functionality, by merging broadcasted audio-video content with additional information. Several industry discussion forums in the area of Digital Video Broadcast (DVB) like the European MHP (Multimedia Home Platform) or the US Dase Platform disclose the use of Internet resources to enhance functionality. WO 01/11874 describes a system wherein website addresses in the form of uniform resource locators (URL) are included in the broadcasted TV signals. When prompted by a message in the TV broadcast, the users may select one or more URLs to contact a website over Internet and, optionally upon further identification or payment, they may obtain additional information relating to the broadcast. However, a user may desire an enhanced experience of a broadcasted audio-video content while not having a suitable Internet connection available.
It is an object of the invention to provide an improved method for combining a signal comprising additional information with a broadcasted signal representing audio-video content. The object is achieved by a method according to the invention, as recited in the characterizing part of claim 1. The method combines with the broadcasted audio-video content additional information extracted from information that is available locally, thus allowing an enhanced user experience even if an Internet connection is not available, or the Internet connection is present but it is not suitable for the desired purpose. For example, during the broadcast of a soccer match, a broadcasted control sequence uses a locally available optical disc comprising information about soccer. In this case a downscaled movie (picture in picture) from the disc about the players may be displayed, or additional information about the players may be extracted and displayed. Or during a movie, information about actors, director, etc. may be extracted and displayed on screen from additional information accompanying a second movie featuring the same actors or director, the second movie and the accompanying information being available locally.
An advantageous embodiment can be obtained according to the measures of claim 2. Including a checking step, for checking if a suitable player is available in the end user system, and an identification step, comprising identifying if a desired media storing the additional information is available, are beneficial as the broadcaster of the audio-video content cannot have prior knowledge about available resources of a given end user system.
In a first embodiment, the determination of locally available resources in the checking and identification steps can be obtained by interactively querying user about the said resources. This mitigates the problem of correctly identifying a suitable player and a desired media.
A second embodiment can be used to advantage according to the measures of claim 4. Executing a test sequence for testing if a suitable player is present in the end user system in the checking step alleviates the problem that an end-user might not be aware of the exact technical details of the end user system. For instance a test sequence may comprise a sequence operative to inducing the end user system to attempt reading information from the desired media. In an advantageous embodiment according to claim 5, the test sequence is comprised in the broadcasted signal, therefore avoiding relying on the unknown resources of the end user system.
In a more advantageous embodiment, the checking step comprises checking information stored by the end user system, operative to determining whether a suitable player is present in the end user system. This obviates the problem of the second embodiment that attempting reading information from a desired media fails in the case of a removable media if no media is inserted in the player. Optionally, instead of checking information stored by the end user system, the checking step may comprise executing a function available to the end user system, operative to determining whether a suitable content player is available.
With respect to Digital Rights Management (DRM), media comprising copyrighted information may also comprise protection so that only authenticated control sequences may executed while attempting to reading the copyrighted information. Consequently, it is advantageous that the control sequence may further comprise information corresponding to an identification key. This allows the use of protected copyrighted information in the combined output step of the method.
It is desirable that in the combined output step, the end user may select the specific pieces of additional information that are used in the combined output step or in selecting a mode of usage for the pieces of additional information.
The invention also includes an end user system according to claim 12. Identification means adapted to identify the presence of playback means solves the problem of how to allow a broadcasted control sequence to reliably identify available playback means. In a first embodiment of the end user system, according to the measures of claim 13, the identification of playback means is realized by means storing information locally whether a suitable player is available. According to a second embodiment of the end user system, the identification is realized by function execution means, adapted to determining when executed whether a suitable content player is present in the end user system. Both embodiments carry the advantage that they are simple to implement by means of firmware avoiding costly hardware modifications.
The invention also includes a transmission system according to claim 15. The transmission system allows an enhanced user experience by providing a combined output of a broadcasted audio-video content with additional information that is retrieved from information stored locally. Therefore, the transmission system allows an enhanced user experience even if an Internet connection is not available. An improved embodiment is obtained by measures of claim 16. Enabling the controller means of the end user system to determine if a suitable player for playing information stored locally is available and to identify if a desired media is available is advantageous as the broadcaster of the audio-video content cannot have prior knowledge about available resources of a given end user system.
The invention also includes a signal corresponding to a broadcasted signal according to claim 21.
The invention also includes a computer application product according to claim 17.
These and other aspects of the invention are apparent from and will be explained with reference to the embodiments described hereinafter.
The features and advantages of the invention will be appreciated upon reference to the following drawings, in which:
A typical broadcast emission system (10) operates as a multi-channel system, implying that the multiplexer (104) can handle information received from a number of (parallel) sources and interacts with the transmitter (106) to broadcast the information along a corresponding number of channels or multiplexed into separate transport streams. In addition to audio-video content, messages or applications or any other sort of digital data may be introduced in some or all of these services/channels interlaced with the audio-video content. As such a transport stream (TS) comprises one or more types of streams, also known to the person skilled in the art under the name services, each service comprising one or more service components. A service component is also known as a mono-media element. Examples of service components are a video elementary stream, an audio elementary stream, a subtitle component, a Java application (Xlet) or other data type. A transport stream (TS) is formed by time multiplexing one or more elementary streams and/or data.
The transmitter (106) broadcasts the transport stream in the form of a broadcasted signal (BS). Returning to transmission system as shown in
Typical examples of end user systems (20), where the invention may be practiced, comprise set-top-boxes (STB), digital television units equipped with Digital versatile Disc (DVD) and/or Blu-ray Disc (BD) playback abilities, or computer based entertainment systems, also known under the name Home Media Servers. The end user system (20) preferably complies with a defined open platform like the European MHP (Multimedia Home Platform) or the US Dase Platform. These public platforms define several types of applications that may be recognized and executed by the end user system. For example, the European MHP platform specifies that applications may be included as Java TM applications, such applications known to the person skilled in the art under the name Xlets.
While not necessary for practicing our invention, a typical end user system (20) may use known communication protocols like TCP-IP to download information from information servers (40), preferably the Internet, the downloading taking place over known communication channels (32), for example cable or telephone/ADSL/ISDN lines.
Further details of an end user system (20) in which the present invention may be practiced will be discussed with reference to
The European Multimedia Home Platform (MHP) represents an open forum describing how applications may be executed on an end user system. The platform specifies that suitable applications are Java applications to be executed by a Java Virtual machine running on the end user system. This corresponds to an abstraction layer, known in the art under name the Application Manager, being present between any application to be executed by the end user system (20) and the specific system resources of the end user system (20). Consequently the Application manager allows applications to be carried over any Digital Video Broadcast (DVB) compliant network, independent of the specific end user system (20), for example on high or low end STBs, on integrated digital TVs or on home media servers.
Preferably the data stream (203) and the handling of the data stream (203) by the end user system both comply with the open European Multimedia Home Platform (MHP). Consequently, the applications comprised in the data stream are specifically Java applications known under the name Xlets. The data stream (203) outputted by the demultiplexer (202) is fed to the Application Manager (207). Any application comprised in the data stream (203) will be executed by the Application Manager (207).
The end user system may also comprise a media player/recorder (209). This may be for example a Blu-ray Disc (BD) or a Digital Versatile Disc (DVD) player and/or recorder, a hard disk or any other suitable device. The media player (209) extracts an encoded information stream, for example an MPEG2 stream, from a storage media (210), for example an optical disc or a hard disk, and splices it into separate audio (212), video (213), subtitle (214), and data (211) streams. The data stream (211) is fed to the Application Manager (207), while the audio (211), video (212) and subtitle (214) streams are fed to the controller (208).
An advantageous embodiment may be obtained when the information retrieving functions of the media player (209) can be accessed by the broadcasted application comprised in the data stream (203). For example it is expected that Blu-ray Disc (BD) players/recorders are able to execute Java Applications, at least several of those specified in the open software platform known under the name GEM (Globally Executable MHP)
A method for combining additional information with broadcasted audio-video content according to an embodiment of the invention is further explained with respect to
The details of the execution (80) and combined rendering (90) method step according to an embodiment of the invention are further explained with reference to
The execution of the broadcasted application is started by the Application Manager in step (801). In the checking step (802) the availability of suitable playback resources to the end user system is checked. Detailed embodiments of the checking step (802) will be discussed further on. The method proceeds to a decision step (803). If no suitable playback resources are found, the method proceeds to a standard rendering step (901). It should be noted that the standard rendering step (901) may contain interactive parts that make use of data content included with the broadcasted application or data content that is downloaded from the Internet, but the standard rendering step (901) does not make use of information stored locally. If suitable playback resources, for example a Blu-ray Disc (BD) player, have been identified, the method proceeds to identification of available media storing local information. If the available media contains the desired information, the method proceeds to a combined rendering step (902). It should be noted that, in view of the fact that certain media may require application authentication before the stored information is made available, the combined rendering step (902) may be preceded by a certificate check step (814). For example, in the case of Blu-ray Disc (BD) players, it is possible that only authenticated applications are allowed to run when a desired BD disc is played. Returning to the decision step (805), if the presently available media is not the desired one, the application proceeds to checking if a list of available media titles is present in the firmware memory of the end user system (806). For example, in the case of Blu-ray Disc (BD) players, such a list of available media titles may be maintained in the firmware memory. If such a list is available, in step 810, the presence of a desired title in the list is checked. The method proceeds to a decision step 811. If no title is found in decision step 811, or if in decision step 807 no title list was found, the method proceeds to a user query step 808, step in which the user is queried if the desired media title is available locally. If the user indicated that no desired media title is available, the decision step 809 is followed by the standard rendering step 901. If the user indicated a desired title is available, the decision step 809 is followed by a media insertion step 812, in which the user is asked to insert the corresponding media. Returning, if a desired title is found in the list in step 810 then the corresponding decision step 811 is followed by the media insertion step 812. In the waiting step (813) the application waits for the desired media to be inserted. After the media is inserted, optionally the authentication key is checked in step (814) and the combined rendering of locally stored information and of the broadcasted content is executed in the combined step (902).
With respect to a detailed embodiment of the checking step (802), the technical problem solved by the present invention relates to the fact that party that provides the broadcasted signal (the network provider) cannot know what specific playback resources are available to the end user system and no identification methods for playback resources have been disclosed. For example, the present implementation of the open Globally Executable MHP (GEM) standard does not specify any methods, functions and/or system properties that would allow a broadcasted application to determine what specific playback resources are available to the end user system.
In a first embodiment of the method, the checking step (802) of the method comprises interactively querying the user via a pop-up window over the specific playback resources available to the end user system. Based on the input from the user, in step 803 the method either proceeds to a standard rendering step (901), otherwise the method continues with the media checking step (804).
In a second, more advantageous embodiment of the method, the checking step (802) comprises directly attempting to playback a certain media type by directly executing the corresponding playback function. This embodiment alleviates the problem that an end-user might not be aware of the exact technical details of the end user system. For example, in case of an MHP compliant system this would correspond to attempting playing the desired type of media. If the playback function returns an error, it means that the desired type of playback resource is not available and the application may repeat the attempt to playback for another media type until all media types are checked or a suitable media playback resource is found. If no suitable media is found, in decision step 803 the method proceeds to the standard rendering step (901) otherwise it continues with the media checking step (804). In a more advantageous embodiment, the specific playback function is included in the broadcasted application stream comprised within the broadcasted data stream.
In a third embodiment of the method, the checking step (802) of the method comprises the broadcasted application using novel identification features of the end-user-system. For example, information with respect to available system resources is added in the firmware memory of the end user system. This may be implemented by software means known to the man skilled in the art as a system property. The information with respect to system resources may be included by the end-system's manufacturer before sale or can be provided later by means of a firmware update. Returning to the description of the method according to the invention, in one embodiment the firmware memory is inspected in the checking step (802) by the broadcasted application and the playback facilities are identified.
An alternative embodiment for the checking step (802) corresponds to adding to the end user system identification means, that allow the identification of available resources. This may be implemented by means of software known to the man skilled in the art as an identification function. When executed, the function outputs information with respect to available resources. Identification means may be included by the end-system manufacturer before sale or can be provided later by means of a firmware update. Returning to the description of the method according to the invention, in an alternative embodiment, the broadcasted application calls the identification function in the checking step (802) and available system resources are identified.
These embodiments for the checking step (802) obviates the problem that the method corresponding to the second embodiment fails in the case the application attempts to read information from certain type of removable media (for example BD-ROM disc) and no media of the corresponding type is inserted in the content player.
It should be noted that the above-mentioned embodiments are meant to illustrate rather than limit the invention. And that those skilled in the art will be able to design many alternative embodiments without departing from the scope of the appended claims. In the claims, any reference signs placed between parentheses shall not be construed as limiting the claim. Use of the verbs “comprise” and “include” and their conjugations do not exclude the presence of elements or steps other than those stated in a claim. The article “a” or an” preceding an element does not exclude the presence of a plurality of such elements. The invention may be implemented by means of hardware comprising several distinct elements and by means of a suitable programmed computer. A computer program may be stored/distributed on a suitable medium, such as optical storage or supplied together with hardware parts, but may also be distributed in other forms, such as being distributed via the Internet or wired or wireless telecommunication systems. In a system/device/apparatus claim enumerating several means, several of these means may be embodied by one and the same item of hardware or software. The mere fact that certain measures are recited in mutually different dependent claims does not indicate that a combination of these measured cannot be used to advantage.
| Number | Date | Country | Kind |
|---|---|---|---|
| 05103003.9 | Apr 2005 | EP | regional |
| Filing Document | Filing Date | Country | Kind | 371c Date |
|---|---|---|---|---|
| PCT/IB06/51069 | 4/15/2006 | WO | 00 | 10/10/2007 |
