Patent Grant
7382964
The present invention relates to the field of digital audio and/or video recording, and more particularly to recording of metadata by means of a digital video recorder (DVR).
It is as such known from the prior art to include metadata in a transport stream. The term “metadata” is used for all kinds of data about data. This encompasses data which is descriptive about content, such as program title and synopsis. Further the term metadata does also encompass data which relates to the data transmission and/or recording process itself.
For example, the TV-Anytime forum has published metadata specifications which define the attractors and data structures that allow consumers to find, navigate and manage content. The “TV-Anytime” standard is an emerging standard which is defined by the TV-Anytime forum.
Such metadata is also referred to as “attractors” because it can attract a consumer to content. Attractors allow consumers to find, navigate and manage content from various sources. In addition to attractors metadata as defined by TV-Anytime also includes information about user preferences and history. User preference information, such as favorite actors or TV-shows, is included within the scope of TV-Anytime metadata to allow software agents to select content on the consumers behalf.
The metadata representation format is a specification of how TV-Anytime metadata is represented in the extended mark up language (XML). However the TV-Anytime metadata is not restricted to XML can also be encoded in a binary format for transmission or storage. Details of the metadata specification are published in the document SP003V10 of 16 Feb. 2001 which is available on the web-site www.tv-anytime.org. So far no transport mechanism is disclosed for the metadata within the scope of the TV-Anytime specification; also the manner in which the metadata is stored, accessed and used on a personal digital recorder (PDR) is unknown.
Further it is as such known from the prior art to include metadata in a MPEG-2 transport stream. Such transport streams are used for digital video broadcasting. In this instance the metadata is included in the transport stream in the form of digital video broadcast-service information (DVB-SI). The DVB-SI format is described in EN 300 468, DVB Specification for Service Information (SI) in DVB systems.
For the recording of a DVB program by means of a digital video recorder (DVR) a so-called DVR-standard is currently under development. However, a problem associated with the recording of a DVB signal by means of a DVR is that not all program related information (DVB-SI) is stored on the storage medium, e.g. an optical disc. The loss of this descriptive data has serious disadvantages for the DVR operation. Furthermore, the user cannot include user provided data such as annotations or other user provided content into the recording. Finally, the DVR format does not provide for a means to store such information outside the stream for making metadata available for navigation purposes.
The present invention provides for an improved method for recording of program data comprised in a transport stream, such as MPEG-2, by means of a digital audio and/or video recorder (DVR). Further the invention provides for an improved computer program digital audio and/or video recorder for recording of program data comprised in such a transport stream.
The invention enables to include metadata provided by the transport stream into the navigation data of the digital recording. This allows a user to take full advantage of the metadata provided by the broadcasters and/or to include additional metadata, such as user provider annotations and/or data from other sources like the Internet, digital audio broadcast data (DAB) or teletext.
It is a further advantage of the present invention that the metadata information which is stored as part of the navigation data of the digital recording enables a user to use that information for retrieval of recordings and to readily access metadata information.
In accordance with a further preferred embodiment of the invention the metadata is also stored as part of the DVR MPEG-2 transport stream file (MPEG TS). This is done by ingesting of additional data packets into the MPEG TS transport stream.
The additional data packets carry the metadata information. In case the metadata which is stored as part of the navigation data is erased by a user operation or otherwise this metadata can be reconstructed from the additional data packets which are stored as part of the transport stream MPEG TS.
In accordance with a further preferred embodiment of the invention additional data packets are ingested in the MPEG TS transport stream in isochronous intervals. These metadata packets contain hash tables which are calculated during the recording.
A hash table is a checksum or a CRC (Cyclic Redundancy Check) and provides consistency checks after recording. The check is done by recalculating the hash table metadata during playback and comparing it to the hash tables comprised in the additional data packets of the transport stream.
In accordance with a further preferred embodiment of the invention additional metadata packets are provided for trick modes. Metadata packets embedded within the MPEG TS transport stream are carrying pointers to adjacent entry points for I-frames. For example the trick mode metadata packets encompass a list of past and/or future I-frames. This simplifies handling of the trick mode.
In the following preferred embodiment of the invention will be explained in greater detail by making reference to the drawings in which:
The demultiplexer 2 is coupled to DVR encoder 8. Further the demultiplexer 2 is coupled to analyser 4. The demulitplexer 2 serves to de-multiplex the transport stream 1 in order to provide the required program data to the DVR encoder 8 and to provide DVB-SI data 3 which is embedded in the transport stream 1 to the analyser 4.
The analyser 4 serves to decode the DVB-SI data 3 in order to provide metadata 5 to navigation data and packet embedder 6.
In addition or alternatively other metadata 12 is provided to the navigation data and packet embedder 6 from data source 13. Data source 13 can be an entry device for user provided metadata such as annotations. Alternatively data source 13 provides for an interface to teletext metadata and/or metadata received via digital audio broadcast (DAB) or the Internet.
The navigation data and packet embedder 6 provides for metadata in the form of vendor specific data 7 and for data transport packets 14 to be ingested into the recorded stream.
The vendor specific data 7 and the data transport packets 14 are in putted into the DVR encoder 8. Based on the program data which the DVR encoder receives from the demultiplexer 2 and based on the vendor specific data 7 and the data transport packets 14 the DVR encoder generates a data stream 9 and navigation data 10.
The data stream 9 comprises the additional data transport packets 14 provided by the navigation data and packet embedder 6 whereas the navigation data 10 comprises the vendor specific data 7 from the navigation data and packet embedder 6. The data stream 9 and the navigation data 10 are recorded on DVR disc 11.
In operation a transport stream 1 is received by means of a satellite or cable transmission or via another communication channel. The transport stream 1 comprises a number of video and/or audio programs as well as associated DVB-SI data 3.
The user selects one or more of the programs contained in the transport stream 1 for recording. The corresponding program data packets are provided from the demultiplexer 2 to the DVR encoder 8.
The DVB-SI data 3 which is associated with the user selected programs is also demultiplexed and provided to the analyser 4 for decoding. The analyser 4 outputs the decoded metadata 5.
The navigation data and packet embedder 6 transforms this metadata into vendor specific data 7 and into data transport packets and provides these two formats of transformed metadata to the DVR encoder 8.
This way the DVR encoder 8 integrates the vendor specific data 7 into the navigation data and it ingests the additional data transport packets 14 into the data stream 9 for recording. As a result the recording on the DVR disc 11 contains the metadata both in the form of additional data transport packets 14 as well as in the form of navigation data 10.
The navigation data 10 is primarily used for navigation purposes, such as retrieval of a specific user desired program. As metadata is included in the navigation data 10 the user is enabled to define a search profile which encompasses information stored in the metadata. This has the further advantage that the navigation data 10 can be accessed quickly such that a search is performed very rapidly.
In case the metadata comprised in the navigation data 10 is erased for some reason it can be reconstructed by means of the additional data transport packets 14 which have been ingested into the data stream 9.
The DVR of
The DVR decoder 15 outputs a MPEG-2 transport stream 16 which is inputted into demultiplexer 17. The demultiplexer 17 demultiplexes DVB-SI data 18 which is contained in the transport stream 16. The DVB-SI data 18 is inputted into analyser 19.
The analyser 19 decodes the DVB-SI data 18 and provides corresponding metadata 20 to navigation data embedder 21 in addition or alternatively metadata is provided from data source 13 as it is the case in the embodiment of
The navigation data embedder 21 transforms the metadata 12 and/or metadata 20 into vendor specific data 22. The vendor specific data 22 is provided to the DVR encoder 23 which generates modified navigation data 24 comprising the metadata 12 and/or 20 in the form vendor specific data 22. The modified navigation data 24 is written onto the DVR disc 11.
This way a user is enabled to add navigation data in the form of metadata to a previous recording. This feature is especially advantageous for recordings which have been made previously on a prior art DVR. In such recordings the DVB-SI data 18 may have been recorded as part of the transport stream. However such recorded DVB-SI data is not accessible by a user of a prior art DVR and cannot be used for navigation purposes. By means of the embodiment of
This way data packets are embedded into the DVR vendor specific data field and into the DVR MPEG-2 transport stream (MPEG TS). Both types of embedded packets can be used separately or in combination. For example vendor specific data packets can be used to locate the additional metadata packets in the MPEG TS transport stream and the packets in the MPEG-2 transport stream can be used to generate the vendor specific data metadata packets.
In accordance with the preferred embodiment of
Vendor specific data are defined for the volume (info file), each playlist and for the files storing the attributes of A/V stream file.
A form of metadata packets which is in compliance with the syntax and semantic of a transport packet is illustrated in
The packet identifier (PID) of
Examples for metadata are DVB-SI information, which has been almost disregarded by the DVR specification (like program genre). Also information retrieved from other sources such as teletext, DAB and internet content carry metadata, which can be embedded within the MPEG TS.
If at the beginning of the recording no payload is existent—this is a further embodiment—placeholder packets are written to the MPEG TS stream. Later theses placeholders can be replaced with valid metadata.
Another use of the technique is to store metadata packets in isochronous intervals in the MPEG TS stream (
For this purpose additional metadata packets 25 are ingested into the transport stream 26 at time intervals Δt.
By the usage of the hash table metadata packet it is possible to retrieve and also to generate a consistent take even when a power drop occurred during the record in the DVR. A power drop will generate inconsistent DVR files.
Also by the usage of the hash table metadata packet it is possible to detect edit operations having been done by a prior art DVR recorder. For those edited streams a metadata update may be necessary.
By calculating a hash table value for all meaningful DVR files (like the playlist file) edit operations can easily be detected. Even edit operations that have been done with other DVRs can be identified.
It is a further advantage of the invention to provide metadata packets for trick modes. Metadata packets embedded within the bit stream (MPEG TS) are carrying pointers to adjacent entry points for I-frames. The trick mode metadata packets can encompass a list of N I-frames in the past and/or in the future, which will simplify the handling of trick mode.
It is to be noted that the present invention enables the additional storage of metadata content in parallel to the broadcast information which makes all the metadata accessible independent from their definition in the DVR standard. Further the invention provides for editing capabilities for user-defined collections, annotations and short cuts.
By embedding hash tables in the MPEG TS stream the error handling and recovery capabilities of a digital video recorder are improved. Further the invention enables to store adjacent I-picture positions which permits easier trick mode handling.
| Number | Date | Country | Kind |
|---|---|---|---|
| 01127015 | Nov 2001 | EP | regional |
| Number | Name | Date | Kind |
|---|---|---|---|
| 6289169 | Okuyama | Sep 2001 | B1 |
| 6925247 | Kim et al. | Aug 2005 | B2 |
| 7200601 | Bradley et al. | Apr 2007 | B1 |
| 7228560 | Panabaker | Jun 2007 | B2 |
| Number | Date | Country |
|---|---|---|
| 1111916 | Jun 2001 | EP |
| WO0057895 | Oct 2000 | WO |
| 0176241 | Oct 2001 | WO |
| Number | Date | Country | |
|---|---|---|---|
| 20030091337 A1 | May 2003 | US |
