The present invention will be further described in relation to the accompanying drawings, in which:
a and b schematically show the relevant content of EP tables provided in overhead data shown in
The present invention is generally directed towards seamless switching over among content related media streams, like for instance among different angles of the same content that has been coded into three different transport streams. In the following a system for providing this facility will be described in relation to MPEG coded media data in the form of transport streams that are stored on an optical disc according to the Blu-ray standard. It should however be realized that the invention is not limited to Blu-ray or even MPEG, but can be used on other standards having suitable similar properties. The invention is furthermore not limited to such media streams which are provided on an optical disc, but they can be stored on any suitable storage medium, such as hard disks or memory sticks.
The creation of content related media streams out of a number of substreams will now be described with reference being made to
The device first receives content related substreams in the form of packetised elementary streams PES, The device receives one such audio stream PES-A and a number of video streams PES1-V, PES2-V and PESN-V. The video substreams PES1-V, PES2-V and PESN-V are here different angles of the same content, which content thus has been captured with n different cameras. It should be realized that although three are shown in the figure, that more or fewer angles can be provided. The substreams are divided into access units AU that are made up of a number of video packets according to the MPEG standard. An independent group of access units or closed GOP (Group Of Pictures) is here indicated through information provided in the video substreams that point out an entry point in the form of the first video packet of the first access unit in the closed GOP. This first access unit of the closed GOP is here also called an entry access unit. A closed GOP is a set of access units that have content that can be presented separately without the need for information from other access units outside the group. The closed GOPs in the different streams have furthermore been generated in such a way that they have common timing markers or time stamps PTS (Presentation Time Stamp) and the same number of access units. This means that the content in the different video substreams are related to each other and synchronized in such a way that a closed GOP in one video substream has corresponding closed GOPs in the other video substreams with the same time stamp. Finally the audio stream is also divided into access units and has time stamps in the same fashion.
The different substreams are thus applied to the different substream handlers 12, 14, 16, 18, which units thus receive these streams, step 40. The controller thereafter sets an access unit counter AU to one, step 42. For a given access unit AU the video substream handler 14, 16, 18 thereafter extracts the presentation time stamps, positions of the access units in the substreams and information of the video packets and closed GOP indications if there are any from the streams PES1-V, PES2-V and PESN-V and supplies this information to the controller 26, step 44. The controller 26 then compares the number of packets of the streams in the access unit in question with each other, step 46. The controller 26 thereafter selects the substream having the most packets in the current access unit as a reference and proceeds to make the access units equal in size, step 48. This is done by ordering the substream handlers handling the other substreams to add filling packets in the form of null packets N to the access unit in order to make the lengths equal. A substream handler thus pads the video streams with these packets in the access unit in question. If the access unit is the first access unit of a closed GOP, the controller 26 then sets an angle switch point or a switch over marker SOM by giving the SOM a value of one, and if not the SOM marker gets a value of zero, step 50. Thereafter the controller 26 finds out if the access unit was the last access unit of the substreams, step 52. If it was not, the access unit counter is increased by one, step 54, and the controller 26 goes back and repeats steps 44-50. If it was the last access unit, the controller 26 orders the multiplexing of the thus modified substreams PES′1-V, PES′2-V and PES′N-V with the audio substream PES-A and stream control information CI in order to create media or transport streams TS1, TS2, TSN, which stream control information CI is provided to the multiplexers 20, 22, 24 by the controller 26, step 56. This audio substream and the stream control information is provided in a way that meets the Blu-ray specification requirements. The stream control information can include control packets SC, in the form of PAT (Program Association Table), PMT (Program Map Table) or PCR (Program Clock Reference) packets. Thereafter the controller 26 creates overhead data associated with the created transport streams TS1, TS2, TSN in the form of n separate overhead data or clip info files O1, O2, ON, the overhead data files then include so-called EP-tables (Entry Point tables) for each access unit and pointing to the first video packet of the access unit, step 58. The structure of the EP table will be described in more detail later. After that the controller 26 supplies the overhead data O1, O2, ON to the combiners 28, 30, 32, where they are combined with the transport streams TS1, TS2, TSN supplied by the multiplexers 14, 16, 18. Finally the controller 26 makes the writing unit 34 record the combined streams and clip info files on the disc 38 in the disc drive 36.
The different method steps described above in relation to
In
The above described creation of media streams has the advantage of being simple and not requiring any special encoding of source video material and complex mastering of the different content related streams in order to meet coding requirements, like Blu-ray requirements. In standard encoders this could need the involvement of special encoding of the video, requiring strict encoder control, which might be hard to achieve, lead to high costs and time involvements while mastering a disc. Therefore the present invention can be applied in consumer equipment. Furthermore, by using a closed GOP for encoding the switch over marker, the encoding is easy to control for most hardware and software MPEG encoders.
A first type of operation of the device in
It is first assumed that the disc 38 in the disc drive 62 includes transport streams TS1-TSN and corresponding overhead data O1-ON. The method starts by the controller 70 ordering the reading unit 64 to fetch all overhead data from the disc, step 76. In the present embodiment the overhead data is being combined with the transport streams. The combined stream and data are then received by the reading unit, which forwards them to the separator 66. The controller 70 therefore receives the overhead data in the form of the clip info files O1, O2, ON from the separator 66. The controller 70 then continues and extracts the EP tables of the overhead data, step 76. Thereafter the controller compares the PTS and SOM fields for the same source packet numbers SPN for all clip info files, step 78. This means that all EP, tables are compared with each other, all EP2 tables are compared with each other etc. If these fields are then not identical, step 80, a standard switch over method is selected, step 82. If however they are identical, step 80, a simplified scheme is selected, step 84. The simplified scheme will be described later on.
The different method steps described above in relation to
This method of selecting a scheme can be varied in several ways. It is firstly possible that the only EP-tables compared are the EP tables where a SOM setting exists, i.e. SOM is set to one, in order to reduce the number of comparisons. Here too it should be realised that the EP tables could include more information that differ from clip info file to clip info file. This differing data is then not used in the comparison. Another possible variation is that the clip info files are not decoded, i.e. that the EP tables are not extracted, for obtaining entries in the EP tables in order to find out if the simplified scheme is to be used or not. Instead it is possible that the controller looks at the raw clip info files and first investigates if the lengths of them are the same for all streams. The controller then goes on and sees if the data in the clip info files is essentially the same, by looking at the binary values of the files. These values should be identical, perhaps except for some limited regularly recurring parts that differ. These differing parts should then occur at the same positions that recur periodically in limited sections of the clip info files. The only data in the clip info files that should differ from each other should here be the fields that contain information about the original sizes of MPEG pictures.
The recognition whether a simple switch over scheme is to be used is easily made, since it only requires a look at the overhead data and requires no analysis of the media streams, which would normally be the case. Since these streams are normally considerable large, this does without the processing and time required for such analysis needed for it.
A method of simplified seamless switch over between two different transport streams performed by the device in
The method starts by a user selecting to play a transport stream TS via the interface 72. The controller 70 therefore receives such a selection, step 85. As an illustrating example it is assumed that the selection is the selection of TS1 in
The different method steps described above in relation to
The above described way of directly switching over greatly simplifies the processing in the controller and also allows the provision of a simpler player, which will be advantageous with respect to costs. Another advantage of this scheme is that a switch over is made much more quickly since fewer computing steps have to be performed, which is an advantage to the end user. This aspect of the invention is thus saving both time and memory.
The encoding and presentation controllers in both the devices are preferably each provided in the form of a processor with associated program code for performing the method according to the invention. Also the different handlers can be provided in the form of program code associated with the processor. Such program codes can also be provided on a data carrier, where one in the form of a CD Rom disc 98 is shown in
There are a number of variations that can be made to present invention. The invention is not limited to multiplexed audio and video substreams but can for instance be used for video substreams only. In this case there would be no need for an audio substream handler. It is not necessary to provide the transport streams combined with the clip info files, but these can be provided separately. In this case there would not be a need for stream separators and stream combiners. It is furthermore possible to combine the two devices into a combined mastering/playing device. The streams that are multiplexed together in order to form the transport streams can furthermore include more streams, such as presentation and graphics streams.
It should be emphasized that the term “comprises/comprising” when used in this specification is taken to specify the presence of stated features, integers, steps or components, but does not preclude the presence or addition of one or more other features, integers, steps, components or groups thereof. It should furthermore be realized that reference signs appearing in the claims should in no way be construed as limiting the scope of the present invention.
Number | Date | Country | Kind |
---|---|---|---|
04104357.1 | Sep 2004 | EP | regional |
Filing Document | Filing Date | Country | Kind | 371c Date |
---|---|---|---|---|
PCT/IB05/52834 | 8/30/2005 | WO | 00 | 3/6/2007 |