The present invention relates to: an information record medium, such as a high density optical disc, capable of recording thereon various information such as main picture information or video information, audio information, sub-picture information, reproduction control information, and so on, at high density; an apparatus for and a method of recording the information onto the information record medium; an apparatus for and a method of reproducing the information from the information record medium; an apparatus and a method capable of both recording and reproducing the information; a computer program for controlling the recording or reproduction; and a data structure including a control signal for controlling the reproduction.
DVDs become common as optical discs onto which various information such as main picture information, audio information, sub-picture information, reproduction control information and so on is recorded. According to a DVD standard, the main picture information (video data), the audio information (audio data) and the sub-picture information (sub-picture data) are packetized each with the reproduction control information (navigation data) and are multi-recorded onto a disc in a program stream format of MPEG 2 (Moving Picture Experts Group phase 2), which is a high performance encoding technology. Among them, the main picture information has data, which is compressed in a MPEG video format (ISO 13818-2), for one stream in one program stream. On the other hand, the audio information is recorded in a plurality of formats (i.e. linear PCM, AC-3, MPEG audio and so on) and has data for up to 8 streams in one program stream. The sub-picture information is defined by a bitmap, and is compressed and recorded in a run length method, and has data for up to 32 streams in one program stream.
On the other hand, a transport stream format of MPEG2 standard is coming to be standardized, which is suitable for data transfer. According to the transport stream format, a plurality of elementary streams are transferred at the same time. For example, a plurality of programs, such as a plurality of satellite digital broadcasting channels in one satellite radio wave, are transmitted at the same time in a TDM (Time Division Multiplex) scheme.
This type of DVD is capable of an “angle reproduction”, which records a plurality of video informations relating to a scene or image (hereinafter referred to as an “angle” as appropriate) viewed from a plurality of viewpoints onto a same disc, and reproduces an angle desired to watch by a user. For this, according to this type of DVD, a plurality of video informations corresponding to each angle are interleaved with each other by unit of interleaved unit (ILVU). In a navigation packet (NV_PCK) disposed at head of a video object unit (VOBU) composing each interleaved unit, an angle information (SML_AGLI) indicating a size and an address of an interleaved unit to be reproduced next for each angle is stored.
In the aforementioned DVD, an address map (VTS_VOBU_ADMAPI), in which address information about a video object unit (VOBU) is stored, is used to access the video information. Therefore, even if a reproduction entry is in an interleaved block, an access is made to a head of the interleaved unit, so that the video information in the interleaved unit is reproduced after a navigation packet is reproduced.
However, in a record format for a large volume high density optical disc under development of the present applicant, a time map (referred to as an “ES address information” in the present embodiment), in which a packet number corresponding to each display start time is stored, is used to access the video information. Therefore, if a reproduction entry is in an interleaved unit, an access is made to a mid of the interleaved unit, so that the vide information is reproduced without reproducing a navigation packet. This makes it unknown which interleaved unit is to be reproduced next. As a result, it is difficult, from a technical viewpoint, to perform an angle switching “seamlessly” without discontinuity of the video information (herein referred to as a “seamless angle reproduction” as appropriate).
Additionally, if an angle reproduction is performed by using an interleaved unit, a “jump” processing to jump or skip reading the interleaved unit is enforced to a DVD player. For this, a packet of an audio stream (i.e. audio packet) corresponding to a video stream, which composes contents such as a movie, needs to be duplicated or replicated and disposed for every interleaved unit. As a result, the authoring operation becomes complicated, which is a technical problem.
The present invention has been accomplished in view of the above problems for example. It is therefore an object of the present invention to provide an information record medium, an information record apparatus and method, an information reproduction apparatus and method, an information record reproduction record reproduction apparatus and method, a computer program for a record or reproduction control, and a data structure including a control signal, which enable a seamless angle switching among a plurality of video streams or video streams composing a TS (transport stream) without using the interleaved unit for example.
The above object of the present invention is achieved by an information record medium onto which a whole stream including a plurality of partial streams each comprising a series of content information is multi-recorded by a unit of a packet that is a physically accessible unit, said medium comprising: an object data file for storing object data comprising a plurality of packets each storing a piece of the content information and being multiplexed by the unit of the packet; and an object information file for storing association definition information to define a relationship between multiplexed packets and the plurality of partial streams, as reproduction control information to control a reproduction of said object data file, wherein the plurality of partial streams include a plurality of video streams comprising a plurality of angle video informations corresponding to a plurality of viewpoints, each of the plurality of angle video informations comprises an assembly of minimum image units, which are individually reproducible and defined by a predetermined standard, each of the minimum image units is divided and stored into the packets in said object data file, and in the object data file, a switch unit as a logical section for an angle switching on a reproduction time scale is defined such that the plurality of packets for dividing and storing a same minimum image unit does not extend over a boundary of the switch unit, and such that a minimum image unit reproducible without using another minimum image unit belonging to an anterior switch unit extending over the boundary of the switch unit is arranged as a first minimum image unit of the switch unit.
According to the information record medium of the invention, the object data file stores object data consisting of a plurality of packets each storing pieces of the content informations. Usually, the object data is a unit logically accessible by the information reproduction apparatus. The content information includes audio information (e.g. audio sound of a movie and the like) and sub-picture information (e.g. caption of a movie and the like), in addition to a plurality of video information. The object information file stores relation definition information (e.g. an ES map table and the like, as mentioned later) including information indicating a packet corresponding to each display start time, for each of a plurality of video information. Therefore, at the reproduction of the information record medium, the object data is recorded separately onto the information record medium for example. For example, they are reproduced in a predetermined sequence, according to reproduction sequence information such as play list information and the like stored in a reproduction sequence information file such as play list information file. In this case, object data relating to a desired stream among a plurality of partial streams are selectively reproduced, according to the relation definition information such as an ES map table.
A plurality of partial streams reproduced selectively as such include a plurality of video streams consisting of a plurality of angle video information corresponding to a plurality of viewpoints. Each of a plurality of angle video information is made of a collection of minimum video units each reproducible alone and defined by a predetermined standard, such as GOPs based on a MPEG2 standard.
Each of minimum video units such as GOPs is divided into packets and stored in the object data file. More specifically, one I picture (Intra-coded picture) composing the GOP for example is divided into a plurality of packets and stored. Also one P picture (Predictive-coded picture) is divided into a plurality of packets and stored. Also one B picture (Bidirectionally predictive-coded picture) is divided into a plurality of packets and stored. For example, one GOP is made of a few to a few tens of pictures, depending on the video contents, and thereby is divided as a whole into a plurality of packets to be stored.
Particularly in this invention, a switch unit is defined as a logical section for an angle switching on a reproduction time scale or axis in the object data file. Herein, a plurality of packets for dividing and storing the same minimum video unit is defined not to extend over a boundary of the switch unit. For example, packets belonging to the same GOP exist in the same switch unit. Furthermore, the minimum video unit reproducible without the aid of the minimum video unit belonging to an anterior switch unit extending over the boundary of the switch unit is defined to be arranged as a first minimum video unit of the switch unit. For example, a first GOP of the switch unit starts from an I picture, and reproducible without any of I, P and B picture belonging to another GOP of the anterior switch unit.
Therefore, when an angle switching is performed during the reproduction of the information record medium, once an operational command for an angle switching is issued by a user operation via a remote controller, control panel and the like, the video stream to be reproduced is not switched instantly but switched after the reproduction until the boundary of the switch unit is completed as a logical section for an angle switching. Then, a switch unit #i+1 (i=1, 2, 3, . . . ) to be reproduced next to the switch unit #i whose reproduction is completed is reproducible without minimum video units whose first unit belongs to the switch unit #i. Furthermore, a plurality of packets for dividing and storing the same minimum video unit does not extend over the boundary between the switch units #i and #i+1. Therefore, following the completion of the reproduction of the switch unit #i+1, the switch unit #i+1 can be reproduced appropriately and sequentially from a packet to be firstly reproduced. That is, by performing an angle switching from the switch unit #i to the switch unit #i+1 at the boundary of the switch unit, while angle video information for relatively short time can be reproduced via a buffer for a seamless reproduction, a seamless angle reproduction can be easily achieved. In order to shorten a response time for a switching during such a seamless angle reproduction, it is sufficient to shorten a length of the aforementioned switch unit. In practice, the length is preferably within 1.5 seconds.
As a result, according to the present invention, a seamless angle switching or a seamless angle reproduction can be achieved, without the aid of an interleaved unit.
For example, a transfer rate of an optical disc whose recording density and recording speed are recently in progress may be expected as an order of 32 Mbps. Therefore, if a transfer rate of one video stream is 5 Mbps, a switching of 5 to 6 angles can be achieved seamlessly and sufficiently with the aid of the information record medium of the invention. Alternatively, if a transfer rate of one video stream is 10 Mbps, a switching of 2 to 3 angles can be achieved seamlessly and sufficiently with the aid of the information record medium of the invention.
The “angle switching” according to the present invention indicates not only an angle switching in a narrow meaning among a plurality of videos providing one scene from a different angles, but also an angle switching in a broad meaning among a plurality of video information having or not having a special relationship to each other. In any case, the effect of the present invention is obtained, insofar as a switching among a plurality of video information needs to be seamless or speedy.
A length (data amount) of the switch unit corresponds to a length of a minimum video unit such as a GOP when it is shortest, for example a few tenth seconds to a few seconds as the reproduction time. Then, the length of the switch unit may vary depending on the contents of the content information (e.g. motion extent of a motion picture indicated by the video information). Alternatively, it may be fixed.
Incidentally, various information stored in the reproduction sequence information file or the object information file according to the present invention is preferably not multiplexed by the unit of the packet on the information record medium, different from a case of the object data file. Therefore, on the basis of the reproduction control information or the reproduction sequence information, the information reproduction apparatus can reproduce the object data. A packet address according to the present invention may be a physical address, but typically a logic address. An actual physical address is defined uniquely from a logic address, under control of the file system.
In an aspect of the information record apparatus according to the present invention, the minimum image unit is a GOP (Group of Picture) based on a MPEG (Moving Picture Experts Group) standard.
According to this aspect, a plurality of packets for dividing and storing the same GOP does not extend over the boundary of the switch unit. Furthermore, a GOP reproducible without the aid of a GOP belonging to an anterior switch unit extending over the boundary is arranged at the head of the switch unit. Therefore, a seamless angle reproduction can be achieved without the aid of an interleave. Incidentally, although a GOP is typically standardized by “MPEG2” standard, it may be based on another MPEG standard other than MPEG2.
In another aspect of the information record medium according to the present invention, the switch unit is defined by position information, the position information indicating a head address of the switch unit.
According to this aspect, the seamless angle switching is achieved, by performing the angle switching at the boundary of the switch unit, on the basis of the position information which indicates the head address of the switch unit, at the reproduction of the information record medium.
Incidentally, the switch unit may be defined by position information which indicates a rear-most address of the switch unit. This also allows the boundary of the switch unit to be identified on the reproduction.
In this aspect, the position information may be stored for each switch unit, in a switch unit address table constructed in the object information file.
In this arrangement, the position information which indicates the head of the switch address can be obtained for each switch unit by firstly reproducing the object information file and then referring to the switch unit address, in order to reproduce the information record medium. According to this, it is possible to perform the seamless angle switching relatively efficiently.
In this aspect, the position information may be stored for each switch unit, in a navigation packet forming a part of the partial streams in the object data file.
In this arrangement, the position information which indicates the head of the switch address can be obtained for each switch unit, by referring to the navigation packet forming a part of the video stream relating to the angle video information or the partial stream relating to another control information, before or after the reproduction of the angle video information, in order to reproduce the information record medium. According to this, it is possible to perform the seamless angle switching relatively efficiently.
Further in this case, the position information as for anterior n (n is natural number equal to or more than 1) switch units and posterior m (m is natural number equal to or more than 1) switch units, with respect to a switch unit to which the navigation packet is belonged as a standard, is stored in the navigation packet.
In this arrangement, the position information which indicates the head of the switch address, with regard to the n-units-anterior or m-units-posterior switch unit relative to the switch unit to which the navigation packet is belonged, by referring to the navigation packet before or after the reproduction of the angle video information. In this case, controlling or adjusting the number of units, such as the “n-units” or the “m-units” makes it possible to selectively obtain the position information having a strong relationship with the presently reproduced switch unit, while the increase of the data amount of each navigation packet is avoided. Therefore, it is possible to perform the seamless angle switching efficiently.
In an aspect of such a navigation packet, the navigation packet may be arranged as a head packet of the switch unit.
In this arrangement, the navigation packet is firstly reproduced, in order to reproduce the switch unit. Therefore, it is possible to selectively obtain the position information having a strong relationship with the presently reproduced switch unit, via the navigation packet. Therefore, it is possible to perform the seamless angle switching very efficiently.
In an aspect of such position information, the position information may be a serial number of the packets or a PTS (Presentation Time Stamp).
In this arrangement, the head address of the switch unit can be identified, for example by the serial number of packets sequentially assigned within various ranges such as within the object file or within the title, or by the PTS on the reproduction time scale.
In another aspect of the information record medium according to the present invention, the association definition information has table information, the table information indicating, for each partial stream, packet identification numbers assigned specifically to a plurality of packets multiplexed at a same time.
In this aspect, in accordance with the table information in the association definition information, for example, on the basis of a packet identification number specific to each partial stream, it is possible to reproduce packets relating only to a desired partial stream. Then, for the angle switching, it is possible to perform the angle switching by switching from a process of reproducing sequentially packets to which packet identification numbers specific to the video stream relating to one angle video information are assigned, to a process of reproducing sequentially packets to which packet identification numbers specific to the video stream relating to another angle video information are assigned. Furthermore, since such a switching is performed at the boundary of the switch unit, it is performed as a seamless angle switching.
In another aspect of the information record medium according to the present invention, the medium further comprises a reproduction sequence file for storing reproduction sequence information to define a reproduction sequence of the object data.
According to this aspect, the object data stored in the object date file is reproduced in the reproduction sequence or reproduction procedure defined by the reproduction sequence information (e.g. play list information) stored in the reproduction sequence information file. Then, it is possible to reproduce relatively efficiently the contents exactly as intended by the contents maker.
The above object of the present invention is achieved by an information record apparatus for multi-recording a whole stream including a plurality of partial streams each comprising a series of content information by a unit of a packet that is a physically accessible unit, onto an information record medium, said apparatus comprising: a first record device for recording an object data file, the object data file storing object data comprising a plurality of packets each storing a piece of the content information and being multiplexed by the unit of the packet; and a second record device for recording an object information file, the object information file storing association definition information to define a relationship between multiplexed packets and the plurality of partial streams, as reproduction control information to control a reproduction of said object data file, wherein the plurality of partial streams include a plurality of video streams comprising a plurality of angle video informations corresponding to a plurality of viewpoints, each of the plurality of angle video informations comprises an assembly of minimum image units, which are individually reproducible and defined by a predetermined standard, each of the minimum image units is divided and stored into the packets in said object data file, and in the object data file, a switch unit as a logical section for an angle switching on a reproduction time scale is defined such that the plurality of packets for dividing and storing a same minimum image unit does not extend over a boundary of the switch unit, and such that a minimum image unit reproducible without using another minimum image unit belonging to an anterior switch unit extending over the boundary of the switch unit is arranged as a first minimum image unit of the switch unit.
According to the information record apparatus of the invention, the first record device, such as a controller, encoder, TS object generator (mentioned later), optical pickup or cutting device, records the aforementioned object data file according to the present invention, onto the information record medium, such as a DVD and the like. The second record device, such as a controller, encoder, optical pickup or cutting device, records the aforementioned object information file according to the present invention, onto the information record medium, such as a DVD and the like.
Therefore, the information record medium according to the present invention as mentioned above (including various aspects thereof) can be recorded relatively efficiently.
Incidentally, the information record apparatus according to the present invention may also take various aspects, corresponding to aforementioned various aspects of the information record medium according to the present invention.
The above object of the present invention is achieved by an information record method of multi-recording a whole stream including a plurality of partial streams each comprising a series of content information by a unit of a packet that is a physically accessible unit, onto an information record medium, said method comprising: a first record process of recording an object data file, the object data file storing object data comprising a plurality of packets each storing a piece of the content information being multiplexed by the unit of the packet; and a second record process of recording an object information file, the object information file storing association definition information to define a relationship between multiplexed packets and the plurality of partial streams, as reproduction control information to control a reproduction of said object data file, wherein the plurality of partial streams include a plurality of video streams comprising a plurality of angle video informations corresponding to a plurality of viewpoints, each of the plurality of angle video informations comprises an assembly of minimum image units, which are individually reproducible and defined by a predetermined standard, each of the minimum image units is divided and stored into the packets in said object data file, and in the object data file, a switch unit as a logical section for an angle switching on a reproduction time scale is defined such that the plurality of packets for dividing and storing a same minimum image unit does not extend over a boundary of the switch unit, and such that a minimum image unit reproducible without using another minimum image unit belonging to an anterior switch unit extending over the boundary of the switch unit is arranged as a first minimum image unit of the switch unit.
According to the information record method of the invention, the first record process records the aforementioned object data file according to the present invention and the second record process records the aforementioned object information file according to the present invention, on the information record medium such as a DVD or the like, with the aid of the controller, encoder, TS object generator (mentioned later), optical pickup or cutting device.
Therefore, the information record medium according to the present invention as mentioned above (including various aspects thereof) can be recorded relatively efficiently.
Incidentally, the information record method according to the present invention may also take various aspects, corresponding to aforementioned various aspects of the information record medium according to the present invention.
The above object of the present invention is achieved by an information reproduction apparatus for reproducing the aforementioned information record medium (including various aspects), the apparatus comprising: a reproduction device for reproducing the object data file and the object information file; an input device for inputting externally an instruction for an angle switching; a control device for controlling the reproduction device to reproduce a video stream relating to one angle video information in the object data file, on the basis of the association definition information included in the object information file reproduced by the reproduction device, and to switch from a reproduction of a video stream relating to said one angle video information to a reproduction of a video stream relating to another angle video information, at a boundary of the switch unit, in accordance with the instruction for the angle switching inputted via the input device.
According to the information reproduction apparatus of the invention, the reproduction device, such as a decoder, demultiplexer, optical pickup, can reproduce the object data file and the object information file. The input device, such as a remote controller, a button, key or switch on a control panel, can input the instruction for the angle switching, externally. The control device, such as a controller, controls the reproduction device to reproduce the video stream relating to one angle video information, on the basis of the association definition information. Once the instruction for the angle switching is inputted via the input device during the reproduction, the control device is controlled to switch from the reproduction of the video stream relating to said one angle video information to a reproduction of the video stream relating to another angle video information, in response to this instruction for the angle switching. Particularly, this switching is performed at the boundary of the switch unit.
Therefore, the information record medium according to the present invention as mentioned above (including various aspects thereof) can be reproduced relatively efficiently.
Incidentally, the information reproduction apparatus according to the present invention may also take various aspects, corresponding to the aforementioned various aspects of the information record medium according to the present invention.
The above object of the present invention is achieved by an information reproduction method of reproducing the aforementioned information record medium (including various aspects) and implemented by an information reproduction apparatus having (i) a reproduction device for reproducing the object data file and the object information file and (ii) an input device for inputting externally an instruction for an angle switching, the method comprising: a first control process of controlling the reproduction device to reproduce a video stream relating to one angle video information in the object data file, on the basis of the association definition information included in the object information file reproduced by the reproduction device, and a second control process of controlling the reproduction device to switch from a reproduction of a video stream relating to said one angle video information to a reproduction of a video stream relating to another angle video information, at a boundary of the switch unit, in accordance with the instruction for the angle switching inputted via the input device.
According to the information reproduction method of the invention, the first control process controls, with the aid of a controller or the like for example, the reproduction device, such as the decoder, demultiplexer, optical pickup, to reproduce the video stream relating to one angle video information, on the basis of the association definition. Once the instruction for the angle switching is inputted via the input device, such as the remote controller, the button, key or switch on the control panel, during the reproduction, the second control process, controls the reproduction device to switch from the reproduction of the video stream relating to said one angle video information to a reproduction of the video stream relating to another angle video information, in response to the instruction for the angle switching. Particularly, this switching is performed at the boundary of the switch unit.
Therefore, the information record medium according to the present invention as mentioned above (including various aspects thereof) can be reproduced relatively efficiently.
Incidentally, the information reproduction method according to the present invention may also take various aspects, corresponding to aforementioned various aspects of the information record medium according to the present invention.
The above object of the present invention is achieved by an information record reproduction apparatus for multi-recording and reproducing a whole stream including a plurality of partial streams each comprising a series of content informations by a unit of a packet that is a physically accessible unit, onto an information record medium, the apparatus comprising: the aforementioned information record apparatus and the aforementioned information reproduction apparatus.
According to the information record reproduction apparatus of the invention, since it has both function of the aforementioned information record apparatus and information reproduction apparatus according to the present invention, it can record or reproduce the aforementioned information record medium according to the present invention (including various aspects) relatively efficiently.
Incidentally, the information record reproduction apparatus according to the present invention may also take various aspects, corresponding to aforementioned various aspects of the information record medium according to the present invention.
The above object of the present invention is achieved by an information record reproduction method of multi-recording and reproducing a whole stream including a plurality of partial streams each comprising a series of content informations by the unit of the packet that is a physically accessible unit, onto an information record medium and implemented by an information record reproduction apparatus having (i) a reproduction device for reproducing the object data file and the object information file and (ii) an input device for inputting externally an instruction for an angle switching, the method comprising: the aforementioned information record method according to the present invention and the aforementioned information reproduction method according to the present invention.
According to the information record reproduction method of the invention, since it has both of the information record method of the invention and the information reproduction method of the invention, which are mentioned above, it is possible to record and reproduce the information record medium of the invention (including various aspects), which is mentioned above, relatively efficiently.
Incidentally, the information reproduction method according to the present invention may also take various aspects, corresponding to aforementioned various aspects of the information record medium according to the present invention.
The above object of the present invention is achieved by a computer program for a record control to control a computer disposed at the aforementioned information record apparatus according to the present invention (including various aspects), the program making the computer function as at least a part of the first record device and the second record device.
According to the computer program for the record control of the invention, the aforementioned information record apparatus of the invention may be embodied relatively easily, by reading and running the computer program from a record medium, such as a ROM, a CD-ROM, a DVD-ROM, a hard disk and so on, storing the computer program therein/thereon, or by downloading the computer program to the computer via the communication device and running it.
Incidentally, the computer program for the record control may also take various aspects, corresponding to aforementioned various aspects of the information record medium according to the present invention.
The above object of the present invention is achieved by a computer program for a reproduction control to control a computer disposed at the information reproduction apparatus according to the present invention (including various aspects), the program making the computer function as at least a part of the reproduction device, the input device and the control device.
According to the computer program for the reproduction control of the invention, the aforementioned information record apparatus of the invention may be embodied relatively easily, by reading and running the computer program from a record medium, such as a ROM, a CD-ROM, a DVD-ROM, a hard disk and so on, storing the computer program therein/thereon, or by downloading the computer program to the computer via the communication device and running it.
Incidentally, the computer program for the reproduction control may also take various aspects, corresponding to aforementioned various aspects of the information record medium according to the present invention.
The above object of the present invention is achieved by a computer program for a record reproduction control to control a computer disposed at the information record reproduction apparatus according to the present invention (including various aspects), the program making the computer function as at least a part of the first record device, the second record device, the reproduction device, the input device and the control device.
According to the computer program for the record reproduction control of the invention, the aforementioned information record apparatus of the invention may be embodied relatively easily, by reading and running the computer program from a record medium, such as a ROM, a CD-ROM, a DVD-ROM, a hard disk and so on, storing the computer program therein/thereon, or by downloading the computer program to the computer via the communication device and running it.
Incidentally, the computer program for the record reproduction control may also take various aspects, corresponding to aforementioned various aspects of the information record medium according to the present invention.
The above object of the present invention is achieved by a data structure including a control signal, wherein a whole stream including a plurality of partial streams each comprising a series of content information is multi-recorded by a unit of a packet that is a physically accessible unit, said structure comprising: an object data file for storing object data comprising a plurality of packets each storing a piece of the content information and being multiplexed by the unit of the packet; and an object information file for storing association definition information to define a relationship between multiplexed packets and the plurality of partial streams, as reproduction control information to control a reproduction of said object data file, wherein the plurality of partial streams include a plurality of video streams comprising a plurality of angle video informations corresponding to a plurality of viewpoints, each of the plurality of angle video informations comprises an assembly of minimum image units, which are individually reproducible and defined by on the basis of a predetermined standard and reproducible independently, each of the minimum image units is divided and stored into the packets in said object data file, and in the object data file, a switch unit as a logical section for an angle switching on a reproduction time scale is defined so such that the plurality of packets for dividing and storing the divided minimum image unit pieces obtained by dividing a same minimum image unit does not extend over a boundary of the switch unit, and such that a minimum image unit reproducible without using another minimum image unit belonging to an anterior switch unit extending over the boundary of the switch unit is arranged as a first minimum image unit of the switch unit.
According to the data structure including the control signal of the invention, it is possible to perform the seamless angle switching or the seamless angle reproduction, without using the interleaved unit, similarly to the case of the information record medium of the invention mentioned above.
Incidentally, the data structure including the control signal according to the present invention may also take various aspects, corresponding to aforementioned various aspects of the information record medium according to the present invention.
The above object of the present invention is achieved by a computer program product for a record control in a computer-readable medium for tangibly embodying a program of instructions executable by a computer disposed at the aforementioned information record apparatus according to the present invention (including various aspects), the program making the computer function as at least a part of the first record device and the second record device.
The above object of the present invention is achieved by a computer program product for a reproduction control in a computer-readable medium for tangibly embodying a program of instructions executable by a computer disposed at the information reproduction apparatus according to the present invention (including various aspects), the program making the computer function as at least a part of the reproduction device, the input device and the control device.
The above object of the present invention is achieved by a computer program product for a record reproduction control in a computer-readable medium for tangibly embodying a program of instructions executable by a computer disposed at the information record reproduction apparatus according to the present invention (including various aspects), the program making the computer function as at least a part of the first record device, the second record device, the reproduction device, the input device and the control device.
According to the computer program product for the record control, the reproduction control, or the record reproduction control of the invention, at least a part of the first record device, the second record device, the reproduction device, the input device and the control device according to the present invention mentioned above may be embodied relatively easily, by reading and running the computer program product from a record medium, such as a ROM, a CD-ROM, a DVD-ROM, a hard disk and so on, storing the computer program therein/thereon, or by downloading the computer program product to the computer via the communication device and running it. More specifically, the computer program product may be made of computer readable codes (or computer readable commands) to make the computer function as at least a part of the first record device, the second record device, the reproduction device, the input device and the control device.
These effects and other advantages of the present invention become more apparent from the following embodiments and examples.
(Information Record Medium)
The information record medium of the present invention is discussed, with reference to its embodiments, as well as
Firstly, with reference to
As shown in
Next, with reference to
In
In
In
Incidentally, for convenience of explanation, the video stream, the audio stream and the sub-picture stream are arranged in this order from the top in
The optical disc 100 in the aforementioned embodiment is adapted to multi-record the transport stream (TS) as shown in
Next, with reference to
In the following explanation, the “title” means a reproduction unit, on the basis of which a plurality of “play lists” are executed continuously or sequentially, and which is a logically large grouped unit, such as one movie or one TV program. The “play list set” means a bundle of “play lists”. For example, it may be a bundle of play lists to reproduce a plurality of content information having a special relationship switchable to each other in an angle reproduction or a parental reproduction, or may be a bundle of play lists to reproduce content information relating to a plurality of programs broadcasted in the same time zone and collectively recorded. Alternatively, it may be a bundle of play lists to reproduce various content information, in one title, prepared on the basis of required function, for example on the basis of video performance or audio performance required for the information reproduction system, such as a high vision compatibility, a display resolution, a surround speaker compatibility, a speaker layout and so on. The “play list” is information for storing the information required to reproduce the “object” and consists of a plurality of “items” each storing the information about a reproduction range of the object to access the object. The “object” is the entity information of contents constructing the aforementioned MPEG2 transport stream.
In
The disc information file 110 is a file for storing general information about the entire optical disc 100, and stores the disc general information 112, the title information table 114 and other information 118. The disc general information 112 may store the total numbers of titles or the like in the optical disc 100. The title information table 114 includes a title pointer 114-1 and a plurality of titles 200 (title #1-#m) whose ID (identification) number or record address is indicated by the title pointer. In each title 200, each title type (e.g. sequential reproduction type, branch type and so on), or the play list (P list) number constructing each title is recorded for each title, as the logical information.
More specifically, for example, as shown in
The pointer 200PT as an example of the first pointer information according to the present invention indicates an ID number of the play list set 126S stored in the play list information file 120 corresponding to content information to be reproduced on the basis of the title element 200-2 including the pointer 200PT. Incidentally, the pointer 200PT may be information to indicate a record position of the play list set 126S corresponding to the content information to be reproduced on the basis of the title element 200-2. The pre-command 200PR as an example of the first pre-command according to the present invention indicates a command to be executed before reproducing the content information whose reproduction sequence is defined by one play list set 126S designated by the pointer 200PT. The post command 200PS as an example of the first post command according to the present invention is a command to be executed after reproducing the content information whose reproduction sequence is defined by said one play list set. Other information 200-5 included in the title element 200-2 may include next information to designate a title element for a next reproduction after the present reproduction of the present title element, for example.
Therefore, when the information reproduction apparatus reproduces the information record medium, the desired content information can be reproduced as a title element 200-2, by making access to the play list set 126S in accordance with the pointer 200PT and performing a control to select play list corresponding to the desired program or the like from among a plurality of play lists 126 in the play list set 126S. Furthermore, reproducing such a title element 200-2 solely or sequentially makes it possible to reproduce one title 200. Furthermore, it is possible to execute commands to be executed before reproduction, in the content information whose reproduction sequence is defined by one play list set 126S designated by the pointer 200PT, according to the pre-command 200PR. Furthermore, it is possible to execute commands to be executed after the reproduction, in the content information whose reproduction sequence is defined by one play list set 126S designated by the pointer 200PT, according to the post command 200PS. The post command 200PS may be a command to branch the content information, a command to select a next title and so on. Additionally, it is possible to reproduce a next title element 200-2 to be reproduced after the presently reproduced title element 200-2, according to the “next information” included in other information 200-5.
Again in
As shown in
The pointer 126PT as an example of the second pointer information according to the present invention indicates an item identification number defined by the item definition table 126-3 corresponding to the content information to be reproduced on the basis of the play list element 126-2 including the pointer 126PT. Incidentally, the pointer 126PT may be an item record position defined by the item definition table 126-3.
As shown in
Again in
As shown in
As shown in
As shown in
Again in
The object data file 140 stores a plurality of TS objects 142 for each transport stream (TS #1 object-TS #s object), i.e. entity data of contents to be actually reproduced.
Incidentally, four kinds of file discussed with reference to
As shown in
Next, with reference to
As shown in
As shown in
Furthermore, in
In the case that the transport stream as shown in
In this embodiment, these PAT and PMT are included as the TS packets 146 to be stored in the TS object 142 shown in
Furthermore in this embodiment, these PAT and PMT recorded as such are not referred to when the optical disc 100 is reproduced. Instead, referring to the AU table 131 and the ES map table 134, shown in
Next, with reference to
In
Incidentally, in the case of a simple logical structure, one title element 200-2 consists of one play list set 126S. Furthermore, one play list set 126S consists of one play list 126. On the other hand, it is possible to refer to one play list set 126S by a plurality of title elements 200-2 or a plurality of titles 200.
Each play list 126 is logically made of a plurality of items (play items) 204. In each play list 126, a plurality of items 204 may have the sequential structure or may have the branch structure. On the other hand, it is possible to refer to one item 204 by a plurality of play lists 126. The aforementioned in-point information and out-point information recorded on/in the item 204 logically designates the reproduction range of the TS object 142. Then, the object information 130d of the logically designated reproduction range is referred to and thereby the reproduction range of the TS object 142 is physically designated, via the file system finally. Here, the object information 130d includes various information to reproduce the TS object 142, such as the attribute information of the TS object 142, the ES address information 134d and the like required for the data search in the TS object 142 (Incidentally, the ES map table 134 shown in
Then, when the information record and reproduce apparatus reproduces the TS object 142 as mentioned below, a physical address to be reproduced in the TS object 142 is obtained from the item 204 and the object information 130d so that a desired elementary stream is reproduced.
Incidentally, the EP (Entry Pass) map including a plurality of ES address information 134d, shown within the object information of
Thus, in this embodiment, the in-point information and out-point information recorded on/in the item 204, as well as the ES address information 134d recorded in the ES map table 134 (see
As discussed above, in this embodiment, units of the TS packet 146 are multiplexed and recorded on the optical disc 100. Thereby, the transport stream including a plurality of elementary streams as shown in
(Information Record Reproduction Apparatus)
Next, with reference to
In
The information record reproduction apparatus 500 is provided with: an optical pickup 502; a servo unit 503; a spindle motor 504; a decoder 506; a demultiplexer 508; a video decoder 511; an audio decoder 512; a sub-picture decoder 513; an adder 514; a still picture decoder 515; a system controller 520; a memory 530; a memory 540; a memory 550; a modulator 606; a formatter 608; a TS object generator 610; a video encoder 611; an audio encoder 612; and a sub-picture encoder 613. The system controller 520 includes a file system/logical structure data generator 521 and a file system/logical structure data reader 522. Furthermore, the memory 530 and a user interface 720 to give a user input such as title information are connected to the system controller 520.
Among these constitutional elements, the decoder 506, the demultiplexer 508, the video decoder 511, the audio decoder 512, the sub-picture decoder 513, the adder 514, the still picture decoder 514, the memory 540 and the memory 550 mainly constructs the reproduction system. On the other hand, among these constitutional elements, the modulator 606, the formatter 608, the TS object generator 610, the video encoder 611, the audio encoder 612 and the sub-picture encoder 613 mainly constructs the record system. The optical pickup 502, the servo unit 503, the spindle motor 504, the system controller 520, the memory 530 and the user interface 720 to give the user input such as title information are generally shared for both the reproduction system and the record system. Furthermore, for the record system, a TS object data source 700 (or a PS object data source 700, or a still picture data source 700 such as bit map data, JPEG data and the like); a video data source 711; an audio data source 712; and a sub-picture data source 713 are prepared. Furthermore, the file system/logical structure data generator 521 disposed in the system controller 520 is used mainly in the record system, and the file system/logical structure reader 522 is used mainly in the reproduction system.
The optical pickup 502 irradiates the optical disc 100 with a light beam LB such as a laser beam, at the first power as reading light for the reproduction, and at the second power with the light beam LB being modified as writing light for recording. The servo unit 503 performs the focus servo, the tracking servo and the like for the optical pickup 502, as well as the spindle servo for the spindle motor 504, under control of the control signal Sc1 outputted from the system controller 520, during the reproduction and recording. The spindle motor 504 is controlled under the spindle servo by the servo unit 503, for rotating the optical disc 100 at a predetermined speed.
(i) Structure and Operation of Record System
Next, with reference to
(i-1) In the Case that the Already Generated Object is Used
This case is discussed, with reference to
In
Firstly in
Next, the TS object data source 700 outputs the TS object data D1, under control of the control signal Sc8 to indicate the data reading from the system controller 520. Then, the system controller 520 imports the TS object data D1 from the TS object data source 700 (step S23), and performs the data array analysis (e.g. a record data length and the like) of the TS object data D1, the analysis of each elementary stream structure (e.g. understanding of ES_PID (elementary stream/packet identification number)), on the basis of the PAT, the PMT and the like packetized with the video data as mentioned above, due to the TS analysis feature in the file system/logical structure data generator 521 (step S24).
Next, the system controller 520 makes the file system/logical structure data generator 521 generate the disc information file 110, the play list information file 120, the object information file 130 and the file system 105 (see
Incidentally, variations in which the data about each elementary stream structure information and the TS object data D1 data array may be prepared in advance are naturally understood or suggested, all of which are encompassed within a scope of the embodiment.
In
At step S26 in
The selection output from the formatter 608 is transmitted to the modulator 606 as disc image data D5, and modulated by the modulator 606, and recorded onto the optical disc 100 through the optical pickup 502 (step S27). The system controller 520 also executes the disc record control in this case.
Then, if both the logical information file data D4 generated at the step S25 and the corresponding object data D1 have not been completely recorded yet, the operational flow returns to the step S26 to continue the recording (step S28: No). Incidentally, there is no preference in the record sequence of the logical information file data D4 and the corresponding object data D1.
On the other hand, if the both have been already recorded, it is judged whether or not the recording onto the optical disc 100 is to be ended, on the basis of the presence or absence of an end command (step S29). If it is not to be ended (step S29: No), the operational flow returns to the step S21 to continue the recording. On the other hand, if it is to be ended (step S29: Yes), a series of record processing ends.
As described above, the information record reproduction apparatus 500 performs the record processing in the case of using the already prepared TS object.
Incidentally, the example in
Additionally, a PS object data source or a still picture data source may be used instead of the TS object data source 700. In this case, the recording processing the same as in the case of the TS object data D1 as mentioned above is performed for the PS object data, or the sill picture data such as bit map data, JPEG data and the like, instead of the TS object data D1. Furthermore, instead of the TS object 142, the PS object data or the still picture data is stored in the object data file 140. Then, various logic information about the PS object data or the still picture data is generated under control of the system controller 520, and stored in the disc information file 110, the play list information file 120, the object information file 130 and the like.
(i-2) The Case of Receiving and Recording the Transport Stream on Air
This case is explained with reference to
Again, in this case, the similar processing is performed, as is “the case of using the already prepared object” described above. Therefore, the following explanation is focused on the differences from this case.
In the case of receiving and recording the transport stream on air, the TS object data source 700 is provided with a receiver (set top box) for receiving the digital broadcast on air, for example, receives the TS object data D1, and transmits it to the formatter 608 in real time (step S41). At the same time, reception information D3 (i.e. information corresponding to the data transmitted through the receiver and the interface of the system controller 520) including the program construction information and the below mentioned ES_PID information, which are deciphered upon receiving, is imported into the system controller 520 and is stored into the memory 530 (step S44).
In the meantime, the TS object data D1 outputted to the formatter 608 is outputted to the modulator 606 under the switching-control by the formatter 608 (step S42), and is recorded onto the optical disc 100 (step S43).
Along with these operations, using the program construction information and the ES_PID information included in the reception information D3 imported upon receiving and stored in the memory 530, the file system/logical structure data generator 521 prepares the logical information file data D4 (step S24 and step S25). Then, after the completion of recording a series of the TS object data D1, this logical information file data D4 is additionally recorded onto the optical disc 100 (step S46 and step S47). Incidentally, these steps S24 and S25 may be performed after the step S43.
Moreover, as the occasion demands (e.g. in the case of editing one portion of the title, or the like), by adding the user input 12 of the title information and the like from the user interface 720 to the program construction information and the ES_PID information stored in the memory 530, it is possible to prepare the logical information file data D4 by the system controller 520 and additionally record this onto the optical disc 100.
As described above, the information record reproduction apparatus 500 performs the record processing in the case of receiving the transport stream on air and recording it in real time.
Incidentally, if all the reception data obtained when broadcasting is once stored into an archive apparatus, and then, if this is used as the object source 700, the same processing as that in “the case of using the already prepared object” will do.
(i-3) The Case of Recording the Video Data, the Audio Data and the Sub-Picture Data
This case is explained with reference to
In the case of recording the video data, the audio data, and the sub-picture data, which are individually prepared in advance, the video data source 711, the audio data source 712, and the sub-picture data source 713 are individually provided with the memory storage, such as a video tape and a memory, and store a video data DV, an audio data DA, and a sub-picture data DS, respectively.
These data sources are controlled by the control signal Sc8 giving an instruction for reading out the data from the system controller 520, and they transmit the video data DV, the audio data DA, and the sub-picture data DS, to the video encoder 611, the audio encoder 612, and the sub-picture encoder 613, respectively (step S61). Then, the video encoder 611, the audio encoder 612, and the sub-picture encoder 613 execute a predetermined type of encode processing (step S62).
The TS object generator 610 is controlled by a control signal Sc6 from the system controller 520 and converts the data encoded in this manner to the TS object data constituting the transport stream (step S63). In this case, the data array information of each TS object data (e.g. a record data length and the like) and the construction information of each elementary stream (e.g. the ES_PID, as described later, and the like) are transmitted as information 16 from the TS object generator 610 to the system controller 520 and are stored into the memory 530 (step S66).
On the other hand, the TS object data generated by the TS object generator 610 is transmitted to the {circle around (2)} side of the switch Sw1 of the formatter 608. Namely, when formatting the TS object data from the TS object generator 610, the formatter 608 is switching-controlled by the switch control signal Sc5 from the system controller 520 to shift the switch Sw1 to the {circle around (2)} side and the switch Sw2 to the {circle around (1)} side, thereby outputting the TS object data (step S64). Then, this TS object data is recorded onto the optical disc 100 through the modulator 606 (step S65).
Along with these operations, using the data array information of each TS object data and the construction information of each elementary stream imported as the information 16 into the memory 530, the file system/logical structure data generator 521 prepares the logical information file data D4 (step S24 and step S25). Then, after the completion of recording a series of the TS object data D2, the logical information file data D4 is additionally recorded onto the optical disc 100 (step S67 and step S68). Incidentally, the step S24 and the step S25 may be processed after the step S65.
Moreover, as the occasion demands (e.g. in the case of editing one portion of the title), by adding the user input 12 such as the title information and the like from the user interface 720 to these information stored in the memory 530, it is possible to prepare the logical information file data D4 by the file system/logical structure generator 521 and additionally record this onto the optical disc 100.
As described above, the information record reproduction apparatus 500 performs the record processing in the case of recording the video data, the audio data, and the sub-picture data, which are individually prepared in advance.
Incidentally, this record processing is applicable even when recording an arbitrary content the user has.
(i-4) The Case of Recording the Data by Authoring
This case is explained with reference to
In this case, by combining the above described three types of record processing in the three cases, an authoring system generates the TS object, the logical information file data, and the like in advance (step S81), and then completes the processing until switching-control performed at the formatter 608 (step S82). Then, the information obtained by this operation is transmitted, as the disc image data D5, to the modulator 606 equipped in front of and/or behind an original disc cutting machine (step S83), and this cutting machine prepares the original disc (step S84).
(ii) Structure and Operation in Reproduction System
Next, the specific structure and operation of each constitutional element constituting the reproduction system of the information record reproduction apparatus 500 is explained with reference to
In
Responding to this, the system controller 520 controls the disc reproduction with respect to the optical disc 100, and the optical pickup 502 transmits a reading signal S7 to the demodulator 506.
The demodulator 506 demodulates a recorded signal recorded onto the optical disc 100 from this reading signal S7, and outputs it as demodulated data D8. The logical information file data (i.e. the file system 105, the disc information file 110, the P list information file 120, and the object information file 130, shown in
On the other hand, depending on whether the TS object data is included as the multiplexed information part in the demodulated data D8, or whether the still picture data is included, or whether both data are included, the shift switch Sw3 is shifted to {circle around (1)} side (demultiplexer 508 side) or shifted to {circle around (2)} side (still decoder 515 side), under control of the control signal Sc10 from the system controller 520. Thereby, the TS object data is selectively supplied to the demultiplexer 508, and the still picture data is selectively supplied to the still picture decoder 515.
Then, as for the TS object data included as the multiplexed information part in the demodulated data D8, the demultiplexer 508 demultiplexes the TS object data, under control of the control signal Sc2 from the system controller 520. Here, when the access to the reproduction position address is terminated under the reproduction control by the system controller 520, the control signal Sc2 is transmitted to start the demultiplexing.
The video packet, the audio packet and the sub-picture packet are transmitted respectively from the demultiplexer 508 and supplied respectively to the video decoder 511, the audio decoder 512 and the sub-picture decoder 513. Then, the video data DV, the audio data DA and the sub-picture data DS are decoded, respectively. In this case, the sub-picture data DS is supplied to the adder 514 via the memory 540. The sub-picture data DS is outputted from the memory 540, selectively or at a predetermined timing, under control of the control signal Sc5 from the system controller 520, so as to be super-imposed on the video data DV, if needed. That is, in comparison with a case that the sub-picture data outputted from the sub-picture decoder 513 is directly super-imposed, it is easy to control the timing of the super-imposing, or to judge the need for the super-imposing. For example, under output control of the control signal Sc5, it is possible to select whether or not a caption using the sub-picture is displayed over the main picture, or whether or not a menu screen using the sub-picture is displayed.
Incidentally, although the packets obtained by packetizing the PAT or the PMT, included in the transport stream shown in
The adder 514 is controlled by a control signal Sc3 giving an instruction of the mixing from the system controller 520, and mixes or superimposes in a predetermined timing the video data DV and the sub-picture data DS, which are respectively decoded at the video decoder 511 and the sub-picture decoder 513. The result is outputted as a video output from the information record reproduction apparatus 500 to a TV monitor, for example.
On the other hand, the audio data DA decoded at the audio decoder 512 is outputted as an audio output from the information record reproduction apparatus 500 to an external speaker, for example.
In the case that the still picture data is included in the decoded data D8, the still picture data is supplied to the still picture decoder 515, via the shift switch Sw3 controlled by the control signal Sc10 from the system controller 520, instead of or in addition to such a reproduction operation or processing of the video data DV or the sub-picture data DS. Then, the still picture data such as the decoded bit map data, JPEG data and the like is added to the adder 514 via the shift switch Sw4, without subjected to any processing, under control of the control signal Sc11 from the system controller 520. Alternatively, it may be temporarily stored in the memory 550 via the shift switch Sw4. The still picture data is outputted from the memory 550, selectively or at a predetermined timing, under control of the control signal Sc12 from the system controller 520, and then supplied to the adder 514 via the shift switch Sw5. Thereby, if needed, the video data DV or the sub-picture data DS is super-imposed over the still picture data or vice versa. That is, in comparison with a case that the still picture data outputted from the still picture decoder 515 is directly super-imposed, it is easy to control the timing of the super-imposing, or to judge the need for the super-imposing. For example, under output control of the control signal Sc12, it is possible to select whether or not a still picture such as a menu screen or a window screen using the still picture data or a still picture as a background image using the still picture data is displayed on the main picture of the sub-picture.
Additionally, under control of the control signal Sc13 from the system controller 520, the still picture data may be outputted via another route (not shown), with the aid of the shift switch Sw5 shifted to {circle around (2)} side. Alternatively, no still picture data may be outputted from the shift switch Sw5 shifted to {circle around (2)} side.
Here, the specific example of a reproduction processing routine by the system controller 520 is explained with reference to a flow chart of
In
Firstly, the choice or selection of the title is performed via the user interface 720 (step S211). Responding to this, the system controller 520 obtains the information about the reproduction sequence from a reading result of the file system/logical structure data reader 522. Incidentally, in the selection of the title 200, the desired title element(s) 200-2 (see
Then, contents of a plurality of play lists 126 composing a play list set 126S corresponding to the selected title 200 (title element 200-2) are obtained. Here, as a processing at a logic hierarchy, the information about the each play list 126 structure and each item composing each play list (see
Then, contents of the play list 126 to be reproduced is obtained from among a plurality of play lists 126 obtained at step S212. For example, herein, the reproduction is started from a play list #1, and the contents of the corresponding play list 126 is obtained (step S213). The contents of the play list 126 may be one or more play list elements 126-2 (see
Then, the pre-command 126PR (see
Then, the TS object 142 (see
Incidentally, in this embodiment, also the below mentioned AU (Association Unit) information 132I and PU (Presentation Unit) information 302I are obtained as the information stored in the object information file 130. On the basis of these informations, the aforementioned logic hierarchy is associated with the object hierarchy (see
Then, the reproduction of the TS object 142 determined at step S215 is actually started. That is, on the basis of the processing at the logic hierarchy, the processing at the object hierarchy is started (step S216).
During the reproduction of the TS object 142, it is judged whether or not the next item 204 composing the play list 126 to be reproduced exists (step S217). Then, insofar as the next item 204 exists (step S217: Yes), the process goes back to the step S215 to repeat the aforementioned determination and the reproduction of the TS object 142.
On the other hand, at the judgement at step S217, if it is judged that the next item 204 does not exist (step S217: No), the post command 126PS (see
Then, it is judged whether or not the next play list 126 composing the selected title 200 exists (step S219). If exists (step S219: Yes), the process goes back to the step S213 to repeat the processings following obtaining the play list 126 to be reproduced.
On the other hand, at the judgement at step S219, if it is judged that the next play list 126 does not exist (step S219: No), i.e. if the all play lists 126 to be reproduced corresponding to the title 200 selected at step S211 are completely reproduced, a series of reproduction operations or processings is terminated.
As discussed above, the information record reproduction apparatus 500 in this embodiment reproduces the optical disc 100.
Particularly in this embodiment, in (i) the structure and operation of the record system mentioned above, from the start to the end is recorded logically as one title 200, while a plurality of play list sets 126S including a plurality of play lists 126 are recorded with respect to a plurality of content informations. Furthermore, each TS object in the object data file 120 is recorded by the unit of “switch unit” to perform an angle switching during the reproduction, as mentioned later in detail.
Particularly in this embodiment, in (ii) the structure and operation of the reproduction system, the desired content information can be reproduced as the title, by performing a control to select one or more, from among a plurality of play lists 126 included in each play list set 126S, which corresponds to a desired program or desired angle block. Furthermore, it is possible to perform the angle switching seamlessly at each boundary of the switch unit, in response to an “angle switching instruction”, during the reproduction of the TS object 142 at the step S216. Such an angle switching operation or angle reproduction operation is mentioned later in detail.
(Selection Method of Play List in Play List Set)
In this embodiment, the play list 126 corresponding to the desired content information is appropriately selected from the play list set 126S included in the reproduced play list information file 120.
Such a selection of the play list may be performed on the basis of a selection condition, which is described in a play list selection commands list for each play list 126, provided in the pre-command 200PR (see
(Angle Switching Operation)
Now, with reference to
Firstly, an explanation is made on the switch unit that is a basis for the angle switching operation in this embodiment, with reference to
The video data packetized as the TS object 142 (see
Now, an explanation is made on the outline of the MPEG2 format. Frame images before and after a certain frame image in a series of frame images often have a resemblance and an interrelation to each other. The MPEG2 format notes this point to generate intervening frame images between or among a plurality of frame images transferred discretely so that these intervening frame images are not transferred, through an interpolation based on motion vectors of the original image. In this case, it is sufficient for recording these intervening frame images to record differential information from a plurality of frame images and the motion vector information. For the reproduction, it is possible to reproduce these intervening frame images by predicting them from a plurality of frame images with reference to these differential information and motion vector information. Thereby, a compression recording of images can be achieved.
As shown in
In a seamless angle switching operation using an interleave in the comparative example, as shown in
More specifically, in
In this embodiment, it is noted that the angle switching can be achieved without using the interleave as shown in
In view of the consideration for the aforementioned comparative example, this embodiment performs the seamless angle switching without using the interleave, and has the following data arrangement in the object data file 140.
That is, firstly, a plurality of video streams in this embodiment include a plurality of video stream made of a plurality of angle video information corresponding to a plurality of viewpoints. Each of a plurality of angle video information are made of an assembly of GOPs (see
Particularly in this embodiment as shown in
Particularly herein, a plurality of TS packets 146 for storing the divided GOP 52 are defined not to extend over each boundary between switch units. For example, the TS packets 146 belonging to the same GOP 52 exist in the same switch unit. Furthermore, it is defined so that the GOP 52 reproducible without using any GOP 52 belonging to an anterior switch unit extending over the switch unit boundary is arranged as the first GOP 52 of the corresponding switch unit. For example, the first GOP 52 of the switch unit is started from an I picture. For this, the first GOP 52 of the switch unit can be reproduced without using any of I, P and B pictures belonging to another GOP 52 of the anterior switch unit (see
Due to such a recording, the information record reproduction apparatus 500 does not shift or switch the video stream to be reproduced immediately in response to an angle switching instruction, for performing the angle switching during the reproduction of the optical disc 100, but shifts or switches the video stream after waiting the reproduction is completed until the boundary of the switch unit. Then, for example in
Incidentally, in order to shorten the response time for the switching in the seamless angle reproduction, the length of the aforementioned switch unit is advantageously shortened. For example, it may be preferably within 1.5 seconds in practice. This length may be fixed, or may be variable.
As a result, in this embodiment, the seamless angle switching can be achieved, even without using the interleave. Since the interleave is not used, there is no need for replicating and recording the same object for every ILVU shown in
As mentioned later, in this embodiment, the head address (e.g. a head packet number or a PTS thereof) of each switch unit defining the boundary between switch units may be recorded in the upper logical information, such as the object information file 130, the play list information file 120, the disc information file 110 and so on (see
Next, an explanation is made on a specific example of the object information, the reproduction control information and the like used for performing the angle switching process in this embodiment, with reference to
As shown in
In this specific example, as shown in
Particularly, in the item information #2, the switch unit identification (ID) information 126-3SU and the number of the angles are recorded. The TS object 142 designated by this item information #2 is an object including the switch units. Incidentally, in this specific example, other item information #1, #3 and #4 have no relationship with the video stream compatible with the angle switching.
In this specific example, as shown in
In this specific example as shown in the upper column of
Furthermore, in the AU table 131, the index number of the corresponding ES map table 134 is described as the AU information 132I indicating the ES table index #m in each PU #m corresponding to each AU #n. Here, the “AU” is a unit which may correspond to a “program” of a television broadcasting as mentioned above (particularly a unit including a plurality of switchable “visions” in the case of a “multi-vision type” broadcasting), in which one or more PUs is included as reproduction units. On the other hand, the “PU” is an assembly of elementary streams switchable to each other and included in each AU as mentioned above. The PU information 302I identifies the ES table index # corresponding to each PU. For example, in the case that multi-view contents are composed of the AU, a plurality of PUs are stored in the AU, and the pointer to a plurality of elementary stream packet IDs indicating the packets composing each view contents are stored in each PU.
In the mid column of
In the “ES map table general information”, the ES map table size, a total index number and the like are described.
Each “index #m” includes the elementary stream packet ID for all elementary stream used for the reproduction, and the corresponding index number and the elementary stream address information.
For example, in this embodiment, if the elementary stream is a video stream of MPEG2 as mentioned above, only the head TS packet number of the I picture and the corresponding display time are recorded in the ES map table 134, as this address information, i.e. as the ES address information 134d, so that the data amount is reduced.
Due to this construction, the elementary stream packet ID (ES_PID) of the actual elementary stream can be obtained from the index number of the ES map 134 designated in the AU table 131. Furthermore, since the address information of the elementary stream corresponding to the elementary stream packet ID can be obtained at the same time, so that the object data can be reproduced on the basis of these informations.
Particularly in this embodiment, in the AU information 132I in the AU table 131, the information about the switch units, such as “switch unit identification (ID) information” and “switch unit type”, is recorded as part of the AU attribute information. Furthermore, also in other informations in the AU table 131, the record position of the switch unit address table is recorded. Here, the “switch unit identification information” is information to identify whether or not any switch unit, which allows the angle reproduction, is used in each AU. Furthermore, the “switch unit type” is identification information to indicate whether the switch unit address table 135 (see the lower column of
Particularly in this embodiment, in addition to the above, the ES map table 134 is recorded with using the switch units. That is, with regard to the indexes #5 to #7 corresponding to three video streams compatible with the angle switching, the table number information 134SA5 of the switch unit address table 135 indicating a boundary or section of the corresponding switch unit is recorded.
As shown in the lower column of
Thus, according to the data structure of the optical disc 100 discussed with reference to
Additionally, according to the data structure of the optical disc 100 as mentioned above, even if a new title is added to the optical disc 100, the required information can be added easily. This is very advantageous. On the contrary, even in a case that some information becomes useless, as a result of editing for example, it is advantageous that the information does not need to be deleted actually from the table, insofar as the information is not used (referred to).
Next, an explanation is made on a specific example of the navigation packet or the like used for performing the angle switching operation in this embodiment, with reference to
In this embodiment, the address information of the switch unit may be stored in the navigation packet disposed at the head of each switch unit, instead of or in addition to the switch unit address table 135 shown in
As shown in
Here, the “general information” indicates a switch unit number representative of a serial number (identification number) of a switch unit having the navigation packet disposed at the head thereof; the total number of the addresses of the anterior switch units (e.g. in past on the reproduction time scale) stored in the navigation packet; the total number of the addresses of the posterior switch units (e.g. in future on the reproduction time scale) stored in the navigation packet, and so on.
The “anterior switch unit address information” indicates the head address of the one-anterior switch unit, . . . , the head address of the M-unit-anterior switch unit (M is natural number more than 1 but including 1). On the other hand, the “posterior switch unit address information” indicates the head address of the one-posterior switch unit . . . , the head address of the N-units-posterior switch unit (N is natural number more than 1 but including 1). Here, M and N may be the same, or may be different from each other. Furthermore, their values may be set to relatively large values, insofar as the processing load to read the navigation packet does not become excess. Particularly, increasing the anterior units number (N) is advantageous to perform the angle switching during the reproduction. For example, if this N value is large, the angle switching can be performed easily and quickly at the next-coming switch unit boundary by identifying the boundary near (anterior in particular) the presently reproduced switch unit, when the user inputs an instruction for the angle switching. Furthermore, these M and N may be fixed, or may be variable.
Thus, according to the data structure of the optical disc 100 discussed above with reference to
Now, an explanation is made on the reproduction operation or processing of the object including the angle switching operation or processing in this embodiment, with reference to a flow chart of
Incidentally, in this embodiment, the angle switching is performed at the switch unit boundary, with using at least one of the switch unit address information in the navigation packet discussed with reference to
In
If the switch unit type is the address table (step S223: Yes), the switch unit address table 135 shown in the lower column of
On the other hand, at the judgement of the step S223, it is judged that the to-be-reproduced TS object 142 does not consist of the switch units, or the switch unit type is not the address table (step S223: No), the reproduction of the packet number obtained at the step S222 is directly started (step S225).
Then, it is judged whether or not the reproduced packet is the navigation packet (step S226). This judgement may be performed with reference to the identification information specific to the navigation packet. If the reproduced packet is the navigation packet (step S226: Yes), the information in the navigation packet is obtained (step S227). Particularly in this case, if the switch unit address information shown in
Then, it is judged whether or not the “angle switching” is instructed via the remote controller from the user (step S228). On the other hand, if it is judged at the step S226 that the presently reproduced packet is not the navigation packet (step S226: No), then it is directly judged whether or not the angle switching is instructed (step S228).
If the angle switching is instructed (step S228: Yes), it is judged whether or not the video stream having a switchable stream number is presently reproduced, i.e. whether or not the video stream compatible with the angle switching is presently reproduced (step S229).
Then, if the video stream having the switchable stream number is presently reproduced (step S229: Yes), this video stream is not immediately switched to another video stream, but the video stream number to be reproduced is changed after the next switch unit (SU) (step S230). That is, the angle switching is performed at the next switch unit boundary.
On the other hand, if it is judged from the judgement at the step S229 that the presently reproduced is not the video stream having the switchable stream number (step S229: No), the angle switching is judged as impossible and the process goes back to the step S226 to repeat the following processings.
On the other hand, if the angle switching is not instructed at the judgement of the step S228 (step S228: No), then it is judged whether or not “fast forward/fast rewind” is instructed via the remote controller from the user (step S231).
If the “fast forward/fast rewind” is instructed (step S231: Yes), after the “fast forward/fast rewind” is executed (step S232), the process goes back to the step S225, to repeat the following processings.
On the other hand, if the “fast forward/fast rewind” is not instructed at the step S231 (step S231: No), or if the video stream number is changed at the step S230, it is judged whether or not the reproduction object is completed (step S234).
Then, if the reproduction object is not completed (step S234: No), the process goes back to the step S226 to repeat the following processings On the other hand, if the reproduction object is completed (step S234: Yes), a series of processings is terminated.
As discussed above, in this embodiment, the switch unit address information in the switch unit address table 135 is obtained at the step S224. Alternatively, instead of or in addition to this, the switch unit address information in the step S227 is obtained. Then, with using the switch unit address information obtained as such, the seamless angle switching can be achieved at the switch unit boundary at step S230.
As explained in detail with reference to
(Access Flow on Reproduction)
Next, with reference to
In
Among them, the logic hierarchy 401 is a hierarchy for logically specifying various logical information to reproduce the desired title during the reproduction, as well as the play list (P list) to be reproduced and its constitutional contents. In the logic hierarchy 401, disc information 110d indicating the entire titles 200 and the like on the optical disc 100 is written within the disc information file 110 (see
Next, the logic-object association hierarchy 402 is a hierarchy for specifying the attribute and the physical storage address of the TS object data 140d to be reproduced, so as to specify the combination and/or the construction of the TS object data 140d as the entity data and perform an address conversion to the object hierarchy 403 from the logic hierarchy 401, on the basis of the information specified in the logic hierarchy 401 as described above. More specifically, in the logic-object association hierarchy 402, the object information data 130d, which separates a group of the contents composing each item 204 into units of the AU 132 and which finely separates each AU 132 into units of the PU 302, is written in the object information file 130 (see
Here, the “PU (Presentation Unit) 302” is a unit associating and uniting a plurality of elementary streams by the reproduction switchable unit. If there are three audio streams in the PU 302, the user can freely switch these three audio (e.g. audio for each language), during the reproduction of this vision.
On the other hand, the “AU (Associate Unit) 132” is a unit uniting a plurality of elementary streams such as video streams in the TS object used in one title, and made of one or more PUs 302. More specifically, it is a unit uniting the elementary stream packet IDs (ES_PID) for each TS object, indirectly via the PU 302. This AU 132 corresponds to an assembly made of a plurality of programs having a specific inter-relationship in view of the contents, such as a plurality of programs switchable to each other in the multi-source broadcasting. The PUs 302 belonged to the same AU 132 corresponds to one or more elementary stream assemblies each constructing a plurality of programs switchable to each other by the user operation during the reproduction.
Therefore, if the AU 132 to be reproduced is identified, and the PUs belonged to the AU are identified, the elementary stream to be reproduced is identified. That is, a desired elementary stream can be reproduced from the multi-recorded optical disc 100, without using the PAT or the PMT shown in
Incidentally, a further specific data structure of the AU information 132I and the PU information 3021, each defining the AU 132 and the PU 302, is discussed later in detail.
The elementary stream to be actually reproduced herein is identified or designated by the ES_PID that is a packet ID (see
Thus, in the logic-object association hierarchy 402, an address conversion is performed from a logical address relating to each item 204 to a physical address relating to each PU 302.
Next, the object hierarchy 403 is a physical hierarchy to reproduce the actual TS object data 140d. In the object hierarchy 403, the TS object data 140d is written within the object data file 140 (see
Thus, in the object hierarchy 403, the object data is actually reproduced, using the physical address obtained from the conversion in the logic-object association hierarchy 402.
As described above, the three hierarchies shown in
(Structure of Each Information File)
Now, an explanation is made on a specific example of a data structure of various information files constructed on the optical disc 100 in this embodiment, i.e. the data structure of the play list information file 120 and the disc information file 110 discussed with reference to
With reference to
Firstly, as shown in
The title information set is provided with: one disc header 112x; a plurality of title information 200 (title information #1, #n); a plurality of play list (P list) sets 126S (P list sets #1, . . . , #n); and other information.
(1) Disc Header:
Firstly, from among the title information set shown in
In
As described above, the disc header 112x having the plurality of fields and tables is to collectively manage a plurality of titles of the entire recording area on the disc.
Here, the “version number” is a version number in the standard, and according to ISO 646, it is regarded as a code “0070”, for example. The “title total number” is the total number of the titles of the entire recording area on the disc, and the “title information total number” is the total number of the title information of the entire recording area on the disc. The “play list set total number” is the total number of the play list sets of the entire recording area on the disc, and the “title start address table” indicates the start address of each title, as a relative byte number from the head of the title set. This byte number is counted from zero, for example. The “play list set start address table” indicates the start address of each play list set, as a relative byte number from the head of the title set. This byte number is counted from zero, for example. The “title set attribute” indicates the attribute of the title set, such as the data length of the title set, the type of language used in the title set (Japanese, English, etc.), and the name of the title set.
In
Here, the “title menu start address” indicates the start address of the title information including each title menu, as a relative byte number from the head of the title set. This byte number is counted from zero, for example. The title menu start address “0” is assigned to the disc menu about the entire disc. The “title contents start address” indicates the start address of the title information including each contents title, as a relative byte number from the head of the title set. Here, the “contents title” is a title for indicating the contents of each title. This byte number is counted from zero, for example. The title contents start address “0” is assigned to a first play title which is unconditionally reproduced at the initial stage of the title reproduction, for example.
In
Here, the “play list set start address” indicates the start address of each play list set, as a relative byte number from the head of the title set. This byte number is counted from zero, for example.
(2) Title Information:
Next, from among the title information set shown in
In
Here, the “title element total number” indicates the total number of the title elements included in the title information.
In
Here, the “pointer 200PT in which the play list set number is written” is a pointer for indicating the identification (ID) number of the play list set. The “candidate total number” indicates the total number of the play list which can be a selection candidate of the title element in the play list set specified by the pointer 200PT. The “P list identification information 200PN” indicates the ID (identification) number of one or more play lists which can be the selection candidate. By providing such P list identification information 200PN, it is possible to include the play list which can be the selection candidate for the reproduction of different titles, in one play list set, and it is possible to share the one play list set with different title elements. On the other hand, the “P list pre-command 200PR”, the “P list post command 200PS”, and the “next information 200-6N”, and the like are the same as described above.
(3) Play List Set:
Next, from among the title information set shown in
In
Here, the “play list total number” indicates the total number of the play lists in the play list set. The PL presentations #1, . . . , #i are attribute information corresponding to the P lists #1, . . . , #i, respectively, and correspond to the attribute information shown in
As shown in
Here, the “video codec” is used in recording the video information associated with the play list set, and thus indicates the type of the video codec to be used in reproducing it. The “video resolution” indicates video resolution used in recording the video information associated with the play list corresponding to the main pass (i.e. the video stream for providing the video) from among the play list set. The “video aspect ratio” indicates a video aspect ratio used in recording the video information associated with the play list corresponding to the main pass from among the play list set. The “video frame rate” indicates a video frame rate used in recording the video information associated with the play list corresponding to the main pass from among the play list set. The “audio channel assignment” indicates the assignment of an audio channel used in recording the audio information associated with the play list corresponding to the main pass from among the play list set.
In
Here, the “length” of the play list indicates the length of the play list continuing to the next, with the byte number. This indicates the length of the data which does not include the field itself. The “play list header” indicates information about the total number of the play list elements included in the play list, the reproduction time length of the play list, the name of the play list, and the like.
Moreover, in
Here, the “pointer 126PT”, the “pre-command 126PR”, and the “post command 126PS” are the same as described above. Moreover, the “sub pass total number” indicates the total number of the sub passes which exist in the play list element. The “next information 126-6N” indicates the play list element to be reproduced next.
Moreover, in
Here, the “sub pass type” indicates what type of display is performed by the sub pass, such as various menu display. The “slave P item total number” indicates the total number of slave play items of the sub pass.
Each slave play item (slave P item) information 126-subPT is shown in a form branched toward the right end from the center in the figure, and has a plurality of fields for recording a slave play item (slave P item) number and a start PTS of the master play item (master P item), in order from the top in the figure.
Here, the “slave P item number” indicates the ID (identification) number of the play item of the sub pass. The “start PTS (Presentation Time Stamp) of the master play item” indicates the reproduction time point of the slave item on the reproduction time scale of the master play item.
On the other hand, in
Here, the “play item total number” indicates the total number of the items 204 on the item definition table.
In
Here, the “play item (P item) type” indicates the type of the play item. For example, in the case of the item for the stream object for the moving picture or video, it is set to a code “00h”, and in the case of the item for the stream object for the still picture, it is set to a code “10h”. In the case of the item for the object for various menus, it is set to a code “20h”.
Moreover, the stream object play item (P item) 204-stream is shown in a form branched to the right end from the center in the figure, and has information for indicating an ES (Elementary Stream) index number, an IN time (IN point), an OUT time (OUT point), and the like, which are related to each play item, in order from the top in the figure.
Here, the “ES index number” indicates the ID (identification) number and the type of the elementary stream to which the IN time and the OUT time are applied. Moreover, the “IN time (IN point)” and the “OUT time (OUT point)” are as descried above, and the reproduction time point and the end time point of the item are written on a time basis of 90 kHz, for example.
Incidentally, in
Incidentally, the data amount of each of the title information set explained above may be a fixed byte or a variable byte. Moreover, each field may have a structure in which a required number of each table can be added.
Now, an explanation is given, regarding the reproduction order of various files or the like, in the reproduction of the optical disc 100 having such a data structure as the one specific example, explained with reference to
Firstly, the disc header 112x is reproduced out of the title information set shown in
Next, in accordance with the obtained address information, the reproduction of the title information 200 shown in
Next, the play list set table 112xpt shown in
Then, the PL presentation 126-1xi, one example of the required function information, is compared with the reproduction function (i.e. video performance, audio performance, and the like) of the information reproduction system during the reproduction of the optical disc 100, and thus, one optimum play list 126 is selected from the play list set 126S shown in
Next, the selected play list 126 is reproduced. More specifically, the play list element 126-2 shown in
As explained in detail with reference to
Incidentally, in the aforementioned embodiment, the explanation is made on the optical disc 100 as an example of the information record medium and the recorder or player of the optical disc 100 as an example of the information record reproduction apparatus. Nevertheless, the present invention is not limited to the optical disc and the player or recorder thereof, but is applicable to various record media and the recorders or players thereof, supporting other high density recording or high transfer rate.
The present invention is not limited to the above-described embodiments, and various changes may be made, if desired, without departing from the essence or spirit of the invention which can be read from the claims and the entire specification. An information record medium, an apparatus for and a method of recording the information, an apparatus for and a method of reproducing the information, an apparatus for and a method of recording and reproducing the information, a computer program for controlling the record or the reproduction, and a data structure including a control signal, all of which involves such changes, are also intended to be within the technical scope of the present invention.
An information record medium, a apparatus for and a method of recording the information, an apparatus for and a method of reproducing the information, an apparatus for and a method of recording and reproducing the information, a computer program for controlling the record or the reproduction, and a data structure including a control signal, all of which are according to the present invention, can be applied to a high-density optical disc for consumer or industrial use, such as a DVD, on which various information, such as the video information, the audio information and the sub-picture information, can be recorded at high density and further can be applied to a DVD player, a DVD recorder, and the like. Moreover, they can be applied to an information record medium, an information record reproduction apparatus, or the like, which are mounted on or can be connected to various computer equipment for consumer or industrial use, for example.
Number | Date | Country | Kind |
---|---|---|---|
2002-288266 | Oct 2002 | JP | national |
Filing Document | Filing Date | Country | Kind | 371c Date |
---|---|---|---|---|
PCT/JP03/12581 | 10/1/2003 | WO | 11/8/2005 |