Next, an embodiment of the present invention will be described in the following order.
For easy understanding of the present invention, a system according to an embodiment of the present invention will be described. According to the embodiment of the present invention, a player model is described with a script language called an ECMA script. The ECMA script is a script language for a cross platform based on JavaScript (registered trademark) and standardized by European Computer Manufacturers Association (ECMA). The ECMA script has higher compatibility with HTML documents. In addition, since the ECMA script allows original objects to be defined, the ECMA script can be suitably used for a player model according to the present invention.
In the following description, the standard that uses a script language based on the ECMA script and that accords to the embodiment of the present invention is referred to as UMD (Universal Media Disc: registered trademark) video standard. A script part of the UMD video standard is referred to as the UMD video script standard.
Next, the UMD video standard will be described in brief.
According to the UMD video standard, digitally encoded video data, audio data, and subtitle data are treated as an MPEG2 stream of which they have been multiplexed as an elementary stream according to the MPEG2 (Moving Picture Experts Group 2) system. An MPEG2 stream of which elementary streams of video data, audio data, and subtitle data have been multiplexed is referred to as a clip AV stream. A clip AV stream is stored in a clip AV stream file. When a clip AV stream file is recorded, a clip information file is created according to the clip AV file in the relation of 1 to 1. A pair of a clip information file and a clip AV stream file corresponding thereto is referred to as a clip.
A clip is a recording unit of a disc. The reproduction order of clips is managed in the play list layer higher than the clip layer. The play list layer is a layer that designates the reproduction path of clips. The play list layer contains one or a plurality of play lists. A play list is composed of a set of play items. A play item contains a pair of an IN point and an OUT point that represent the reproduction range of a clip. When play items are placed, clips can be reproduced in any order. A play item can redundantly designate clips. The IN point and the OUT point of a clip AV stream are designated with time stamps (intra-clip times). Time stamps are converted into byte positions of a clip AV stream file according to information of a clip information file.
A play list has a structure that reproduces play items that represent all or part of clips in a predetermined order. Only with a play list, the reproduction order of clips cannot be changed. In addition, a play list does not provide the user with an interactive function. According to the embodiment of the present invention, a plurality of play lists are collectively stored in one file “PLAYLIST.DAT.” The script layer is a layer composed of UMD video scripts as an extension of ECMA scripts as language specifications. An UMD video script is a script of which an ECMA script is extended to accomplish a special function based on the UMD video standard.
The script layer is an upper layer of the play list layer. The script layer is composed of a sequence of commands that designate the reproduction of a play list and that set a player. Commands in the script layer accomplish play list reproduction including a conditional branch so that one of streams according to a plurality of languages can be selected or streams can be reproduced according to a play list selected in a predetermined condition. An example of an application that uses play list reproduction including a conditional branch is a multi-story content. The script layer provides the user with an interactive function.
According to the embodiment of the present invention, the script layer is composed of one file “SCRIPT.DAT.” File “SCRIPT.DAT” is managed as a resource. File “SCRIPT.DAT” contains script data described according to a real ECMA script, sound data for sound effects and so forth in button operations, a screen design composed of image data used for a background image and so forth of a menu screen, and image data (bit map data) for GUI parts such as button images.
Next, a model of a reproducing apparatus (player) that reproduces data according to the UMD video standard, namely a player model, will be described. The player reads a script program, a play list, and a clip information file from a disc. Thereafter, the player reads a clip AV stream file in the reproduction order according to those files and reproduces video data, audio data, subtitle data, and so forth.
In the language specifications of the script program a functional block that reproduces a play list is implemented as an object in the script program. According to the UMD video standard, the object that reproduces the play list is referred to as the movie player object. Commands that designate the reproduction of the play list and set the player are methods of the movie player object. The movie player object is controlled by the methods of the script layer. At this point, the movie player object requires a function that informs the script layer of a state change, a reproduction position, and so forth. This function corresponds to an operation that the movie player object issues an event to the script program. A process corresponding to the event is described as an event handler.
When a model of which the movie player object transfers information as an event to the script program and the script program controls the movie player object with a method is made, the script program can control the reproduction of a clip AV stream.
Since it is thought that the movie player 300 and the movie player object are substantially the same, in the following description, they are denoted by the same reference numeral.
In
The inside of the movie player object 300 depends on the implementation of the UMD video player that reproduces data from the UMD video disc. The script layer 302 provides APIs (Application Programming Interfaces) that are methods and properties as black-box objects. In this case, the UMD video player represents a real device that implements a movie player. All UMD video players implement a movie player according to the UMD video standard and have reproduction compatibility with other UMD video players.
As shown in
The control command 311 is a command that is received from the native implementation platform 301 and that controls the operation of the movie player object 300. The native implementation platform 301 is an interface between an original portion of the UMD video player as a real device and the movie player 300.
The event 312 is a script event sent from the movie player 300 to the script layer 302. The method 313 is a method that a script program of the script layer 302 designates to the movie player 300.
The movie player object 300 has a database 320 for play lists and clip information according to the UMD video standard. The movie player object 300 masks the user's input 310. In addition, the movie player object 300 performs for example a process that converts the reproduction position designated by a time into a byte position of a clip AV stream with the database 320.
A playback module 321 of the movie player object 300 decodes a clip AV stream, which is an MPEG2 PS (Program Stream) of which video data, audio data, and subtitle data have been multiplexed. The playback module 321 has three states that are play, stop, and pause. The playback module 321 changes among these states with a control command and a method (see
The script layer 302 is a layer that executes a script program according to the UMD video script standard, controls the movie player object 300, and displays data on the display. The script layer 302 accomplishes a scenario that the content creator side intends. The script layer 302 issues the method 313 to the movie player object 300. The script layer 302 receives the event 312 from the movie player object 300. The script layer 302 exchanges a key event 314 according to the user's input 310 and a method 315 that causes the native implementation platform 301 to display data on the display with the native implementation platform 301.
For example, buttons on the menu screen are generated by the native implementation platform 301 according to the method 315 supplied from the script program of the script layer 302 to the native implementation platform 301. When the user performs an operation such as selection or decision for one of the buttons, the key event 314 according to the user's input 310 is sent from the native implementation platform 301 to the script layer 302. The script program of the script layer 302 performs a process with the key event 314 according to the user's input 310.
Thus, the movie player 300 performs decode and display controls for video data, audio data, and subtitle data. On the other hand, the script layer 302 performs arrange and display processes for part images that compose graphical user interfaces such as buttons (hereinafter, these part images are referred to as GUI parts) and processes against selection and decision operations of the GUI parts.
The native implementation platform 301 is a platform for operations of the movie player object 300 and the script program. When the real UMD video player is hardware, the native implementation platform 301 is implemented as hardware so that the native implementation platform 301 intermediates a process between hardware and the player model.
The native implementation platform 301 receives the user's input 310 from the user and determines whether the received user's input 310 is a command for the movie player 300 or a command for a button generated and displayed in the script layer 302. When the determined result represents that the user's input 310 is a command for the movie player 300, the native implementation platform 301 converts the user's input 310 into the control command 311 that is an internal control command for the movie player 300 and issues a control command to the movie player 300.
When the determined result represents that the user's input 310 is a command of a GUI part generated and displayed in the script layer 302, the native implementation platform 301 informs the script layer 302 of the key event 314 according to the user's input 310. For example, the native implementation platform 301 can display for example a button image on the display according to the method 315 that the script layer 302 designates according to the key event 314. In other words, the native implementation platform 301 and the script layer 302 can directly exchange an event and a method not through the movie player 300.
Next, the movie player 300 will be described in details.
The playback module 321 is composed of a decoder engine 322 and a property 323. The property 323 is a value that represents the state of the playback module 321. The property 323 has two types of a property 323A (read-only parameter) whose value depends on the initial setting of the movie player 300 like a language code and a property 323B (player status) whose value depends on the state of the playback module 321.
The value of the property 323A, whose value depends on the initial setting, is set by a native device for example a real device. Thus, the value of the property 323A is not changed by a play list, clip information, and a script program. The value of the property 323A can be read from a script program. In contrast, the value of the property 323B, which represents the state of the playback module 321, can be read from a script program. In addition, the value of the property 323B can be written from some script programs.
In this operation model, it is assumed that a play list and clip information are pre-loaded from the disc before a clip AV stream is reproduced. Instead, the operations of the movie player model may be accomplished in another implementation.
The movie player object 300 reproduces a play list designated by the script layer 302 or the native implementation platform 301. For example, the movie player 300 references the database 320 and obtains the reproduction position of the clip AV stream as the byte position of the file according to the designated play list. In the playback module 321, the decoder engine 322 controls the decoding of the clip AV stream according to the information of the reproduction position.
As shown in
The state of the movie player 300 depends on the state change among play, pause, and stop of the decoder engine 322 of the movie player 300. The value of the property 323B is updated according to the state change of the decoder engine 322.
Resume information 324 stores the state that exits immediately before the stop state occurs. After the movie player 300 decodes a play list, when the movie player 300 is in the play state, if the state of the movie player 300 is changed to the stop state, the resume information 324 stores the state that exists immediately before the stop state occurs. In addition, the resume information 324 for each title of the disc can be stored in a nonvolatile memory of the player as hardware. The disc has unique identification information (referred to as title ID) for each title of the disc. The resume information 324 and the identification information are correlatively stored. Thus, when the state of the disc having the title according to the identification information is changed from the stop state to the play state, data can be reproduced from the position at which the stop state occurred.
Next, an event model of the movie player 300 will be described. In the play state, the movie player 300 reproduces a play list and generates various events. The events execute process programs described as scripts and referred to as event handlers. The event handlers are methods called upon occurrence of events. A program execution model that starts executing a process program upon occurrence of an event is referred to as an event driven model. In an event driven model, an irregular event occurs. When the event occurs, a predetermined program is executed. According to the embodiment of the present invention, a script program controls the operations of the movie player object 300 with an event handler group.
Since the system side selects an event handler called upon occurrence of an event, the content creator side does not need to describe a process that determines what event occurred in a script program.
In such a manner, while the player is operating, various events occur. When an upper level program is informed of an occurrence of an event, the upper level program can grasp the state of the player.
When the upper level program provides programs (event handlers) that are executed according to events of which it is informed, it can handle various events. Events and event handlers will be described later.
When the content creator side has not described an event handler, the upper program executes an operation (default event handler) built in the player and that is defined in the standard or ignores the event. When no process is required, if an event handler according to the event is not described, the event can be actively ignored.
As event models, there may be an event listener model, a single-method model, and so forth. In an event listener model, an object registers a listener according to a predetermined event to the player object. When an event that occurs in the player object is an event that has been registered, the player object transmits the event to the object that has registered the event. The object executes a corresponding method. In a single-method model, one method is called whatever event occurs.
The event model according to the embodiment of the present invention is simpler than an event listener model that requires processes such as event registration process and event deletion process. The single-method model needs to know what event occurred and describe in the method a pre-process that changes a process routine according to each event that occurs. Since the method is implemented by the content creator side, even if the model is simple, the load of the content creator side increases. In addition, whenever an event occurs, since one large process program (method) is called, a large memory area will be used and the execution speed will become slow. Thus, since the model according to the embodiment of the present invention provides process programs (event handlers) according to individual events, the model is superior to the other models in these points.
Next, the external specifications of the movie player object 300 will be described. Generally, an object defined according to the ECMA script language specifications has a property and a method. Like this object, as shown in
When a disc is loaded into the movie player 300, a scrip file that is read from the disc is decided according to the language code represented by property languagecode that is set in the read-only parameter 323A. When the disc loaded into the movie player 300 does not have a script file according to the language, a default script file is read from the disc. For example, a file recorded at the beginning of a plurality of script files is read as a default script file.
Properties that belong to the player status 323B shown in
The dual monaural is a mode of which left and right (L, R) channels of stereo audio are independently used as monaural audio channels.
When the movie player 300 is in the play state or the pause state, each property that belongs to the player status 323B represents these information. When the movie player 300 is changed to the stop state, each property that belongs to the player status 323B is backed up as the resume information 324. At this point, the contents of the player status 323B may be cleared.
According to the UMD video standard, video data can be displayed at a part of the display screen. The following four methods are methods that display video data at a part of the display screen. Method setposo sets the display position of video data. Method getPos( ) obtains the display position of video data. Method setsize( ) sets the display size of video data. Method getsize( ) obtains the display size of video data.
In reality, the movie player 300 and the native implementation platform 301 are integrated. In other words, the movie player 300 UMD and the native implementation platform 301 are correlated as hardware, a UMD player that loads a disc and reproduces video data from the disc, and software that controls the UMD player. What portion is hardware and what portion is software depend on the implemented structure. For example, when the UMD player is a personal computer or the like, the other portions except for the disc dive are composed of software. When a single UMD player is used, besides the disc drive, for example the video decoder, the audio decoder, and so forth may be composed of hardware. Thus, methods, commands, and events exchanged between the movie player 300 and the native implementation platform 301 are not limited to those explicitly shown in
On the other hand, with respect to key inputs of the user, as shown in
Key VK_PLAY provides a function corresponding to a play key that starts the reproduction operation. Key VK_STOP provides a function corresponding to a stop key that stops the reproduction operation. Key VK_PAUSE provides a function corresponding to a pause key that pauses the reproduction operation. Key VK_FAST_FORWARD provides a function corresponding to a fast forward key that performs the fast forward reproduction operation. Key VK_FAST_REVERSE provides a function corresponding to a fast reverse key that performs the fast reverse reproduction operation. Key VK_SLOW_FORWARD provides a function corresponding to a slow (forward) key that performs the forward slow reproduction operation. Key VK_SLOW_REVERSE provides a function corresponding to a slow (reverse) key that performs the reverse slow reproduction operation. Key VK_STEP_FORWARD provides a function corresponding to a step (forward) key that performs the forward step reproduction operation. Key VK_STEP_REVERSE provides a function corresponding to a frame (reverse) key that performs the reverse step reproduction operation.
Key VK_UP provides a function corresponding to an up direction designation key that inputs a value that represents “up.” Key VK_DOWN provides a function corresponding to a down direction designation key that inputs a value that represents “down.” Key VK_RIGHT provides a function corresponding to a right direction designation key that input a value that represents “right.” Key VK_LEFT provides a function corresponding to a left direction designation key that inputs a value that represents “left.” Key VK_UP_RIGHT provides a function corresponding to an upper right direction designation key that inputs a value that represents “upper right.” Key VK_UP_LEFT provides a function corresponding to an upper left direction designation key that inputs a value that represents “upper left.” Key VK_DOWN_RIGHT provides a function corresponding to a down right direction designation key that inputs a value that represents “down right.” Key VK_DOWN_LEFT provides a function corresponding to a down left direction designation key that inputs a value that represents “down left.” With these direction keys, the user can designate for example the movement of the cursor on the display.
Key VK_ANGLE provides a function corresponding to an angle change key that designates an angle change operation for multi-angle video data. Key VK_SUBTITLE provides a function corresponding to a subtitle change key that designates English subtitle, Japanese subtitle, and subtitle ON/OFF. Key VK_AUDIO provides a function corresponding to an audio change key that designates an audio mode such as surround mode or bilingual mode. Key VK_VIDEO_ASPECT provides a function corresponding to an aspect change key that changes an aspect ratio of video data. Key VK_COLORED_KEY—1 provides a function corresponding to a colored function key 1. Key VK_COLORED_KEY—2 provides a function corresponding to a colored function key 2. Key VK_COLORED_KEY—3 provides a function corresponding to a colored function key 3. Key VK_COLORED_KEY—4 provides a function corresponding to a colored function key 4. Key VK_COLORED_KEY—5 provides a function corresponding to a colored function key 5. Key VK_COLORED_KEY—6 provides a function corresponding to a colored function key 6.
Since the functions of the key inputs shown in
On the other hand, since the key inputs shown in
Next, commands shown in
Command uo_playChapter(chapterNumber) starts reproducing the play list being reproduced from a chapter designated by argument chapterNumber. Without the chapter number designated, this command starts reproducing the play list from the beginning of the chapter being reproduced. This command corresponds to method playchapter( ) without the chapter number designated. Command uo_playPrevChapter( ) starts reproducing the play list from the immediately previous chapter. Command uo_playNextChapter( ) starts reproducing the play list from the immediately next chapter. Command uo_stop( ) stops reproducing the play list.
Command uo_jumpToEnd( ) jumps to the end of the play list. This command corresponds to a user's operation that causes the movie player 300 to stop the reproduction and generate event playListEnd. According to this command, the script layer 302 executes event handler on PlayListEnd. Command uo_forwardScan(speed) forward reproduces the play list at a reproduction speed designated by argument speed. Command uo_backwardScan(speed) backward reproduces the play list at a reproduction speed designated by argument speed. Argument speed of these commands uo_forwardScan(speed) and uo_backwardScan(speed) depends on the implementation of the UMD video player.
Command uo_playStep(forward) forward reproduces the play list step by step. Command uo_playStep(backward) backward reproduces the play list step by step. Command uo_pauseono pauses the reproduction of the play list according to a user's operation. Command uo_pauseOff( ) cancels the pause state of the reproduction of the play list according to a user's operation.
Command uo_changeAudioChannel(value) changes the channel of audio data or one channel of dual monaural reproduction. When this command is executed, the value of flag audioFlag needs to be accordingly changed. Command uo_setAudioEnabled(Boolean) turns ON/OFF the audio stream. When this command is executed, the value of flag audioFlag needs to be accordingly changed. Command uo_setSubtitleEnabled(Boolean) turns ON/OFF the subtitle stream. When this command is executed, the value of flag subtitleFlag needs to be accordingly changed. Command uo_angleChange( )changes the display angle. When the movie player 300 is informed of the user's operation for this command, the movie player 300 informs the script layer 302 of event angleChange. Command uo_audiochange(audioStreamNumber) changes the audio stream to be reproduced. Command uo_subtitleChange(subtitleStreamNumber) changes the subtitle stream to be reproduced.
Next, the relationship between events shown in
Event up, event down, event left, event right, event focusin, event focusOut, event push, and event cancel are events that occur when button images as GUI parts on the screen are focused. The native implementation platform 301 informs the script layer 302 rather than the movie player 300 of these events. When a button image is focused, for example the cursor displayed on the screen represents the coordinates of the button image so that the button image can be selected. Event up, event down, event left, and event right occur when an up button image, a down button image, a left button image, and a right button image are focused, respectively. Event focusin occurs when any button image is focused. Event focusOut occurs when any focused button image is defocused. Event push occurs when a press operation is performed for any focused button image. Event cancel occurs when a cancel operation is performed against the press operation for any button image.
Event autoPlay and event continuPlay are events that cause the script layer 302 to start executing a script. Event autoplay is an event that causes a script to automatically start executing when a disc is loaded. Event continuePlay causes a script to resume executing from the position that the script was stopped according to for example the resume information 324 when a disc is loaded.
There are programs that are executed when events shown in
Event mark and event handler onMark( ) are executed when an event mark is detected. An event mark is embedded in for example a play list. While the movie player 300 is reproducing the play list, the movie player 300 detects a play list from the play list. When the movie player 300 detects an event mark, the movie player 300 informs the script layer 302 of event mark. The script layer 302 executes event handler onMark( ) corresponding to event mark. Likewise, event playListEnd and event handler on PlayListEnd( ) are executed when the reproduction of a play list is completed. Event chapter and event handler onchapter( ) are executed when a chapter mark is detected. A chapter mark is embedded in for example a play list and detected by the movie player 300 while it is reproducing the play list.
Event anglechange and event handler on AngleChange( ) are executed when the angle change is designated by a user's operation. For example, when key input VK_ANGLE is input to the native implementation platform 301 by the user's operation as the user's input 310, the native implementation platform 301 converts the user's input 310 into command uo_angleChange( ) and supplies it to the movie player 300. The movie player 300 generates event anglechange corresponding to command uo_angleChange and supplies event anglechange to the script layer 302. The script layer 302 executes event handler on AngleChange( ) corresponding to event anglechange. Likewise, event audiochange and event handler on AudioChange( ) are executed when the audio change is designated by a user's operation. Event subtitlechange and event handler on SubtileChange( ) are executed when the subtitle change is designated by a user's operation.
Event menu and event handler on Menu( ) jump to a menu. Event menu is an event of which the native implementation platform 301 informs the script layer 302 when the menu key is pressed by a user's operation. The script layer 302 receives the event, executes the corresponding event handler on Menu( ), and arranges and displays GUI parts that compose a menu screen with event handler on Menu( ). Event exit and event handler onExit( ) are an event and a corresponding event handler that the native implementation platform 301 generates when it completes the UMD video application.
When a user' operation or the like designates the completion of the operation of the UMD video player, the native implementation platform 301 informs the script layer 302 of event exit. When the script layer 302 receives event exit, the script performs an exit process with event handler onExit( ). Event autoPlay, event handler on AutoPlay( ), event continuePlay, and event handler on ContinuePlay( ) start executing corresponding scripts.
Besides event handlers for the system object, there are event handlers for buttons. However, event handlers for buttons do not closely relate to the present invention, their description will be omitted.
Next, with reference to a flow chart shown in
While the UMD video player is normally reproducing data from the disc, when the user presses the key “next” on the remote control commander of the UMD video player (at step S10), key VK_NEXT is supplied as the user's input 310 to the native implementation platform 301. The native implementation platform 301 generates user command uo_playNextChapter( ) corresponding to the user's input 310 (at step S11). The native implementation platform 301 informs the movie player 300 of user command uo_playNextChapter( ).
When the movie player 300 receives command uo_playNextChapter( ), the movie player 300 searches the database 320 for the position of the next chapter mark based on the current reproduction position corresponding to play list information (at step S12). At step S13, it is determined whether the next chapter mark exists. When the determined result represents that the next chapter mark does not exist, the movie player 300 does not perform the chapter jump operation, but continues the current reproduction operation.
In contrast, when the determined result at step S13 represents that the next chapter mark exists, the flow advances to step S14. At step S14, the movie player 300 stops the current reproduction operation and obtains the byte position of the next chapter mark in the clip AV stream file from feature point information of the clip information file of the database 320. At step S15, the movie player 300 accesses the obtained byte position of the file and starts reproducing the stream from the position.
After step S16, a process that displays a message that informs the user that the chapter was changed on the screen is performed. When the chapter is changed and the reproduction is started from the beginning of the chapter, event chapter occurs (at step S16). For example, the movie player 300 detects the chapter mark at the beginning of the chapter, event chapter occurs. The movie player 300 informs the script layer 302 of event chapter. In addition to the event, the movie player 300 also informs the script layer 302 of the chapter number of the chapter to be jumped. The script layer 302 starts executing an event handler corresponding to the informed event, for example event handler onchapter( ) (at step S17).
In this example, it is assumed that an operation that displays a message that represents that the chapter was changed on the screen is described in the event handler. A script of the script layer 302 executes the event handler, obtains the chapter number of which the movie player 300 informed the script layer 302 when the event occurred (at step S18), and causes the native implementation platform 301 to display a predetermined message that represents for example the beginning of the obtained chapter number on the screen. According to the command, the native implementation platform 301 displays the message on the screen (at step S19) and completes the process of the event handler (at step S20).
In the foregoing process, when the user operates the key “next” that causes the movie player 300 to start reproducing the next chapter, the movie player 300 performs the chapter jump operation and displays a message that represents the beginning of the chapter on the screen when the movie player 300 starts reproducing the next chapter to be jumped.
Thus, the user's input event causes the state of the movie player 300 to change. In addition, the user's input event causes a new event to occur. With new events, the movie player 300 can perform various processes.
When the user places the disc in a predetermined position of the UMD video player, it loads the disc according to a predetermined operation so that the UMD video player can reproduce video data from the disc (at step S30). When the disc is loaded, the native implementation platform 301 references the resume information 324 and loads continuous reproduction information corresponding to the disc from the resume information 324 (at step S31).
Thereafter, the resume information 324 corresponding to the disc is referenced. It is determined whether the continuous reproduction information exists (at step S32). When the continuous reproduction information exists, the native implementation platform 301 informs the script layer of event continuePlay. The script layer 302 executes event handler on ContinuePlay corresponding to the informed event continuePlay (at step S33). When the determined result at step S32 represents that the continuous reproduction information corresponding to the disc does not exist, the flow advances to step S34. At step S34, the native implementation platform 301 informs the script layer 302 of event autoplay. The script layer 302 executes event handler on AutoPlay corresponding to event autoPlay.
At step S35, the reproduction operation for the disc and other operations are preformed according to the contents of event handler on AutoPlay and event handler on ContinuePlay. An event that occurs corresponding to the reproduction operation for the disc and an event handler corresponding to the event are executed.
When the native implementation platform 301 generates event exit, the flow advances to step S36. At step S36, the script layer 302 executes event handler onExit corresponding to event exit. Event handler onexit executes a process that completes the UMD video application. Event exit is generated by the native implementation platform 301 according to the user's input 310 as a predetermined operation on for example the remote control commander.
When the script process according to event handler onExit is completed, the native implementation platform 301 operates. At step S37, the movie player 300 executes a process that stops the reproduction operation. At this point, the state that exists immediately before the movie player 300 stops the reproduction operation is stored as continuous reproduction information in the resume information 324. The reproduction operation for the disc is completed (at step S38). When the reproduction operation for the same disc is not preformed (at step S39), the flow advances to step S40. At step S40, the native implementation platform 301 ejects the disc and completes the sequence of steps of the process. When the reproduction operation for the same disc is performed, the flow returns to step S31.
In contrast, when the determined result at step S51 represents that the script does not contain event handler on AutoPlay( ), the flow advances to step S53. The native implementation platform 301 informs the script layer 302 of event exit. In this case, when the user operates the menu key for the reproduction operation on the menu screen implemented in the native implementation platform 301, the movie player 300 starts reproducing data from the disc. When the script layer 302 has event handler onExit( ), the script layer 302 executes event handler onExit( ).
When the resume information 324 corresponding to the loaded disc exists, the flow advances to step S63. At step S63, the native implementation platform 301 determines whether the script contains event handler onContinuePlay( ). When the script contains event handler onContinuePlay( ), the native implementation platform 301 informs the script layer 302 of event handler onContinuePlay( ). Accordingly, the script layer 302 executes event handler onContinuePlay( ) (at step S64). Thus, the movie player 300 resumes the reproduction for the loaded disc according to event handler onContinuePlay( ).
In contrast, when the determined result at step S63 represents that the script does not contain event handler onContinuePlay( ), the flow advances to step S65. At step S65, the native implementation platform 301 executes default event handler onContinuePlay( ). The default event handler onContinuePlay( ) simply starts the reproduction operation from the last reproduction end position according to for example the resume information 324.
User interfaces of event handler on AutoPlay and event handler onContinuePlay are not limited to those examples. Instead, various methods may be used. For example, in
(1) restrains new events from occurring,
(2) discards event handlers that have been queued, and
(3) issues control command uo_stop( ) to the movie player 300.
The native implementation platform 301 executes the exit process at step S71. After the native implementation platform 301 stops the execution of the current event handler (at step S72), the flow advances to step S73. At step S73, the native implementation platform 301 informs the script layer 302 of event exit. Accordingly, the script layer 302 executes onExit( ) (at step S74). Event handler onExit( ) executes for example a predetermined post process performed upon completion of the reproduction operation and method setUserData that stores user's setting data.
At step S75, the native implementation platform 301 performs the exit process. In the exit process, the native implementation platform 301 stores continuous information to for example a nonvolatile memory (namely, a backup of the state that exists immediately before the reproduction operation is completed to the resume information 324) and causes the system menu to appear on the screen.
The player model can reproduce video data, audio data, and subtitle data. Since events that the content creator intended occur at reproduction times that he or she intended and corresponding event handlers that he or she intended are executed, operations that he or she intended can be accomplished. In addition, when the user operates the UND video player that is performing the reproduction operation for a disc, the native implementation platform 301 informs the movie player 300 of a command corresponding to the user's operation so that the state of the player is changed to the state that the user intended. In addition, the native implementation platform 301 informs the script layer 302 of an event corresponding to the user's input. As a result, the script layer 302 can accomplish the operations that the content creator intended corresponding to user's operations. When the player model has this structure, the user can interactively operate the video player to reproduce video data, audio data, and subtitle data.
Next, an example of a script program of the script layer 302 will be described. It is assumed that the content creator created a flow of content reproduction as shown in
In addition, in the structure shown in
Event handler on Menu( ) is called when the user operates the menu key. Event handler on Menu( ) calls the top menu 402 and displays it on the screen. Event handler onMark( ) is executed when a reproduction time designated by mark Mark elapsed. In the example shown in
In the example shown in
Method “movieplayer.play( )” causes the movie player 300 to reproduce a play list. A play list number to be reproduced is described in parentheses ( ) as an argument. When the play list has been reproduced, event playListEnd occurs. When event playListEnd occurs, the script calls event handler movieplayer.on PlayListEnd( ). At this point, in addition to event playListEnd, object event_info is supplied to the script. The play list number of the play list that has been completely reproduced and so forth are stored in object event_info. The script can change the next operation corresponding to the content of object event_info.
Next, with reference to
File “TITLEID.DAT” and directory “VIDEO” are placed under the root directory. Directory “RESOURCE,” directory “CLIP,” directory “STREAM,” and file “PLAYLIST.DAT” are placed under directory “VIDEO.”
File “TITLEID.DAT” is a file that stores a title identifier that differs in each title (type of content). One disk has one file “TITLEID.DAT.”
File “SCRIPT.DAT” is placed under directory “RESOURCE.” As described above, file “SCRIPT.DAT” stores a script program that composes the script layer 302. Normally, file “SCRIPT.DAT” as one file is placed under directory “RESOURCE.” Instead, a plurality of files “SCRIPT.DAT” may be placed under directory “RESOURCE.” In this case, parts of the file names are changed so that they become unique. A plurality of files “SCRIPT.DAT” are used for different display languages. In this case, however, one file “SCRIPT.DAT” is used at a time.
At least one clip information file is placed under directory “CLIP.” A clip information file has a file name composed of a character string portion having several to five characters such as “00001” (in this example, numerals), a period as a delimiter, and an extension portion such as “CLP.” Extension portion “CLP” represents that the file is a clip information file.
At least one clip AV stream file is placed under directory “STREAM.” A clip AV stream file has a file name composed of a character string portion having several to five characters such as “00001” (in this example, numerals), a period as a delimiter, and an extension portion such as “PS.” Extension portion “PS” represents that the file is a clip AV stream file. According to the embodiment of the present invention, a clip AV stream file is an MPEG2 (Moving Pictures Experts Group 2) program stream of which a video stream, an audio stream, and a subtitle stream are multiplexed and stored in a file identified by extension portion “PS.”
As described above, a clip AV stream file is a file of which video data and audio data are compression-encoded and time-division multiplexed. Thus, when the clip AV stream file is read and decoded, video data and audio data are obtained. A clip information file is a file that describes the characteristics of a clip AV stream file. Thus, a clip information file and a clip AV stream file are correlated. According to the embodiment of the present invention, since the character string portions having several to five characters of the file names of the clip information file and the clip AV stream file are the same, the relationship therebetween can be easily obtained.
File “SCRIPT.DAT” is a script file that describes a script program. File “SCRIPT.DAT” stores a program that causes reproduction states for a disc to be interactively changed according to the embodiment of the present invention. File “SCRIPT.DAT” is read before other files are read from the disc.
File “PLAYLIST.DAT” is a play list file that describes a play list that designates the reproduction order of a clip AV stream. Next, with reference to
Field name_length has a data length of 8 bits and represents the length of the name assigned to the play list file. Field name_string has a data length of 255 bytes and represents the name assigned to the play list file. In field name_string, the area from the beginning for the byte length represented by field name_length is used as a valid name. When the value of field “name_length” is “10,” 10 bytes from the beginning of field name_string is interpreted as a valid name.
Field number_of_PlayList has a data length of 16 bits and represents the number of blocks PlayList( ) that follow. Field number_of_PlayLists is followed by a for loop. The for loop describes blocks PlayList( ) corresponding to field number_of_PlayLists. Block PlayList( ) is a play list itself.
Next, an example of the internal structure of block PlayList( ) will be described. Block PlayList( ) starts with field PlayList_data_length. Field PlayList_data_length has a data length of 32 bits and represents the data length of block PlayList( ), including field PlayList_data_length. Field PlayList_data_length is followed by field reserved_for_word_alignment having a data length of 15 bits and flag capture_enable_flag_PlayList having a data length of 1 bit. Field reserved_for_word_alignment and flag capture_enable_flag_PlayList having a data length of 1 bit align data at a 16-bit position in block PlayList( ).
Flag capture_enable_flag_PlayList is a flag that represents whether a moving picture that belongs to block PlayList( ) including flag capture_enable_flag_PlayList is permitted to be secondarily used. When the value of flag capture_enable_flag_PlayList is for example “1,” it represents that the moving picture that belongs to PlayList( ) is permitted to be secondarily used in the player.
In the foregoing example, flag capture_enable_flag_PlayList has a data length of 1 bit. Instead, flag capture_enable_flag_PlayList may have a data length of a plurality of bits that describe a plurality of secondary use permission levels. For example, flag capture_enable_flag_PlayList may have a data length of 2 bits. In this case, when the value of the flag is “0.” the movie picture may not be perfectly prohibited from being secondarily used. When the value of the flag is “1,” the movie picture may be permitted to be secondarily used in the case that the movie picture is compression-encoded with a predetermined resolution or lower such as 64 pixels×64 lines. When the value of the flag is “2,” the moving picture may be perfectly permitted to be secondarily used without any restriction. Instead, when the value of bit 0 of the flag is “0.” the moving picture may be permitted to be secondarily used in the content reproduction application. When the value of bit 1 of the flag is “1,” the moving picture may be permitted to be secondarily used in another application (for example, wall paper image or a screen saver) in the movie player. In this case, the values of bits 0 and 1 of the flag may be used in combination.
Field PlayList_name_length has a data length of 8 bits and represents the length of the name assigned to block PlayList( ). Field PlayList_name_string has a data length of 255 bits and represents the name assigned to block PlayList( ). In Field PlayList_name_string, the area from the beginning for the byte length represented by field PlayList_name_string is used as a valid name.
Field number_of_PlayItems has a data length of 16 bits and represents the number of blocks PlayItem( ) that follow. Field number_of_PlayItems is followed by a for loop. The for loop describes blocks PlayItem( ) corresponding to field number_of_PlayItems. Block PlayItem( ) is a play item itself.
Blocks PlayItem( ) of block PlayList are assigned identification information (ID). For example, block PlayItem( ) described at the beginning of block PlayList( ) is assigned for example 0. Blocks PlayItem( ) are assigned serial numbers in the order of appearance such as 1, 2, and so forth. The serial numbers are used as identification information of blocks PlayItem( ). Argument i of the for loop repeated for blocks PlayItem( ) can be used as identification information for blocks PlayItem( ). Block PlayItem( ) is followed by block PlayListMark( ).
Next, with reference to
Field IN_time and field OUT_time have a data length of 32 bits each. Field IN_time and field OUT_time are time information that designate the reproduction start position and the reproduction end position of a clip AV stream file corresponding to the clip information file designated by field Clip_Information_file_name in block PlayItem( ). With field IN_time and field OUT_time, the reproduction start position other than the beginning of the clip AV stream file can be designated. Likewise, with field IN_time and field OUT_time, the reproduction end position other than the end of the clip AV stream file can be designated.
Next, with reference to
Next, an example of the internal structure of block Mark( ) will be described. Block Mark( ) starts with field mark_type. Field mark_type has a data length of 8 bits and represents the type of block Mark( ) including field mark_type. According to the embodiment, as shown in
Field mark_name_length has a data length of 8 bits and represents the length of the name assigned to block Mark( ). Field mark_name_string at the last line of block Mark( ) represents the name assigned to block Mark( ). In field mark_name_string, the area from the beginning for the byte length represented by field mark_name_length is used as a valid name.
Four elements of field ref_to_PlayItem_id, field mark_time_stamp, field entry_ES_stream_id, and field entry_ES_private_stream_id correlate block Mark( ) defined in block PlayList( ) with a clip AV stream file. In other words, field ref_to_PlayItem_id has a data length of 16 bits and represents identification information of block PlayItem( ). Thus, field ref_to_PlayItem_id identifies a clip information file and a clip AV stream file.
Field mark_time_stamp has a data length of 32 bits and designates the time of a mark in a clip AV stream file. Next, with reference to
In this case, when a mark is designated to time t0 of the play list, the value of field ref_to_PlayItem_id is “1” that represents play item 1 including time t0. In addition, time corresponding to time t0 in the corresponding clip AV stream file is described in field mark_time_stamp.
Returning to the description of
The stream ID (stream_id) of the packets (packet( )) and the private stream ID (private_stream_id) of the private packet header (private_packet_header( )) are based on provisions on a program stream of the MPEG2 system.
Field entry_ES_stream_id and field entry_ES_private_stream_id are used when the chapter structure of clip AV stream #0 is different from that of clip AV stream #1. When block Mark( ) is not correlated with a predetermined elementary stream, the values of these two fields are “0.”
Next, with reference to
Field presentation_start_time and field presentation_end_time are followed by field reserved_for_word_alignment that has a data length of 7 bits and flag capture_enable_flag_Clip that has a data length of 1 bits. Field reserved_for_word_alignment and flag capture_enable_flag_Clip having a data length of 1 bit align data at a 16-bit position in file “XXXXX.CLP.” Flag capture_enable_flag_Clip is a flag that represents whether a moving picture contained in a clip AV stream file corresponding to file “XXXX.CLP” is permitted to be secondarily used. For example, when the value of flag capture_enable_flag_Clip is for example “1,” it represents that the moving picture of the clip AV stream file corresponding to file “XXXXX.CLP” is permitted to be secondarily used in the video player.
Field number_of_streams has a data length of 8 bits and represents the number of blocks StreamInfo( ) that follow. Field number_of_streams is followed by a for loop. The for loop describes blocks StreamInfo( ) corresponding to field number_of_streams. The for loop is followed by block EP_map( ).
Next, an example of the internal structure of block StreamInfo( ) will be described. Block StreamInfo( ) starts with field length. Field length has a data length of 16 bits and represents the length of block StreamInfo( ). Field length is followed by field stream_id and field private_stream that have a data length of 8 bits each. As shown in
In
Block StreamInfo( ) mainly describes two types of information, the first type not varying in a stream, the second type varying in a stream. Information that does not vary in a stream is described in block StaticInfo( ), whereas information that varies in a stream is described in block DynamicInfo( ) with change points designated with time information.
Block StaticInfo( ) is followed by field reserved_for_word_alignment that has a data length of 8 bits. Field reserved_for_word_alignment aligns data in a byte in block StreamInfo( ). Field reserved_for_word_alignment is followed by field number_of_DynamicInfo. Field number_of_Dynamicinfo has a data length of 8 bits and represents the number of blocks DynamicInfo( ) that follow. Field number_of_DynamicInfo is followed by a for loop. The for loop describes fields pts_change_point and blocks DynamicInfo( ) corresponding to field number_of_DynamicInfo.
Field pts_change_point has a data length of 32 bits and represents a time at which information of block DynamicInfo( ) becomes valid with PTS. A time at which each stream starts is represented by field pts_change_point and equal to field presentation_start_time defined in file “XXXXX.CLP.”
Next, with reference to
When the elementary stream is a video stream, block StaticInfo( ) is composed of field picture_size, field frame_rate, and flag cc_flag. Field picture_size and field frame_rate each have a data length of 4 bits each. Flag cc_flag has a data length of 1 bit. Field picture_size and field frame_rate represent the picture size and the frame frequency of the video stream. Flag cc_flag represents whether the video stream contains a closed caption. When the value of flag cc_flag is for example “1,” the video stream contains a closed caption. Field reserved_for_word_alignment aligns data in 16 bits.
When the elementary stream is an audio stream, block StaticInfo( ) is composed of field audio_language_code having a data length of 16 bits, field channel_configuration having a data length of 8 bits, flag lfe_existance having a data length of 1 bit, and field sampling_frequency having a data length of 4 bits. Field audio_language_code represents a language code contained in the audio stream. Field channel_configuration represents a channel attribute of audio data such as monaural, stereo, multi-channel, or the like. Field lfe_existance represents whether the audio stream contains a low frequency emphasis channel. When the value of field lfe_existance is for example “1,” the audio stream contains the low frequency emphasis channel. Field sampling_frequency represents the sampling frequency of audio data. Field reserved_for_word_alignment is aligned at a 16-bit position.
When the elementary stream is a subtitle stream, block StaticInfo( ) is composed of field subtitle_language_code having a data length of 16 bits and flag configurable_flag having a data length of 1 bit. Field subtitle_language_code represents a language code contained in the subtitle stream. Flag configurable_flag represents whether the size and position of characters of the subtitle stream that is displayed are permitted to be changed. When the value of flag configurable_flag is for example “1,” it represents that the size and position of characters of the subtitle stream that is displayed are permitted to be changed. Field reserved_for_word_alignment is aligned at a 16-bit position.
Next, with reference to
When the elementary stream is a video stream, block DynamicInfo( ) is composed of field display_aspect_ratio having a data length of 4 bits. Field display_aspect_ratio represents whether the display output aspect ratio of video data is 16:9 or 4:3. Field reserved_for_word_alignment aligns data in 16 bits.
When the elementary stream is an audio stream, block DynamicInfo( ) is composed of field channel_assignment having a data length of 4 bits. When the audio stream is composed of two channels, field channel_assignment represents whether the output is a stereo or a dual monaural. The dual monaural is used to reproduce audio data for example in two languages. Field reserved_for_word_alignment aligns data in 16 bits.
When the elementary stream is a subtitle stream, block DynamicInfo( ) is composed of field reserved_for_word_alignment. Field reserved_for_word_alignment aligns data in 16 bits. In other words, with respect to a subtitle stream, block DynamicInfo( ) does not define an attribute that dynamically varies.
Next, with reference to
Since the valid decode start position of a fixed rate stream can be calculated, information such as block EP_map( ) is not necessary. On the other hand, for a variable rate stream and a stream whose data size varies in each access unit such as a stream according to the MPEG video compression-encoding system, block EP_map( ) is information necessary for randomly accessing data.
Block EP_map( ) starts with field reserved_for_word_alignment having a data length of 8 bits. Field reserved_for_word_alignment aligns data in 16 bits. Field reserved_for_word_alignment is followed by field number_of_stream_id_entries. Field number_of_stream_id_entries has a data length of 8 bits and represents the number of elementary streams described in block EP_map( ). A first for loop describes fields stream_id, fields private_stream_id, and fields number_of_EP_entries corresponding to field number_of_stream_id_entries. In the first for loop, a second for loop describes fields PTS_EP_start and fields RPN_EP_start corresponding to field number_of_EP_entries.
The first for loop describes field stream_id and field private_stream_id that have a data length of 8 bits each and identify the type of the elementary stream as shown in
Field PTS_EP_start and field RPN_EP_start have a data length of 32 bits each and represent entry points themselves. Field PTS_EP_start represents a time of an entry point in a clip AV stream file with PTS. On the other hand, field RPN_EP_start represents the position of an entry point in a clip AV stream file in the unit of 2048 bytes.
According to the embodiment, one sector as a disc access unit is 2048 bytes. Thus, field RPN_EP_start represents the position of an entry point of a clip AV stream file in sectors.
The valid reproduction start position of a video stream needs to be immediately preceded by packet private_stream—2. Packet prIvate_stream—2 is a packet that stores information that can be used to decode a video stream. Thus, the position of an entry point of a video stream is the position of pack packo that stores packet private_stream—2.
Block EP_map correlates times of a clip AV stream and positions of a clip AV stream file. Thus, with time information (time stamp) of an access point of a clip AV stream, the clip AV stream file can be easily searched for a data address at which data are read. As a result, the disc can be smoothly randomly accessed.
According to the embodiment, in block EP_map( ), sets of time information and position information (sets of field PTS_EP_start and field RPN_EP_start in the second for loop) for each elementary stream are pre-registered in the ascending order (descending order). In other words, time information and position information have been rearranged in a predetermined direction. Thus, a binary search can be performed for the data.
According to the embodiment of the present invention, as described above, an elementary stream of a video stream is an elementary stream on the basis of the MPEG2-Video standard. However, the present invention is not limited to this example. For example, an elementary stream of a video stream may be an elementary stream according to the MPEG4-Visual standard or MPEG4-AVC standard. Likewise, according to the embodiment, as described above, an elementary stream of an audio stream is an elementary stream on the basis of the ATRAC audio system. However, the present invention is not limited to such an example. Instead, an elementary stream of an audio stream may be an elementary stream on the basis of for example MPEG1/2/4 audio system.
Next, a disc reproducing apparatus according to an embodiment of the present invention will be described.
In addition, a disc drive 102 is connected to the drive interface 114. The disc drive 102 exchanges data and commands with the bus 111 through the drive interface 114.
The CPU 112 has a read-only memory (ROM) and a random access memory (RAM) (not shown). The CPU 112 exchanges data and command with each section of the disc reproducing apparatus 100 through the bus 111 according to a program and data pre-stored in the ROM and controls the entire disc reproducing apparatus 100. The RAM is used as a work memory of the CPU 112.
Supplied to the input interface 115 is an input signal that is input from an input device with which the user performs an input operation. The input device is for example a remote control commander with which the user remotely operates the disc reproducing apparatus 100 using for example an infrared signal and keys disposed on the disc reproducing apparatus 100. The input interface 115 converts an input signal supplied from the input device into a control signal for the CPU 112 and outputs the control signal.
Recorded on a disc 101 in the format shown in
The clip AV stream file that is read from the disc 101 is temporarily stored in the memory 113. The video decoder 116 decodes a video stream and a subtitle stream of the clip AV stream file stored in the memory 113 according to a command received from the CPU 112. The CPU 112 performs an image process such as an enlargement process or a reduction process for the decoded video data and subtitle data, a synthesization process or an addition process for the video stream and subtitle stream, and obtains one stream of video data. The image process may be performed by the video decoder 116 and the video output interface 118. The video data are buffered by the memory 113 and supplied to the video output interface 118. The video output interface 118 converts the supplied video data into an analog video signal and supplies the analog video signal to a video output terminal 120.
Likewise, the audio decoder 117 decodes an audio stream of the clip AV stream file stored in the memory 113 according to a command received from the CPU 112. The decoded audio data are buffered in the memory 113 and supplied to the audio output interface 119. The audio output interface 119 converts the supplied audio data into for example an analog audio signal and supplies the analog audio signal to an audio output terminal 121.
In the example, each section shown in
When the power of the disc reproducing apparatus 100 is turned on, the operation system 201 initially starts up on the CPU 112 and performs necessary processes such as initial settings for each section, and reads an application program (in this example, the video content reproduction section 210) from the ROM. The operation system 201 provides basic services such as reading of a file from the disc 101 and interpreting of a file system for the video content reproduction section 210 while the video content reproduction section 210 is operating. For example, the operation system 201 controls the disc drive 102 through the drive interface 114 corresponding to a file read request supplied from the video content reproduction section 210 and reads data from the disc 101. The data that are read from the disc 101 are supplied to the video content reproduction section 210 under the control of the operation system 201.
The operation system 201 has a multitask process function that controls a plurality of software modules virtually in parallel by for example time-division control. In other words, each module that composes the video content reproduction section 210 shown in
Next, the operation of the video content reproduction section 210 will be described more specifically. The video content reproduction section 210 has more internal modules and accomplishes the following functions.
(3) When the determined result represents that the loaded disc 101 is the UMD video disc, the video content reproduction section 210 also reads files that composes a database (namely, a play list file, a clip information file, and so forth) and supplies the files to a player control module 212.
Next, the operations of the modules of the video content reproduction section 210 will be described.
The script control module 211 interprets a script program described in script file “SCRIPT.DAT” and executes it. As described in the player model, GUIs that create and output images of the menu screen, move the cursor corresponding to a user's input, and change the menu screen are accomplished by a graphics process module 219 controlled according to the script program. By executing the script program, the script control module 211 can control the player control module 212.
The player control module 212 references database information stored in files such as play list file “PLAYLIST.DAT” and clip information file “XXXXX.CLP” that are read from the disc 101 and performs the following controls to reproduce video contents recorded on the disc 101.
(3) The player control module 212 performs player state change controls such as reproduction, reproduction stop, and reproduction pause and a reproduction control process such as stream change according to a command received from the script control module 211 or the input interface 115.
The content data supply module 213 reads content data such as a clip AV stream file from the disc 101 according to a command received from the player control module 212 and supplies the content data to the buffer control module 215. The buffer control module 215 stores the content data in the memory 113 as a substance 215A of the buffer. The content data supply module 213 controls the buffer control module 215 to supply the content data stored in the memory 113 to a video decoder control module 216, an audio decoder control module 217, and a subtitle decoder control module 218 according to requests therefrom. In addition, the content data supply module 213 reads content data from the disc 101 so that the amount of content data stored under the control of the buffer control module 215 becomes a predetermined amount.
The decode control module 214 controls the operations of the video decoder control module 216, the audio decoder control module 217, and the subtitle decoder control module 218 according to a command received from the player control module 212. The decode control module 214 has an internal clock function and controls the operations of the video decoder control module 216, the audio decoder control module 217, and the subtitle decoder control module 218 so that video data and audio data are synchronously output.
The buffer control module 215 exclusively uses a part of the memory 113 as the substance 215A of the buffer. The buffer control module 215 stores a data start pointer and a data write pointer. The buffer control module 215 also has as internal modules a video read function, an audio read function, and a subtitle read function. The video read function has a video read pointer. The video read function has a register that stores information au_information( ) as access unit information. The audio read function has an audio read pointer. The subtitle read function has a subtitle read pointer and a subtitle read function flag. The subtitle read function flag controls enabling/disabling of the subtitle read function according to a write value. When for example “1” is written to the subtitle read function flag, the subtitle read function becomes enabled. When for example “0” is written to the subtitle read function flag, the subtitle read function becomes disabled.
The video read function, the audio read function, and the subtitle read function, which are internal modules of the buffer control module 215, have demultiplexer functions that demultiplex a multiplexed clip AV stream, of which a video stream, an audio stream, and a subtitle stream have been multiplexed, into these streams. According to the embodiment of the present invention, a plurality of elementary streams are multiplexed according to time-division multiplying system and MPEG2 system program stream format and thereby a clip AV stream is formed. Thus, the video read function, the audio read function, and the subtitle read function have demultiplexer functions for the MPEG2 system program streams.
Consequently, the video read function reads the value of field stream_id (see
The video decoder control module 216 causes the video read function of the buffer control module 215 to read one video access unit of the video stream from the memory 113 and supply the video access unit to the video decoder 116. The video decoder control module 216 controls the video decoder 116 to decode the video stream supplied to the video decoder 116 in the access unit and generate video data. The video data are supplied to the graphics process module 219.
Likewise, the audio decoder control module 217 causes the audio read function of the buffer control module 215 to read one audio access unit of the audio stream from the memory 113 and supply the audio stream unit to the audio decoder 117. According to the embodiment of the present invention, the access unit (audio frame) that composes an audio stream has a predetermined fixed length. The audio decoder control module 217 controls the audio decoder 117 to decode the audio stream supplied to the audio decoder 117 in the access unit and generate audio data. The audio data are supplied to an audio output module 242.
The subtitle decoder control module 218 causes the subtitle read function of the buffer control module 215 to read one subtitle access unit of the subtitle stream from the memory 113 and supply the subtitle access unit to the subtitle decoder control module 218. According to the embodiment of the present invention, the subtitle access unit that composes the subtitle stream contains length information at the beginning. The subtitle decoder control module 218 has a subtitle decode function that can decode the supplied subtitle stream and generate subtitle image data. The subtitle image data are supplied to the graphics process module 219.
As described above, the video data decoded by the video decoder 116 under the control of the video decoder control module 216 and the subtitle image data decoded by the subtitle decoder control module 218 are supplied to the graphics process module 219. The graphics process module 219 adds the subtitle image data to the supplied video data and generates a video signal that is output. The graphics process module 219 generates the menu image and the message image corresponding to a command received from the script control module 211 and the player control module 212 and overlays them with the output video signal.
For example, the graphics process module 219 performs an enlargement process and a reduction process for the supplied subtitle image data and adds the processed image data to the video data according to a command received from the script control module 211.
In addition, the graphics process module 219 converts the aspect ratio of the output signal according to the aspect ratio of the predetermined output video device and the output aspect ratio designated in the content reproduced from the disc 101. When the aspect ratio of the output video device is 16:9 and the output aspect ratio is 16:9, the graphics process module 219 directly outputs the video data. When the output aspect ratio is 4:3, the graphics process module 219 performs a squeezing process that matches the height of the image with the height of the screen of the output video device, inserts black portions into left and right sides of the image, and outputs the resultant image. When the aspect ratio of the output video device is 4:3 and the output aspect ratio is 4:3, the graphics process module 219 directly outputs the video data. When the output aspect ratio is 16:9, the graphics process module 219 performs a squeezing process that matches the width of the image with the width of the screen of the output video device, inserts black portions into the upper and lower portions of the image, and outputs the resultant image.
The graphics process module 219 also performs a process that captures the video signal that is being processed according to a request from the player control module 212 and supplies the requested video signal thereto.
A video output module 241 exclusively uses a part of the memory 113 as a first-in first-out (FIFO) buffer. The video output module 241 temporarily stores video data processed by the graphics process module 219 in the buffer and reads the video data therefrom at predetermined timing. The video data that are read from the buffer are output from the video output interface 118.
The audio output module 242 exclusively uses a part of the memory 113 as a FIFO buffer. The audio output module 242 stores audio data that are output from the audio output interface 119 to the buffer and reads the audio data therefrom at predetermined timing. The audio data that are read from the buffer are output from the audio output interface 119.
When the audio mode of the content is dual monaural (for example, bilingual), the audio output module 242 outputs the audio data according to a predetermined audio output mode. When the audio output mode is “main audio,” the audio output module 242 copies audio data of the left channel in for example the memory 113 and outputs audio data of the left channel and audio data from the memory 113. Thus, the audio output module 242 outputs audio data of only the left channel. When the audio output mode is “sub audio,” the audio output module 242 copies audio data of the right channel in for example the memory 113 and outputs audio data of the right channel and audio data from the memory 113. Thus, the audio output module 242 outputs audio data of only the right channel. When the audio output mode is “main and sub audio” or the content is stereo, the audio output module 242 directly outputs the audio data.
The user can interactively sets the audio output mode on for example the menu screen that the video content reproduction section 210 generates.
A nonvolatile memory control module 250 writes data to an area whose data are not erased after the operation of the video content reproduction section 210 is completed (this area is referred to as a nonvolatile area) and reads data therefrom according to a command received from the player control module 212. The nonvolatile memory control module 250 has a function that stores a plurality of sets of data Saved_Player_Status and data Saved_Player_Data with a key of a title ID (Title_ID). The nonvolatile memory control module 250 stores as data Saved_Player_Status data Backup_Player_Status that the player control module 212 has. Data Backup_Player_Status corresponds to data of for example the player status 323B that exist immediately before the operation of the player control module 212 is completed. Data Saved_Player_Status corresponds to the resume information 324. In addition, the nonvolatile memory control module 250 stores as data Saved_User_Data data User_Data that the player control module 212 has. Data User_Data are predetermined data that the user'sets to the player control module 212.
When the disc reproducing apparatus 100 has a flash memory or the like, which is a nonvolatile memory, the nonvolatile memory control module 250 correlatively stores a set of data Saved_Player_Status and data Saved_User_Data with the title ID of the disc 101 in a predetermined region of the flash memory. The storage medium that the nonvolatile memory control module 250 stores data is not limited to a flash memory, but a hard disk or the like.
Next, the restriction of users operations according to an embodiment of the present invention will be described. According to the embodiment of the present invention, combinations of restrictions of user's operations are defined as modes (referred to as user's operation mask modes, UOP mask modes). In other words, flags that represent whether user's operations are permitted are not provided. Instead, a set of user's operations expected to be frequently used are provided on the player side. The content creator side selects a provided mode to restrict user's operations.
Information of a user's operation mask mode is defined as field UOP_mask_mode in syntax of a play list. The information of the user's operation mask mode is placed in only the play list layer, not in a plurality of layers.
Thus, combinations of restrictions of user's operations are implemented as user's operation mask mode on the player side and provided to the content creator side. As a result, the load of the content creator side that verifies the operations decrease.
When the content creator needs to restrict user's operations, he or she needs to only select a prepared user's operation mask mode. Thus, user's operations can be more easily controlled. As a result, the load of the content creator side that creates contents and verifies their operations decreases. In addition, the load of the player side that verifies implemented operations decreases.
Next, the restrictions of user's operations according to the embodiment of the present invention will be described.
The position of field UOP_mask_mode is an example, not limited thereto.
As shown in
Field UOP_mask_mode has a data length of 4 bits and represents a user's operation mask mode defined for each play list stored in file “PLAYLIST.DAT.”
When the value of field UOP_mask_mode is “0x1,” the user's operation mask mode for the play list is “1.” When the user's operation mask mode for the play list is “1,” only the reproduction stop as a user's operation is permitted. Even if other user's operations are performed while the play list being reproduced, the player side ignores these user's operations.
When the user's operation mask mode for the play list is “1” and a user's operation so-called “jump reproduction” that starts reproducing the play list at any time is performed, the jump reproduction is not permitted. Instead, the play list is reproduced from the beginning in the forward direction at a predetermined speed (for example, regular reproduction speed). In other words, while another play list is being reproduced, when a jump reproduction is performed for a play list whose user's operation mask mode is “1,” the play list is reproduced in the forward direction at a predetermined speed, for example regular reproduction speed.
It is expected that the user's operation mask mode “1” is used for a play list that is reproduced before a movie content is reproduced from the disc 101 when the play list is used for a warning message (FBI warning) that represents that contents are prohibited from being copied and broadcast without permission.
When the value of field UOP_mask_mode is “0x2,” the user's operation mask mode for the play list is “2.” When the user's operation mask mode for the play list is “2,” a user's operation that jumps to the end of the play list is prohibited while the play list is being reproduced, but a stop operation is always permitted. In addition, user's operations fast forward reproduction and fact reverse reproduction are permitted.
The restrictions of the user's operation mask mode “2” are weaker than those of the user's operation mask mode “1.” It is expected that the user's operation mask mode “2” is used for a play list that is reproduced before or after a rental content is reproduced from the disc 101 when the play list is used for an advertisement picture (trailer).
The values “0x3” to “0xF” of field UOP_mask_mode are future reserved.
Next, the control of user's operations according to field UOP_mask_mode will be described.
On the other hand, a user's operation is input as the user's input 310 to the native implementation platform 301. The native implementation platform 301 converts the user's input 310 into a control command 311 and supplies the control command 311 to the movie player 300. The control command 311 is supplied to the command filter 502 of the movie player 300. The command filter 502 references a command filter table 501 and determines whether to supply the control command 311 to the playback module 321. The user's operation restricted according to field UOP_mask_mode is a user's operation corresponding to the control command 311 that is filtered by the command filter table 501 and is not supplied to the playback module 321.
The command filter table 501 described in
When a user's operation is performed for the player at step S100, the user's input 310 according to the user's operation is input to the native implementation platform 301. When the native implementation platform 301 receives the user's input 310 at step S101, the flow advances to step S102. At step S102, the native implementation platform 301 converts the received user's input 310 into a control command 311 for the movie player 300 and informs the movie player 300 of the control command 311.
When the movie player 300 receives the control command 311, the movie player 300 references the command filter table 501 of the play list that is being reproduced (at step S103). At step S104, the movie player 300 determines whether the informed control command 311 is permitted to be executed in accordance with the command filter table 501. When the determined result represents that the control command 311 is not permitted to be executed, the flow advances to step S105. At step S105, the movie player 300 does not execute the control command 311.
In contrast, when the determined result at step S104 represents that the control command 311 is permitted to be executed, the flow advances to step S106. At step S106, the movie player 300 determines whether the control command 311 is a command that is executed in the play list that is being reproduced. Namely, at step S106, the movie player 300 determines whether the control command 311 is a command that is executed in the play list that is being reproduced for example a chapter jump command or a stream change command that jumps to another chapter of the play list or that changes the stream or a command that stops the reproduction of the current play list and starts the reproduction of a predetermined chapter of another play list.
When the determined result at step S106 represents that the control command 311 is a command that is executed in the play list that is being reproduced, the flow advances to step S107. At step S107, the movie player 300 executes the control command 311. When the movie player 300 executes the control command 311, the movie player 300 can restrict the control command 311 with an event handler. In other words, after a user's operation is filtered by a user's operation mask, the user's operation may be filtered by an event handler.
When the determined result at step S106 represents that the control command 311 is a command that is not executed in the play list that is being reproduced, the flow advances to step S108. At step S108, the movie player 300 references the command filter table 501 of another play list to be newly reproduced. When the control command 311 of which the movie player 300 is informed at step S102 is a command that jumps from the play list that is being reproduced to another play list, the movie player 300 references the command filter table 501 of the play list to be jumped.
Thereafter, the flow advances to step S109. At step S109, the movie player 300 determines whether the other play list to be newly reproduced is permitted to be reproduced from the beginning according to the command filter table 501 of the other play list. When the determined result represents that the play list is permitted to be reproduced from only the beginning, the flow advances to step S110. Even if the control command 311 reproduces the other play list from other than the beginning, the movie player 300 causes the playback module 321 to start reproducing the other play list from the beginning.
When the determined result represents that the other play list is permitted to be reproduced from other than the beginning, the flow advances to step S111. At step S111, the movie player 300 causes the playback module 321 to reproduce the other play list at the time and chapter according to the control command 311.
As described above, user's operations are controlled according to the embodiment of the present invention.
Number | Date | Country | Kind |
---|---|---|---|
2004-239346 | Aug 2004 | JP | national |
Filing Document | Filing Date | Country | Kind | 371c Date |
---|---|---|---|---|
PCT/JP05/14490 | 8/2/2005 | WO | 00 | 2/15/2007 |