This invention is related to the field of digital signal processing, recording and retrieval of video and audio data for storage or display applications, for example.
In digital video processing and storage applications, packetized video data is typically encoded with ancillary information for use in locating, decoding and navigating through encoded image data. In a Digital Video Disk (DVD) type application, ancillary data in the form of volume/file structure data and navigation data contains information for use in locating data and navigating through different image sequences. Volume/file structure information uses one or more file directories in defining file structures for use in locating and recovering data from a storage medium, for example. Navigation data additionally locates and links sections of video/audio program data for use in navigating through image sequence in different modes of operation, for example. In normal program play mode a first sequence of images is located, linked and processed for play by a DVD player and in another mode a different sequence of images is processed to provide a different scene or camera angle, for example. However, such ancillary file structure and navigation information may be encoded in different data formats in accordance with different encoding standards and applications. A program encoded with file structure and navigation data according to one standard for read-only DVD applications may be incompatible with the navigation data structure and content requirements of a different standard such as a recordable DVD format, for example. As a result a recordable format DVD disk may not be playable by a read-only DVD player or a program encoded for read-only DVD format may not be directly stored by a recordable DVD player, and vice versa.
In addition, the content and format of existing file structure and navigation data structures for DVD and other applications are limited and do not adequately support advanced decoder navigation features for multimedia and other applications. Advanced decoder navigation features include, for example, trick play operation (such as reverse, fast forward, freeze-frame etc.), image manipulation (involving linking images out of sequence and from different programs), and navigation in a multi-windowed composite image display containing different video programs or other multimedia application images. Such multimedia picture-in-picture (PIP) type images may comprise, for example, Internet web pages, electronic program guides, Email, telephone, fax, video-phone, home appliance control images as well as video program images. These deficiencies and derivative deficiencies are addressed by a system according to the present invention. Specifically, a system according to the invention addresses the problems involved in generating, processing and formatting ancillary volume/file structure and navigation data to be compatible with different data encoding standards and to support advanced multimedia navigation features.
A video processing system adaptively generates and processes volume/file structure and navigation data of different data format and converts data between different formats for decoding, recording and other applications. The system provides navigation information supporting navigation through different images of one or more video programs by parsing encoded packetized data representative of a sequence of individual images to determine parameters to support navigation through the sequence of individual images. The determined parameters are formatted into a predetermined data structure and incorporated into a pre-formed navigation data field.
In the drawing:
A video processing system advantageously adaptively generates and processes volume/file structure and navigation data of different data format and converts data between different formats for decoding, recording and other applications. The principles of the invention may be applied to processing and storage of terrestrial, cable, satellite, Internet or computer network broadcast data. Further, although the disclosed system is described as processing video programs, this is exemplary only. The term ‘program’ is used to represent any form of packetized data such as audio data, telephone messages, computer programs, Internet web pages or other communications, for example.
The processing system is discussed in the context of processing and converting data of different data format, specifically in processing and converting between recordable and read-only formats for a DVD type application and vice versa. However, this is exemplary only, the principles of the invention may also be applied to the processing and conversion of other data formats. Other formats may include, for example, proprietary and custom formats, MPEG format (including data encoded to the MPEG-4 or MPEG-7 standards) and non-MPEG compatible formats. Note, the read-only DVD data format employs a sub-set of the MPEG2 format and is defined by a proprietary standard adopted by a consortium of consumer electronics companies and described in available literature such as “DVD Demystified—The Guidebook of DVD-Video and DVD-ROM”, 1997, by Jim Taylor published by McGraw Hill. Further, MPEG2 compatible data is encoded in accordance with the “MPEG standard” comprised of a system encoding section (ISO/IEC 13818-1, 10 Jun. 1994) and a video encoding section (ISO/IEC 13818-2, 20 Jan. 1995).
A program encoded with file structure and navigation data according to a recordable DVD standard may be incompatible with the file structure and navigation data requirements of a program encoded to a different standard such as a read-only DVD format, for example. As a result a recordable DVD disk may not be playable by a read-only DVD player or a program encoded for read-only DVD format may not be directly stored by a recordable DVD player, and vice versa. Such data format incompatibility may arise between other different data formats. Data format incompatibility may also arise between data encoded in different versions of a single format such as between different versions of a recordable DVD format. The resulting lack of backward compatibility means a recorded disk may not be playable on different generations of player, for example.
A processing system, according to the invention, adaptively generates and processes file structure and navigation data of different data format. The processing system also converts file structure and navigation data between different formats for decoding, recording and other applications. In a specific embodiment, a processing system encodes a video program into a generic data format (as exemplified in
A number of difficulties are involved in processing a program in a recordable data format for play by a read-only format player. Specifically, a program encoded in a read-only format (as exemplified by
A processing system, according to the invention, minimizes the burden of generating such file structure and navigation data by advantageously adaptively generating and processing data in distinct modes. These modes comprise, (a) pre-processing, (b) contemporaneous and (c) post-processing modes. The pre-processing mode precedes a program recording or format conversion operation. The contemporaneous mode occurs during a program recording or format conversion operation. Further, the pre-processing and contemporaneous modes may each involve creating pre-formed data fields for subsequent insertion of file structure and navigation parameters. The post-processing mode occurs after program recording or format conversion and involves inserting file structure or navigation parameters in the pre-formed data fields.
A processing system encodes a video program into a generic data format (as exemplified in
The file structure and navigation parameters incorporated within the generic format of
The main menu of a DVD disc in video manager section (VMG) 200 is optional. This main menu represents the first image a User sees on accessing a DVD disk. VMG 200 is hierarchically associated with video manager control data 207, disc menu 209 and video manager back-up information 210. Further, control data 207 comprises: information management table 230; title search pointer table 233; menu program chain information unit table 235; parental management information table 237; video title set attribute table 239; text data manager 242; menu cell address table 244; and menu video object unit address map 246. Specifically, items 230-246 define size and start addresses of VMG information, attributes of video objects of the video manager menu, video program search information, menu language information, parental rating control information, duplicate video program attribute information, and program identification names (e.g. volume, album or producer names). Further, title search pointer table 233 includes search information items 253, 255, 257 and 259 each specifying program type, program number, number of camera angles, parental rating identifier and program start address, for example) for each program on a disk. Title search pointer table 233 also includes in item 248 parameters defining size and location of search pointer table 233 itself.
1. Pre-Processing Mode
The pre-processing of data in the manner described herein advantageously simplifies and expedites the generation and processing of file structure and navigation data of different data format. The pre-processing and pre-forming of data elements prior to program recording or format conversion reduces the processing burden otherwise involved in performing these operations during recording or in post-processing. Such pre-processing may involve counting the number of individual I, P and B frames in an MPEG compatible GOP or in a VOBU, for example. Further, some pre-formed data elements are advantageously updated with new data during recording or post-processing mode. Other pre-formed data elements may be advantageously subsequently modified to accommodate newly available functions or features. For example, a menu may be generated before recording in the form of a stored bit map or may be embedded within software (e.g. in HTML). In one version, such a menu may be pre-formed to contain visible and invisible buttons. The invisible buttons are associated with inactive commands (e.g. no-operation NOP commands). A pre-formed menu containing invisible buttons is retrieved from memory and incorporated into video program data during program recording or to expand decoder features. The invisible menu buttons are subsequently activated by rendering the buttons visible and by replacing the dummy commands with active commands in response to a request to add a feature, for example.
2. Contemporaneous Mode (Occurring During Program Recording).
In recording a new video program set, information items 701-716 are recorded and dummy data is incorporated for subsequent update in post-processing. In recording a new program, a program start address is added to management table 701 and a pointer is incorporated in pointer table 703. Further, program chain table 705 and unit table 707 are updated to include linking data for segments of the added program. Similarly, in time map table 709 containing program address links permitting random access for trick play and other navigation modes, time map link addresses may be updated, an associated index number is incremented and a search pointer is added. Unknown data is recorded as dummy data for update in post-processing. A new menu button permitting User selection of the added program is added in the video program set menu 650. In addition, associated navigation items are updated including menu program chain information 655 and navigation command data 669. The number of menu video objects 657 may also be updated to accommodate the new menu button if necessary.
In recording a new video object, new video title set cell information 711 is added, and the number of video objects and unknown data are recorded as dummy data. Program chain information 705 and menu program chain information unit table 707 are updated to reflect the new changed number of programs and cells. Note, items 705 and 707 contain data related to program control for a video tile set and its associated menu. Navigation commands (NextPGC, PreviousPGC, GoUp PGC, PG playback mode, and Still Time Value) are recorded as dummy commands (NOP) if the navigation destination is unknown at this stage. For a new cell, a cell number entry is added in the video title cell address table 716. In addition, video object units are stored in memory as complete units and are parsed prior to recording to determine video object unit level navigation information. Forward address links of sequentially linked video object units are unknown and are recorded as dummy data for update during post-processing.
3. Post-Processing Mode.
In the case of conversion of a single program or an entire disk, data is advantageously processed in Error Correction Coded (ECC) block units to simplify processing. In other embodiments, processing may be performed on the basis of different sized data involving correspondingly different memory capacities for the conversion processing. In step 367, ECC blocks in a video object unit (VOBU) are individually processed and this is repeated for each of the VOBUs in the program. Individual ECC blocks of a program are retrieved from storage and parsed to generate generic format volume, file structure and navigation parameters for incorporation in generic format data fields. Further, in step 367, the pre-processed generic format data is re-stored back to the original disk, either to overwrite the original stored program, or to occupy a different storage area (on the original disk or on a different disk). During the re-storage of the generic format program, selected file structure and navigation parameters are generated or updated as described previously in connection with the contemporaneous mode processing of
In read mode, the digital video disk player is controlled by a central processing unit (CPU) 510 of block 500 in conjunction with memory 80. Unit 510 processes the reproduced bitstream and error flags from channel IC 40 to provide separate video, audio, sub-picture and system control data for output to other units and for internal use. Controller 510 provides MPEG encoded video and audio data to decoder 530 and audio decoder 110 respectively. In addition CPU 510 receives user control commands from user interface 90, and MPEG decoder control functions from the MPEG decoder element 530 of block 500. MPEG decoder 530 uses memory 60 in decoding MPEG encoded video data from unit 510 using variable length coding, discrete cosine transform and quantization functions. Following MPEG or AC3 audio decoding by unit 110, a digitized audio signal results which is coupled to an audio post processor 130 for digital to analog conversion and generation of various base band audio signal outputs. Also, following MPEG video decoding, a digital video output signal from unit 530 is transformed into raster scan format and processed by encoder 590 which provides digital to analog signal conversion and generates baseband video components and encoded video signals for output to a reproduction device.
In record mode, input video and audio datastreams are digitized by analog to digital converters 551 and 541 respectively. The resultant digital video and audio datastreams are MPEG encoded by video encoder 533 and either MPEG or AC3 encoded by audio encoder 113 under direction of controller 513. The functions of controller 513 may, in other embodiments, be encompassed within the functions performed by unit 510. Unit 33 generates sub-picture data (e.g. text, captions, menus etc.) and unit 43 generates file structure and navigation data compatible with the generic format of
Controllers 510 and 513 control the elements of the record/replay system of
The architecture of
This application is a divisional of U.S. application Ser. No. 09/378,669, filed Aug. 20, 1999 now U.S. Pat. No. 7,133,598, herein incorporated by reference.
Number | Name | Date | Kind |
---|---|---|---|
4914732 | Henderson et al. | Apr 1990 | A |
5276665 | Aoki et al. | Jan 1994 | A |
5384910 | Torres | Jan 1995 | A |
5414809 | Hogan et al. | May 1995 | A |
5502494 | Auld | Mar 1996 | A |
5559999 | Maturi et al. | Sep 1996 | A |
5619337 | Naimpally | Apr 1997 | A |
5621840 | Kawamura et al. | Apr 1997 | A |
5729648 | Boyce et al. | Mar 1998 | A |
5745643 | Mishina | Apr 1998 | A |
5764818 | Capps et al. | Jun 1998 | A |
5801781 | Hiroshima et al. | Sep 1998 | A |
5818533 | Auld et al. | Oct 1998 | A |
5832085 | Inoue et al. | Nov 1998 | A |
5835636 | Auld | Nov 1998 | A |
5841420 | Kaply et al. | Nov 1998 | A |
5870523 | Kikuchi et al. | Feb 1999 | A |
5902115 | Katayama | May 1999 | A |
5929857 | Dinallo et al. | Jul 1999 | A |
5960006 | Maturi et al. | Sep 1999 | A |
6160952 | Mimura et al. | Dec 2000 | A |
6172712 | Beard | Jan 2001 | B1 |
6173113 | Okada et al. | Jan 2001 | B1 |
6370322 | Horiguchi et al. | Apr 2002 | B2 |
6381398 | Yamauchi et al. | Apr 2002 | B1 |
6385389 | Maruyama et al. | May 2002 | B1 |
6434326 | Kondo et al. | Aug 2002 | B1 |
6504996 | Na et al. | Jan 2003 | B1 |
7133598 | Lin et al. | Nov 2006 | B1 |
20070116434 | Yamamoto et al. | May 2007 | A1 |
Number | Date | Country |
---|---|---|
0724264 | Jul 1996 | EP |
0797204 | Sep 1997 | EP |
0942426 | Sep 1999 | EP |
0986062 | Mar 2000 | EP |
1039468 | Sep 2000 | EP |
11007705 | Jan 1999 | JP |
11164243 | Jun 1999 | JP |
Entry |
---|
PCT International Search Report Dated Nov. 13, 2000. |
Number | Date | Country | |
---|---|---|---|
20060263056 A1 | Nov 2006 | US |
Number | Date | Country | |
---|---|---|---|
Parent | 09378669 | Aug 1999 | US |
Child | 11495255 | US |