Patent Application
20050053352
This invention related to moving picture recording and editing devices and processes. More particularly, the invention relates to a device for non-linear recording and editing of digital moving pictures.
Present day video recorders are typically a combination of a video camera with a video tape recorder which are constructed so as to be portable. They are often called camcorders or video tape recorders (VTR). For the purposes of this application, they are referred to as video tape recorders. Present day portable tape recorders use a video tape, usually contained within a cassette, as the recording medium. Recording is done in numerous formats, including analog BETA and VHS format, and the digital D1 format. A major disadvantage of video tape recorders is that video tape allows only linear access to a given point on the video tape. That is, if the tape has just finished recording, in order to access the beginning of a recorded session located at the beginning of the tape, the tape is rewound.
The problem of linear access to video tape recordings in most obvious in the field of broadcast television news. Typically, a reporting crew goes to a news location with a video tape recorder to record an event. Upon completion of recording, the tape must be rewound and then played back and transmitted, for example via satellite or microwave line, to a base station in a studio facility. At the base station, the information then can be edited into a final new program.
Editing of moving pictures is commonly done digitally, using a non-linear computer-based editing system such as the Avid/1 Media Composer or NewsCutter available from Avid Technology, Inc. of Tewksbury, Mass. Such a system typically digitizes, or converts analog video signals into a digital, computer-readable format. Even if the video signal is from a digital video tape, linear access to information on the tape still presents the same problems. Tape recording, transmission and digitization are usually performed unless there is an actual live connection from the camera to the base station. Because of the delays in rewinding, playback and transmission of recorded information from a video tape, there is typically a half hour delay between the completion of recording of an event and the time an edited version of the recorded event actually can be broadcast by the base station. This delay is a significant competitive problem in broadcast news where the time to air is very important as stations strive to produce “up to the minute” news coverage and broadcast.
Today, electronic still cameras exist which record a still image on magnetic medium, such as a floppy disk. Such a camera is described in U.S. Pat. No. 5,084,775, issued Jan. 28, 1991, and assigned to Sony Corporation. However, the camera described in that patent records still images only, not full motion video images. In addition, computer video capture systems exist, such as the NuVista video capture card available from RasterOps/Truevision, Inc. Such systems, however, have not been reduced to the portable form of the present invention to perform live digital capture directly from a camera.
Additionally, it has been recently suggested by those skilled in the field of moving picture recording that numerous problems with a non-linear digital moving picture recorder are insurmountable. In particular, it has been suggested that there is a large image quality trade-off with increased recording time capability. Additionally, it has been suggested that, using disk-based media, a little shake of the camera would cause a disk crash. Finally, it has been suggested that the disk media is substantially costlier than tape.
Additionally, while still picture editing is available in some digital still video cameras, such as described in U.S. Pat. No. 5,301,026, such systems are significantly simpler than full motion video editing system, and thus, such a still camera does not have the capability of recording and/or editing moving pictures.
Additionally, it is known that in many television stations there are a variety of switching capabilities to allow multiple sources of information to be fed to a single output channel. These sources are generally locked to and synchronized with the output channel frequency. Switching is performed between vertical time intervals, i.e. between frames, using a vertical time interval switch (VTIS). However, in a camera, there are typically only two sources of output, either live images or playback from tape, which are designed to be preselected by a user during playback but do not incorporate VTIS.
The present invention combines editing capability, typically found only in a production studio, along with switching capabilities, typically found only in a television station, in a portable moving picture recorder that records on computer-readable and writable random access recording media, such as a magnetic or optical disk. With such a combination, editing can be performed in the field at the same time as recording, providing an interaction between videography and editing in video production.
By providing a portable video recorder which records directly onto digital computer readable and writable random access (i.e., non-linear) medium, there is no longer a significant delay due to rewinding of the tape or for digitization of video tape for editing purposes. By further combining the advantages of non-linear recording and non-linear editing with non-linear broadcasting system and switching control, the time from videography to broadcast of an edited news event is drastically reduced. This reduction of the time from videography to broadcast provides a significant competitive advantage for broadcast news stations.
Accordingly, one aspect of the present invention is a digital moving picture recording and editing device in a portable housing. This device receives a motion video signal and converts the motion video signal to digital moving picture information. The digital moving picture information is then stored. The storage may be a computer-readable random-access medium. The digital moving picture information may be retrieved from the storage and displayed. An editing system allows for editing the stored digital video information.
Another aspect of the invention is a digital moving picture recording device. This device receives a motion video signal and converts the motion video signal to digital moving picture information. The digital moving picture information is then stored. The storage may be a computer-readable random access medium. The device includes a selector, selectable by a user, for causing fixed amount of video information to be stored in a loop for an indefinite period of time. The selector, or another similar selector, selectable by a user, allows for stopping recording of the loop and for continuing recording of video information. The recorded loop is appended to the beginning of the subsequently recorded video information. This aspect of the invention may be provided in combination with other aspects and embodiments of the invention.
In embodiments of the foregoing aspects of the invention, a video camera in the housing provides as an output the motion video signal.
The invention also applies to recording and/or editing of audio information. In one embodiment of the invention, video and/or audio data is processed as a stream of digital information the storage medium and various inputs and outputs. This processing uses a form of demand-based flow control to move data between a pixel bus and the storage medium.
In further embodiments of the invention, a user interface is provided which includes a display and associated input buttons. The editing system is responsive to operations of the input buttons to perform functions having corresponding displayed indications on the display.
In further embodiments of the invention, the editing system maintains an event list of events of an edited sequence. The event list may include events related to recorded clips and events related to other sources of video information. These other sources of video information include a video signal received from a camera.
In further embodiments of the invention, the editing system maintains a clip list of recorded clips stored on the means for storing. An outtake list may also be provided along with a means enabling an individual to move indications of clips recorded on the means for storing to the outtake list. The editing system may also maintain attribute information in the clip list allowing ranking of recorded clips. Clips having a given ranking may thus be selected and indications of these clips may be displayed.
In further embodiments of the invention, the editing system includes a graphical user interface that labels frames of a recorded and edited clip using symbols indicative of the status of each frame in an edited event. Alternatively, or in addition, the user interface may include a first user interface for allowing selection of recording operations to be performed and a second user interface for allowing selection of editing operations to be performed.
It should be understood that the invention relates to both the apparatus and devices described herein as well as the processes performed thereby.
In the drawings,
The present invention will be more completely understood through the following detailed description which should be read in conjunction with the attached drawing in which similar reference numbers indicate similar structures.
A general description of the moving picture recording device is first provided in connection with
The output of the video camera is generally an analog video signal. Presently known cameras available from Ikegami have a 79-line bus for the purposes of communicating with a recorder, whereas Sony cameras use a 52-line bus. The recorder provides physical and electrical connections to interface with a standard bus such as the Ikegami, Sony or other bus, so that the motion picture recorder receives the output of the camera as if the recorder were a videocassette recorder. The motion picture recorder also includes, using techniques well known to those skilled in the art, electrical contacts and connections (not shown) to turn the camera on and off, initiate recording, etc.
Having now described a general mechanical structure of an embodiment of the moving picture recorder, the electronic circuitry for processing the moving pictures will now be described. The output of the video camera 22, which is generally an analog signal, is provided to the digitizing electronic circuitry such as shown in
However, to interface a recorder with presently existing analog output video cameras, the digitizer 35 is used. The digitizer may comprise a number of analog to digital (A/D) converters. These converters, well known to those skilled in the art, may accept the output of the analog video camera, and may comprise on A/D converter for each component Y, Cr and Cb signal from the video camera. Analog composite video may also be decoded into digital video data. Digital video may also be processed and synchronization signals may be removed to provide digital video information. A 4:2:2 format is typically used, but 4:1:1 and 4:4:4 formats may also be used. Other color formats may be used such as CMYK, HSI and RGB in 8, 16 or 32 bits formats. However, the Y, Cr, Cb format is preferable for use with the well known Joint Photographer's Expert Group (JPEG) compression standard, which may be used in this moving picture recorder. Other compression standards, well known in the art, such as MPEG, may also be suitable for use in the present invention. The video may also remain uncompressed. However, JPEG compression is useful for editing because it does not rely on differences between adjacent frames or fields, but instead each frame or fields is self-contained. Digitizing and compression/decompression circuitry is described in U.S Pat. Nos. 5,355,450, 5,045,940 and published Patent Cooperation Treaty (PCT) applications WO93/12481 and WO93/12613.
Audio signals are also processed and recorded. The audio signal is digitized from a microphone. Digitization is unnecessary if a digital audio source is used. Audio is generally not compressed.
One difference between the systems described in the above patents and published applications and one embodiment of the present invention is that this embodiment of the present invention does not require a frame grabber or frame buffer. The frame buffer is eliminated to reduce power consumption, which is desirable with a portable, battery-powered system. Its removal is possible by using a high throughput compression circuit such as the ZR36050 and ZR36015 JPEG compression circuits, available from Zoran of Santa Clara, Calif. These circuits provide full 60 field per second uncompressed data rates for 720×480 digital still images, which provides CCIR601 compliant broadcast quality images. Due to the high throughput compression circuit, the compression circuitry of this embodiment does not require any stalling or metering mechanism for delaying processing of data through this pipeline. Other circuits are available for JPEG compression, such as from LSI Logic.
In order to maintain correct color of the captured images from the video camera, the signals from the camera may be calibrated to match well known and established SMPTE digital video color standards. In the absence of such calibration, the compression circuitry of one embodiment of the invention, based on the well known and established JPEG compression standard, may create errors because JPEG compression relies on frequencies derived from the colors present in the signal. Calibration is done automatically in response to actuation of a calibration selection switch 33 on the video recorder of
Calibration is performed by causing the camera to generate a reference signal. A commonly-used reference signal is known as “color bars” or “test patterns.” The test pattern for any given camera is in a predetermined format and is typically generated by the camera circuitry in a known manner. Using this format, the overall signal level of the color bar signal is determined by the recorder, and thus the values output by the camera and, by inference, the CCD device are determined. These values are then mapped to the SMPTE standard for digital color representations, of which an indication is stored in the recorder. More precisely, the A/D converters in the digitization process, described below, are adjusted so that the analog level output in the reference signal are translated to the corresponding SMPTE digital value. By creating this mapping in a deterministic way, the camera is thus forced into providing a SMPTE compliant digital video information. It is therefore no longer necessary to record a clip of color bars as is common with video tape. It may, nonetheless, be preferable to store a single frame of color bars digitally in connection with each recorded clip of compressed video.
These components shown in
Management of media files and the disk controller may be performed by any number of known techniques, including that disclosed in U.S. Pat. No. 5,267,351, assigned to Avid Technology and as disclosed in published PCT application WO 93/21636. Data files are in the DOS-compliant file format, such as is available in the Real Time File System (RTFS) from etc bin systems of Groton, Mass. The RTFS file system is DOS compatible/re-entrant. This file system can be supplemented by a media file format known as the Open Media Framework (OMF), defined in the OMF Interchange Specifications available from Avid Technology and available in the OMF Interchange Toolkit, also available from Avid Technology. Management of lists of clips is described in more detail below in connection with the editing aspects of this system.
Also connected to the YUV pixel bus is a JPEG Codec 92. Although the described embodiment uses JPEG compression, this is not necessary and other types of video compression may be used. However, it has been found that, with a commercially-available Codec, full-motion broadcast quality images can be provided. Additionally, because each field is compressed using JPEG independently of other fields in video stream, editing of video is not hindered by the compression algorithm. The JPEG Codec 92 receives input from and outputs to the pixel bus 84. The JPEG Codec is connected to a media data path controller 94. The media data path controller 94 also receives audio information from the audio subsystem as indicated at 96. The audio subsystem is described in more detail below.
Tie media data path controller 94 controls compressed data flow between JPEG Codec 92 and the media data buffer 98. Additionally, it controls compressed data flow between the media data buffer 98 and media storage 100, which is typically a computer readable and writable random access recording medium, such as a magnetic disk or an optical disk. The entire system is controlled by a central processing unit 102. The control of the media data buffer 98 and CPU 102 is described, for example, in U.S. Pat. No. 5,045,940 and others as described above. The central processing unit has a bus 104 which connects it to a system peripheral controller 106 which provides control signals to the entire system. For example, it provides controls to the media data path 94, JPEG Codec 92, disk controllers for disk subsystem 100, the YUV bus logic 82, decoder 80, the genlock decoder 60 and the encoders 86 and 88. It is also connected to a read only memory 104 which is used to store control programs in the operating system for the CPU. A flash ROM 106 is also provided in addition to some volatile memory such as dynamic random access memory as shown in 108. Finally, a serial I/O controller 110 may be used to provide either an ETHERNET or RS-422 connection to other computers or other equipment.
A more detailed block diagram of the circuitry shown in
Digitizing circuitry includes a GENLOCK circuit 104, which processes composite video signals, and a set of analog-to-digital converters 106, associated with a synchronization signal stripping circuit 108, which processes component video signals into a YUV 4:2:2 format digital signal. The composite video signal output by the GENLOCK circuit 104 is provided to a decoder 110, which converts it into a digital component information, similar to that output by the analog-to-digital converters 106. The horizontal synchronization signal (HSYNC), vertical synchronization signal (VSYNC), and the pixel clock (PIX) are used to synchronize the rest of the circuit. The composite signal is provided along a bus 109 to a decoder 110 which translates it into a YUV 4:2:2 digital component signal. The composite signal is also directed to encoder 152.
The component digital signals are applied to a pixel bus 112 which directs them through a switch 114, such as a multiplexer, to a raster block converter 116 and memory 118, which generates picture blocks from the serial pixel data for use and processing according to the JPEG compression standard described above. The memory 118 typically has a size of 32K×16. The transfer of pixel data to the raster block converter 116 bypasses the central processing unit (CPU) 100, i.e., pixel data is not written to the CPU's main memory 105. A JPEG processor 120 interacts with the raster block converter 116 and memory 118 to take a digital still image obtained from the pixel data and compresses it using the JPEG compression standard to provide an output as indicated at 122. The JPEG compression standard may be adaptive to provide improved image quality while maintaining good compression levels in accordance with the teachings of U.S. Pat. No. 5,355,450.
As to audio signals inputted, a microphone or line-in signal indicated at 130 is applied to one or more audio coders and decoders (CODEC) 132 which provide a serial digital output 134. The coders are not necessary if the input signal is digital, such as from a digital microphone, digital audio tape, compact disc or other digital source, or if the output signal is digital. The sampling rate may be any desired rate, but typical rates for audio include 44.1 KHz, 22 KHz and 48 KHz. 8, 16 or 32-bit formats may be used, among other. It should be understood that the invention is not limited to any particular digital audio format. Additionally, they may receive digital input via the bus 136 to convert them to analog output signals at 138. The serial audio data 134 and the compressed video data 122 are applied to a pipeline control circuit 124. The pipeline control circuit 124 is controlled using synchronization control information from a synchronization controller 126 to direct the data into a data buffer 128 typically implemented as a dynamic RAM. A suitable size for this buffer is 2M×32 and it is typically implemented logically as a ring buffer. The pipeline control circuit is implemented in accordance with the teachings of U.S. Pat. No.5,045,940 and PCT publication WO 93/12481. The CPU 100 controls synchronization controller 126, pipeline control circuit 124 and disk controllers 140 to direct the flow of the video and audio data between memory 128 and the disk storage 142. Two disk controllers are used for performing conventional striping. However, one controller may be used to send commands to circuitry on the drive package which may divide an incoming stream or combine an outgoing stream of data in response to commands from a single disk controller 100. Striping may be performed at the word level, or at block or byte levels. The disk controllers and associated bus to the disk may be a standard disk controller, such as IDE or SCSI controllers. It should be understood that the invention is not limited to the type of disk controller.
The pipeline controller provides a form of local synchronization using demand-based flow control of the media data between the encoders and decoders and the computer-readable storage. The movement of data on the pixel bus is through the compressed data buffer and to the storage is intermittent, but has an average flow that is comparable to the continuous, synchronized flow of a video signal. This flow control accommodates for statistical variations in flow due to disk accesses, memory management and other impact on the flow due to the other operating system activities. The flow control ensures that an encoder receives data when the data is needed and that data is read from a decoder without being dropped. An additional benefit of using flow-controlled media data is that no pre-roll time is needed to lock to an incoming source or to lock to an output frequency and phase.
This system may also be provided with the capability of providing an output video signal generated from the digitized video signal. For example, the pixel bus 112 may be connected to an overlay circuit 150. The output of the overlay circuit 150 and the composite signal 109 may be provided to an encoder 152. The output of the encoder may be provided back to the camera which has an input for the view finder 154. Additionally, this signal may be provided to monitor output 156. In one embodiment of the invention, the camera's view finder 154 receives a signal not only from the camera, but also from an alternate source. Using this capability, the moving picture recorder may have a controller 158 and an associated memory 160 which may provide additional status information via the view finder in connection with the video being recorded. Such status information may be an indication of battery level, time codes, time. of day, function performed (e.g., recording or playback), etc. The central processing unit 100 also has associated with it a programmable read-only memory, such as a flash memory 101 in which program information is stored and a dynamic RAM controller 103 and dynamic RAM 105, which are common in the art, for storing volatile data while processing. Typically the memory 101 contains an operating system and other programming code which is kept in non-volatile storage. A suitable size for this memory 101 is 4M. A suitable DRAM size is 4M×16.
In one embodiment, the moving picture recorder has an additional encoder 162 which provides a composite-out video signal with VITC/LTC control information. The input to the encoder may be any one of the pixel bus 112, the output of decoder 110, bypassing pixel bus 112, the output of A/D converters 106, bypassing pixel bus 112 or the output 109 of genlock circuit 104. Alternatively, each of these inputs may be applied to its own separate encoder. The outputs of these encoders may be fed to a simple switch allowing for the selection of one of these outputs. Additionally, an ETHERNET connection 164 may also be provided.
In one embodiment of the invention, two pixels buses 112 may be used. The first bus is the record bus which connects to the outputs of the decoders 110 and 106, and to the inputs of the JPEG compression circuitry via the input side of switch 114 and the encoders 162 and 152. The second bus is the playback bus which connects to the output of the JPEG decompression circuitry, via the output side of switch 114, and the inputs of encoders 162 and 152.
In one embodiment of this invention, the GENLOCK circuit 104 may be a Raytheon 22071 GENLOCK circuit. The decoder 110 may be a Raytheon SAA7151 decoder. The encoders 152 and 162 may also be either a Raytheon or TRW 22191 fill video encoder. The ETHERNET circuit, audio modules and disk controller are available in a variety of forms and are available from a number of suppliers.
In another embodiment, a warning tone generating circuit is provided which is selectively applied to either the program-out or headphone circuitry. Additionally, a speaker on the camera may be connected to play the program-out audio.
Control of the amplifiers and switches is provided by computer programming in a control program on the CPU. This communication is done over what is indicated as a QSPI bus in
Synchronization of the playback of video and audio through the program-out channels will now be described in
Having now described the general structure and operation of the digital moving picture recording device, operations for editing will now be described. As discussed above, recording and editing of clips is managed by a computer program. running on the main processor of the recorder. An editing system may be implemented to perform functions commonly performed by current computerized video editing systems, such as the Avid/1 Media Composer and NewsCutter from Avid Technology of Tewksbury, Mass. These functions are implemented so as to be operative in response to keypad input as described below.
There are three kinds of lists which are used to maintain and manage instances of recorded clips. A user interface is provided (discussed below in connection with
The recorder uses three kinds of lists to maintain proper overall organization of recording and sequencing activities. In particular, it maintains what is called herein a “clip list” which indicates currently available and active recorded clips. A clip list is provided for a currently active bin. There may be a plurality of bins stored in the system, and thus a clip list is maintained for each bin. Any clip may be moved from and to the different bins. Another list, called herein an “outtake list,” is a list of clips which the videographer has indicated as rejectable. Clips in this list are moved to it from the clip list by the videographer in a manner described below. The clip list and outtake list thus include the available clips or outtakes and are automatically organized in ascending clip order. That is, each clip as it is recorded is assigned a number. This number is incremented for each recorded clip. It is assigned to the clip regardless of weather the clip remains in the clip list or in the outtake list.
A third list, called herein a “sequence play list,” is a programmable list of events. An event may hold information for playing a clip, or an event may control a switch to a specific video source. This programmable list is played back to the program video output. The sources available for events in the sequence play list are the camera, external video, black, or a test signal, as well as clips recorded on the disk. The disk source is automatically selected whenever a clip is playing. Thus, the sequence play list also includes live or recorded video and audio clip tracks. Audio track assignments may be individually selected for each event and include left, right or both line audio output channels.
A sample clip list is found in Table I below. In this clip list, mark in and mark out points are indicated by underlined time codes. The start and end time codes for each clip is also provided as well as its length. In this example, some clips have been deleted to the outtake bin (illustrated in Table II).
A sample sequence play list is shown in Table III. Each event is assigned a number, and indicates a source as well as tracks which are controlled by it. If there are attributes (textual or numerical) assigned to clips, these are also indicated in a name/data field. In the source field, the use of a number indicates a clip in an available bin. A duration of a clip is also indicated. The tracks indicate one video channel and five audio channels. The first character thus indicates either a test signal, such as may be read from disk, black, or camera, there is also the possibility to provide an external video signal which could be signified by an “X”. The second field may indicate a microphone input to be directed to the output. Finally, the last four fields indicate which audio track should be used. It is possible, for example, to use the audio track from one clip and the video from another as indicated in event 5 is this play list.
Time displays in this system are based on standard SMPTE time code, which can be used in any of the typical SMPTE modes. Values can be preset. Use of a time display in this form permits logging by the videographer for later reference as part of a typical journal of production notes. This time location can also be used in a character overlay to display the time location of a current freeze frame, for example. During recording, a running time value may be shown.
A clip is the result of any one cycle of recording and may include video information, audio information, or both. The frame is digitized and stored between the time when record mode (digitizing) begins and ends as a clip. When recording stops, each clip automatically receives a unique identifying number. The clip counter is advanced by one every time a new clip is recorded. Like the time values, the clip counter may be preset to a desired value for recording. Clip numbers may be used for navigating and locating a clip. Also, a current clip value may be displayed along with time value on a monitor output character overlay. Clips may also be assigned a mark in and mark out points using the editing features described below.
An event contains mark in and mark out locations and track playback assignments for a clip. An event may also control the program out to select any source, such as the camera, external video, black, or test. By allowing the clips to be assigned or inserted into any event, this feature supports split “L” cuts, narration. of music to pictures, etc. Events may be navigated, reviewed and trimmed in the same manner as clips, using the editing features described in more detail below.
The user interface for the system will now be described in connection with
Referring now to
The functions provided by these buttons will now be described in more detail.
In this embodiment of the invention there arc two primary display pages which provide the basis of routine operations. One of these pages is selected by the user as a home page. Depressing of the “clear” key returns the system to the home page after other operations have been completed. A third page is accessible from either of these two pages to provide access for a system set-up tasks, adjustments, and diagnostic functions.
One of the primary display pages, a recorder display, is illustrated in
The table of assignments of these pairs to timeline locators are shown in Table V.
Examples of how each frame in a timeline is defined by these two characters is provided by the examples of Table VI,. wherein each frame is defined by 2 characters in the timeline.
Example D indicates a clip right after recording, with no marks.
In the sequencer mode, the display is such as shown in
The clip mode will now be described, which is entered by pressing the F2 function key in the sequencing mode. This mode may the default mode for the sequencer and recorder. The clip mode may be generally asserted after a TIMEOUT period, after recording after editing events or after depression of the clear key.
The upper portion of the display in the sequencer mode in
Basic sequence building functions are available on the right hand side of the display, namely DELETE and INSERT which are operated respectively by the F7 and F8 function keys. By pressing either the F1 or F2 function keys, numeric input is received to bring the system to a current location which then may be acted upon using either DELETE or INSERT, or other keys such as described in more detail below.
The command line 240 (line 4) is at the base of this area just below the clip display. The command line displays the current state or mode of operation, i.e., either time, clip, outtake, event or sequence. GOTO and play controls, provided by the F5 function key respond to the displayed command line mode and its numeric field value.
In the clip mode, the command line displays an indication of a clip, its duration and recorded tracks. In the event mode, the command line displays the event and its associated clips in similar fashion. Because navigation and sequencing activities typically involve managing the relationships between clips and events, the command line is situated between the current clip display and the event window. When first selecting or defaulting to the clip mode, the command line and the clip display agree. When first selecting the event mode, the lower of the two events displayed in the event window and the command line agree.
When selected, the time, page, and outtake modes also appear on a command line in the same manner. Thus, the command line provides an indication of the current mode and manages numeric input field for navigation. Together, the command line and the numeric field input work together to provide a system that offers straightforward operating simplicity and speed of a common calculator. As each transaction progresses, some function key captions are updated. This provides an appropriate controlled universe of choices. Appropriate functions and operators are presented as needed. This limited interface technique simplifies the overall screen presentation.
In the center of the sequencer display is the event display area between the F3 and F9 function keys. The event display is a scrolling window that shows two events in the sequence play list. Whenever this system is placed in the event mode by depressing the function key F3, the lower event (indicated by a “>”), moves up to also be displayed on the command line. Tracks may be accessed for assignment via depression of the F9 function key. The track assignment for the next event is shown on the lower event line. The insert and delete functions assigned to function keys F7 and F8 apply to the lower of the displayed events.
The lowest portion of the sequencer display is used for other maintenance and recording activities. Thus, recording can be done from the sequencer display rather than the recorder display. Additional menu pages may also be directly invoked as provided.
The functions performed by the dedicated keys as well as the programmable function keys associated with the display area will now be described in more detail.
The dedicated key controls as shown in
The “CAM” key switches the camera to the program output. Preset microphones are set to the audio program output. When a disk is in playback mode, depressing this key. pauses disk motion from any clip, outtake or event on and switches the camera to program output. When this key is depressed along with the “PLAY” key, recording of the camera is invoked. When this key is depressed with the “PAUSE” key, the camera is switched to the monitor output and preset microphones are set to the audio monitor output. The time and clip displays are switched to the record counter. When in the event mode, and not on line, the camera may be selected for insertion to any event, for a given time duration or an open-ended defaulted duration as described in more detail below.
The “DISK” key switches the disk to the program output. When in the clip mode, recorded clips are played back. In the event mode, the sequence list is played back. In the outtake mode, the outtakes are played back.
The “EXT” key is identical in function to the “CAM” key except that it selects external video rather than camera as the source for either program output, monitor output or recording or insertion as an event.
Similarly, the “BLACK” button operates similar to the “EXT” and the “CAM” buttons, however, it provides a black image to either program output or the monitor output. Generally, black is not recorded.
The “TEST” button is similar in operation to the “BLACK” button. However, it recalls a color bar pattern from memory and switches this along with a test tone to the audio program and monitor outputs. When depressed with the “PLAY” button, the host camera is switched to the monitor output, and a color bar calibration sequence is invoked. This color bar pattern is stored in memory. When depressed with the “PAUSE” button, the test signal freeze frame is switched to the monitor output and the test tone is switched to the audio monitor output. Its operation is otherwise similar to the “BLACK” button in the event mode.
The “PGM” button turns the program output encoder on and off. The program output encoder is automatically switched on by entering the sequencer mode. The program output encoder defaults to black when it is on.
The “READY” button cycles the disk media up or down. This is forced by invoking the sequence mode as well. When the disk is cycled up, the disk is caused to spin, and the sequence, clip and outtake lists are retrieved from the disk. Also, the last positions of the disk are also recalled, along with the last sequence play list that was used, and the last event in that sequence play list. Mode displays are updated, along with a command line and the ready indication is set to be “ON”. On cycle down, the ready indicator is set to “OFF”. Clip, outtakes and sequence play lists are stored on the disk drive along with the last clip and outtake positions, the last sequence play list, and the last even position of the sequence play list. The disk drive is then spun down, and a “NOT READY” message is posted.on the command line. The “READY” button may be invoked with the “PAUSE” button which matches the ready to off, and operates to eject the disk drive pack. The message “EJECTED” is posted on the command line.
The “PLAY” key switches the disk as the video source to the monitor output and the audio tracks to the monitor audio output. A play command is then initiated for any current sequence event, clip or outtake. If the disk drive is not ready, it invokes the ready initiation sequence. Any current clip, outtake or event is displayed in the command line, which is updated at boundary crossings (transitions). The time display is updated in seconds. Frame and timeline marks are omitted from the display during playback.
The “PAUSE” key is available in numerous modes. From the play mode, motion of clips, outtakes or events is frozen and a freeze of the last frame played is maintained on the monitor output or program output. This system updates the time display at this point in time. From the record mode, recording is paused, however displaying of a previously selected end-to-end input signal is continued. With either of the “CAM”, “EXT”, or “TEST” buttons, the end-to-end signal is switched to the monitor output only and the time and clip displays are switched to the record counter. When “PAUSE” is depressed with “DISK”, the disk is switched to the monitor output only and the current freeze frame is displayed. Time and clip displays are switched to the current position.
The scan left and scan right buttons, indicated by “<<<” and “>>>” are available in the play and pause modes. In the play mode, a scan button operates as latching only and speeds up motion to about three times normal. This scan mode is stopped by pushing the “PLAY” button. From the pause mode, this button operates as latching only and initiates five times normal play speed. By depressing this key several times, the motion can be increased even more. By pressing the opposite direction scan button, the speed can be reduced.
The “MIC>” key, when depressed, performs a binary operation, which turns preset microphones on or off to the program output. It operates with the tracks function in the event mode which is described in more detail below.
The audio input level controls 214 regulate the input gain and level to the four disk tracks. Similarly, audio playback level controls 212 regulate the playback gain and level of the four disk tracks.
The “RETRO/LOOP” key 222 sets the system input to the camera and starts a function called “LOOP/RECORD”. The system is set to the clip mode and optionally switches the LCD display to the recorder page. The camera is switched to program and monitor outputs and audio program and monitor outputs are switched to preset microphones. Once in this mode, a standard record may be invoked by normal operations. The “LOOP/RECORD” function stores a loop of video information, for example, a few seconds to a couple of minutes worth, in a memory loop such as a ring-like buffer. This buffer may be in memory or in the disk. When other recording is invoked, the data in the loop is appended to the beginning of the next contiguous recorded clip.
The number keys 0-9, indicated at 204, are simply keypad inputs to displays encountered which are entered via the command line field. These numerical keys are used to provide numeric input presets for other functions, such as for the GOTO function or “set counter” functions, described below. The sign key, “+/−”, has three states of operation, plus, minus, and off. It may be invoked before or after a numeric entry and places a plus or a minus sign trailing the command line numeric field. This may then be used to apply the numeric field as a value relative to the current location. For example, a numeric field input can be added or subtracted to the current location value for any time, clip, outtake or event and a GOTO operation can be performed using the results and value.
The “CLEAR” key provides similar functionality of an undo key. For example, in response to this key, the system deletes an entry in an active numeric field, or returns to the sequencer or recorder home page. When at the sequencer page, the system deletes an entry from the command line numeric field, puts the command line in clip mode, or set the clip display to the last recorded clip. When at the recorder page, the clear key sets the clip display to the last recorded clip, invokes GOTO to the last clip freeze frame and updates the clip time display line.
The “FRAME” keys, denoted as “<” and “>”, step a display frame back or ahead by one. This is only used for playing a track for each frame to the monitor only. It may also be used in combination with the “SHIFT” key to step ahead or back by 10 frames, for example. It may also be depressed in combination with an IN or OUT key, as described below, to operate a TRIM function on a clip, by moving Mark IN and Mark OUT markers by one frame to the left or to the right (or forward or backward in time). In the clip mode, a clip is altered using the trim function. In event mode, the event is altered using the trim function.
The “PRIOR” key is used to navigate a list such as a clip list, outtake list or a sequence play list. For example, the command line numeric field. is decremented by 1 and a GOTO command is invoked to the mark in point or first frame of the clip and a clip bin play list. A similar operation is performed for the outtake list. In the event mode, the GOTO function is not automatically invoked.
The “NEXT” key has similar operation to the “PRIOR” key except that it goes to the next position in the list rather than the previous position in the list.
The “SHIFT” key has been already been described in a couple of instances above.
It may be used in combination with other of the adaptive key functions to be described below. Additionally, the combination of the shift, clear and play keys can be used to reboot the machine.
The “IN” key operates within the active clip, outtake, or event list. When in this mode, for a given clip, outtake or event, the system is updated and moved to the frame previously marked as in the current clip. If no frame is marked, no GOTO operation is performed, and a message is displayed for a brief period of time to the user that there is no mark in the current clip. When this key is used in combination with the SHIFT key, it sets a Mark in point in either the clip or the event. in outtake mode, no marks are made.
The “OUT” key operates similarly to the IN key, but moves to any Mark OUT position in a clip. The SHIFT key when used in combination with this key forms a Mark OUT point.
Finally, the toggle switches provided at 224 include a viewfinder tri-state toggle switch “Finder”. When set at “DISK”, the monitor OUT is also output to the viewfinder. When in “AUTO”, a switch table is used to control the viewfinder. That is, a number of variety of switching arrangements are provided such that when they are entered into using other editing operations, that switch table controls the viewfinder. When in “CAM” state, the camera is directed to the viewfinder.
The control panel switch “Panel” enables local control of the system via the user interface such as disclosed in
A “LIGHT” switch allows power to an external light to be on, off, or automatically turned on or off with the record mode.
Finally, a “POWER” button is provided at 220. This provides power control to the system and the camera. It follows the camera's power switch setting when set in AUTO mode, which is useful for routine record mode. When it is set to “ON” the system is set to ON, independently of the camera's power switch setting. This is useful for sequence playback with no live camera event, to avoid providing power to the camera. When set to “OFF” the system is set to be off, independent of the camera's power switch setting.
Having now described the multiple dedicated buttons on the display, the adaptive key operations and conventions will now be described.
When the recorder page is displayed, such as shown in
The F9 function key sets the system to the sequencer as the home page. The F10 function key is set to display a list of systems set up chapters which may be scrolled with the PRIOR and NEXT keys. These pages of menus of yet additional pages can be provided as desired and provide merely text navigation.
The F11 function key provides information on other keys and modes. When pushed, this button causes “????” to appear in place of the word HELP, and allows a user to push a key for which help information can be provided as a text message.
The F12 function key invokes the outtake mode and playlist. The highest number of the outtakes appears on the command line. At this point, the F6 function key operates as a restore function. The keystroke SHIFT F12 (outtake) keeps the recorder page in clip mode. The current clip is removed from the clip list and is relocated into the outtake play list. The clip display number then decrements by 1 and the command line is updated. in the outtake mode, the F6 function operates as a restore key as mentioned above. It replaces “attributes” and the “set counter” functions. It takes a current outtake from the outtake play list and restores it into the clip in play list. Clip displays are updated to the restored clip. The command resets to the clip mode and updates.
Turning now to the sequencer page, and
The F5 key may also may act as a GOTO function which may be invoked when a caution is displayed, for example on the command line. Otherwise, the F5 key operates a PLAY/PAUSE operation which starts and stops clip or event motion at normal speed.
The F6 function key is set to invoke attribute operations as discussed above when in the recorder mode. For example, it may be used mark locators during recording, for grading clip merit after recording, etc. Whenever the numeric field is changed at the command line, the F6 function key changes its function to the SET COUNTER function. This is only available in time and clip modes, but not event the mode. When invoked, if the clip or time exists, this key performs a GOTO function. Otherwise, the current frame is unfrozen and the monitor output is switched to the camera input. The timer clip counter is set a new value and the timer clip display is updated. The next recorder clip is assigned the two time clip values from these counters.
in the event modes the alternate function to “attributes” is “sequence”. This function is used to begin playback of the sequence play list. in this mode, if the disk drive is not ready, it is made to be ready and is locked on. A GOTO operation is then performed to bring first event to be current. The program out encoder is set on and to black, if it was off. If the program out encoder is on, the currently selected source is maintained. Functions in the event mode are described in more detail below.
Finally, the F10 function key in the sequencer mode is reserved for accessing lists. The type and formatting of the displayed list is determined by the selected mode. For example, in the page mode, the F10 function key acts as an index and displays a list of system set up chapters as described above. in the time mode, the F10 function key performs a list function which opens and presents a portion of the clip bin, and can display a list of up to ten clips which can be scrolled using the PRIOR and NEXT keys. The same operation is provided when the recorder is in the clip mode. in the outtake mode, the function is similar, but presents a portion of the outtake bin. Finally, in the event mode the operation is similar but opens and presents a portion of the sequence play list. Thus, to see the sequence of events in the sequence play list, from the sequencer page, one would simply press F3 event, F10 list.
Given the foregoing definitions of the keys of the user interface, numerous transactions can be provided on the camera by controlling switching and by maintaining clip list and other list data structures for sequences. These transactions will now be described in detail. The set of transactions should be considered exemplary and not limiting.
As a preliminary matter, before a discussion of editing of sequences and clips, a discussion concerning the meaning of a markout frame will now be provided. in traditional time code based editing systems, the markout frame is regarded as exclusive within an edit decision list event. The in frame is played as part of any event in a sequence, but the out frame is not played. Thus, traditional time code based editing systems do not include the outgoing frame in the online assembly of an edit decision list. Thus, the markout frame is treated as the first frame following the desired event duration. An ambiguity that editors should be aware of with visually based editing systems using outframe exclusion is that the displayed outpoint freeze frame is not part of the assembly sequence. What should be set as the mark out frame in such a system is the frame following the desired final frame for the clip or the event. For many routine editing decisions this visual ambiguity is not significant, but the selection of the outframe is no longer purely instinctive. Editors instinctively tend to select the last frame that they want included in the event. This is a very natural extension of the experience and physical act of cutting film. Video editing systems vary by design. To support the natural experience, the outframe in this system is consistently operated to be inclusive when marking or playing clips are events. The inclusive outframe technique also provides clear expression of the true visual relationship between event boundaries and further simplifies trimming operations.
Some editing conventions for the sequence play list will first be described. The function key F7 is used for the delete function in the clip, outtake and event modes. in a clip and outtake modes, upon depression of the delete key, a warning caption is displayed adjacent to the function key F6. Depression of the F6 key deletes the clip from the clip bin, or the outtake from the outtake bin. The display is decremented by one and the time and clip displays, along the command line, are updated. The F6 attributes caption is restored. Deletion of a clip from the outtake bin deletes it completely and frees up the disk space for storing further clips.
If the delete key is invoked from the event mode, the time and clip displays are updated and a warning message is displayed adjacent the F6 function key. Depressing the F6 function key then deletes the event data from the play list and ripples any contiguous subsequent events up in the list, until any null or black event mounted is attained. The event display position is not incremented, but the event display is updated.
The INSERT command, invoked by the F8 function key, can be invoked from either the clip or event modes. It inserts a clip into an event position if invoked in the clip mode. If evoked in the event mode, it ties a current clip to the current event. It does not normally replace previous event data. Any previous event data is generally rippled to the next event, and any contiguous subsequent events are also rippled through the sequence play list. The event counter is then incremented by one and the event display is updated, and the command line is returned to clip mode.
The first transaction to be described is mounting a disk in the recorder mode.
A similar transaction, as seen from the sequencer page, will now be described in connection with
Once a ready state is achieved such as shown in either of
A transaction for selecting a navigating and operating mode will now be described.
By depressing the F4 function key, the sequencer is switched to page access mode in which INSERT and DELETE functions are still suppressed and the recorder is still available through use of the. F8 function key. The F10 function is then changed to “index”. The time display adjacent to the F2 function key is changed to a page display, e.g., “.1”, as shown in
Depression of the F2 function key switches the sequencer to the clip operating mode, which is the default mode for the sequencer. The tracks display shows the recorded tracks of a clip above the F9 function key command and shows the tracks of an event below the F9 function key command as shown in
Depression of the F3 function key places a sequencer in event mode, such as shown in
The F9 function key, when depressed in either of the time, page, clip or event modes, sets the sequencer to the clip mode tracks manager, as shown in
In the tracks manager, the F6 function key sets a playback track for operations. The desired playback clip is currently displayed. Selecting any one track for play locks it out from recording. No original playback clip information is replaced. New clips are created using the record counter values, which inherit marks and timing from the playback clip. This allows them to be easily synchronized later. When a track is selected for play, such as track 2 as indicated adjacent to the F10 key, the status is indicated as “play”.
The sequencer set to the event mode tracks manager is shown in
The process of finding and playing a clip will now be described. in the sequencer page, when the clip key is depressed, the display is such as shown in
Finding and playing an event is similar to finding and playing an outtake or a clip. First, a user depresses the event key, and the event display is presented. The desired event number is then input in a command line. Depressing the F5 key causes a GOTO function, jumping to the event. Depressing the PLAY key starts playback of the event. The event display is shown in
Inserting a clip into an event is similar to finding and playing back an event, but rather than pressing PLAY to play back, the EVENT key (function key F3) is depressed and the event display is presented. At this point in time, depressing the INSERT key (function key F3) places the selected clip into the event. Depressing of the EVENT key can also occur after the user has pressed the PLAY key after finding the clip to be inserted. When switched to event mode from clip mode after selection of a clip, the display appears like
Selecting tracks before an insert will now be described. Once in the event mode, such as shown in
Automatic sequential clip inserts into events can also be made. This provides a shorthand method to rapidly build a sequence because clips need not be marked or trimmed in advance, and events may be trimmed after a sequence playlist is built. Additionally tracks may be set after a sequence playlist is built. Beginning in the clip mode as described above, in connection with finding a clip, the GOTO function need not be performed. Rather, the INSERT key may be simply depressed. The event display is simply updated and incremented by 1 and the command line remains in the clip mode. Thus, a user can input a number and hit the INSERT key followed by another number and then the INSERT key etc. Thus, a sequence can be rapidly built.
Deletion of an event is similar to finding and playing back an event. However, instead of depressing the PLAY key, the DELETE key is depressed instead. After pressing the DELETE key, the display updates to what is shown in
Finding and trimming a transition or event will now be described. Generally, the same steps are followed so as to identify the event, including depressing the event key, numerical keys, and the GOTO key. At this stage, the user can depress the IN key and hold it down. The frame trim keys are then depressed a number of times to move the mark in point as desired. The user can watch the display area and monitor the frame status as provided by the two symbol indication near the top center of the display. Holding down the OUT key likewise with each depression of the frame key moves the mark out event. Playing a sequence play list to program out will now be described. The EVENT key is depressed to present the event display and enter the event mode. A desired event number may optionally be depressed at that point as well. At this point in time, rather than depressing the GOTO key, the user may depress the function key F6 associated with the unction “sequence”. The command line displays “sequence=event 3”. The system automatically preloads event 3 and sets the program out encoder to ON. Depressing either the camera trigger or the play key starts playback of the sequence playlist. in accordance with the media data controller described above, while event is being played back, another is being preloaded into memory.
The transaction of adding a second clip or track to an existing event, such as a second audio track, will now be described. This is similar to finding the desired new clip from the clip list and then entering the event mode, through the key sequence of commands CLIP, NUMBER, GOTO and EVENT. Once in the event mode, the “prior” key can be selected to identify a previous existing event. At this point in time, the command line is updated to indicate the current event and the currently selected clip. The event window indicates the currently selected event and the event which is stored therein. Depressing the TRACKS key at this point in time opens the track manager display. The track manager display adjacent to the F5 and F6 function keys indicates the first clip, the new clip, and an indication of the tracks used in the second clip. Depression of the F6 key selects the second clip as the candidate clip as a second source. This clip does not replace the first clip. It also does not ripple events on insert. The command line then updates to show both candidate clips and tracks displays to show tracks for the second clip such as shown in
A final exemplary transaction involves playing forward to mark the next transition in a sequence. After insertion of a second clip in an event, depressing the F3 function key returns to the event mode. Depressing the GOTO key presets the pair of clips. It is then possible to play or scan forward to the desired mark out point. The frame keys can be used to find a Mark out frame, for example. After selection of the mark out frame, the tracks manager may then be opened by depressing the F9 function key. When the track manager opens, it is preset to the first clip tracks. Depressing the SHIFT F6 function key switches to the second clip tracks. Depressing the F4 function key matches marks to complete the event. The “match marks” operation matches the out marks for both of the clips and then the in marks for both of the clips, and removes any old mark outs. The event display is then incremented by 1. The system then returns to the clip mode and the transaction is complete.
It should be understood that the foregoing transactions are merely exemplary of the multitude of functions that this non-linear recording method and technology can provide. These functions are designed to provide a simple interface for high-speed field editing on recording location without any mouse or other graphical user interface. A videographer can perform editing functions at any time, without the need for transmission to an editing studio. This provides an interaction between the videography and editing steps in video production.
Other functionality may also be provided in such a device. For example, given the ability to provide attributes, searching of these attributes, searching of these attribute fields may provide an easy way to quickly identify a variety of clips. For example, if an attribute is a numeric value, such as a grating value of a clip on a scale of 1 to 10, clips having a value above a given threshold can be retrieved for selection and editing purposes.
Having now described a few embodiments of the invention, it should be apparent to those skilled in the art that the foregoing is merely illustrative and not limiting, having been presented by way of example only. Numerous modifications and other embodiments are within the scope of one of ordinary skill in the art and are contemplated as falling within the scope of the invention as defined by the appended claims.
This Application is a divisional application of: U.S. patent application Ser. No. 09/898,878, filed Jul. 3, 2001, pending, which is a divisional of: U.S. patent application Ser. No. 08/932,994, filed Sep. 18, 1997, abandoned, which is a continuation of: U.S. patent application Ser. No. 08/606,050, filed Feb. 23, 1996, abandoned, which is a continuation of: U.S. patent application Ser. No. 08/418,948, filed Apr. 7, 1995, abandoned; all of which are hereby incorporated by reference.
| Number | Date | Country | |
|---|---|---|---|
| Parent | 09898878 | Jul 2001 | US |
| Child | 10897506 | Jul 2004 | US |
| Parent | 08932994 | Sep 1997 | US |
| Child | 09898878 | Jul 2001 | US |
| Number | Date | Country | |
|---|---|---|---|
| Parent | 08606050 | Feb 1996 | US |
| Child | 08932994 | Sep 1997 | US |
| Parent | 08418948 | Apr 1995 | US |
| Child | 08606050 | Feb 1996 | US |
