Patent Application
20120174010
The disclosure generally relates to graphical user interfaces and digital video editing.
Video editing applications allow users to create, manipulate and aggregate video data. Vendors of video editing applications often seek to provide a user interface that makes video editing applications easy to use. Often vendors attempt to provide an interface with a look and feel that a user may enjoy.
Media content flocking is disclosed. According to implementations, a method can include displaying a first sequence of objects on a display of a computing device, receiving a selection of at least two non-adjacent objects from the first sequence, and animating the at least two non-adjacent objects to move along respective paths from the display of the first sequence to a current location of a cursor on the display. The objects in the first sequence can be video clips or other types of media, such as presentation slides, audio clips or any other media that can be manipulated in a timeline.
According to implementations, the method can include displaying a preview sequence of the at least two non-adjacent objects at the current location of a cursor. Some implementations provide that while moving the cursor on the display, the preview sequence is moved proximate to the cursor. The at least two non-adjacent objects can be displayed in the preview sequence contiguously and in the same relative order as they were displayed in the first sequence.
According to implementations, the method can include receiving input indicating a position in the first sequence; moving the at least two non-adjacent objects to the position in the first sequence to change the order of the objects in the first sequence; and displaying the changed first sequence of objects.
According to an implementation, the method can include receiving input that causes displaying the cursor and the preview sequence hovering over a position in the first sequence, and responsive to the input, displaying an empty space at the position in the first sequence, the empty space having a width that corresponds to a length of the preview sequence.
According to implementations, the method can include performing a drag operation that causes two or more images corresponding to the at least two non-adjacent objects in the first sequence to move from the display of the first sequence to the current location of the cursor on the display. The method can include performing a drag-and-drop operation that causes two or more images corresponding to the at least two non-adjacent objects displayed at the current location of the cursor to move from the current location of the cursor to an indicated location in the first sequence. The drag and drop operation can cause the at least two non-adjacent objects to move from their previous locations in the first sequence to adjacent positions at the indicated location in the first sequence. The drag-and-drop operation can be used to generate a reordered first sequence.
A system and computer-readable storage medium for performing the method above are also disclosed.
Details of one or more implementations are set forth in the accompanying drawings and the description below. Other features, aspects, and potential advantages will be apparent from the description and drawings, and from the claims.
Like reference symbols in the various drawings indicate like elements.
According to implementations, the video editing application may be configured so that video clips may be added to timeline 218 by performing a drag and drop operation on a video clip. For example, a video clip outside of display environment 100 (e.g., external to the video editing application) may be selected by a user, dragged to a location in timeline 218, and dropped at the location into the sequence of video clips 204-216. If no video clips exist in the timeline, the external video clip is added to timeline 218. Video clips already in timeline 218 may be rearranged or removed through drag and drop operations. For example, a user may select a clip in timeline 218 and drag it to a different location in timeline 218 to modify the sequence of video clips 204-216. To remove video clips from timeline 218, the user may select one or more video clips and delete the selected video clips via a menu item (such as a delete menu item in a pull-down menu) or a keyboard key (such as a delete or backspace key).
A video clip preview may be presented to a user to provide a contextual preview of the selected video clips. For example, clip 206 and clip 210 may be displayed in preview 400 as a contiguous sequence of video clips. Clip 206 and clip 210 may be positioned in preview 400 in the same relative order in which they were positioned in timeline 218. The video clip preview 400 may be moved about display environment 100 using cursor 300. For example, a user may move cursor 300 around display environment 100 and the video clip preview 400 may move proximate to cursor 300 such that cursor 300 and the video clip preview 400 appear to move together.
In block 604, the video clip sequence is displayed. For example, the video clip sequence may be displayed on a timeline, such as timeline 218 of
In block 606, a selection of video clips is received. For example, a user may select one or more video clips displayed in the timeline. The clips may be adjacent or non-adjacent clips. For example, multiple non-adjacent clips may be selected.
In block 608, the selected clips are flocked to the cursor. Flocking may be initiated by dragging one of the selected clips from the timeline. For example, in
In block 610, a preview sequence of the selected clips is displayed. For example, once the selected clips have flocked to the cursor location, a preview sequence of the selected clips may be displayed. The preview sequence may display images corresponding to the selected clips in the same respective order as they were displayed in the timeline. The preview sequence may be moved around the display as if the sequence was a single clip. For example, a user may use the cursor to move the preview sequence around the display. Allowing the preview sequence to be manipulated in this way may allow drag-and-drop operations to be performed on the video clips in the preview sequence.
The preview sequence of video clips may be held at the cursor until released. For example, a user may select multiple clips from the timeline and click and hold a mouse button down to drag the clips from the timeline. While the user continues to hold the mouse button down, a preview sequence may continue to be displayed at the location of the cursor. If the user releases the mouse button at a location other than the timeline or if the user cancels the preview by pressing a keyboard key (e.g., Esc or Backspace keys), the preview sequence may be released causing the images of the video clips in the preview sequence to return to the timeline without changing the timeline. For example, when a cancel event is received (e.g., the preview is canceled or released) a reverse flocking animation may be performed in which the video clip images in the preview sequence may be shown or animated to move back to their original positions in the timeline from the video clip preview. When the preview sequence is released, the images may be displayed moving back to the timeline from the cursor location along respective paths. Once the images have reached the timeline, the video clip images may occupy empty spaces in the timeline that were created when the video clip images were dragged from the timeline.
In block 612, a location in the sequence of clips in the timeline is received. For example, a user may move the preview sequence of video clips as if the sequence was a single clip to a location in the timeline. The user may hover the preview sequence over the location. For example, a user may hold a mouse button down while dragging the preview sequence to the location in the timeline and hover the preview sequence over the location by continuing to hold the mouse button down while the preview sequence is held over the location. While hovering the preview sequence over the location in the timeline, the video clips in the timeline near the location may move to grow a space in the timeline having a width that corresponds to the total duration of the video clips in the preview sequence, as illustrated by
In block 614, the selected clips are moved to the location in the timeline. For example, the preview sequence (sequence of images of selected clips) may be dragged to a location in the timeline and dropped (mouse button released) into the timeline at the location. When the preview sequence is dropped into the location in the timeline, the images of the selected clips may be inserted at the drop location in the timeline. Dropping the preview sequence into the timeline at the location may cause the sequence of video clips in the timeline to be modified. The modified sequence of video clips in the timeline may be generated by moving the selected video clips from their previous locations in the timeline to a new location in the timeline corresponding to the location in the timeline where the preview sequence was dropped. Thus, the system may generate and display a modified sequence of images in the timeline and generate a modified sequence of video clips 616 that corresponds to the modified sequence of images.
At step 704, a selection of video clips is received. For example, a selection of video clips may be received in the manner disclosed in the description of
At step 706, the selected video clips are flocked to a cursor. For example, the selected video clips may be flocked to the cursor in the manner disclosed in the description of
At step 708, the selected video clips are dragged to a new location in the sequence. For example, the selected video clips may be dragged to a new location in the sequence in the manner disclosed in the description of
At step 710, the selected video clips are moved from their previous locations in the sequence to new locations in the sequence. For example, the selected video clips may be moved in the sequence in the manner disclosed in the description of
Display device 806 can be any known display technology, including but not limited to display devices using Liquid Crystal Display (LCD) or Light Emitting Diode (LED) technology. Processor(s) 802 can use any known processor technology, including but are not limited to graphics processors and multi-core processors. Input device 804 can be any known input device technology, including but not limited to a keyboard (including a virtual keyboard), mouse, track ball, and touch-sensitive pad or display. Bus 812 can be any known internal or external bus technology, including but not limited to ISA, EISA, PCI, PCI Express, NuBus, USB, Serial ATA or FireWire. Computer-readable medium 810 can be any medium that participates in providing instructions to processor(s) 802 for execution, including without limitation, non-volatile storage media (e.g., optical disks, magnetic disks, flash drives, etc.) or volatile media (e.g., SDRAM, ROM, etc.).
Computer-readable medium 810 can include various instructions 814 for implementing an operating system (e.g., Mac OS®, Windows®, Linux). The operating system can be multi-user, multiprocessing, multitasking, multithreading, real-time and the like. The operating system performs basic tasks, including but not limited to: recognizing input from input device 804; sending output to display device 806; keeping track of files and directories on computer-readable medium 810; controlling peripheral devices (e.g., disk drives, printers, etc.) which can be controlled directly or through an I/O controller; and managing traffic on bus 812. Network communications instructions 816 can establish and maintain network connections (e.g., software for implementing communication protocols, such as TCP/IP, HTTP, Ethernet, etc.).
A graphics processing system 818 can include instructions that provide graphics and image processing capabilities. For example, the graphics processing system 818 can implement the video clip flocking processes, as described with reference to
Application(s) 820 can be an image processing application or any other application that uses the video clip flocking processes described in reference to
The described features can be implemented advantageously in one or more computer programs that are executable on a programmable system including at least one programmable processor coupled to receive data and instructions from, and to transmit data and instructions to, a data storage system, at least one input device, and at least one output device. A computer program is a set of instructions that can be used, directly or indirectly, in a computer to perform a certain activity or bring about a certain result. A computer program can be written in any form of programming language (e.g., Objective-C, Java), including compiled or interpreted languages, and it can be deployed in any form, including as a stand-alone program or as a module, component, subroutine, or other unit suitable for use in a computing environment.
Suitable processors for the execution of a program of instructions include, by way of example, both general and special purpose microprocessors, and the sole processor or one of multiple processors or cores, of any kind of computer. Generally, a processor will receive instructions and data from a read-only memory or a random access memory or both. The essential elements of a computer are a processor for executing instructions and one or more memories for storing instructions and data. Generally, a computer will also include, or be operatively coupled to communicate with, one or more mass storage devices for storing data files; such devices include magnetic disks, such as internal hard disks and removable disks; magneto-optical disks; and optical disks. Storage devices suitable for tangibly embodying computer program instructions and data include all forms of non-volatile memory, including by way of example semiconductor memory devices, such as EPROM, EEPROM, and flash memory devices; magnetic disks such as internal hard disks and removable disks; magneto-optical disks; and CD-ROM and DVD-ROM disks. The processor and the memory can be supplemented by, or incorporated in, ASICs (application-specific integrated circuits).
To provide for interaction with a user, the features can be implemented on a computer having a display device such as a CRT (cathode ray tube) or LCD (liquid crystal display) monitor for displaying information to the user and a keyboard and a pointing device such as a mouse or a trackball by which the user can provide input to the computer.
The features can be implemented in a computer system that includes a back-end component, such as a data server, or that includes a middleware component, such as an application server or an Internet server, or that includes a front-end component, such as a client computer having a graphical user interface or an Internet browser, or any combination of them. The components of the system can be connected by any form or medium of digital data communication such as a communication network. Examples of communication networks include, e.g., a LAN, a WAN, and the computers and networks forming the Internet.
The computer system can include clients and servers. A client and server are generally remote from each other and typically interact through a network. The relationship of client and server arises by virtue of computer programs running on the respective computers and having a client-server relationship to each other.
One or more features or steps of the disclosed embodiments can be implemented using an API. An API can define on or more parameters that are passed between a calling application and other software code (e.g., an operating system, library routine, function) that provides a service, that provides data, or that performs an operation or a computation.
The API can be implemented as one or more calls in program code that send or receive one or more parameters through a parameter list or other structure based on a call convention defined in an API specification document. A parameter can be a constant, a key, a data structure, an object, an object class, a variable, a data type, a pointer, an array, a list, or another call. API calls and parameters can be implemented in any programming language. The programming language can define the vocabulary and calling convention that a programmer will employ to access functions supporting the API.
In some implementations, an API call can report to an application the capabilities of a device running the application, such as input capability, output capability, processing capability, power capability, communications capability, etc.
A number of implementations have been described. Nevertheless, it will be understood that various modifications may be made. For example, other steps may be provided, or steps may be eliminated, from the described flows, and other components may be added to, or removed from, the described systems. Accordingly, other implementations are within the scope of the following claims.
