This disclosure relates to presenting different representations of a media sequence.
A user interface for editing a video may provide a timeline view of the video clip(s) being edited. Such a view may make applying effects to the video clip(s) difficult and cumbersome.
This disclosure relates to presenting a media sequence. A sequence of media items may include media items ordered in a sequence. A timeline representation of the sequence of media items may be presented. The timeline representation may include timeline media elements that graphically represent lengths of the media items. A tile representation of the sequence of media items may be presented. The tile representation may include tile media elements that graphically represent content of the media items.
A system that presents a media sequence may include one or more electronic storage, processor, and/or other components. The electronic storage may store information relating to media items, information relating to a sequence of media items, information relating to timeline representations, information relating to tile representations, and/or other information.
The processor(s) may be configured by machine-readable instructions. Executing the machine-readable instructions may cause the processor(s) to facilitate presenting a media sequence. The machine-readable instructions may include one or more computer program components. The computer program components may include one or more of a timeline representation component, a tile representation component, and/or other computer program components.
The timeline representation component may be configured to present a timeline representation of a sequence of media items. The sequence of media items may include media items ordered in a sequence. The timeline representation may include timeline media elements that graphically represent lengths of the media items.
In some implementations, the timeline representation of the sequence of media items may be presented in a user interface for selecting segments of the media items for inclusion in the sequence of media items.
The tile representation component may be configured to present a tile representation of the sequence of media items. The tile representation may include tile media elements that graphically represent content of the media items.
In some implementations, the tile representation of the sequence of media items may include an individual tile media element for an individual video or an individual image in the sequence of media items. In some implementations, the tile representation of the sequence of media items may include an individual tile media element for an individual video segment in the sequence of media items.
In some implementations, the tile representation of the sequence of media items may be presented in a user interface for applying an effect to the sequence of media items. In some implementations, the tile representation of the sequence of media items may be presented in a user interface for changing a playback speed of the media items in the sequence of media items. In some implementations, the tile representation of the sequence of media items may be presented in a user interface for changing an order of the media items in the sequence of media items. In some implementations, the tile representation of the sequence of media items may be presented in a user interface for adding or removing the media items in the sequence of media items.
In some implementations, presentation of the tile representation of the sequence of media items may include a change of the timeline representation of the sequence of media items into the tile representation of the sequence of media items. The change of the timeline representation of the sequence of media items into the tile representation of the sequence of media items may include removal of the timeline representation of the sequence of media items and addition of the tile representation of the sequence of media items.
These and other objects, features, and characteristics of the system and/or method disclosed herein, as well as the methods of operation and functions of the related elements of structure and the combination of parts and economies of manufacture, will become more apparent upon consideration of the following description and the appended claims with reference to the accompanying drawings, all of which form a part of this specification, wherein like reference numerals designate corresponding parts in the various figures. It is to be expressly understood, however, that the drawings are for the purpose of illustration and description only and are not intended as a definition of the limits of the invention. As used in the specification and in the claims, the singular form of “a,” “an,” and “the” include plural referents unless the context clearly dictates otherwise.
The electronic storage 13 may be configured to include electronic storage medium that electronically stores information. The electronic storage 13 may store software algorithms, information determined by the processor 11, information received remotely, and/or other information that enables the system 10 to function properly. For example, the electronic storage 13 may store information relating to media items, information relating to a sequence of media items, information relating to timeline representations, information relating to tile representations, and/or other information.
The processor 11 may be configured to provide information processing capabilities in the system 10. As such, the processor 11 may comprise one or more of a digital processor, an analog processor, a digital circuit designed to process information, a central processing unit, a graphics processing unit, a microcontroller, an analog circuit designed to process information, a state machine, and/or other mechanisms for electronically processing information. The processor 11 may be configured to execute one or more machine-readable instructions 100 to facilitate presenting a media sequence. The machine-readable instructions 100 may include one or more computer program components. The machine-readable instructions 100 may include one or more of a timeline representation component 102, a tile representation component 104, and/or other computer program components.
The timeline representation component 102 may be configured to present a timeline representation of a sequence of media items. A timeline representation of a sequence of media items may be presented on one or more displays. A timeline representation of a sequence of media items may be presented within one or more graphical user interfaces.
A display may refer to an electronic device that provides visual presentation of information. A display may be configured to present visual content, graphical user interface(s), and/or other information. In some implementations, a display may include a touchscreen display. A touchscreen display may be configured to receive user input via a user's engagement with the touchscreen display. A user may engage with the touchscreen display via interaction with one or more touch-sensitive surfaces/screens and/or other components of the touchscreen display. A display may be a standalone device or a component of a computing device, such as a display of a mobile device (e.g., camera, smartphone, smartwatch, tablet, laptop) or a desktop device (e.g., touch monitor). User interaction with elements of the graphical user interface(s) may be received through the display (e.g., touchscreen display) and/or other user interface devices (e.g., keyboard, mouse, trackpad).
A graphical user interface may refer to a user interface that enables a user to interact with the system 10 through one or more interface elements. A graphical user interface may refer to a user interface that enables the system 10 to provide information to a user through one or more interface elements. A graphical user interface may include interface elements. A graphical user interface may be static or dynamic. A graphical user interface may include a static configuration of interface elements and/or include dynamic configurations of interface elements that changes (e.g., with time, based on user interaction with one or more interface elements). Multiple/different interface elements may be presented/included within a graphical user interface at the same time, may be presented/included within a graphical user interface at different times, and/or may be presented/included within a graphical user interface responsive to user interaction with one or more other interface elements and/or other information.
An interface element may refer to a graphical element of the user interface, such as window, icon, button, graphic, and/or other visual indicator. An interface element may visually provide information and/or enable a user to provide inputs to the system 10. For example, an interface element may visually provide information determined by the system 10 and/or a user may interact (e.g., engage, toggle, manipulate) with an interface element to provide one or more input to the system 10. A graphical user interface may facilitate interaction of the user with one or more of the interface elements via the user input received through one or more user interface devices (e.g., touchscreen display, keyboard, mouse, trackpad) and/or other user input. For example, a graphical user interface may present/include the interface elements in a particular arrangement and enable the user to interact with individual interface elements by engaging with locations corresponding to the individual interface elements on a touchscreen display.
A sequence of media items (media sequence) may refer to an arrangement of media items. A sequence of media items may refer to an ordering of media items. A sequence of media items may refer to a particular order in which media items are arranged/follow each other. A sequence of media items may include media items ordered in a sequence. A sequence of media items may include (define) a sequence (a particular arrangement/order) of media items. A sequence of media items may provide a view of the media items included in the sequence. For example, a sequence of media items may refer to an arrangement/order of media items in a media summary. For example, a sequence of media items may be generated to include a particular arrangement of one or more images, one or more videos, and/or other media items for playback. For example, a sequence of media items may refer to a video edit that include one or more images, one or more videos, and/or other media items arranged in a particular sequence. A media item may refer to an item that may be visually and/or audibly consumed. A media item may refer to a multimedia item. For example, a media item may include an image, a video, a sound clip, and/or other media item.
A timeline representation of a sequence of media items may refer to a representation of the sequence of media items that conveys information relating to temporal characteristics of the sequence of media items. A timeline representation of a sequence of media items may visually represent lengths (e.g., durations) of the media items in the sequence of media items. A timeline representation of a sequence of media items may visually represent the total lengths of the media items (e.g., total duration of a video clip) and/or the lengths of the media items as they are to be presented within the sequence of media items (e.g., duration a video clip is to take in a video edit). One or more visual characteristics of the timeline representation may indicate the lengths of the media items.
A timeline representation of a sequence of media items may include and/or be made up of one or more interface elements. For example, a timeline representation may include timeline media elements that graphically represent lengths of the media items in the sequence of media items. A timeline media element may refer to an interface element that visually represent the length of a media item. A timeline media element may provide graphical representation of a length of a media item based on the size of the timeline media element. For example, the length of a timeline media element may represent the length of a media item.
In some implementations, a timeline representation of a sequence of media items may be presented in a user interface for selecting segments of the media items for inclusion in the sequence of media items. A timeline representation of a sequence of media items may be included within a user interface that allows a user to specify which temporal portions of the media items should be included in the sequence of media items. A timeline representation of a sequence of media items may be included within a user interface that allows a user to specify the lengths that media items should occupy in the sequence of media items. For example, a sequence of media items may include a video summary/video edit of one or more images and/or one or more videos. A timeline representation of the video summary/video edit may be included within a user interface that allows a user to specify which temporal portions of the video(s) should be included in the video summary/video edit. A timeline representation of the video summary/video edit may be included within a user interface that allows a user to specify the lengths that the image(s) and/or the video(s) should occupy in the video summary/video edit.
Referring to
The timeline representation 310 may include individual timeline media elements that graphically represent the lengths of the individual media items. Individual timeline media elements (total length timeline media elements) may graphically represent the total lengths of the individual media items. Individual timeline media elements (selected segment timeline media elements) may graphically represent individual segments of the media items that have been selected for inclusion in the sequence of media items. For example, in
The graphical user interface may include one or more interface elements that enable a user to select one or more effects to be applied to the sequence of media items. An effect may refer to a process/tool that changes the sequence of media items. An effect may change which media items are included in the sequence of media items. For example, an effect (media item addition/removal effect) may allow to a media item to be added to or removed from the sequence of media items. An effect may change ordering of media items in the sequence of media items. For example, an effect (media ordering effect) may allow reordering of media items in the sequence of media items. An effect may change one or more visual characteristics of the media items. For example, an effect (visual effect) may change existing visual characteristic(s) of the media items, add new visual characteristic(s) to the media items, and/or remove existing visual characteristic(s) from the media items. An effect may change one or more audio characteristics of the media items. For example, an effect (audio effect) may change existing audio characteristic(s) of the media items, add new audio characteristic(s) to the media items, and/or remove existing audio characteristic(s) from the media items. An effect may change one or more temporal characteristics of the media items. For example, an effect (temporal effect) may change the playback speed of the media items (perceived playback speed of selected segments of the media items) during media sequence playback (e.g., speed up, speed down, reverse speed, freeze frame). Other types of effects are contemplated.
For example, in
The tile representation component 104 may be configured to present a tile representation of the sequence of media items. A tile representation of a sequence of media items may be presented on one or more displays. A tile representation of a sequence of media items may be presented within one or more graphical user interfaces.
A tile representation of a sequence of media items may refer to a representation of the sequence of media items that conveys information on separate media items included in the sequence of media items via separate visual element. A tile representation of a sequence of media items may visually represent individual media items in the sequence of media items using separate visual elements. Rather than providing a continuous representation of the media items, the tile representation may provide discontinuous representations of the media items in the sequence of media items.
A tile representation of a sequence of media items may include and/or be made up of one or more tile media elements. A tile media element may graphically represent content of a media item. For example, the visual appearance of a tile media element may be generated from the visual content of the media item represented by the tile media element. For example, a tile media element may include a thumbnail of the media item. A tile media element may have a tile-shaped shaped (e.g., square shape, rectangular shape, circle shape) element that includes a thumbnail image of the media item. A tile media element may refer to a visual representation of a media item that may be arranged like a tile for display. A tile media element may have one or more sharp corners, one or more rounded corners, and/or other corners.
In some implementations, a tile representation of a sequence of media items may include an individual tile media element for individual media items in the sequence of media items. For example, a tile representation of a sequence of media item may include an individual tile media element for an individual video or an individual image in the sequence of media items. That is, every video/image in the sequence of media items may be represented by a separate tile media element. For example, referring to
In some implementations, a tile representation of a sequence of media items may include an individual tile media element for individual parts of the media items selected for inclusion in the sequence of media items. For example, a tile representation of a sequence of media item may include an individual tile media element for an individual video segment in the sequence of media items. That is, every video segment selected for inclusion in the sequence of media items may be represented by a separate tile media element. For example, referring to
The tile representation of the sequence of media items may make it easier/more intuitive for a user to select media items/parts of media items to which effect(s) are to be applied. Use of the tile representation may make it easy to show which parts have been selected for application of the effect(s).
In some implementations, the tile representation of the sequence of media items may be presented in a user interface for applying one or more effects to the sequence of media items. For example, the tile representation of the sequence of media items may be presented in a user interface for changing a playback speed of the media items in the sequence of media items (e.g., speed up, speed down, reverse speed, freeze frame). The tile representation of the sequence of media items may be presented in a user interface for changing an order of the media items in the sequence of media items. The tile representation of the sequence of media items may be presented in a user interface for adding or removing the media items in the sequence of media items. Presentation of the tile representation for application of other effects are contemplated.
In some implementations, presentation of the tile representation of the sequence of media items may include a change of the timeline representation of the sequence of media items into the tile representation of the sequence of media items. For example, a graphical user interface may change from presenting the timeline representation to presenting the tile representation. The change of the timeline representation of the sequence of media items into the tile representation of the sequence of media items may include removal of the timeline representation of the sequence of media items and addition of the tile representation of the sequence of media items. For example, the timeline representation may be removed from the graphical user interface and the tile representation may be added to the graphical user interface. The change of the timeline representation of the sequence of media items into the tile representation of the sequence of media items may include morphing of the timeline representation of the sequence of media items into the tile representation of the sequence of media items. For example, the timeline representation within the graphical user interface may smoothly change into the tile representation of the sequence of media items.
The representation of the sequence of media items may switch between the timeline representation and the tile representation based on operation being performed on the sequence of media items. For example, the timeline representation may be presented when a user is providing inputs on which segments of the media items are to be selected for inclusion in the media sequence, while the tile representation may be presented when a user is providing inputs on applying effects to the media sequence. For example, such switch in representation may result in the graphical user interface changing between provision of expanded timeline view/scrubber view of the media sequence (timeline representation) and provision of truncated cards to represent the media items (the tile representation). In some implementation, both the timeline representation and the tile representation may be presented at the same time. Such presentation may enable a user to interact with one or both of the representation in modifying the sequence of media items.
Referring to
The graphical user interface may include one or more interface elements that enable a user to select one or more effects to be applied to the sequence of media items. The graphical user interface may include one or more interface elements that enable a user to select one or more characteristics of an effect to be applied to the sequence of media items. For example, in
For example,
Implementations of the disclosure may be made in hardware, firmware, software, or any suitable combination thereof. Aspects of the disclosure may be implemented as instructions stored on a machine-readable medium, which may be read and executed by one or more processors. A machine-readable medium may include any mechanism for storing or transmitting information in a form readable by a machine (e.g., a computing device). For example, a tangible computer-readable storage medium may include read-only memory, random access memory, magnetic disk storage media, optical storage media, flash memory devices, and others, and a machine-readable transmission media may include forms of propagated signals, such as carrier waves, infrared signals, digital signals, and others. Firmware, software, routines, or instructions may be described herein in terms of specific exemplary aspects and implementations of the disclosure, and performing certain actions.
In some implementations, some or all of the functionalities attributed herein to the system 10 may be provided by external resources not included in the system 10. External resources may include hosts/sources of information, computing, and/or processing and/or other providers of information, computing, and/or processing outside of the system 10.
Although the processor 11 and the electronic storage 13 are shown to be connected to the interface 12 in
Although the processor 11 is shown in
It should be appreciated that although computer program components are illustrated in
While computer program components are described herein as being implemented via processor 11 through machine-readable instructions 100, this is merely for ease of reference and is not meant to be limiting. In some implementations, one or more functions of computer program components described herein may be implemented via hardware (e.g., dedicated chip, field-programmable gate array) rather than software. One or more functions of computer program components described herein may be software-implemented, hardware-implemented, or software and hardware-implemented.
The description of the functionality provided by the different computer program components described herein is for illustrative purposes, and is not intended to be limiting, as any of computer program components may provide more or less functionality than is described. For example, one or more of computer program components may be eliminated, and some or all of its functionality may be provided by other computer program components. As another example, processor 11 may be configured to execute one or more additional computer program components that may perform some or all of the functionality attributed to one or more of computer program components described herein.
The electronic storage media of the electronic storage 13 may be provided integrally (i.e., substantially non-removable) with one or more components of the system 10 and/or removable storage that is connectable to one or more components of the system 10 via, for example, a port (e.g., a USB port, a Firewire port, etc.) or a drive (e.g., a disk drive, etc.). The electronic storage 13 may include one or more of optically readable storage media (e.g., optical disks, etc.), magnetically readable storage media (e.g., magnetic tape, magnetic hard drive, floppy drive, etc.), electrical charge-based storage media (e.g., EPROM, EEPROM, RAM, etc.), solid-state storage media (e.g., flash drive, etc.), and/or other electronically readable storage media. The electronic storage 13 may be a separate component within the system 10, or the electronic storage 13 may be provided integrally with one or more other components of the system 10 (e.g., the processor 11). Although the electronic storage 13 is shown in
In some implementations, method 200 may be implemented in one or more processing devices (e.g., a digital processor, an analog processor, a digital circuit designed to process information, a central processing unit, a graphics processing unit, a microcontroller, an analog circuit designed to process information, a state machine, and/or other mechanisms for electronically processing information). The one or more processing devices may include one or more devices executing some or all of the operation of method 200 in response to instructions stored electronically on one or more electronic storage mediums. The one or more processing devices may include one or more devices configured through hardware, firmware, and/or software to be specifically designed for execution of one or more of the operations of method 200.
Referring to
At operation 202, a tile representation of the sequence of media items may be presented. The tile representation may include tile media elements that graphically represent content of the media items. In some implementations, operation 202 may be performed by a processor component the same as or similar to the tile representation component 104 (Shown in
Although the system(s) and/or method(s) of this disclosure have been described in detail for the purpose of illustration based on what is currently considered to be the most practical and preferred implementations, it is to be understood that such detail is solely for that purpose and that the disclosure is not limited to the disclosed implementations, but, on the contrary, is intended to cover modifications and equivalent arrangements that are within the spirit and scope of the appended claims. For example, it is to be understood that the present disclosure contemplates that, to the extent possible, one or more features of any implementation can be combined with one or more features of any other implementation.
Number | Name | Date | Kind |
---|---|---|---|
7805678 | Niles | Sep 2010 | B1 |
7890867 | Margulis | Feb 2011 | B1 |
11169680 | Park | Nov 2021 | B2 |
20100281382 | Meaney | Nov 2010 | A1 |
20120210230 | Matsuda | Aug 2012 | A1 |
20130124996 | Margulis | May 2013 | A1 |
20130195421 | Chen | Aug 2013 | A1 |
20130332836 | Cho | Dec 2013 | A1 |
20140380168 | Wu | Dec 2014 | A1 |
20150346984 | Flint | Dec 2015 | A1 |
20220028427 | Matsuda | Jan 2022 | A1 |
Entry |
---|
Gaggy et al., A_visual_authoring_environment_for_prototyping_multimedia_presentations, 2002, IEEE, 8 pages. |
Fulda et al., TimeLineCurator_lnteractive_Authoring_of_Visual_Timelines_from_Unstructured_Text, 2013, IEEE, 10 pages. |