Patent Application
20080256136
A portion of the disclosure of this patent document contains material that is subject to copyright protection. The copyright owner has no objection to the facsimile reproduction by anyone of the patent document or the patent disclosure as it appears in the U.S. Patent and Trademark Office patent file or records, but otherwise reserves all copyright rights whatsoever.
In the course of producing a video, such as a movie, it is common for audio engineers (or sound engineer) to add audio properties (or characteristics) to audio clips (or segments). The audio clips can be part of one or more audio tracks to a video track. This task can be referred to as audio production. It takes a substantial effort to configure various audio properties to an audio clip. Examples of some audio properties include equalization, reverberation, voice matching, room sounds, etc. There are software programs that assist audio engineers with placing and editing audio clips, including configuring audio properties for the video clips. One example of an existing software program for audio editing/production application is “Soundtrack Pro” available from Apple Inc. of Cupertino, Calif. Even so, there can be numerous attributes and configuring attributes for various audio clips can require significant user effort. It is also difficult and time consuming for a user to manually configure different audio clips to have the same or similar attributes. Hence, there is a need to provide improved approaches to establishing attributes for audio clips.
The invention pertains to methods, graphical user interfaces, computer apparatus and computer readable medium for managing attributes for media content. In accordance with one embodiment, a user of a computing device can utilize the methods, graphical user interfaces, computer apparatus, and computer readable medium to copy attributes from one digital media asset to one or more other digital media assets. The digital media assets can be audio, video or graphical.
The invention can be implemented in numerous ways, including as a method, system, device, apparatus (including graphical user interface), or computer readable medium. Several embodiments of the invention are discussed below.
As a method for applying attributes to a digital media asset, one embodiment of the invention can include at least: receiving a first user request to copy a determined set of attributes associated with a first digital media asset; copying the determined set of attributes from the first digital media asset to memory storage in response to the received first user request; receiving a second user request to apply at least one of the attributes within the determined set of attributes to a second digital media asset; and applying the at least one of the attributes within the determined set of attributes stored in the memory storage to the second digital media asset in response to the received second user request.
As a method for applying attributes to a media segment, one embodiment of the invention can include at least: displaying a lift tool for lifting attributes from digital media segments; determining a set of attributes to be lifted; receiving a selection of a source media segment; lifting attributes from the selected source media segment in accordance with the determined set of attributes that are enabled; subsequently displaying a stamp tool; receiving a selection of a destination media segment; and applying the lifted attributes to the destination media segment.
As a computing device, one embodiment of the invention includes at least: an user input device configured to receive user inputs, a memory storage device configured to access store computer program code, and a processing device configured to execute the computer program code stored in the memory storage device. The stored computer program code including at least: computer program code for determining that a user input pertains to a first user request to copy a determined set of attributes associated with a first digital media asset; computer program code for copying the determined set of attributes from the first digital media asset to said memory storage device in response to the first user request; computer program code for receiving a second user request to apply at least one of the attributes within the determined set of attributes to a second digital media asset; and computer program code for applying the at least one of the attributes within the determined set of attributes stored in said memory storage device to the second digital media asset in response to the second user request.
As a graphical user interface for display on a display associated with a computing device, one embodiment of the invention includes at least: a name for a set of audio properties; a listing of each of the audio properties; a disable control for each of the audio properties; and an apply control for initiating application of those of the audio properties that are not disabled to an audio segment.
As a computer readable medium including at least executable computer program code tangibly stored thereon for applying attributes to a digital media asset, one embodiment of the invention includes at least: computer program code for receiving a request to copy a determined set of attributes associated with a first digital media asset; computer program code for copying attributes from the first digital media asset in response to the received request; computer program code for receiving a request to apply at least one of the copied attributes to a second digital media asset; and computer program code for applying the at least one of the copied attributes to the second digital media asset in response to the received request.
As a computer readable storage medium including at least executable computer program code tangibly stored thereon for applying attributes to a digital asset segment, one embodiment of the invention includes at least: computer program code for displaying a first tool for capturing attributes from digital asset segments; computer program code for determining a set of attributes to be captured; computer program code for receiving a selection of a source digital asset segment; computer program code for capturing attributes from the selected source digital asset segment in accordance with the determined set of attributes that are enabled; computer program code for subsequently displaying a second tool; computer program code for receiving a selection of a destination digital asset segment; and computer program code for applying the captured attributes to the destination digital asset segment.
Other aspects and advantages of the invention will become apparent from the following detailed description taken in conjunction with the accompanying drawings which illustrate, by way of example, the principles of the invention.
The invention will be readily understood by the following detailed description in conjunction with the accompanying drawings, wherein like reference numerals designate like structural elements, and in which:
The invention pertains to methods, graphical user interfaces, computer apparatus and computer readable medium for managing attributes (or properties) for media content. In accordance with one embodiment, a user of a computing device can utilize the methods, graphical user interfaces, computer apparatus, and computer readable medium to copy attributes from one digital media asset to one or more other digital media assets. The digital media assets can be audio, video or graphical. The invention is described below with reference to digital audio assets.
According to one embodiment of the invention, attributes can be copied from one audio clip to one or more other audio clips. A particular source audio clip can have inherent attributes as well as attributes provided through user interaction with an audio production application. Still further, the particular source audio clip can have attributes pertaining to analysis results. Regardless of where the attributes arose from, the attributes can be captured in a user-friendly manner and then later applied to one or more other audio clips, thereby enabling a user to easily replicate attributes from one audio clip to other audio clips.
In one embodiment, the invention can be implemented by lift and stamp tools. A lift tool is able to lift attributes from an audio clip. The attributes can pertain to audio characteristics, audio filters and/or metadata pertaining to the audio clip. Once the attributes have been lifted from an existing audio clip, a stamp tool can be utilized to apply such attributes to one or more other audio clips.
According to one embodiment, once attributes are lifted by the lift tool, the attributes can be stored as a template (or preset) such that they are stored and available for subsequent use (such as applying the attributes to various other audio clips). In another embodiment, the lifted attributes can be enabled or disabled with respect to particular attributes. In still another embodiment, the template (or preset) can be named and a thumbnail image can be provided to represent the template (or preset). Multiple templates (or presets) can be saved and subsequently selected and/or edited.
Embodiments of the invention are discussed below with reference to
Subsequently, a stamp tool 108 is utilized to apply the lifted attributes to a destination audio clip 110. In doing so, the stamp tool 108 may perform analysis on the destination audio clip 110, such as when the analysis-type attributes are to be applied. Then, one or more processing operations can be performed on the destination audio clip 110. The processing operations 114 can, in one embodiment, be a function of the analysis data 106 of the source audio clip 104 as well as the analysis data 112 of the destination audio clip 110. In a general sense, by lifting and stamping attributes from one audio clip to another, the destination audio clip 110 is modified so as to sound more like the source audio clip 104. For example, if the attributes associated with the source audio clip 104 apply a significant amount of reverberation such as associated with a stadium environment, the destination audio clip 110 can be processed to introduce a similar degree of reverberation.
Process-type attributes pertain to effects of processing that are obtained from a source audio clip. Some examples of process-type attributes can include: equalization, compression, reverberation, level adjust, etc.
In general, the analysis-type attribute can provide equalization matching, voice matching, level matching or ambience matching for the source audio clip 104. Examples of some analysis-type attributes can include: Equalization Print (analyze equalization properties of the source audio clip), Voice Signature (for voice-matching/voice morphing dialog), Room Tone (analyze clip and generate a room tone buffer), Reverb (analyze reverb characteristics of clip and choose reverb settings to match), Microphone Print (analyze the sound of a microphone), or Level/Volume (analyze the level/volume of an attribute of the source audio clip). Typically, for analysis-type attributes, the source audio clip is analyzed and the results of that analysis (e.g. an equalization curve, a buffer of audio, algorithm specific analysis data, etc.) is stored as the analysis data 106. When an analysis operation is applied to a destination audio clip, it typically involves at least a two-step process. Namely, first, analyzing the destination audio clip to obtain the analysis data 112, then performing some function (f) on the analysis data from the source audio clip and on the analysis data from the destination audio clip to derive the processing operation 114 (e.g., function/operation/sound processing, etc.) to be applied to the destination audio clip.
Besides the process-type attributes and the analysis-type attributes, the attributes (or properties) can also include administrative attributes. The administrative attributes can, for example, include metadata associated with a audio clip or presentation settings which can effect how the audio clip is presented in a timeline, project, or final composition.
In a general sense, in one embodiment, by lifting and stamping attributes from one audio clip to another, a destination audio clip can be modified so as to sound more like a source audio clip. For example, if the attributes associated with the source audio clip apply a significant amount of reverberation such as associated with a stadium environment, the destination audio clip can be processed to introduce a similar degree of reverberation.
The lift attribute process 200 can begin with a decision 202 that determines whether a lift tool has been activated. The lift tool is a graphical user interface that assists a user in utilizing the lift attribute process 200 with respect to one or more audio clips. When the decision 202 determines that the lift tool has not been activated, the attribute lift process 200 awaits activation of the lift tool. Once the decision 202 determines that the lift tool has been activated, a decision 204 can determine whether lifted attributes are to be limited. When the decision 204 determines that such lift attributes are to be limited, certain attributes are disabled 206. For example, a user can select to disable certain of those of the attributes that are able to be lifted. Since some attributes can require processing of the audio clip, it can be advantageous to disable those attributes that are not to be lifted. A user interface control can be used to assist a user with enabling or disabling attributes that are to be lifted.
Following the block 206 as well as directly following the decision 204 when lifted attributes are not being limited, a decision 208 determines whether an audio clip has been selected. Here, the user of the lift tool can select an audio clip from which the attributes are to be lifted. When the decision 208 determines that an audio clip has not been selected, a decision 210 can determine whether the attribute lift process 200 should end. When the decision 210 determines that the lift attribute process 200 should not end, then the lift attribute process 200 returns to repeat the decision 208 and subsequent blocks. When the decision 208 determines that audio clip has been selected, the enabled attributes can be lifted 212 from the selected audio clip. Following the block 212 as well as directly following the decision 210 when the lift attribute process 200 is to end, the lift attribute process 200 can end.
The stamp tool process 300 can begin with a decision 302 that determines whether a stamp tool has been activated. When the decision 302 determines that a stamp tool has not been activated, the stamp tool process 300 can await activation of a stamp tool. Once the decision 302 determines that a stamp tool has been activated, enabled attributes to be stamped can be displayed 304. In addition, a decision 306 determines whether a preset has been selected. Here, the user of the stamp tool can continue with the enabled attributes being displayed 304, or the user can elect to select a previously stored set of attributes known as a preset. When the decision 306 determines that a preset has been selected, the enabled attributes to be stamped are reset 308 based on the select preset. In this regard, the enabled attributes of the selected preset are displayed.
Following the block 308 or directly following the decision 306 when a preset is not selected, a decision 310 determines whether any attributes are disabled. In one embodiment, the stamp tool allows a user to disable any of the attributes associated with the selected preset or those lifted from the source audio clip. When the decision 310 determines that one or more attributes are to be disabled, then one or more of the enabled attributes can be disabled 312.
Following the block 312 or directly following the decision 310 when none of the attributes are being disabled, a decision 314 determines whether an audio clip has been selected. Here, the selection of an audio clip is the selection of a destination for the enabled attributes. Hence, when the decision 314 determines that there is no selected audio clip, a decision 316 determines whether the stamp tool process 300 should end. When the decision 316 determines that the stamp tool process should end then the stamp tool process 300 ends. Alternatively, when the decision 316 determines that the stamp tool process 300 should not end, the stamp tool process 300 returns the repeat the decision 314. Once the decision 314 determines that an audio clip, namely, a destination audio clip, has been selected, the enabled attributes can be applied 318 to the selected audio clip. Following the block 318, the stamp tool process 300 returns to repeat the decision 314 so that additional audio clips can be selected and have the enabled attributes applied. In one implementation, the enabled attributes can be applied to an entire track, clip or file. In another implementation, the enabled attributes can be applied to a portion of a track, clip or file.
The lift and stamp processes discussed above can be facilitated by a graphical user interface. In one embodiment, the graphical user interface can be referred to as a sound palette.
The sound palette dialog 400 can also includes a number of controls that assist the user with various operations. A “Save as Preset” control 410 can allow the user to save the set of attributes enabled in the attribute region 408 as a new preset (or template). A stamp control 412 can enable a user to apply the set of attributes associated with the selected preset to a destination audio clip. A control 414 allows a user to cause the attributes to be applied differently to the destination audio clip. For example, the control 414 can allow the attributes to “added” to those attributes already associated with destination audio clip. Alternatively, the control 414 can allow the attributes to replace those attributes associated with the destination audio clip.
Although the sound palettes discussed above can be used to apply particular attributes to a destination audio clip, in one embodiment a “paint” tool can be used to apply attributes to one or more audio clips in whole or in part as specified by the “paint” tool. Also, in one embodiment, a lift tool can be an eyedropper-like tool that is used to extract (i.e., lift) attributes from an audio clip and provide them to a sound palette.
Further, although the above discussion primarily discusses copying (e.g., lifting) and applying (e.g., stamping) audio effects to from one digital media asset segment to another, the embodiments of the invention can also be used for lifting and applying color properties, video effects or image processing operations.
Additional details on media production are contained in: (i) U.S. patent application Ser. No. 11/735,468, filed Apr. 14, 2007, and entitled “MULTI-TAKE COMPOSITING OF DIGITAL MEDIA ASSETS,” which is hereby incorporated herein by reference; (ii) U.S. Provisional Patent Application No. 60/911,886, filed Apr. 14, 2007, and entitled “MULTIPLE VERSION MERGE FOR MEDIA PRODUCTION,” which is hereby incorporated herein by reference; and (iii) U.S. patent application Ser. No. 11/735,466, filed Apr. 14, 2007, and entitled “MULTI-FRAME VIDEO DISPLAY METHOD AND APPARATUS,” which is hereby incorporated herein by reference.
The various aspects, features, embodiments or implementations of the invention described above can be used alone or in various combinations.
The invention is preferably implemented by software, hardware, or a combination of hardware and software. The invention can also be embodied as computer readable code on a computer readable medium. The computer readable medium is any data storage device that can store data which can thereafter be read by a computer system. Examples of the computer readable medium generally include read-only memory and random-access memory. More specific examples of computer readable medium include Flash memory, EEPROM memory, memory card, CD-ROM, DVD, hard drive, magnetic tape, and optical data storage device. The computer readable medium can also be distributed over network-coupled computer systems so that the computer readable code is stored and executed in a distributed fashion.
The advantages of the invention are numerous. Different aspects, embodiments or implementations may yield one or more of the following advantages. One advantage of the invention is that attributes for media content can be managed. For example, attributes from one digital media asset can be copied and saved and thereafter applied to other digital media assets in an efficient, user-friendly manner. Another advantage of the invention is that attribute sets can be stored as templates or presets so that they can be subsequently recalled and utilized. Still another advantage of the invention is that the attributes can be analysis items that require an analysis of a source digital asset and/or a destination media asset when being applied to the destination media asset.
The many features and advantages of the present invention are apparent from the written description. Further, since numerous modifications and changes will readily occur to those skilled in the art, the invention should not be limited to the exact construction and operation as illustrated and described. Hence, all suitable modifications and equivalents may be resorted to as falling within the scope of the invention.
This application claims priority to U.S. Provisional Patent Application No. 60/911,884, filed Apr. 14, 2007, entitled “TECHNIQUES AND TOOLS FOR MANAGING ATTRIBUTES OF MEDIA CONTENT”, which is hereby incorporated herein by reference.
| Number | Date | Country | |
|---|---|---|---|
| 60911884 | Apr 2007 | US |
