Patent Application
20160139871
An example embodiment of the present invention relates generally to a user interface configured to associate an audio soundtrack with one or more video clips and, more particularly, to a method and apparatus for permitting user synchronization of an audio soundtrack to one or more video clips.
Video clips are routinely captured and saved for subsequent viewing, sharing or the like. For example, video clips may be captured of special occasions, such as birthdays or other gatherings, of entertainment activities, such as sporting events, concerts or the like, for personal enjoyment or for any of a wide variety of other reasons.
In order to enrich the user experience associated with viewing of the video clips, music or other types of audio soundtracks may be associated with the video clips. Thus, when a video clip is selected for playback, the video may be displayed and the audio soundtrack that has been associated with the video may be concurrently output. Audio soundtracks may be associated with video clips in various manners. For example, the user may select any of various songs to be played while viewing a respective video clip. In this regard, applications are available to suggest songs that a user may consider associating with a video clip in an effort to reduce the effort expended by the user.
However, the simple association of a song with a video clip may not always produce the desired user experience in that the songs that are available to be associated with video clips may not, in their entirety, be consistent with the theme of the video clip. Moreover, applications intended to permit users to select a particular portion of an audio soundtrack to be associated with a video clip in an effort to provide more granular control have generally resulted in the selected portion of the audio soundtrack better matching the theme of the video clip, but have typically required the user to have more substantial audio editing experience or expertise in order to properly select a desired portion of the audio soundtrack and to successfully associate the selected portion with the video clip, thereby potentially limiting the utilization of such applications.
A method, apparatus and computer program product are provided in accordance with an example embodiment in order to facilitate the association of a selected portion of an audio soundtrack with one or more video clips. In this regard, the method, apparatus and computer program product permit the starting point of the audio soundtrack to be defined in an intuitive manner and to be synchronized based upon a predefined feature of the audio soundtrack. As such, the resulting user experience occasioned by the concurrent display of the video clip and the playback of the selected portion of the audio soundtrack may be enhanced.
In an example embodiment, a method is provided that includes causing display of a visual representation of an audio soundtrack. The audio soundtrack is to be associated with one or more video clips to facilitate concurrent playback of at least a portion of the audio soundtrack and one or more video clips. The method of this embodiment receives user input with respect to the audio soundtrack and, in response to the user input, adjusts a starting point of the audio soundtrack relative to the one or more video clips. In this regard, a starting point may be adjusted by defining the starting point of the audio soundtrack based on the user input and also in a manner so as to coincide with a predefined feature of the audio soundtrack.
The method of an example embodiment receives user input by receiving a drag input. In this embodiment, the method adjusts the starting point in a direction indicated by the drag input and defines the starting point to be a predefined time increment of the audio soundtrack that is nearest to a portion of the visual representation of the audio soundtrack that is aligned with a visual indication of a current playback location of the one or more video clips upon termination of the drag input. For example, the predefined time increment may correspond with a beat of the audio soundtrack and, in one embodiment, may be a second or a predefined fraction of a second. The method of this example embodiment may also include causing a predetermined audio output to be provided while receiving the user input with respect to the audio soundtrack.
The visual representation of an audio soundtrack of one embodiment includes a plurality of markers spaced there throughout. In this embodiment, the method receives user input by receiving a flick input. The method of this embodiment also adjusts the starting point to be coincident to the marker that is next in a direction indicated by the flick input. The method of an example embodiment also includes causing display of a frame of a video clip concurrent with the visual representation of the audio soundtrack and during receipt of the user input with respect to the audio soundtrack.
In another example embodiment, an apparatus is provided that includes at least one processor and at least one memory including computer program code with at least one memory and the computer program code configured to, with the processor, cause the apparatus to cause display of a visual representation of an audio soundtrack. The audio soundtrack is to be associated with one or more video clips to facilitate concurrent playback of at least a portion of the audio soundtrack and the one or more video clips. The at least one memory and the computer program code are also configured to, with the processor, cause the apparatus of this embodiment to receive user input with respect to the audio soundtrack and, in response to the user input, to adjust a starting point of the audio soundtrack relative to the one or more video clips. In this regard, the starting point is adjusted by defining the starting point of the audio soundtrack based on the user input and also in a manner so as to coincide with a predefined feature of the audio soundtrack.
The at least one memory and the computer program code are configured to, with the processor, cause the apparatus of an example embodiment to receive user input by receiving a drag input. The at least one memory and the computer program code are configured to, with the processor, cause the apparatus of this embodiment to adjust the starting point by adjusting the starting point in a direction indicated by the drag input and defining the starting point to be a predefined time increment of the audio soundtrack that is nearest to a portion of the visual indication of the audio soundtrack that is aligned with a visual representation of a current playback location of the one or more video clips upon termination of the drag input. The predefined time increment may correspond with a beat of the audio soundtrack and, in one embodiment, may be a second or predefined fraction of second. The at least one memory and the computer program code are further configured to, with the processor, cause the apparatus of this embodiment to cause a predetermined audio output to be provided while receiving the user input with respect to the audio soundtrack.
The visual representation of the audio soundtrack of one embodiment includes a plurality of markers spaced there throughout. The at least one memory and the computer program code are configured to, with the processor, cause the apparatus of this embodiment to receive user input by receiving a flick input. The at least one memory and the computer program code are configured to, with the processor, cause the apparatus of this embodiment to adjust the starting point to be coincident to the marker that is next in a direction indicated by the flick input. The at least one memory and the computer program code are further configured to, with the processor, cause the apparatus to cause display of a frame of a video clip concurrent with the visual representation of the audio soundtrack and during receipt of the user input with respect to the audio soundtrack.
In a further example embodiment, a computer program product is provided that includes at least one non-transitory computer-readable storage medium having computer-executable program code portions stored therein with the computer-executable program code portions including program code instructions configured to cause display of a visual representation of an audio soundtrack. The audio soundtrack is to be associated with one or more video clips to facilitate concurrent playback of at least a portion of the audio soundtrack and the one or more video clips. The computer-executable program code portions of this embodiment also include program code instructions configured to receive user input with respect to the audio soundtrack and program code instructions to, in response to the user input, adjust the starting point of the audio soundtrack relative to the one or more video clips. The program code instructions configured to adjust the starting point include program code instructions configured to define the starting point of the audio soundtrack based on the user input and also in a manner so as to coincide with a predefined feature of the audio soundtrack.
The program code instructions configured to receive user input include, in one embodiment, program code instructions configured to receive a drag input. In this embodiment, the program code instructions configured to adjust the starting point include program code instructions configured to adjust the starting point in a direction indicated by the drag input and to define the starting point to be a predefined time increment of the audio soundtrack that is nearest to a portion of the visual representation of the audio soundtrack that is aligned with a visual indication of a current playback location of the one or more video clips upon termination of the drag input. The predefined time increment may correspond with a beat of the audio soundtrack and, in one embodiment, may be a second or a predefined fraction of a second. The computer-executable program code portions of this embodiment may also include program code instructions configured to cause a predetermined audio output to be provided while receiving the user input with respect to the audio soundtrack.
The visual representation of the audio soundtrack of one embodiment includes a plurality of markers spaced there throughout. In this embodiment, the program code instructions configured to receive user input include program code instructions configured to receive a flick input. In this embodiment, the program code instructions configured to adjust the starting point include program code instructions configured to adjust the starting point to be coincident to the marker that is next in a direction indicated by the flick input. The computer-executable program code portions of an example embodiment also include program code instructions configured to cause the display of a frame of a video clip concurrent with the visual representation of the audio soundtrack and during receipt of the user input with respect to the audio soundtrack.
In yet another example embodiment, an apparatus is provided that includes means for causing display of a visual representation of an audio soundtrack. The audio soundtrack is to be associated with one or more video clips to facilitate concurrent playback of at least a portion of the audio soundtrack and one or more video clips. The apparatus of this embodiment includes means for receiving user input with respect to the audio soundtrack and, in response to the user input, means for adjusting a starting point of the audio soundtrack relative to the one or more video clips. In this regard, a starting point may be adjusted by defining the starting point of the audio soundtrack based on the user input and also in a manner so as to coincide with a predefined feature of the audio soundtrack.
Having thus described example embodiments of the invention in general terms, reference will now be made to the accompanying drawings, which are not necessarily drawn to scale, and wherein:
Some embodiments of the present invention will now be described more fully hereinafter with reference to the accompanying drawings, in which some, but not all, embodiments of the invention are shown. Indeed, various embodiments of the invention may be embodied in many different forms and should not be construed as limited to the embodiments set forth herein; rather, these embodiments are provided so that this disclosure will satisfy applicable legal requirements. Like reference numerals refer to like elements throughout. As used herein, the terms “data,” “content,” “information,” and similar terms may be used interchangeably to refer to data capable of being transmitted, received and/or stored in accordance with embodiments of the present invention. Thus, use of any such terms should not be taken to limit the spirit and scope of embodiments of the present invention.
Additionally, as used herein, the term ‘circuitry’ refers to (a) hardware-only circuit implementations (for example, implementations in analog circuitry and/or digital circuitry); (b) combinations of circuits and computer program product(s) comprising software and/or firmware instructions stored on one or more computer readable memories that work together to cause an apparatus to perform one or more functions described herein; and (c) circuits, such as, for example, a microprocessor(s) or a portion of a microprocessor(s), that require software or firmware for operation even if the software or firmware is not physically present. This definition of ‘circuitry’ applies to all uses of this term herein, including in any claims. As a further example, as used herein, the term ‘circuitry’ also includes an implementation comprising one or more processors and/or portion(s) thereof and accompanying software and/or firmware. As another example, the term ‘circuitry’ as used herein also includes, for example, a baseband integrated circuit or applications processor integrated circuit for a mobile phone or a similar integrated circuit in a server, a cellular network device, other network device, and/or other computing device.
As defined herein, a “computer-readable storage medium,” which refers to a non-transitory physical storage medium (for example, volatile or non-volatile memory device), can be differentiated from a “computer-readable transmission medium,” which refers to an electromagnetic signal.
A method, apparatus and computer program product are provided in accordance with an example embodiment in order to facilitate the association of an audio soundtrack with one or more video clips. In particular, the method, apparatus and computer program product of an example embodiment permit the starting point of the audio soundtrack to be defined in relation to the one or more video clips in a manner that is intuitive to the user. However, the resulting combination of the audio soundtrack and the one or more video clips is synchronized based upon a predefined feature of the audio soundtrack, such as a beat of the audio soundtrack, such that the resulting combination provides for an enhanced user experience.
The audio soundtrack may be associated with one or more video clips. For example, the audio soundtrack may be associated with a single video clip for subsequent playback. Alternatively, the audio soundtrack may be associated with a plurality of video clips. In this embodiment, each video clip may be termed a moment and the plurality of moments that are combined may be termed an event reel. Thus, the audio soundtrack may be associated with an event reel in one embodiment. An event reel may consist of any number of moments with each moment either being of the same duration or of a different duration than other moments of the same event reel. In an instance in which the audio soundtrack is associated with an event reel, the audio soundtrack may be associated with a single moment of the event reel or with the entire event reel including each of the constituent moments. For purposes of explanation, but not of limitation, the audio soundtrack will be described to be associated with an event reel comprising a plurality of moments.
With reference to
The apparatus 20 of an example embodiment may be embodied by or associated with any of a variety of computing devices that include or are otherwise associated with a user interface that facilitates user interaction with an audio soundtrack relative to one or more video clips. For example, the computing device may be a mobile terminal, such as a personal digital assistant (PDA), mobile telephone, smart phone, companion device, for example, a smart watch, pager, mobile television, gaming device, laptop computer, camera, tablet computer, touch surface, video recorder, audio/video player, radio, electronic book or any combination of the aforementioned, and other types of voice and text communications systems. Alternatively, the computing device may be a fixed computing device, such as a personal computer, a computer workstation, a kiosk or the like. Still further, the apparatus may be embodied by or associated with a plurality of computing devices that are in communication with or otherwise networked with one another such that the various functions performed by the apparatus may be divided between the plurality of computing devices that operate in collaboration with one another. For purposes of illustration, but not of limitation, an apparatus embodied by a mobile terminal 14, such as a smart phone, is depicted and will be described herein. However, the apparatus may be embodied by other types of computing devices as noted above.
Regardless of the type of computing device that embodies or is otherwise associated with the apparatus 20, the apparatus of an example embodiment is depicted in
As noted above, the apparatus 20 may be embodied by a computing device. However, in some embodiments, the apparatus may be embodied as a chip or chip set. In other words, the apparatus may comprise one or more physical packages (for example, chips) including materials, components and/or wires on a structural assembly (for example, a circuit board). The structural assembly may provide physical strength, conservation of size, and/or limitation of electrical interaction for component circuitry included thereon. The apparatus may therefore, in some cases, be configured to implement an embodiment of the present invention on a single chip or as a single “system on a chip.” As such, in some cases, a chip or chipset may constitute means for performing one or more operations for providing the functionalities described herein.
The processor 22 may be embodied in a number of different ways. For example, the processor may be embodied as one or more of various hardware processing means such as a coprocessor, a microprocessor, a controller, a digital signal processor (DSP), a processing element with or without an accompanying DSP, or various other processing circuitry including integrated circuits such as, for example, an ASIC (application specific integrated circuit), an FPGA (field programmable gate array), a microcontroller unit (MCU), a hardware accelerator, a special-purpose computer chip, or the like. As such, in some embodiments, the processor may include one or more processing cores configured to perform independently. A multi-core processor may enable multiprocessing within a single physical package. Additionally or alternatively, the processor may include one or more processors configured in tandem via the bus to enable independent execution of instructions, pipelining and/or multithreading.
In an example embodiment, the processor 22 may be configured to execute instructions stored in the memory device 24 or otherwise accessible to the processor. Alternatively or additionally, the processor may be configured to execute hard coded functionality. As such, whether configured by hardware or software methods, or by a combination thereof, the processor may represent an entity (for example, physically embodied in circuitry) capable of performing operations according to an embodiment of the present invention while configured accordingly. Thus, for example, when the processor is embodied as an ASIC, FPGA or the like, the processor may be specifically configured hardware for conducting the operations described herein. Alternatively, as another example, when the processor is embodied as an executor of software instructions, the instructions may specifically configure the processor to perform the algorithms and/or operations described herein when the instructions are executed. However, in some cases, the processor may be a processor of a specific device (for example, the computing device) configured to employ an embodiment of the present invention by further configuration of the processor by instructions for performing the algorithms and/or operations described herein. The processor may include, among other things, a clock, an arithmetic logic unit (ALU) and logic gates configured to support operation of the processor.
The apparatus 20 of an example embodiment may also include or otherwise be in communication with a user interface 26, e.g., user interface 10 of
The apparatus 20 of an example embodiment may also optionally include a communication interface that may be any means such as a device or circuitry embodied in either hardware or a combination of hardware and software that is configured to receive and/or transmit data from/to other electronic devices in communication with the apparatus. In this regard, the communication interface may include, for example, an antenna (or multiple antennas) and supporting hardware and/or software for enabling communications with a wireless communication network. Additionally or alternatively, the communication interface may include the circuitry for interacting with the antenna(s) to cause transmission of signals via the antenna(s) or to handle receipt of signals received via the antenna(s). In some environments, the communication interface may alternatively or also support wired communication.
Referring now to
During or prior to the playback of the one or more video clips, the apparatus 20, such as the user interface 26, may be configured to receive user input to selectively activate various control inputs. For example, the one or more video clips may have an audio recording associated therewith. As such, the user interface may include a control input 16 configured to toggle on or off, e.g., selectively activate, the audio recording that is associated with the one or more video clips. Additionally or alternatively, the user interface may include a control input 18 configured to toggle on or off, e.g., selectively activate, the audio soundtrack that is associated with one or more video clips. In an instance in which the audio soundtrack is toggled off, any audio soundtracks associated with individual moments of an event reel may be output when the corresponding moment is displayed. However, in an instance in which the audio soundtrack is toggled on, the audio soundtrack associated with the event reel is output and any audio soundtracks associated with individual moments of an event reel are disregarded. As described below, the user interface may additionally or alternatively be configured to receive user input that defines the size of the video frame, thereby permitting the video frames of the one or more video clips to be trimmed or otherwise sized as desired.
Concurrent with the display of a frame of the one or more video clips, the apparatus 20, such as the processor 22, the user interface 26 or the like, may be configured to cause the display of a timeline 40 that represents the duration of the one or more video clips with which the audio soundtrack is to be associated. As shown in
In addition to causing the display of a frame of a video clip, the apparatus 20 includes means, such as the processor 22, the user interface 26 or the like, for causing display of a visual representation 44 of an audio soundtrack. As described below, the audio soundtrack is associated with the one or more video clips. The audio soundtrack may be any of a variety of audio soundtracks. For example, the apparatus, such as the memory 24, may have stored a plurality of predefined audio soundtracks that are selectable by the user for association with one or more video clips. Additionally or alternatively, the user may have previously recorded the audio soundtrack and may have stored the recorded audio soundtrack, such as in the memory.
The visual representation 44 of the audio soundtrack may be displayed concurrent with the display of a frame of the video clip with which the audio soundtrack will be associated. The audio soundtrack may be visually represented in various manners. However, in the illustrated embodiment, a waveform representative of the audio soundtrack is presented with the waveform providing a visual representation of the magnitude of the audio signal at each of a plurality of points in time throughout the duration of the audio soundtrack. Although various types of audio soundtracks may be utilized including stereo soundtracks, mono soundtracks and the like, the audio soundtrack of the illustrated embodiment is representative of a stereo soundtrack in which the audio soundtracks for the left and right channels are combined, such as by being averaged, with the resulting visual representation depicting the magnitude of the average of the combination of the left and right channels of the stereo audio soundtrack throughout its duration. While the visual representation of the audio soundtrack is shown to have a beginning and an end at the left and right sides, respectively, of the user interface 26, the apparatus 20, such as the processor 22, the user interface or the like, may be configured such that the audio soundtrack is repeated in a continuous fashion, such as in a loop, such that the beginning of the audio soundtrack immediately follows the end of the audio soundtrack such that the audio soundtrack may continue without interruption.
Upon displaying the visual representation 44 of the audio soundtrack, a starting point within the audio soundtrack relative to the one or more video clips is identified. The starting point of the audio soundtrack relative to the one or more video clips need not be the beginning of the audio soundtrack, but may be any point within the audio soundtrack. During subsequent playback of the one or more video clips and the associated audio soundtrack, the portion of the audio soundtrack that is output commences at the starting point. By permitting the starting point within the audio soundtrack to be tailored as described below, such as by the user, the portion of the audio soundtrack associated with the one or more video clips may be customized by the user to create an improved user experience, such as by permitting the portion of the audio soundtrack that is to be played back to be selected such that the portion of the audio soundtrack matches the theme or mood of the video clip(s).
Upon the initial display of the visual representation 44 of the audio soundtrack, the apparatus 20, such as the processor 22, the user interface 26 or the like, is configured to randomly select the starting point within the audio soundtrack. In this regard, the starting point may be randomly selected such that each time that the visual representation of the audio soundtrack is displayed to facilitate its association with one or more video clips, a different starting point within the audio soundtrack is identified.
As shown in
As shown in block 34 of
In this regard, the apparatus 20, such as the processor 22, may be configured to adjust the starting point of the audio soundtrack relative to the one or more video clips based on the user input and may thereafter refine the definition of the starting point of the audio soundtrack relative to the one or more video clips so as to coincide with a predefined feature of the audio soundtrack. By way of example, the audio soundtrack may have a tempo as defined by a plurality of beats and, more particularly, by a predefined number of beats per minute, e.g., 120 beats per minute (bpm). Thus, after having adjusted the starting point of the audio soundtrack relative to the one or more video clips based on the user input, the apparatus, such as the processor, may be configured to further adjust the starting point of the audio soundtrack so as to coincide with a beat of the audio soundtrack, such as to coincide with the nearest beat of the audio soundtrack to the starting point defined based upon the user input, to the next successive beat of the audio soundtrack relative to the starting point defined based upon the user input, or to the immediately preceding beat of the audio soundtrack relative to the starting point defined based upon user input. By further defining the starting point of the audio soundtrack relative to the one or more video clips so as to coincide with a predefined feature, such as a beat, of the audio soundtrack, the resulting combination of the one or more video clips and the audio soundtrack may be better synchronized so as to enhance the user experience upon playback.
As noted above, the audio soundtrack of an example embodiment includes a predefined number of beats per minute. In an embodiment in which the video clips are recorded or cut to have a duration equal to a multiple of a whole second, the audio soundtracks that are associated with the video clips may be similarly selected to have a tempo with a predefined number of beats per minute that is a multiple of 60, thereby having an even multiple of beats per second, such as one beat per second, two beats per second, or the like. In this example embodiment, the apparatus 20, such as the processor 22, may be configured to adjust the starting point of the audio soundtrack relative to the one or more video clips such that the starting point of the audio soundtrack coincides with a second or a predefined fraction of a second, such as a half second, relative to the beginning of the audio soundtrack. As such, the apparatus of this example embodiment ensures that the one or more video clips and the selected portion of the audio soundtrack are synchronized.
Various types of user input may be provided in order to adjust the starting point of the audio soundtrack. In an example embodiment, the user input may be a drag input and/or a flick input. As such, the apparatus 20, such as the processor 22, the user interface 26 or the like, may be configured to receive a drag input in which the user places their finger, stylus or the like (hereinafter generically referenced as an “input element”) upon the user interface, such as a touchscreen display, and moves their input element in a direction, such as toward the beginning of the visual representation 44 of the audio soundtrack or the end of the visual representation of the audio soundtrack, that includes a component that extends in parallel to the axis representative of time in the visual representation of the audio soundtrack. For example, the drag input may extend in a direction that is parallel or substantially parallel to the axis representative of time in the visual representation of the audio soundtrack, such as in a horizontal direction to the right or the left in the illustrated embodiment of
Additionally or alternatively, the apparatus 20, such as the processor 22, the user interface 26 or the like, may be configured to receive a flick input in which the user touches the user interface, such as a touchscreen display, with an input element and then flicks the input element in a direction, such as toward the beginning of the visual representation 44 of the audio soundtrack or toward the end of the visual representation of the audio soundtrack, that includes a component that extends in parallel to the axis representative of time in the visual representation of the audio soundtrack. For example, like the drag input, the flick input may extend in a direction that is parallel or substantially parallel to the axis representative of time in the visual representation of the audio soundtrack, such as in a horizontal direction to the right or the left in the illustrated embodiment of
While described above in conjunction with a drag input and a flick input provided via a user interface 26 that includes a touchscreen display, other types of user input and, in particular, other manners of providing a drag input or a flick input may be encompassed by other embodiments of the present invention. For example, the drag input and the flick input may be provided by movement of a cursor in a direction across the screen with the movement of the cursor at a speed less than a predefined maximum velocity being considered a drag input and the movement of the cursor at a speed greater than the predefined minimum velocity being considered a flick input.
The apparatus 20, such as the processor 22, the user interface 26 or the like, may be configured to adjust the starting point of the audio soundtrack relative to the one or more video clips in a different manner depending upon the type of user input. With respect to a drag input, for example, the apparatus, such as the processor, the user interface or the like, may be configured to adjust the starting point in the direction indicated by the drag input and to define the starting point to be a predefined time increment of the audio soundtrack that is offset from the prior starting point of the audio soundtrack, such as the initially defined starting point of the audio soundtrack, with respect to the visual representation 44 of the audio soundtrack by a distance equal to the distance traversed by the drag input. Thus, in an instance in which the drag input extends across the display two centimeters to the left, the starting point of the audio soundtrack is adjusted so as to be at that point within the audio soundtrack that is two centimeters to the left along the visual representation of the audio soundtrack relative to the prior starting point.
As described above, a visual indication 42 may be presented along the timeline 40 representative of the duration of the one or more video clips in order to indicate the current playback location of the one or more video clips, that is, to indicate the point within the one or video clips at which playback would begin. In this embodiment, the apparatus 20, such as the processor 22, is configured to adjust the starting point of the audio soundtrack in a direction indicated by the drag input, that is, toward the beginning of the audio soundtrack or toward the end of the audio soundtrack. In addition, the apparatus of this example embodiment, such as the processor, is configured to define the starting point of the audio soundtrack to be a predefined time increment, e.g., a beat, of the audio soundtrack that is nearest to the portion of the visual representation 44 of the audio soundtrack that is aligned with the visual indication of the current playback location of the one or more video clips upon termination of the drag input. In the illustrated embodiment of
In an example embodiment, audio feedback may also be provided to the user during receipt of a drag input. In this regard, the apparatus 20, such as the processor 22, the user interface 26 or the like, may be configured to cause a predetermined audio output to be provided while receiving the user input, e.g., the drag input, with respect to the audio soundtrack. While various forms of predetermined audio output may be provided, audio output that mimics the record scratching sound created by dragging a needle of a record player across a vinyl record may be output.
With respect to a flick input, the apparatus 20, such as the processor 22, the user interface 26 or the like, is configured to adjust the starting point to be coincident with the marker 46 within the audio soundtrack that is next in the direction indicated by the flick input. See
In order to provide further control over the manner in which the starting point of the audio soundtrack is adjusted relative to the current playback location of one or more video clips, the user may provide an ordered sequence of user inputs including one or more drag inputs and one or more flick inputs. In this regard, each user input may cause the starting point of the audio soundtrack to be adjusted in the manner described above with the entire sequence of user inputs collectively having a cumulative impact upon the starting point of the audio soundtrack. In order to provide feedback of the portion of the audio soundtrack that will be associated with the one or more video clips, the portion of the visual representation 44 of the audio soundtrack will be output with the one or more video clips may be differently shaded than the remainder of the visual representation of the audio soundtrack and, as shown in
Once the user has defined the starting point of the audio soundtrack relative to the one or more video clips in a desired manner, the association of the audio soundtrack including the defined starting point with respect to the one or more video clips and, more particularly, with respect to the current playback location of the one or more video clips may be saved, such as in response to the provision of a predefined user input. Thereafter, in an instance in which the one or more video clips are selected for playback and in which the audio soundtrack mode is enabled, e.g., is toggled on, a portion of the audio soundtrack will play concurrent with the display of the one or more video clips with the starting point of the audio soundtrack coinciding with the current playback location of the one or more video clips. As such, the portion of the audio soundtrack that is output is synchronized with respect to the one or more video clips in order to provide an enhanced user experience.
The user inputs may be provided in various manners. In an example embodiment in which the user interface 26 is a touchscreen display, the touchscreen display may be divided into regions configured to receive different types of user input. For example, the user interface may be divided into four regions. As shown in
The method, apparatus 20 and computer program product of example embodiments provide numerous technical advantages including the conservation of processing resources and the associated power consumption otherwise expended in an effort to associate an audio soundtrack with one or more video clips utilizing tools that are more complex and less user friendly and that may result in the increased user interaction in an effort to provide for the desired synchronization therebetween.
In addition to supporting user synchronization of an audio soundtrack with one or more video clips, the computing device may be configured to support one or more other functions. For example, the computing device of an example embodiment may also support a mapping application so as to present maps or otherwise provide mapping information. In order to support a mapping application, the computing device may include or otherwise be in communication with a geographic database, such as may be stored in memory 24. For example, the geographic database includes node data records, road segment or link data records, point of interest (POI) data records, and other data records. More, fewer or different data records can be provided. In one embodiment, the other data records include cartographic (“carto”) data records, routing data, and maneuver data. One or more portions, components, areas, layers, features, text, and/or symbols of the POI or event data can be stored in, linked to, and/or associated with one or more of these data records. For example, one or more portions of the POI, event data, or recorded route information can be matched with respective map or geographic records via position or global positioning system (GPS) data associations (such as using known or future map matching or geo-coding techniques), for example.
In example embodiments, the road segment data records are links or segments representing roads, streets, or paths, as can be used in the calculated route or recorded route information for determination of one or more personalized routes, according to example embodiments. The node data records are end points corresponding to the respective links or segments of the road segment data records. The road link data records and the node data records represent a road network, such as used by vehicles, cars, and/or other entities. Alternatively, the geographic database can contain path segment and node data records or other data that represent pedestrian paths or areas in addition to or instead of the vehicle road record data, for example.
The road/link segments and nodes can be associated with attributes, such as geographic coordinates, street names, address ranges, speed limits, turn restrictions at intersections, and other navigation related attributes, as well as POIs, such as gasoline stations, hotels, restaurants, museums, stadiums, offices, automobile dealerships, auto repair shops, buildings, stores, parks, etc. The geographic database can include data about the POIs and their respective locations in the POI data records. The geographic database can also include data about places, such as cities, towns, or other communities, and other geographic features, such as bodies of water, mountain ranges, etc. Such place or feature data can be part of the POI data or can be associated with POIs or POI data records (such as a data point used for displaying or representing a position of a city). In addition, the geographic database can include event data (e.g., traffic incidents, constructions, scheduled events, unscheduled events, etc.) associated with the POI data records or other records of the geographic database.
The geographic database can be maintained by the content provider (e.g., a map developer) in association with the services platform. By way of example, the map developer can collect geographic data to generate and enhance the geographic database. There can be different ways used by the map developer to collect data. These ways can include obtaining data from other sources, such as municipalities or respective geographic authorities. In addition, the map developer can employ field personnel to travel by vehicle along roads throughout the geographic region to observe features and/or record information about them, for example. Also, remote sensing, such as aerial or satellite photography, can be used.
The geographic database can be a master geographic database stored in a format that facilitates updating, maintenance, and development. For example, the master geographic database or data in the master geographic database can be in an Oracle spatial format or other spatial format, such as for development or production purposes. The Oracle spatial format or development/production database can be compiled into a delivery format, such as a geographic data files (GDF) format. The data in the production and/or delivery formats can be compiled or further compiled to form geographic database products or databases, which can be used in end user navigation devices or systems.
For example, geographic data is compiled (such as into a platform specification format (PSF) format) to organize and/or configure the data for performing navigation-related functions and/or services, such as route calculation, route guidance, map display, speed calculation, distance and travel time functions, and other functions, by a navigation device, such as by the computing device, for example. The navigation-related functions can correspond to vehicle navigation, pedestrian navigation or other types of navigation. The compilation to produce the end user databases can be performed by a party or entity separate from the map developer. For example, a customer of the map developer, such as a navigation device developer or other end user device developer, can perform compilation on a received geographic database in a delivery format to produce one or more compiled navigation databases.
As mentioned above, the server side geographic database can be a master geographic database, but in alternate embodiments, the client side geographic database can represent a compiled navigation database that can be used in or with the computing device to provide navigation and/or map-related functions. For example, the geographic database can be used with the end user device to provide an end user with navigation features. In such a case, the geographic database can be downloaded or stored on the computing device, such as in applications, or the computing device can access the geographic database through a wireless or wired connection (such as via a server and/or a communication network), for example.
In one embodiment, the computing device can be an in-vehicle navigation system, a personal navigation device (PND), a portable navigation device, a cellular telephone, a mobile phone, a personal digital assistant (PDA), a watch, a camera, a computer, and/or other device that can perform navigation-related functions, such as digital routing and map display. Thus, in addition to accessing various media files as described above, the user can use the computing device of an example embodiment for navigation and map functions such as guidance and map display, for example, and for determination of one or more personalized routes or route segments based on one or more calculated and recorded routes, according to example embodiments.
As described above,
Accordingly, blocks of the flowchart support combinations of means for performing the specified functions and combinations of operations for performing the specified functions for performing the specified functions. It will also be understood that one or more blocks of the flowchart, and combinations of blocks in the flowchart, can be implemented by special purpose hardware-based computer systems which perform the specified functions, or combinations of special purpose hardware and computer instructions.
In some embodiments, certain ones of the operations above may be modified or further amplified. Furthermore, in some embodiments, additional optional operations may be included, some of which have been described above. Modifications, additions, or amplifications to the operations above may be performed in any order and in any combination.
Many modifications and other embodiments of the inventions set forth herein will come to mind to one skilled in the art to which these inventions pertain having the benefit of the teachings presented in the foregoing descriptions and the associated drawings. Therefore, it is to be understood that the inventions are not to be limited to the specific embodiments disclosed and that modifications and other embodiments are intended to be included within the scope of the appended claims. Moreover, although the foregoing descriptions and the associated drawings describe example embodiments in the context of certain example combinations of elements and/or functions, it should be appreciated that different combinations of elements and/or functions may be provided by alternative embodiments without departing from the scope of the appended claims. In this regard, for example, different combinations of elements and/or functions than those explicitly described above are also contemplated as may be set forth in some of the appended claims. Although specific terms are employed herein, they are used in a generic and descriptive sense only and not for purposes of limitation.
