The technology of the present disclosure relates generally to portable electronic devices, and more particularly to a portable electronic device that uses metadata to create concatenated highlight portions of media content.
Portable electronic devices commonly have the capability to play media content, such as video and music. Particularly as to video, at times one may not wish to view an entire program or video file, preferring instead a condensed format. For example, viewers often watch highlights of sporting events, movie trailers, excerpts of television programs and movie scenes, particular newscast events, and so on. Such content may be viewed on televisions, computers, mobile telephones and other portable electronic devices, and other media devices. Viewers also at times may desire to skip portions of a video, such as advertisements or uninteresting segments of program content. Broadcasters may provide such partial programming, but it would be entertaining and enjoyable for users of portable electronic devices to be able to create and share customized partial video content, such as highlights of larger programming. There currently appears to be no convenient method for users of portable electronic devices to do so.
Portable electronic devices, such as mobile telephones, media players, personal digital assistants (PDAs), and others, are ever increasing in popularity. To avoid having to carry multiple devices, portable electronic devices are now being configured to provide a wide variety of functions. For example, a mobile telephone may no longer be used simply to make and receive telephone calls. A mobile telephone may also be a camera, an Internet browser for accessing news and information, an audiovisual media player, a messaging device (text, audio, and/or visual messages), a gaming device, a personal organizer, and have other functions as well.
With regard to video player functionality, a user may download video files over the Internet or other communications network and store the downloaded files within memory in the device. Video files also may be streamed to the device, either from a recorded source or from a live broadcast or feed.
Regardless of how a video file is received in an electronic device, the video file typically contains associated “metadata” information. Generally, metadata may be thought of as digital data providing information about other digital data or files. For example, when one takes a picture with a digital camera, metadata associated with the picture file may include such information as the date and time the picture was taken, the file size, an identifier (such as a title, file name, or number), and/or other items of information about the picture. Document files, music files, emails, and other file types similarly may contain metadata that provides information about the associated files. The metadata may be contained within XML descriptive fields within the file.
Like other digital data files, digital video files typically contain metadata information about the video file. For example, the metadata may include the title, genre, prominent entertainers, length, source (such as a studio or broadcast network), and other items of information that describe aspects of the video. There also exist applications or programs that permit a user to define and customize metadata. For example, a user may wish to add a metadata field to describe a category or “mood” to be associated with one or more video files to customize or organize videos into personalized groupings for use at different types of situations, such as parties, traveling, or others.
To improve the consumer experience with electronic devices, there is a need in the art for an improved system and method for customizing media content, and particularly video content, by creating condensed portions of video content. The condensed portions may represent highlights constituting particularly enjoyable, entertaining, or interesting portions of the broader video content. In exemplary embodiments, the video files are “marked” or “flagged” about the portions of the video content to segment the highlight portion or portions within the media file. The marks or flags may be entered and incorporated as part of the metadata of the video file. A user's electronic device may then extract the marks or flags from the metadata, which causes a media player in the portable electronic device to play only the marked highlight portions. In addition, a user may share the highlights with others by transmitting the marked video files to others' electronic devices. Alternatively, the highlight creator may transmit only the metadata to another's electronic device, and the metadata marks may be extracted and applied in a time synchronized fashion to a video file stored on the other's device or streamed thereto.
Therefore, according to one aspect of the invention, an electronic device for creating highlights of a media file comprises a media player for playing media files wherein each media file has associated metadata, an input device, and a controller. The controller is configured to receive at least one input from the input device corresponding to a mark for a highlight portion of a media file, wherein the controller incorporates the mark for the highlight portion into the metadata associated with the media file to segment the highlight portion within the media file. The controller is further configured to extract the highlight mark from the metadata to cause the media player to play only the highlight portion of the media file.
According to one embodiment of the electronic device, the electronic device further comprises a storage device for storing at least one media file.
According to one embodiment of the electronic device, the controller is further configured to receive the media file from a source external to the electronic device.
According to one embodiment of the electronic device, the input device includes a microphone, and the controller is further configured to incorporate audio received by the microphone into the highlight portion of the media file.
According to one embodiment of the electronic device, the electronic device is a mobile telephone.
According to another aspect of the invention, a first system for creating highlights of a media file comprises a media player, a storage device for storing a plurality of media files wherein each of the media files has associated metadata, an input device, and a controller. The controller is configured to receive at least one input from the input device corresponding to a mark for a highlight portion of a media file, and the controller incorporates the mark for the highlight portion into the metadata associated with the media file to segment the highlight portion within the media file. The controller is further configured to extract the highlight mark from the metadata to cause the media player to play only the highlight portion of the media file.
According to one embodiment of the first system, the media player, input device, and controller are components of a same electronic device.
According to one embodiment of the first system, the input device includes a microphone, and the controller is further configured to incorporate audio received by the microphone into the highlight portion of the media file.
According to one embodiment of the first system, the electronic device is a mobile telephone.
According to one embodiment of the first system, the controller comprises a device controller within a user electronic device and a server controller within a network server external to the user electronic device. The server controller is configured to receive the input and incorporate the highlight marks into the metadata, and the device controller is configured to extract the highlight marks and cause the media player to play only the highlight portions of the media file.
According to one embodiment of the first system, the storage device is located within the network server, and the server controller is further configured to transmit the media file containing the marked metadata to the user electronic device.
According to one embodiment of the first system, the storage device is located within the network server, and the server controller is configured to transmit the marked metadata independent of the associated media file to the user electronic device.
According to one embodiment of the first system, the marked metadata includes time synchronization data to synchronize the marked metadata with a video content portion of a media file being played by the media player.
According to one embodiment of the first system, the input device includes a sensor and the input is a sensed change in an environmental condition.
According to one embodiment of the first system, the environmental condition is the level of audience noise.
According to one embodiment of the first system, the media files are video files.
According to another aspect of the invention, a second system for creating highlights of a media file comprises a plurality of user electronic devices each having an input device, a media player, a storage device for storing a plurality of media files wherein each of the media files has associated metadata, and a controller. The controller is configured to receive at least one input from an input device of at least one of the plurality of electronic devices, each input generating a mark for a highlight portion of a media file, and the controller incorporates marks for the highlight portion into the metadata associated with the media file to segment the highlight portion within the media file. The controller is further configured to extract the highlight markings from the metadata associated with the media file to cause the media player to play only the highlight portions of the media file.
According to one embodiment of the second system, the controller comprises a plurality of device controllers, one being within each the user electronic devices, and a network controller within a network device external to the user electronic devices. The network controller is configured to receive the at least one input and incorporate highlight marks into the metadata, and the device controllers are configured to extract the highlight marks and cause the media player to play only the highlight portions of the media file.
According to one embodiment of the second system, the network controller is further configured to incorporate marks based on a ranking system by which only marks corresponding to a threshold of user electronic device inputs are incorporated into the metadata.
According to one embodiment of the second system, the plurality of device controllers each are further configured to receive an input from the input device on the same user electronic device as the device controller, and to modify the metadata in accordance with the input.
According to one embodiment of the second system, the second system further comprising a wireless interface, wherein an input for marking a highlight portion of the media file is transmitted over the wireless interface for incorporation by the network controller into the metadata of a media file in the network device.
According to one embodiment of the second system, the marked metadata for the media file is transmitted from the network device over the wireless interface to at least one of the user electronic devices. The plurality of device controllers each are further configured to receive an input from the input device on the same user electronic device as the device controller, and to modify the metadata in accordance with the input.
According to one embodiment of the second system, the marked metadata is transmitted among each of the plurality of electronic devices over the wireless interface.
Another aspect of the invention is a method of playing a highlight portion of a media file comprising the steps of selecting a media file wherein the media file has associated metadata, identifying a highlight portion of the media file, marking the media file with at least one mark wherein the mark is associated with the identified highlight portion of the media file, incorporating the mark into the metadata associated with the media file to segment the identified highlight portion within the media file, extracting the highlight mark from the metadata, and playing only the highlight portion of the media file on an electronic device.
According to one embodiment of the method, a plurality of highlight portions are identified, and the marking, incorporating, and playing steps are performed as to each of the plurality of identified highlight portions.
According to one embodiment of the method, a plurality of media files are selected, and the identifying, marking, incorporating, and playing steps are performed as to each media file.
According to one embodiment of the method, the identifying and marking steps further comprise watching the media file, inputting a start point for the highlight portion of the media file, inputting an end point for the highlight portion of the media file, and incorporating the start point and end point into the metadata associated with the media file.
According to one embodiment of the method, the method further comprises storing the marked metadata in a file separate from a video content portion of the media file, and time synchronizing the marked metadata with the video content portion of the media file.
According to one embodiment of the method, the incorporating step further comprises adding commentary to the highlight portion of the media file.
According to one embodiment of the method, the selecting, identifying, marking, and incorporating steps are performed with a first electronic device. The method further comprises transmitting the marked metadata to a second electronic device, extracting the highlight mark from the metadata, and playing only the highlight portions of the media file on the second electronic device.
These and further features of the present invention will be apparent with reference to the following description and attached drawings. In the description and drawings, particular embodiments of the invention have been disclosed in detail as being indicative of some of the ways in which the principles of the invention may be employed, but it is understood that the invention is not limited correspondingly in scope. Rather, the invention includes all changes, modifications and equivalents coming within the spirit and terms of the claims appended hereto.
Features that are described and/or illustrated with respect to one embodiment may be used in the same way or in a similar way in one or more other embodiments and/or in combination with or instead of the features of the other embodiments.
It should be emphasized that the terms “comprises” and “comprising,” when used in this specification, are taken to specify the presence of stated features, integers, steps or components but do not preclude the presence or addition of one or more other features, integers, steps, components or groups thereof.
The present invention provides a system and method for customizing video content by permitting convenient creation of concatenated and condensed portions of broader video content. In this manner, viewers need not watch prolonged videos or programming. Rather, a viewer may watch customized highlights constituting the most entertaining and interesting portions of video content.
In exemplary embodiments, the broader video content may be marked or flagged about the portion of the video file to segment the video file into one or more condensed or highlight portions. A viewer may then select to play only the marked portions to provide a condensed viewing session of highlights. The marks may be incorporated as part of the metadata of the video file, and particularly may be stored as XML metadata fields. A user's electronic device may be configured to extract the marks or flags from the metadata. In accordance with the extracted marks, a media player of the electronic device may play only the highlight portions.
In certain embodiments, the highlights or condensed portions may be created by broadcasters or content providers. The marked video files may be stored on a network server, from which the video files may be downloaded or streamed to users' electronic devices. Alternatively or additionally, video files may be marked by individual users to generate customized highlights and condensed video content. Such customized video content may be shared with other users by transmitting the marked video files to others' electronic devices. Alternatively, the highlight creator may transmit only the marked metadata to others, and the receiving electronic device may extract and apply the marks, time synchronized, to a corresponding video file that may be stored or streamed thereto. Groups of users may edit the metadata highlight data, including by adding to the metadata additional highlight flags or marks. In this manner, groups may develop collective highlights to share with one another.
Embodiments of the present invention will now be described with reference to the drawings, wherein like reference numerals are used to refer to like elements throughout. It will be understood that the figures are not necessarily to scale.
The following description is made in the context of a conventional mobile telephone. It will be appreciated that the invention is not intended to be limited to the context of a mobile telephone and may relate to any type of appropriate electronic device, examples of which include a media player, a gaming device, or a desktop or laptop computer. For purposes of the description herein, the interchangeable terms “electronic equipment” and “electronic device” also may include portable radio communication equipment. The term “portable radio communication equipment,” which sometimes hereinafter is referred to as a “mobile radio terminal,” includes all equipment such as mobile telephones, pagers, communicators, electronic organizers, personal digital assistants (PDAs), smartphones, and any communication apparatus or the like.
Referring to
A keypad 18 provides for a variety of user input operations. For example, keypad 18 typically includes alphanumeric keys for allowing entry of alphanumeric information such as telephone numbers, phone lists, contact information, notes, etc. In addition, keypad 18 typically includes special function keys 17 such as a “send” key for initiating or answering a call, and others. Special function keys 17 also may include keys for navigating and selecting items from a menu displayed on display 14. Some or all of the keys may be used in conjunction with the display as soft keys. Keys or key-like functionality also may be embodied as a touch screen associated with the display 14.
It will be appreciated that both the number and nature of the metadata fields may be varied. Some of the metadata, such as title and stars, may be unalterable and set at the time the video file is created. In addition, with an appropriate program or application as is known in the art, metadata fields may be defined by a user. For example, the user may wish to add a “mood” identifier as part of the metadata to associate the video with a particular mood, such as a party or relaxed mood for example. A user also may wish to add a category identifier as part of the metadata to group videos together, such as using metadata to create a “favorites” grouping of videos. Other examples of both automatic and user defined metadata fields may be employed. In addition, although the present invention is described with respect to videos as an exemplary embodiment, similar principles may be applied to metadata associated with other media content, such as music.
Referring again to
The method begins at step 100, at which a video file may be selected for which highlights are desired. At step 110, a portion of the video file may be identified by the user or content provider as the desired highlight. At step 120, the video file may be marked or flagged to create the highlight. In preferred embodiments, the marks or flags are incorporated into the metadata of the video file to segment a highlight portion within the video file. At step 130, it is determined whether the creation of the highlight is complete. At this point, the creator of the highlights has the option to identify and mark additional portions of the video file to create and segment multiple highlight content. Once all highlights are identified and marked, the method may proceed.
As further described below, in certain embodiments the highlight portions may be identified and created by a content provider, such as a broadcaster or Internet service provider. Alternatively, individual users may identify and create the highlight content.
Once the creation of the highlights is complete, the method may proceed to step 140, at which the video file is selected for playback. At step 150, the highlight data is extracted from the marked metadata of the video file, and at step 160, the highlight portions of the video file corresponding to the marked metadata are played.
The method begins at step 200, at which a video file may be selected for which highlights are desired. At step 210, highlight portions may be created with respect to the selected video file. In particular, the highlight portions may be created or segmented within the video file as described above in accordance with steps 110 through 130 of
As stated above, the highlights may be created pursuant to the methods of
Referring to
Communications network 70 also may include a video highlights server 75 for use in accordance with embodiments of the present invention.
Video highlights server 75 also may include a video highlights application 77, embodied as code executable by the controller 79. Via input interface 80, a content provider may identify condensed portions of video content to comprise the desired highlights. The inputs may be in a variety of forms. For example, a content provider may input a start point and an end point within a video file to segment a highlight. An operator may input highlight data points in real time or contemporaneously while the video is being created. For example, a sportscaster may mark a particular play for a highlight immediately upon completion of the play. Alternatively, an operator may input start and end points to segment highlights while watching a previously recorded video file. For content associated with a particular date and time, such as a sporting or news event, the highlight may be inputted by starting and ending time of day and date synchronized to the video file. Time data may be used in other ways. For example, if the known running time of a video file comprises an hour of content, an operator may select minutes 10-15 (or other) as being a highlight. Data size also may be used to create highlights by identifying a dataset within the media file to constitute the highlight portion, and inputting the dataset. For example, if a video file comprises 20 megabytes of data, an operator may select a dataset comprising megabytes 8-9 as being a highlight.
In alternative embodiments, highlight data may be generated automatically. For example, highlight start and end points may be generated by rising and falling levels of audience noise, as indicative of exciting or interesting portions of the content. In such embodiments, the input interface 80 may include an appropriate sensor or sensors 81 to sense an environmental condition to be associated with a desired highlight. In this embodiment, heuristics may be added to create highlights to include video portions encompassing a particular number of seconds around the event triggering the highlight. For example, if the highlight is created based on increased audience or crowd noise, the event triggering the increased noise likely occurred in the seconds prior to the change in noise level. The metadata of the video file, therefore, may be marked to incorporate portions of the video prior to the triggering event to more accurately define the highlight. It will be appreciated that these are but examples, and other features of the video content may be used to segment highlights.
As stated above, referring again to
A user who accesses the networked content may possess an electronic device having a cooperating video highlights application (for example, the video highlights application 43 depicted in
In one embodiment, a user may download or otherwise obtain the entire video file, including the marked metadata, from the content provider. Alternatively, the user may download or otherwise obtain only the marked metadata defining the highlights in a file independent of the underlying video content. The user's electronic device may extract the highlight data from the marked metadata and apply the marks to existing video content contained in a separate file stored in the electronic device, or obtained from another source. When the marked metadata is stored independently from the video content, the highlight data may include time synchronization information to match the highlight data to the corresponding video content. Extracting time synchronization data may proceed similarly to creating highlights based on time data. In one embodiment, if the video has a particular running time, the time synchronization information may correspond to the placement of the highlight within the running time. For example, if the running time of the video is sixty minutes, the time synchronization data may define the highlight as minutes 10-15 (or other). In another embodiment, if the video is a live or recorded event, the highlight data may be time synchronized with a particular time of day and date within the video file.
As seen in
Also shown in
As another example,
Highlights also may be transmitted to other users via a wired or wireless interface as are known in the art. The other users may enjoy the highlight portions created by the first user, and also may have the option to modify the metadata to amend the highlights.
Referring again to
In the example, of
In another embodiment, group highlight data may be generated automatically and across multiple applications. For example, multiple users may be watching the same video content while also engaging in an instant messaging (IM) or network “chat” session. Highlights may be generated automatically by an increase in the level of IM activity. In some sense, this embodiment may be analogous to the audience or “crowd noise” embodiment described above. The increased IM activity may be considered indicative of increased interest or entertainment in the portion of the video being viewed at that time. Furthermore, similar to the audience noise embodiment, the highlight data may be defined to encompass a portion of the video preceding the increased IM activity to more accurately define the highlight.
In addition, as stated above, highlights may be shared among users. Creators of highlights may transmit entire video files containing marked metadata to others. Alternatively, a creator may transmit only the marked metadata to be applied to video files stored by a receiving user within the receiver's electronic device, or streamed thereto. In this manner, copyrights may more easily be protected because each user would have his or her own copy of the underlying video files. In addition, receiving users may add to the highlight data, thereby providing another way by which group highlights may be created and shared. The highlights may be shared over a wireless interface comparable to that depicted in
Referring again to
The mobile telephone 10 may include an antenna 44 coupled to a radio circuit 46. The radio circuit 46 includes a radio frequency transmitter and receiver for transmitting and receiving signals via the antenna 44 as is conventional. The mobile telephone 10 further includes a sound signal processing circuit 48 for processing audio signals transmitted by and received from the radio circuit 46. Coupled to the sound processing circuit 48 are a speaker 50 and microphone 52 that enable a user to listen and speak via the mobile telephone 10 as is conventional.
The display 14 may be coupled to the control circuit 41 by a video processing circuit 54 that converts video data to a video signal used to drive the various displays. The video processing circuit 54 may include any appropriate buffers, decoders, video data processors and so forth. The video data may be generated by the control circuit 41, retrieved from a video file that is stored in the memory 45, derived from an incoming video data stream received by the radio circuit 48 or obtained by any other suitable method.
The mobile telephone 10 also may include a local wireless interface 55, such as an infrared transceiver and/or an RF adaptor (e.g., a Bluetooth adapter), for establishing communication with an accessory, another mobile radio terminal, a computer or another device. The local wireless interface 55 also may be used in connection with group highlights creation as described above with respect to
The mobile telephone 10 also may include an I/O interface 56 that permits connection to a variety of I/O conventional I/O devices. One such device is a power charger that can be used to charge an internal power supply unit (PSU) 58.
Although the invention has been shown and described with respect to certain preferred embodiments, it is understood that equivalents and modifications will occur to others skilled in the art upon the reading and understanding of the specification. The present invention includes all such equivalents and modifications, and is limited only by the scope of the following claims.
This application claims the benefit of U.S. Provisional Application No. 60/988,206 filed Nov. 15, 2007, which is incorporated by reference as if fully rewritten herein.
Number | Date | Country | |
---|---|---|---|
60988206 | Nov 2007 | US |