1. Field of the Invention
This invention relates to a method for synchronising digital media content.
2. Description of the Prior Art
Synchronisation of data from one computing device to another is considered to be a simple procedure of examining two sets of files and copying files between the two devices according to which was most recently modified, with the added requirement for recording the file structure at the time of the last synchronisation in order to detect and handle deletions and, in more sophisticated approaches, file moving and renaming.
The problem with that current approach, which is solved by the present invention, is that it takes no account of the way in which the end user interacts with the files being synchronised, and consequently is, at root, a simple all-or-nothing process: devices are either synchronised or they are not, and there is, for example, no concept of a “partially synchronised” device pair.
With regard to digital media files, this traditional approach to synchronisation has led to media playback devices—any device which is capable of playing any digital media content—being treated in the same manner as digital address books, where each is an independent cache of data that is synchronised with others at intervals.
The invention is a method for synchronising digital media content to a device, comprising the following steps:
The synchronisation approach adopted in an implementation by the present invention is therefore to consider each media playback device to be a repository for a subset of the user's overall media content collection. Rather than attempting to synchronise the entire media content collection with every device, which is what traditionally is meant by device synchronisation, a more intelligent approach may then be adopted, permitting specific portions of the user's collection to be supplied to specific devices based on an analysis of the user's “taste signature” and, in a specific implementation, the interactions with his media content collection together with the specific device's capabilities and an analysis of the user's interactions with that device.
What is provided by the present invention is therefore a mechanism for analysing the consumer's existing tastes and using the results of that analysis to identify both media content which is likely to appeal to that individual and also like-minded individuals who share some or all of that individual's taste in media content.
Such an approach circumvents the limitations of the current approach in the art to device synchronisation and permits the optimisation of the synchronisation process in different and more useful ways to those available to the current art.
Definitions
For convenience, and to avoid needless repetition, the terms “music” and “media content” in this document are to be taken to encompass all “media content” which is in digital form or which it is possible to convert to digital form—including but not limited to books, magazines, newspapers and other periodicals, video in the form of digital video, motion pictures, television shows (as series, as seasons and as individual episodes), images (photographic or otherwise), music, computer games and other interactive media.
Similarly, the term “track” indicates a specific item of media content, whether that be a song, a television show, an eBook or portion thereof, a computer game or any other discreet item of media content.
The terms “playlist” and “album” are used interchangeably to indicate collections of “tracks” which have been conjoined together such that they may be treated as a single entity for the purposes of analysis or recommendation.
The verb “to listen” is to be taken as encompassing any interaction between a human and media content, whether that be listening to audio content, watching video or image content, reading books or other textual content, playing a computer game, interacting with interactive media content or some combination of such activities.
The terms “user”, “consumer”, “end user” and “individual” are used interchangeably to refer to the person, or group of people, whose media content “listening” preferences are analysed and for whom recommendations are made.
The term “taste” is used to refer to a user's media content “listening” preferences. A user's “taste signature” is a computer-readable description of a user's taste, as derived during the process disclosed for the present invention.
The term “recommendations” refers to media content items (“tracks”, “playlists” and “albums”) which are identified - using the mechanisms disclosed in the present invention, in Omnifone Patent Application “Nearest Neighbour & Digital Content Recommendation Techniques” PCT/GB2010/051113 or by any other compatible mechanisms—as matching or complementing the user's taste in media content.
The terms “media collection” and “music collection” and similar terms are used interchangeably to refer to an actual or notional set of “music tracks” which are owned by the user either directly—in the form of physical media or downloaded or encoded digital media files—or indirectly, such as by being bookmarked as “favourite” tracks or within playlists or by some other mechanism in a music subscription service or an media content catalogue. Any media content which is directly linked to the user by such mechanisms is considered to be part of that user's “music collection”.
The terms “device” and “media player” are used interchangeably to refer to any computational device which is capable of playing digital media content, including but not limited to MP3 players, television sets, home computer systems, mobile computing devices, games consoles, handheld games consoles, vehicular-based media players or any other applicable device or software media player on such a device.
Throughout this document, the masculine includes the feminine, and vice versa, and the singular includes the plural, and vice versa.
Overview
The present invention discloses a mechanism whereby the media content (e.g. “music listening”) preferences of an individual may be analysed and the analysis be used to optimise the process of synchronising that user's device or devices with the user's music collection. The music collection may reside as a ‘master’ set on one or more devices, or be held on the cloud, or may be distributed across various devices and the cloud so that no single device includes a master set. We refer collectively to the repository of all places where there might be media content relevant to the user as the ‘media store’. Hence, this invention deals with optimising the process of synchronising a user's device with media content held on the ‘media store’.
The process disclosed by the present invention may be viewed, in the preferred implementation, as encompassing the following steps:
Each stage of the process is described in turn in the sections which follow.
1. Identify and Analyse the User's Media Content
In the preferred embodiment, one or more of the techniques disclosed in this section may be used to identify a set of media content which is directly or indirectly linked to the device, and the owner thereof, which is to be synchronised. The said set, the user's “music collection”, is thus identified, in the preferred embodiment, both in its particulars and in its metadata, to the broadest extent possible.
1.1 Locate Media Content
Users are able to store media content in a variety of locations, some of which may be immediately accessible but others are less so. In order to ensure that an analysis of a user's taste is as useful as possible, such an analysis must be as comprehensive as possible, including as much of that user's media content as it is practical to access.
To meet that “comprehensive” standard, the content of the user's device must be examined to search for media content, looking in all common storage locations, including but not limited to one or more of the following:
When performing this “device sweep” it is important to exclude from the analysis any standard “preview” media content which is included with a device or media player, since such content is not indicative of the specific user's taste and therefore, with the possible exception of any such content which is specific to the service within which the present invention is being utilised, little to no purpose may be served by provisioning such content to the user's device(s). The term “device sweep” should not be interpreted as being limited to an analysis of a single device—in fact it includes a sweep of all devices and locations where relevant media files may be stored—i.e. all devices owned or accessed by the user (his ‘media store’) and also the media stores of others too—for example, friends who make recommendations to the user.
1.2 Gather Metadata
The purpose of the “device sweep” is to gather information about the user's existing media content and their listening preferences with respect to that media content—i.e. a “taste signature”. For that reason, the sweep needs to accumulate a considerable body of metadata concerning the media content files found. Such metadata may take several forms, including but not limited to one or more of the following:
One major purpose of performing this sweep is to identify the media content on the user's device (and, more generally, the user's media store and relevant third party media stores). The metadata for each track may also, in the preferred embodiment, be enriched by reference to a more comprehensive database against which metadata may be matched and additional information about each track retrieved.
As a result of the “device sweep”, a detailed description of the user's available media content (irrespective of where it is stored) has been constructed. That description may include such “metadata” items as the title, artists, duration, release name, beat, tempo, mood signature, playback metrics such as the time the track was last played by the user, associated artwork, ratings of the track by this user and/or any other information which may be available for analysis.
Where this user has previously registered a device with the service provided using the present invention then metadata may also have been obtained from the user's previously-registered device(s). In which case that previously-stored metadata is also, in the preferred embodiment, consolidated with the data obtained from the “device sweep” and the resultant collection of data used for analysis.
1.3 Linked Friends Weighting
In one example embodiment then, where a user has linked himself to one or more other users of a media content provision service within which the present invention is being utilised (i.e. the user has “linked friends” on that service) then the user's own metadata package may be augmented by those of his linked friends, suitably weighted to ensure that any recommendations made are primarily based upon this user's own media rather than that of his linked friends.
In the preferred embodiment, the weighting given to a user's linked friends' media content is configurable according to the type of linked friend.
For example, supposing that this user belongs to a service in which he has n other individuals linked as “close friends” and m linked as “linked friends” (counting only those linked friends for whom metadata is available within that service), where the “close friends” weighting is configured to N % and the “linked friends” weighting to M %. In such a case, the preferred embodiment would, when making recommendations, consolidate the linked friends' metadata to the user's such that the weight given to the user's metadata is (100−N−M)%, the weighting given to each “close friend” is (N/n)% and that to each “linked friend” (M/m)%. Where n or m are zero, the relevant component (N or M respectively) is omitted. Thus, a user with no close or linked friends would have his recommendations entirely based upon his own available media content.
1.4 Demographics as Metadata
The device type may also be used, in the preferred embodiment, as a source of metadata, as may other information such as the location of the user (to whatever granularity is available, from the user's country to their precise location as obtained via GPS or some measure in between the two, such as IP address analysis. Similarly, “device” may refer to a specific device or to a class of devices of a defined type, such as “portable game consoles” or “devices which can play DivX video” or “Games Console Model PQT-4381v2.12” or “devices which incorporate a BluRay player”).
Such information may be used to provide a demographic profile of purchasers/users of specific devices and/or inhabitants of given locales. To take a trivial example, such information would be used in one example embodiment to tend to recommend Spanish-language tracks or tracks which are popular in Spain to those users who are in that country. Hence, on synchronisation, those Spanish tracks could be given priority. So if a tourist were to be visiting Spain, then he might find that relatively little known Spanish tracks were given priority during synchronisation.
In addition, demographic information can, in the preferred embodiment, be obtained from a recommendations database which stores analyses of the musical preferences of all users of the service organised according to device type and/or location.
Device-specific metadata stored in the preferred embodiment includes information as to which tracks are most popular amongst users of a particular device in a particular region, with cross-references relating the demographics of average users of such devices to the popularity of tracks of users with such demographics (for example, where the average user of a particular device in the UK is determined to be an 18-25 year old male then the default tracks recommended for a user of that device, where no more specific information is available from a device sweep, would be those tracks which are generally popular on the service amongst 18-25 year old males in the UK).
The tastes of users within this user's own demographic group—as explicitly provided by the user and/or identified via the mechanisms outlined above—may, in the preferred embodiment, be used to augment recommendations made to this user using the same mechanism, mutatis mutandis, as disclosed in “Linked friends weighting” above.
1.5 Periodic Updates and Playback Metrics
In the preferred embodiment, the user's device (and their associated media store) is re-swept to locate new or updated media content and/or metadata at regular intervals which, in the preferred embodiment, are of configurable duration. Any changes detected are then used to provide more relevant updates.
Where the present invention is utilised within a service which permits user ratings and/or playback metrics to be recorded and communicated then such metrics are, in the preferred embodiment, used to update the recommendations provided to the user, such that future recommendations take account of the user's specific preferences.
1.6 Other Contributing Factors
In addition to the “device sweep”, demographic analysis, contributions from linked friends' taste metrics and the ongoing analysis of a user's playback metrics while using the service within which the present invention is utilised, sundry additional factors may also be utilised, in the preferred embodiment, to influence recommendations given to the user and hence influence synchronisation priority.
In the preferred embodiment, such factors include, but are not limited to:
Such considerations, and any others which are applicable, may be used, in the preferred embodiment, to increase or decrease the weightings given to individual tracks when performing the analysis to locate tracks and “nearest neighbours” (users who share the same taste as this user) to recommend to this user.
1.7 Group Considerations
Up to this point, the disclosure of the present invention has been concerned with individual users rather than groups of users. When considering groups, the preferred embodiment consolidates the metadata of individuals within each group into a single collection of metadata and makes use of that combined metadata for analysis and recommendation purposes.
That consolidation, in the preferred embodiment, is performed in two stages:
In the case of group recommendations, the linked friends of individual group members do not contribute to the overall weighting of tracks for the purposes of making recommendations of media content or of individuals with shared tastes in media.
1.8 Empty Devices
In some instances, such as on first use, it may not be possible to perform a device sweep of a user's media files.
For example, this may occur where there are no identifiable media files on the device and this user has not previously registered a device with the service within which the present invention is being utilised and the user has no linked friends within that service (or no such registered devices or linked friends can be identified due to, for example, a poor quality or absent network connection).
In such a case, recommendations may still be made based on demographic metadata alone, as disclosed above in “Demographics as Metadata”.
In the preferred embodiment, such “blank device profiles” are regularly pre-calculated for appropriate locales (such as countries or regions within a country or whatever other granularity is required) to assist with loading recommendations for new blank devices of that type.
2 Synchronising Unidentified Tracks
There may be media content items (“tracks”) which could not be identified automatically during the “device sweep” phase. Such items may, in an example embodiment, be referred to the user for later definitive identification. In another example embodiment, such unidentified items may be tagged by the system for further analysis at a later point.
Such unidentified media content may also, nonetheless, be synchronised across the user's device(s). In the preferred embodiment, the said unidentified content would be transcoded (converted as to their media content encoding format) to file formats appropriate to the user's other device(s), where necessary, and the transcoded versions of the said files transferred to a location from which they may be provisioned to the said other devices. In another embodiment, the process may be inverted—that is, the files transferred to a storage location where they are then transcoded to suitable formats, if necessary, before being made available for provisioning to the user's other device(s).
In either approach, the said storage facility is, in the preferred embodiment, both remotely located and accessible via a network connection (such as the internet or a wireless network) to the user's device(s) AND the said stored content is “locked” (by encryption or some other suitable approach) to ensure that only the originating user is permitted access to that stored content.
One example embodiment may identify where unidentified files from different users actually encode the same media content and use that information as an aid to identifying files, by ensuring that if/when one such media content file is positively identified then other such files are automatically also identified, tagged with the appropriate metadata and relocated, where possible within the applicable licensing laws and agreements, from the secure storage facility (the “locker”) to more general usage.
One example embodiment may identify where unidentified files from different users actually encode the same media content and use that information to avoid duplication of content within the “locker” by making the same file available to both users, where the applicable law permits such action to be taken.
3 Analyse User-Device Interaction
In addition to analysing the user's music collection to derive a metadata based “taste signature”, in the preferred embodiment the present invention also analyses the way in which the user interacts with that device, in terms of the specific user under consideration and/or in terms of the average user of such a device.
Elements considered include one or more of the following:
The present invention also takes account, in its preferred embodiment, of the capabilities of the device. Elements considered include one or more of the following:
3.1 Device Connection Properties
The properties of a particular device's network connection are utilised, in the preferred embodiment, to influence recommendations (based, for example, on file size) and/or determine the timing as to when synchronisation takes place. Elements considered, in the preferred embodiment, include one or more of:
In the preferred embodiment, such an analysis would indicate that the said original wireless network is the user's “home network” and would permit downloads to (and/or uploads from) the device to be scheduled for those times when the user's device is determined to have its most reliable and/or fastest network connection.
In one example embodiment, the device has a reliable network connection only at specific times of day, as determined from statistical data and/or analysis of the connection activity of a specific user. In such a case, synchronisation—downloads, uploads or both—of larger files may be deferred (using, in the preferred embodiment, a download queue system) until a specifically scheduled time rather than happening on an ad hoc basis throughout the day.
4 Synchronise the Device with the Service
After the content analysis is complete, the process of synchronising the user's music collection with the service within which the present invention is utilised two distinct stages, as shown in
4.1 Playlist Reconstruction
In the preferred embodiment, any playlists identified during the device sweep disclosed earlier would be reconstructed within the service within which the present invention is utilised. Specifically, playlist files, such as those in the form of *.M3U and *.pls and *.wpl files or any other appropriate playlist file format, would be duplicated, in the MusicStation Platform which forms one embodiment of the present invention, under the individual user's profile. That process is illustrated in
Once the user's media content has been located and identified, as disclosed above, his affinity for specific tracks, artists and playlists may be calculated using the techniques disclosed in detail in Omnifone Patent Application “Nearest Neighbour & Digital Content Recommendation Techniques” PCT/GB2010/051113 or by any other compatible mechanisms.
Such a recommendations generation procedure, in the preferred embodiment, takes account both of the user's taste signature, as produced by the analysis of the user's “music collection” as derived from the device sweep disclosed earlier AND of the user's interaction history with the device to be synchronised.
As disclosed above, where any particular data is unavailable then demographically-derived metadata is, in the preferred embodiment, utilised in order to ensure that a set of media content is available for provisioning to the user's device even in the case where this is a new user with an empty device (as disclosed previously in this document, in the “Empty Devices” section).
6 Synchronisation of Channels
In the user interface for some device types the service within which the present invention is utilised may categorise media content into separate “channels”, as disclosed in detail in Omnifone Patent application: Channels and Radio stations PCT/GB2010/050771.
The user's preference for particular “channels” may be used to prioritise the downloading of—and, in the preferred embodiment, to weight the recommendations for—new media content, in combination with one or more of the other user-device interaction analyses, such as those disclosed in “Analyse User-Device Interaction” earlier.
In the preferred embodiment, such “channels” would be pre-populated with metadata and tracks where possible, the determination as to which are to be pre-emptively cached being based on one or more of the overall recommendations for the user, the type of network connection available, demographic data and editorial considerations, such as how to ensure that channels are populated evenly given the analysis already disclosed as to the user's listening preferences.
In the preferred embodiment, the end user would utilise the user interface of their client device to search for available channels and to subscribe to those channels in which he is interested (and to unsubscribe from channels to which he has previously been subscribed). In one example embodiment, the said user is permitted to maintain different sets of subscribed channels, with zero, one or more such channels sets being device-specific, permitting the said user to subscribe to, for example, different channels on each of his registered devices.
Where a channel is subscribed to by the said user, that user's registered client devices are, in the preferred embodiment, automatically updated with new content consistent with that channel's definition for the said user and the said device.
The initial selection of which channels to present—and, in the preferred embodiment, pre-load with some or all of that channel's defined content—to a given user on a given device is, in the preferred embodiment, made in a similar manner, mutatis mutandis, as for the mechanism used to provide track recommendations on the service within which the channels are utilised. In another example embodiment, the said initial selection of channels is made manually.
Channel-specific content is, in the preferred embodiment, stored securely on the client device using DRM protection appropriate to that device, and the synchronisation process for a channel includes the removal of stale channel content from the said device in order to free storage space for new channel content.
Where such channels are themselves grouped into “meta channels” then the preferred embodiment would treat the said meta channels similarly. In addition, in the preferred embodiment, empty channels are not displayed in the user interface.
7 Prioritise the Provision of Media Content to the Device
The provision of media content to the user's device requires, in the preferred embodiment, consideration of several factors, to whit:
In the preferred embodiment, synchronisation occurs as continuously as a device's connection type permits. Where possible, data is transmitted by “piggybacking” onto communications which would have happened anyway. For example, in one sample embodiment a device sends a “polling” communication to the server (of the service within which the present invention is utilised) at regular intervals. Where possible, other data—such as track playback metrics or metadata resulting from the device sweep disclosed earlier—will be sent simultaneously, thus making more efficient use of the available bandwidth.
Features of synchronisation include the following:
Number | Date | Country | Kind |
---|---|---|---|
0921559.1 | Dec 2009 | GB | national |
Filing Document | Filing Date | Country | Kind | 371c Date |
---|---|---|---|---|
PCT/GB2010/052064 | 12/9/2010 | WO | 00 | 11/13/2012 |