Network-based delivery of media content has largely supplanted other forms of media content delivery, such as brick-and-mortar video sales and rental stores, mail-based video rental services, and so on. Instead of traveling a few miles to a physical store or waiting days for a title to arrive by mail, users may select media content titles to stream to their devices over high-speed broadband connections. Consequently, users are quickly growing accustomed to near-immediate delivery of media content. Rising user expectations may lead to frustration when playback does not begin immediately upon user selection of a media content title.
Many aspects of the present disclosure can be better understood with reference to the following drawings. The components in the drawings are not necessarily to scale, with emphasis instead being placed upon clearly illustrating the principles of the disclosure. Moreover, in the drawings, like reference numerals designate corresponding parts throughout the several views.
The present disclosure relates to predictive caching for content items such as, for example, movies, television programs, music, video clips, audio clips, applications, and so on. Such content is increasingly offered through network streaming or progressive download. If the network connection of the user has bandwidth exceeding the bitrate of the content, the content can be played back or otherwise used while it is being downloaded or streamed. Despite having the network bandwidth to support streaming, users may still experience delay after initially selecting a content item for use. For example, playback may be delayed for several seconds, leading to user frustration. This delay may be due to the initial filling of buffers in the client with portions of the content item; launching and initializing various software and/or hardware components in the client to perform decryption, decoding, or other functions; or other causes.
Various embodiments of the present disclosure enable instantaneous, or near instantaneous, playback of network-streamed or progressively downloaded content by predictively caching initial portions of content items that a user is likely to playback or use. The predictive caching may involve downloading initial portions of the content item in advance, downloading metadata including manifest files and decryption keys, decrypting the initial portions of the content items, performing configuration tasks, performing initialization tasks, and/or performing other tasks relating to preparing a content item for playback. The predictive cache may be maintained and updated according to available data storage, available network bandwidth, recommendations data, real-time user behavior data, and/or other factors.
With reference to
The client 106 includes a predictive cache 118 in memory that stores a content item initial portion 121 and content item metadata 124 for each predictively cached content item. Through predictive caching, the client 106 is configured to obtain the content item initial portion 121 and the content item metadata 124 from the computing environment 103 over the network 109 before the user at the client 106 requests use or playback of the content item. Further, the client 106 may initialize various software and/or hardware components based at least in part on the content item initial portion 121 and/or the content item metadata 124 in order to provide an instantaneous use experience when the user selects the content item for use.
After the user requests use of the content item, the client 106 may then begin to obtain content item subsequent portions 127 in a content stream 130 over the network 109 from the computing environment 103. Thus, as the client 106 exhausts use of the content item initial portion 121, the client 106 may seamlessly continue use of the content item subsequent portions 127. In the following discussion, a general description of the system and its components is provided, followed by a discussion of the operation of the same.
Turning now to
The computing environment 103 may comprise, for example, a server computer or any other system providing computing capability. Alternatively, the computing environment 103 may employ a plurality of computing devices that may be employed that are arranged, for example, in one or more server banks or computer banks or other arrangements. Such computing devices may be located in a single installation or may be distributed among many different geographical locations. For example, the computing environment 103 may include a plurality of computing devices that together may comprise a cloud computing resource, a grid computing resource, a content delivery network, and/or any other distributed computing arrangement. In some cases, the computing environment 103 may correspond to an elastic computing resource where the allotted capacity of processing, network, storage, or other computing-related resources may vary over time.
Various applications and/or other functionality may be executed in the computing environment 103 according to various embodiments. Also, various data is stored in a data store 133 that is accessible to the computing environment 103. The data store 133 may be representative of a plurality of data stores 133 as can be appreciated. The data stored in the data store 133, for example, is associated with the operation of the various applications and/or functional entities described below.
The components executed on the computing environment 103, for example, include a recommendations engine 136, a content server 139, and other applications, services, processes, systems, engines, or functionality not discussed in detail herein. The recommendations engine 136 is executed to generate a list of recommended content for a user. To this end, the recommendations engine 136 may analyze various behavioral data collected regarding the user. The list of recommended content corresponds to content that the user is likely to playback or consume. The list may include relative priorities for the recommended content. The list may be sent to the client 106 over the network 109 as recommendations data 142.
The content server 139 is executed to serve up content items and associated data to users at clients 106. To this end, the content server 139 is configured to send content data 145 to the client 106 via the network 109. In addition, the content server 139 may generate and send user interface data to the client 106 to facilitate user browsing, searching, and/or selection of content. Such user interface data may correspond to web page data, mobile application data, and/or other forms of user. Such user interface data may include hypertext markup language (HTML), extensible markup language (XML), cascading style sheets (CSS), and/or other data. In one embodiment, the content server 139 may send directives to the client 106 that instruct the client 106 to predictively cache preselected content items.
The data stored in the data store 133 includes, for example, user account data 148, a content library 151, and potentially other data. The content library 151 includes data relating to content items that are made available by the content server 139 for playback, download, viewing, lease, purchase, etc. Such content items may include, for example, movies, television shows, music, music videos, video clips, audio clips, applications such as mobile applications, and so on. The content library 151 may include content portions 153, metadata such as manifests 155 and decryption keys 157, and/or other data.
Each of the content portions 153 may correspond to a distinct time segment of the particular content item. In some cases, multiple alternative content portions 153 may be provided for time segments, e.g., both English and Spanish language audio tracks, different bitrates with different encoding qualities, and so on. The content portions 153 may include Moving Pictures Experts Group (MPEG) video data, H.264 data, Flash® media data, MPEG layer 3 (MP3) audio data, Dolby Digital® audio data, Advanced Audio Coding (AAC) audio data, data for subtitles, etc.
The manifests 155 may describe, for example, how a particular content item is made up of various content portions 153. The manifest 155 may include identifiers for content portions 153 that make up the content item along with sequence-specifying data so that the client 106 can obtain and render the content portions 153 in the correct order. The manifest 155 may also identify various alternative content portions 153 for a content item such as, for example, alternative languages, alternative bitrates, and other alternatives. In some cases, the manifest 155 may provide license-related information, including the location of the decryption keys 157.
The decryption keys 157 may be employed by the client 106 to decrypt content portions 153 which are encrypted under digital rights management (DRM) technologies. A decryption key 157 may be sent along with the content portions 153 if the client 106 has rights to the corresponding content item. The rights to the corresponding content item may expire at a particular time, after a time period, upon a certain number of plays for the content item, or at some other time. Thus, the decryption keys 157 may be configured to expire in response to expiration of the rights of the client 106 to the corresponding content item. In some embodiments, the decryption keys 157 may be referred to as “licenses” for the corresponding content items.
The user account data 148 may include various data associated with user accounts with the content server 139. Such accounts may be explicitly registered and configured by users or may be created implicitly based on client 106 interaction with the content server 139. The user account data 148 may include, for example, behavior history 160, real-time behavior data 162, bandwidth history 164, content preferences 166, watch lists 168, recommended lists 170, subaccount data 172, content rights 175, and other data. In addition, security credentials, contact information, payment instruments, and/or other user-related data may be stored in the user account data 148.
The behavior history 160 describes historical behavior of the user associated with the user account. Such behavior may include a content consumption history describing which content items the user has viewed, downloaded, purchased, etc. In one example, the content consumption history corresponds to a media consumption history indicating which media content items the user has viewed, downloaded, purchased, etc. Such behavior may also include a browse history tracking network pages or content the user has previously accessed, a search history tracking previous search queries, subscription history, purchase and browse history for non-content items, and/or other forms of online behavior.
The real-time behavior data 162 may include data describing what the user is currently doing, e.g., what content the user is currently browsing, what search queries the user is currently executing, what search results are being displayed to the user, etc. The real-time behavior data 162 may be observed by the content server 139 or collected from reports by the client 106. For example, the client 106 may be configured to report to the content server 139 that the user is hovering a cursor over a description of a certain content item in a user interface. In some embodiments, the real-time behavior data 162 may be maintained in the client 106 rather than the computing environment 103.
The bandwidth history 164 profiles the network bandwidth available for the user through the client 106. The bandwidth history 164 may be employed to select from among multiple bitrates of content items automatically for predictive caching. If the user employs multiple clients 106, multiple profiles may be created in the bandwidth history 164. Also, multiple location-dependent profiles may be created for clients 106 that are mobile devices. As a non-limiting example, a user may have third-generation (3G) cellular data access at an office location, but high-speed Wi-Fi data access at a home location, thereby resulting in multiple location-dependent bandwidth profiles for the same client 106 in the bandwidth history 164.
The content preferences 166 include various preferences inferred from user behavior or explicitly configured by users. Such preferences may be relating to media content quality (e.g., bitrate, codec, etc.), language preferences, subtitle preferences, closed captioning preferences, supplemental content preferences (e.g., relating to directors' or actors' commentaries, etc.), parental control preferences, and so on. The watch lists 168 may correspond to lists of content items in which users have explicitly indicated that they desire to consume the content at some time in the future. The recommended lists 170 correspond to lists of recommended content items generated for each user by the recommendations engine 136.
The subaccount data 172 may be employed to describe preferences or behaviors that differ across multiple users of a user account. For instance, a family may have a single user account but subaccounts for each member of the family. Each user may explicitly log in to a subaccount, or the subaccount may be inferred based on time of day, day of the week, identity or type of the client 106, location of the client 106, and/or other factors. In some cases, one user may be associated with multiple subaccounts. Further, a subaccount may be associated with multiple users. The subaccount data 172 may specify restrictions on content access in some cases. As a non-limiting example, a subaccount for a child may be limited to access only child-friendly content from approved sources. In some cases, different subaccounts may be associated with different clients 106.
The content rights 175 may describe the rights to content which are associated with the user account. For example, a user may have a subscription to certain content or all content available through the content server 139. Such a subscription may be for indefinite use of the accessed content, time-limited use, device-limited use, and/or other licensing arrangements. Alternatively, a user may purchase or lease content on a per-content-item basis.
The client 106 is representative of a plurality of client devices that may be coupled to the network 109. The client 106 may comprise, for example, a processor-based system such as a computer system. Such a computer system may be embodied in the form of a desktop computer, a laptop computer, personal digital assistants, cellular telephones, smartphones, set-top boxes, music players, web pads, tablet computer systems, game consoles, electronic book readers, or other devices with like capability. The client 106 may include a display 177. The display 177 may comprise, for example, one or more devices such as liquid crystal display (LCD) displays, gas plasma-based flat panel displays, organic light emitting diode (OLED) displays, LCD projectors, or other types of display devices, etc.
The client 106 may be configured to execute various applications such as a content access application 179, a predictive caching system 181, and/or other applications. The content access application 179 may be executed in the client 106, for example, to access and render content items from the computing environment 103 and/or other servers. Moreover, the content access application 179 may access various other network content served up by the computing environment 103 and/or other servers, thereby rendering a user interface 112 on the display 177. The content access application 179 may provide various media player functionality including, for example, initiating playback, stopping playback, pausing playback, adjusting volume, setting preferences, browsing for media content, searching for media content, recommending media content by rendering recommendations 115 (
The predictive caching system 181 is executed to predict various content items that the user is likely to access and to cache content item initial portions 121 (
The client 106 may also include a secure data store 187 for storage of decryption keys 157 used in decrypting content items to which the user has rights in the client 106. The secure data store 187 may comply with various rules regarding security for storage of DRM licenses. The secure data store 187 may have relatively limited storage space for decryption keys 157. In some cases, the limited storage space in the secure data store 187 may in turn limit the size of the predictive cache 118. The predictive caching system 181 may be configured to install the decryption keys 157 in the secure data store 187 which the corresponding content items are predictively cached. The client 106 may be configured to execute applications beyond the content access application 179 and the predictive caching system 181 such as, for example, browsers, mobile applications, email applications, social networking applications, and/or other applications.
Next, a general description of the operation of the various components of the networked environment 100 is provided. To begin, users may register and interact with the content server 139 such that behavior history 160 (e.g., consumption history, etc.), bandwidth history 164, content preferences 166, watch lists 168, and/or other data in the user account data 148 is created for a content access account. The recommendations engine 136 may process this data in order to generate the recommended lists 170 for the users. In some cases, the recommended lists 170 may be based on real-time behavior data 162 associated with the users. Such real-time behavior data 162 may, for example, describe a listing of content items being presented to the user a user interface, a listing of search results generated in response to a search query obtained from the user, and so on. The recommended lists 170 may depend further on the time of day, the day of the week, which subaccount is active, etc.
The recommended lists 170 and/or other data used to generate recommendations may be sent to the client 106 as recommendations data 142. From a list of recommended content items, the predictive caching system 181 selects a subset of the list based at least in part on a respective priority of the content items, an available data storage for the client 106, available storage in the secure data store 187, available bandwidth, power state in the client 106, costs associated with the network 109 connection to the client 106, type of network 109 connection to the client 106, configuration parameters, and/or other factors. In one embodiment, the predictive caching system 181 determines the selected subset according to a directive from the computing environment 103.
The predictive caching system 181 proceeds to predictively cache the content items in the selected subset. In doing so, the predictive caching system 181 may prepare the client 106 for instantaneous use or playback of the selected subset of content items before the user selects any of the selected subset of content items for use. To this end, the predictive caching system 181 may obtain initial portions from the content portions 153 and metadata such as manifests 155 and decryption keys 157 from the content server 139.
The content portions 153 may be sent in a decrypted format. To handle this, the predictive caching system 181 may obtain decryption keys 157, which are then installed in the secure data store 187 to handle the decryption. The predictive caching system 181 may spin up and initialize hardware and/or software resources of the client 106, to include, for example, decoding components 183, decryption components 185, and other components of the content access application 179. Thus, the predictive caching system 181 may perform some processing relative to the metadata and/or the initial portion of the content item in order to prepare the client 106 for instantaneous playback of the predictively cached content items prior to the user explicitly indicating that use or playback is desired.
Instantaneously available use may then be provided by the content access application 179 when any of the selected subset of content items is selected for use or playback by the user. The content access application 179 is configured to stream the selected content item from the content server 139 as a content stream 130. Although described as “instantaneous” playback, it is understood that such playback may include a fade transition or other transition in order to avoid a jarring experience of cutting directly to playback.
Referring next to
Beginning with box 203, the predictive caching system 181 determines a list of recommended content items. To this end, the predictive caching system 181 may obtain recommendations data 142 (
In box 206, the predictive caching system 181 selects a subset of the list of recommended content items to be predictively cached. The selection may be driven by priority of the respective content items, available resources in the client 106 (e.g., available memory or data storage allocated for the predictive cache 118 (
In box 209, the predictive caching system 181 determines whether previously cached content from the predictive cache 118 is to be purged. Such content may be purged in order to free up resources for other content that is determined to be more likely to be consumed by the user. The previously cached content may also be rendered obsolete by a change to the factors which prompted its initial selection to be predictively cached, e.g., if the content is no longer timely, if the real-time behavior of the user that prompted the predictive caching of the content has changed, if the user has completed consuming the content, and so on. In some cases, the user may explicitly request that content be purged from the cache.
If previously cached content is to be purged, the predictive caching system 181 moves from box 209 to box 212 and determines which of the previously cached content items are to be purged. In some cases, the user may explicitly identify which content is to be purged. In box 215, the predictive caching system 181 deallocates resources in the client 106 that had been allocated to the content items that are to be purged. In doing so, the predictive caching system 181 may, for example, remove content item initial portions 121 (
In box 218, the predictive caching system 181 obtains content item initial portions 121 from the content server 139 (
In box 227, the predictive caching system 181 may render a user interface 112 (
Turning now to
Beginning with box 303, the content access application 179 obtains a request to use a content item. For instance, a user may navigate to a user interface 112 (
In box 309, the content access application 179 obtains a content item initial portion 121 (
It is noted that performing the tasks of boxes 309-315 may delay playback of the content item relative to the case in which the content item has been predictively cached. The content access application 179 then continues to box 318. If the content access application 179 determines that the content item has been predictively cached, the content access application 179 moves from box 306 to box 318.
In box 318, the content access application 179 begins use of the content item. If the content item was predictively cached, an instantaneous use experience is provided as the delay-inducing tasks of boxes 309-315 were performed in advance. In box 321, the content access application 179 determines whether more data for the content item remains to be streamed or downloaded. If no more data remains, the portion of the content access application 179 ends. If use is not finished, the content access application 179 instead continues to box 324 and obtains a content item subsequent portion 127 (
Moving on to
Beginning with box 403, the content server 139 authenticates a user at a client 106 (
In box 412, the content server 139 determines whether the client 106 has rights to the content item to which the content data 145 pertains. If not, the content server 139 may prompt the user to acquire the rights in box 415. For example, the content server 139 may send data encoding a user interface 112 (
If the client 106 does have the rights, the content server 139 moves from box 412 to box 418 and sends the content data 145 to the client 106 over the network 109 (
With reference to
Stored in the memory 506 are both data and several components that are executable by the processor 503. In particular, stored in the memory 506 and executable by the processor 503 are the recommendations engine 136, the content server 139, and potentially other applications. Also stored in the memory 506 may be a data store 133 and other data. In addition, an operating system may be stored in the memory 506 and executable by the processor 503. The client 106 (
It is understood that there may be other applications that are stored in the memory 506 and are executable by the processor 503 as can be appreciated. Where any component discussed herein is implemented in the form of software, any one of a number of programming languages may be employed such as, for example, C, C++, C#, Objective C, Java®, JavaScript®, Perl, PHP, Visual Basic®, Python®, Ruby, Flash®, or other programming languages.
A number of software components are stored in the memory 506 and are executable by the processor 503. In this respect, the term “executable” means a program file that is in a form that can ultimately be run by the processor 503. Examples of executable programs may be, for example, a compiled program that can be translated into machine code in a format that can be loaded into a random access portion of the memory 506 and run by the processor 503, source code that may be expressed in proper format such as object code that is capable of being loaded into a random access portion of the memory 506 and executed by the processor 503, or source code that may be interpreted by another executable program to generate instructions in a random access portion of the memory 506 to be executed by the processor 503, etc. An executable program may be stored in any portion or component of the memory 506 including, for example, random access memory (RAM), read-only memory (ROM), hard drive, solid-state drive, USB flash drive, memory card, optical disc such as compact disc (CD) or digital versatile disc (DVD), floppy disk, magnetic tape, or other memory components.
The memory 506 is defined herein as including both volatile and nonvolatile memory and data storage components. Volatile components are those that do not retain data values upon loss of power. Nonvolatile components are those that retain data upon a loss of power. Thus, the memory 506 may comprise, for example, random access memory (RAM), read-only memory (ROM), hard disk drives, solid-state drives, USB flash drives, memory cards accessed via a memory card reader, floppy disks accessed via an associated floppy disk drive, optical discs accessed via an optical disc drive, magnetic tapes accessed via an appropriate tape drive, and/or other memory components, or a combination of any two or more of these memory components. In addition, the RAM may comprise, for example, static random access memory (SRAM), dynamic random access memory (DRAM), or magnetic random access memory (MRAM) and other such devices. The ROM may comprise, for example, a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), or other like memory device.
Also, the processor 503 may represent multiple processors 503 and/or multiple processor cores and the memory 506 may represent multiple memories 506 that operate in parallel processing circuits, respectively. In such a case, the local interface 509 may be an appropriate network that facilitates communication between any two of the multiple processors 503, between any processor 503 and any of the memories 506, or between any two of the memories 506, etc. The local interface 509 may comprise additional systems designed to coordinate this communication, including, for example, performing load balancing. The processor 503 may be of electrical or of some other available construction.
Although the recommendations engine 136, the content server 139, the content access application 179 (
The flowcharts of
Although the flowcharts of
Also, any logic or application described herein, including the recommendations engine 136, the content server 139, the content access application 179, and the predictive caching system 181, that comprises software or code can be embodied in any non-transitory computer-readable medium for use by or in connection with an instruction execution system such as, for example, a processor 503 in a computer system or other system. In this sense, the logic may comprise, for example, statements including instructions and declarations that can be fetched from the computer-readable medium and executed by the instruction execution system. In the context of the present disclosure, a “computer-readable medium” can be any medium that can contain, store, or maintain the logic or application described herein for use by or in connection with the instruction execution system.
The computer-readable medium can comprise any one of many physical media such as, for example, magnetic, optical, or semiconductor media. More specific examples of a suitable computer-readable medium would include, but are not limited to, magnetic tapes, magnetic floppy diskettes, magnetic hard drives, memory cards, solid-state drives, USB flash drives, or optical discs. Also, the computer-readable medium may be a random access memory (RAM) including, for example, static random access memory (SRAM) and dynamic random access memory (DRAM), or magnetic random access memory (MRAM). In addition, the computer-readable medium may be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), or other type of memory device.
It should be emphasized that the above-described embodiments of the present disclosure are merely possible examples of implementations set forth for a clear understanding of the principles of the disclosure. Many variations and modifications may be made to the above-described embodiment(s) without departing substantially from the spirit and principles of the disclosure. All such modifications and variations are intended to be included herein within the scope of this disclosure and protected by the following claims.