Synchronized digital content samples

BACKGROUND

Generally described, computing devices and communication networks facilitate the collection and exchange of information. In a common application, computing devices, such as personal computing devices, can utilize a wide area communication network, generally referred to as the Internet, to access content or other data from other computing devices associated with content providing entities. The specific design/function of each computing device can vary the type of content exchanged between the computing devices.

Users can request data from a content providing entity so that the content is delivered to one or more computing devices in a relatively “real time” basis. For example, users can request content from a network resource (e.g., a Web site, Web service, or cloud node) for immediate presentation on a computing device display screen, or they can request the immediate transfer of content, such as a document or data file, from a network resource or Web service for storage on the computing device. In another example, users can transmit a request, or initiate a transaction, that results in the downloading or streaming of content to a computing device. Typically, the content providing entity would initiate the transfer upon receipt of the request from the computing device.

In some instances, limited portions of electronic content, such as an electronic book (“e-book”) or an audio book, may be provided to customers as a content sample of the complete content. Acquisition of a content sample may be associated with lower requirements than acquisition of the corresponding complete content. For example, a content sample may be provided free of charge. As such, content samples may enable a customer to better assess whether to acquire the complete content.

In one application, various computing devices associated with a user or a user account have access to different representations of companion content. For example, a user may utilize a computing device such as an e-book reader that has obtained a digital representation of content (e.g., an e-book) or other digital publication that can be presented on an e-book reader via a communication network (e.g., a wireless communication network). This content may be referred to as a “first” content. The same user may also utilize a computing device such as a laptop that has obtained a separate companion representation of the same or similar content (e.g., an audio book that can be audibly presented via headphones/speakers and that corresponds to the e-book obtained by the user's e-book reader). This content may be referred to as a “second” content. The second content may be obtained at a different time and/or from a different source than the first content. As a result, the first content and the second content can be decoupled from one another, and additional features related to the synergy of the first content and the second content (collectively, the “companion content”) are not readily available to computing devices utilized by the user or associated with the user's account maintained by a content provider.

BRIEF DESCRIPTION OF THE DRAWINGS

The foregoing aspects and many of the attendant advantages will become more readily appreciated as the same become better understood by reference to the following detailed description, when taken in conjunction with the accompanying drawings, wherein:

FIG. 1 is a block diagram depicting an illustrative companion identification environment for use in identifying companion content that can be synchronously presented;

FIG. 2 is a block diagram depicting an illustrative content management environment for use in providing synchronization information to one or more computing devices;

FIG. 3A depicts an illustrative general architecture of a companion identification server for identifying companion content that can be synchronously presented;

FIG. 3B depicts an illustrative general architecture of a content management server for providing content synchronization information to one or more computing devices;

FIGS. 4A and 4B are block diagrams of the content management environment of FIG. 2 illustrating various embodiments for the transmission of synchronization information based on an identified match between first content and second content;

FIG. 5 is an illustrative interface generated on a computing device for selecting options related to an identified content match;

FIG. 6 is an illustrative interface generated on a computing device for requesting content synchronization information for selected content;

FIG. 7 is a flow diagram of an illustrative method of presenting synchronized content;

FIG. 8 is a flow diagram of an illustrative method of rending synchronized content that includes mismatches in companion content;

FIG. 9 depicts an illustrative computing device synchronously presenting companion content;

FIG. 10 is a block diagram of the content management environment of FIG. 2 illustrating an interaction for the display of a companion content notification to a computing device in response to a notification trigger;

FIGS. 11 and 12 are illustrative user interfaces for selecting preferences regarding notifications of companion content;

FIG. 13 is an illustrative user interface for presenting a companion content notification to a user in response to a notification trigger;

FIG. 14 is a flow diagram of an illustrative routine for determining a notification trigger and presenting a companion content notification to a computing device;

FIG. 15 is a block diagram of the content management environment of FIG. 2 illustrating an interaction for provisioning of a synchronized content sample to a computing device;

FIGS. 16 and 17 are illustrative user interfaces for displaying a synchronized content sample and enabling acquisition of a complete content corresponding to the content sample; and

FIG. 18 is a flow diagram of an illustrative routine for generating and delivering a synchronized content sample to a computing device 204 of FIG. 2.

DETAILED DESCRIPTION

Generally described, aspects of the present disclosure relate to managing decoupled companion content so that it can be synchronized and played back simultaneously or interchangeably by a user computing device or devices. For example, companion content may comprise an e-book and a corresponding, decoupled (e.g., separately obtainable) audio book. When provided with both items of companion content as well as synchronization information, a computing device may synchronously present the text of the e-book with the corresponding audio of the audio book. However, in some instances, the user may not be aware of, or may not have access to, both items of companion content, e.g., both the e-book and the corresponding audio book. Accordingly, aspects of the present disclosure relate to providing a user who has access to a first content with a limited portion or sample of companion content, such that a user may evaluate synchronous playback of the first content with the sample of companion content. For example, a user who has access to an e-book may be provided with a sample of a corresponding, separately obtainable audio book, as well as synchronization information enabling synchronous playback of the e-book and the sample of the audio book. Accordingly, the user's computing device may synchronously present the text of the e-book with the corresponding audio of the audio book sample. If the user enjoys the experience, the user may then obtain access to the remaining or entire item of companion content (e.g., the remaining or entire audio book) so as to continue synchronized playback of the companion content. Further, in some embodiments, limited portions or samples of companion content may be provided for independent or separate playback by a user. For example, a user of an e-book may be notified of the availability of the corresponding, separately obtainable audio book. The user may be provided with access to a sample of the audio book, in some cases beginning at the position within the audio book corresponding to the last position that the user has accessed within the e-book. Such a corresponding position may be determined, for example, based at least in part on synchronization information corresponding to the e-book and audio book. The user may then consume the sample of the audio book separately from the e-book.

A first content and a second content that can be synchronized may be referred to as companion content or a companion content pair. For each pair of companion content, content synchronization information associated with the companion content can be generated, transmitted, and/or obtained via computing devices in a communication network. The content synchronization information can include any data related to the synchronous presentation of the first content and the second content, so as to enable one or more computing devices to synchronously present the companion content. Content synchronization information can include reference points mapping portions of the first content to corresponding portions of the second content. In a specific example, content synchronization information can include data that can be used to map a segment of text (e.g., a word, line, sentence, etc.) to a timestamp of a corresponding audio recording. The content synchronization information can also include information related to the relative progress of the presentation, or a state of presentation of the digital representation of the content. The synchronous presentation of the companion content can vary as a function of the capabilities and/or configuration of the device (e.g., a portable e-book reader vs. a mobile phone) and/or the formats of the content in a companion content pair (e.g., a digital publication and an audio recording vs. a video and an audio recoding). Accordingly, the content synchronization information can be generated in a variety of formats, versions, etc. Moreover, the content synchronization information can include a match score and/or a passage mismatch score, as will be described in more detail below, which can be used for synchronously presenting content. In addition, the content synchronization information can include any combination of features or data used to synchronize content in U.S. patent application Ser. No. 12/273,473 (hereinafter, “the '473 Application”), filed Nov. 18, 2008, entitled “SYNCHRONIZATION OF DIGITAL CONTENT,” which is hereby incorporated by reference in its entirety. While the present disclosure may focus on examples of synchronously presenting companion content for illustrative purposes, the principles and advantages described herein may be applied to other ways of synchronizing content. Content can refer to any data that can be directly or indirectly accessed by a user, including, but not limited to, multi-media data, digital images, digital video, displayable text, audio data, electronic documents, electronic publications/books, computer-executable code, portions of the above, and the like.

However, the first and second content in a companion content pair may be decoupled or separately obtained from each other. Companion content may be decoupled from each other, for example, by being stored on separate computing devices, by being stored in separate data stores that are not part of the same logical memory, by being obtained via different or separate transactions, by being obtained at different times, by being obtained from different sources, or any combination thereof. For instance, a user can buy an e-book and then at a later point in time purchase an audio book version of the e-book from a different vendor. In such cases, the user may wish to listen to the audio book while simultaneously reading the e-book. However, when such companion content is decoupled, it can be difficult to provide the user with a synchronous presentation experience, such as presenting portions of the audio book corresponding to text of the e-book presented on a display.

The decoupled nature of companion content can result in a number of difficulties for providing a user with a synchronous presentation experience. Such difficulties may include, for example, determining sources from which to obtain content information identifying the content, identifying that a second content matches or is a companion to a first content, generating content synchronization information needed to synchronize presentation of the first and second content, providing content synchronization information to a computing device with access to the first and/or second content, managing the storage of information related to the first and/or second content, or any combination thereof.

Further, the nature of decoupled content may result in difficulties in notifying a user of the availability of an item of companion content. For example, a user may own an e-book of The Adventures of Tom Sawyer. A corresponding audio book version of The Adventures of Tom Sawyer may also be available. However, the audio book may be published at a different time than the e-book, made available through a different source (e.g., a different retailer or content provider), or otherwise decoupled, as described above. As such, the user may be unaware of the existence of the audio book. Further, the user may be unaware that synchronized playback of the e-book and audio book is possible. Accordingly, a user may benefit from notifications as to the availability of companion content for synchronous playback. In general, a user may prefer to opt-in to such notifications, such that notifications are only received if desired. Further, notifications may be provided to a user on an intelligent basis, such as based on the user's current context (e.g., location, time of day, or other metrics related to the state of the user) or a user's preferences.

Still further, the nature of decoupled content may result in instances where a user may not be aware of, and/or has not yet obtained or acquired access to, both items in a companion content pair. For example, a user may have access to an audio book which corresponds to an e-book, but may not have access to the e-book itself. Accordingly, the user may be unable to enjoy synchronous presentation of the audio book and the e-book. The user may therefore benefit from being provided with at least a portion of the corresponding, not yet obtained e-book, in order to experience synchronous presentation of the audio book and e-book. For example, such a limited portion may constitute a sample portion or trial use portion of the e-book. The limited portion may be provided to the user free of charge, or at a lower fee than would be associated with acquisition of the complete e-book. As will be described in more detail below, a sample of companion content may be provided with use restrictions, such as a maximum duration of consumption of the content. By acquisition of a limited portion of companion content, the user may evaluate synchronous playback of a companion content pair without being required to acquire both items of companion content. Accordingly, if the user enjoys the experience, the user may then obtain access to the remaining or entire item of companion content (e.g., the remaining or entire e-book) so as to continue synchronized playback of the companion content.

Though reference may be made herein to a first content that has already been obtained by the user, aspects of the present disclosure may further relate to providing a limited portion of corresponding second content for synchronous playback with only a limited portion of the first content. For example, a sample of a companion audio book may be provided for synchronous playback with a sample of an e-book. Accordingly, though reference may be made to a first or acquired content, such reference should not be construed to apply only to complete content, but may include content samples, trial uses, or other portions of a first content.

Aspects of the present disclosure will first be described with respect to identifying companion content pairs (e.g., a first content and a corresponding second content), and enabling synchronous playback of the companion content pair. Thereafter, aspects of the present disclosure will be described with respect to notifying a user or users as to the availability of companion content. Still further, aspects of the present disclosure will be described with respect to providing to a user a limited portion of a corresponding second content for synchronous playback with a first content.

With respect to the general identification and presentation of companion content pairs, since the first content and the second content of a companion content pair may be decoupled from each other, one or more computing devices may identify a content match, which indicates that the second content may be a companion of the first content. As used herein, identification of a content match may generally indicate the identification of a first content that is a companion to a second content, or vice versa. Accordingly, the term “content match” should not be construed as including only identical items of content. Similarly, though items of content may have limited characteristics in common, such as a common genre, author, publisher, etc., these common characteristics might not be sufficient to indicate that a first content is a companion to a second content, and therefore might not be sufficient to indicate a content match. In embodiments in which the user already has access to the first content and the second content, the one or more computing devices can also identify that the user has such access. Based on determining the content match, the one or more computing devices can identify a receiving computing device associated with the user, and cause transmission of content synchronization information related to the companion content to the receiving computing device. Thereafter, the receiving computing device can utilize the content synchronization information to synchronously or simultaneously present the companion content to the user. Those skilled in the art will appreciate that more than one individual content may match or be a companion to another content. Accordingly, more than two individual contents may be synchronously presented without departing from the scope of the present disclosure. In addition, in some embodiments, one or more receiving computing devices associated with one or more users may receive the content synchronization information and utilize the content synchronization information to synchronously present the companion content.

As an illustrative, non-limiting example, a user may obtain access to companion content (e.g., an e-book formatted for an e-book reader, an audio book, and an e-book formatted for a mobile phone) that can be synchronously presented. More specifically, the user may initially obtain a first content, such as an e-book of The Adventures of Tom Sawyer, and store the e-book on the user's e-book reader. In some instances, the audio book of The Adventures of Tom Sawyer may become available after the user obtains the first content. Yet, in other instances, the audio book of The Adventures of Tom Sawyer may already be available when the user obtains the first content. The user may then obtain this second content, i.e., the audio book of The Adventures of Tom Sawyer, via a separate transaction, which can include purchasing, lending, sharing, transferring, or any combination thereof. The separate transaction may be a purchase transaction resulting from a message that the audio book has become available or from browsing a catalog of available audio books. As will be described below, in some embodiments, the user may obtain the second content (or a trial thereof) in response to a notification that the second content is available. After the audio book and the e-book are obtained, the user may desire to synchronously listen to the audio book while viewing the e-book.

In this regard, a content management system can identify that the first content and the second content are a content match, based on determining that the first and second content are companion content. The content management system may be implemented by one or more computing devices, which may, in some instances, include any computing device(s) associated with the user. The content information may be obtained, for example, from network resources, such as an external data source that includes purchase information associated with a user or user account, and/or from information the user shares from a computing device, such a list of content available to the computing device.

In addition to identifying a content match, the content management system can also identify a computing device associated with the user that can synchronously present the first and second content, such as the e-book reader or another computing device. A particular version of the content synchronization information may be transmitted to the identified device in order to be compatible with the companion content that is presented using the identified computing device and/or be compatible with identified computing device itself. For example, a different version of content synchronization information may be provided to an e-book reader versus a mobile phone, based on different formats used to visually present the text of an e-book. The identified computing device may already store the companion content or the content management system may cause at least a portion of the companion content to be transmitted to the identified computing device. The content management system can also cause content synchronization information to be transmitted to the identified device.

With the companion content and the content synchronization information available to the same computing device, the computing device can synchronously present the companion content to provide the user with an enhanced content consumption experience. For instance, the user may listen to the audio book of The Adventures of Tom Sawyer while viewing the corresponding text of the e-book, which text can be highlighted, underlined, or otherwise enhanced to correspond to the playback of the audio book. The synchronous presentation experience may also include, for example, automatic page turning synchronized with audio playback and/or aligning search results in one format with a presentation position of the other format, with subsequent synchronous presentation starting at the search result position. Further, though examples may be described with respect to simultaneous output of companion content, synchronized playback may also include interchangeable playback of a synchronized first content and second content. For example, content synchronization information can be used to switch back and forth between presenting a first content and a second content. More specifically, in some implementations, a computing device can display the text of an e-book and then switch to playing the audio of an audio book at a corresponding position using the content synchronization information, or vice versa.

As described above, in some embodiments, the decoupled nature of companion content may present difficulties in notifying a user that companion content exists. For example, a user may purchase a first content of a companion content pair, but not be aware that a corresponding second content is also available. Moreover, even if the user is aware both the first content and second content are available, the user may not be aware that the companion content pair can be synchronously presented. As such, the user of a first content may benefit by being notified that a corresponding second content exists, and may be synchronously presented. Further, a user may not immediately recognize the potential benefits of synchronous presentation. As such, a notification may, in some embodiments, include an offer to acquire a portion of the second content (e.g., a trial portion). This portion of the second content may be offered at a reduced cost, or may be offered free of charge. For example, a user that has previously acquired a first content may be offered a corresponding second content at a discount rate. In some embodiments a cost associated with acquisition of a portion of the second content may be dependent on the user's position within the first content. For example, a user may consume 85% of The Adventures of Tom Sawyer e-book without acquiring any portion of a corresponding audio book. A user may be notified that such an audio book exists, and provided with an offer to acquire only the portion of the audio book corresponding to the unconsumed portion of the e-book. Illustratively, the user may be offered the portion of the audio content corresponding to the last 15% of the e-book, at an 85% reduced cost. As will be appreciated by one skilled in the art, offers to acquire companion content may be associated with a variety of pricing models or mechanisms, as will be discussed in more detail below.

In some embodiments, notifications may be provided based on a variety of notification triggers. Generally, a notification trigger may refer to any action or event, series of actions or events, or user context that indicates a user may desire to be notified that companion content is available. For example, a user may have acquired an e-book of The Adventures of Tom Sawyer, but may have not acquired the corresponding audio book. As such, the user may read the e-book (e.g., via an e-book reader, or via an e-book reader application) for a threshold amount of time. Thereafter, the user may, within a predefined period of time, halt consumption of The Adventures of Tom Sawyer e-book and begin consumption of an unrelated audio book (e.g., Anna Karenina). The user may alter the format of consumption of content from a visual (e.g., text) medium to an audio medium for any number of reasons. For example, the user's eyes may be otherwise occupied (e.g., while walking, driving, etc.), the user may be tired (and find it easier to listen to content than to read it), or the user's current lighting conditions may not easily facilitate reading. One skilled in the art will appreciate that a user may switch between consumption formats for any number of reasons. Because the user had previously been reading The Adventures of Tom Sawyer e-book, it may be that the user would prefer to continue consuming this content, but is unable or unwilling to (e.g., for any of the reasons described above). As such, the user may have instead chosen to listen to the unrelated audio book. In accordance with aspects of the present disclosure, the user may therefore be notified that an audio book of The Adventures of Tom Sawyer is available, and may be synchronously presented with the e-book version of The Adventures of Tom Sawyer. Beneficially, this may enable the user to continue consuming The Adventures of Tom Sawyer, despite the difficulties which initially prompted a shift to consuming audio content.

Though a single example of a notification trigger is given above, any number of actions or events may indicate that a user may desire to be notified as to the existence of companion content. For example, a user may consume text content on a first device, and thereafter enter a car capable of outputting only audio content. As such, the user may wish to be notified that a text content the user was previously consuming is also available in audio format. As a further example, a user's device may be capable of automatically modifying content from a first format to a second format (e.g., via an automated text-to-speech process). A user activation of such a feature may indicate a desire to consume content in the second format. However, the automatic modification of content may produce less than optimal results. For example, the text-to-speech conversion process may result in unnatural sounding audio. As such, the user may be notified that their consumed content exists natively within the second format (e.g., as a professionally narrated audio book).

Moreover, notification triggers may include context information regarding a user or their surroundings. For example, a notification trigger may include an assessment of the rate of consumption of content. Illustratively, the trigger may correspond to monitoring how quickly “pages” within an e-book are consumed. A reduced speed of consumption may correspond to a high likelihood that the user would like to be notified that a corresponding audio book exists. Further notification triggers include, but are not limited to: other assessments of the consumption of content (e.g., a very high volume or font size); an assessment of external conditions (e.g., a low light source or high amount of external noise); the state of a user's device (e.g., headphones or speaker available, amount of battery available to power a screen or speakers, etc.). In some embodiments, notification triggers may include or be modified by additional information regarding a user. For example, a user's location may indicate whether notifications are desired. Illustratively, a user may not desire to be notified of companion content while they are at work or otherwise occupied. As a further example, a user may only desire to be notified between certain hours of the day (e.g., notifications may not be desirable very late at night).

In some embodiments, information regarding a user or their context may be gathered from additional data sources. For example, in some embodiments, a user may allow notification triggers to be modified based on a shared calendar resource, such as a user's electronic calendar. Illustratively, this may prevent notifications at times in which the user is unavailable or has limited availability.

In still more embodiments, notification triggers may be based at least in part on secondary information regarding a user, such as the user's purchase history, a user's interaction with previous notifications, or demographic data regarding a user. For example, a user with a high number of historical audio book purchases may be more likely to respond positively to a notification that audio book content corresponding to a base content exists. As a further example, a user with little or no previous audio book purchases may not be aware that content in audio format is available, and so may benefit from a notification. In some embodiments, a user's purchase history over time may be analyzed to determine a purchase rate or velocity. For example, a user that purchased a high number of e-books in the past, but has recently purchased little or no e-books may have a declining e-book purchase velocity. As such, a notification may be triggered in order to attempt to regain the patronage of the user. Further, a user's interaction with previous notifications may be used to determine whether a notification trigger has occurred. For example, where a user has consistently declined offers within a specific type of notification trigger, that notification trigger may be less likely to occur in the future. Conversely, where a user has consistently accepted offers presented based on a specific type of notification trigger, that notification trigger may be more likely to occur. Still further, demographic data regarding a user may be used to determine or modify notification triggers. For example, a user's age, location, gender, income, profession, or other information may (with the consent of the user) be compared against demographic information of other users to estimate the user's response to a notification trigger. Illustratively, users between the ages of 18 and 30 may consistently decline offers transmitted in response to a given notification trigger. As such, users between 18 and 30 may be less likely to receive offers in response to the given notification trigger. Though illustrative examples of secondary information regarding a user have been described above, secondary information may include any information regarding a user that may reflect the user's desire to receive notifications as to the availability of companion content.

As described above, in some embodiments, the decoupled nature of companion content may result in instances where one or both items within a companion content pair have not yet been acquired by a user. For example, a user may have access to an e-book that corresponds to a companion audio book, but may not yet have access to the companion audio book. As a further example, a user may have access to only a portion of the e-book, such as a sample chapter, without access to a corresponding portion of a companion audio book. Accordingly, aspects of the present disclosure relate to generation and transmission of a sample of companion content. Such a companion content sample may be generated and transmitted, for example, upon user request, upon acquisition of a first content (or limited portion thereof) for which companion, second content exists, or upon occurrence of a notification trigger described above. Further, aspects of the present disclosure may facilitate generation and transmission of synchronization information corresponding to a companion second content sample, such that a user computing device is enabled to synchronously present the first content along with the generated companion second content sample. Accordingly, a user may experience synchronous playback of a companion content pair without acquiring both items of companion content. For example, in instances when acquisition of the companion second content is associated with a fee, a sample of the second content may be provided for a reduced fee, or at no fee. Accordingly, a user may evaluate synchronous playback of a companion content pair at a reduced or negated cost and if the user enjoys the experience, the user may then obtain access to the remaining or entire companion second content so as to continue synchronized playback of the companion content pair.

In some embodiments, a content sample of companion second content may be modified or created based on aspects of the companion second content (e.g., the text, audio, etc., included within the companion second content). For example, in some embodiments, a provider of a companion second content may desire that the content sample comprise approximately 10% of the companion second content. However, such a content sample may have undesirable characteristics. For example, such a content sample may include only a portion of a word or sentence, thereby impairing the experience of a consuming user. Accordingly, such a content sample may be modified to include complete words and/or sentences. In other embodiments, a content sample may be modified to include complete instances of any other metrics or units, such as paragraphs, pages, chapters, acts, scenes, movements, sections, stanzas, etc. Examples of systems and methods for generating content samples based on an item of content may be found within U.S. application Ser. No. 13/332,235, entitled “Providing Personalized Content Samples,” and filed on Dec. 20, 2011 (hereinafter, “the '235 application”), which is herein incorporated by reference in its entirety.

Further, in some embodiments, a content sample may be generated based at least in part on one or more preferences of a user to which the content sample is to be transmitted. For example, a user may express interest in specific types of content samples, such as those including action sequences, those including romantic scenes, etc. Accordingly, the content management system 202 may generate a content sample including one or more portions of a companion second content corresponding to the user preferences. Examples of systems and methods for generating content samples based user preferences may be found within the '235 application, incorporated by reference in its entirety above.

As noted above, a user of computing device may, during or after consumption of a generated content sample, want to acquire access to an additional or remaining portion of, or the complete, companion second content corresponding to the generated content sample. For example, the user's computing device may synchronously present an e-book, as well as a content sample of a companion audio book. During such synchronous presentation, the user may desire access to more of the audio book (e.g., in order to enable or continue further synchronous presentation of the e-book and the audio book). Accordingly, aspects of the present disclosure relate to providing a user with access to an addition or remaining portion of, or the complete companion second content during or after consumption of the companion second content sample. In some embodiments, systems and methods may be employed for facilitating delivery of content while viewing a sample of the content. Examples of such systems and methods may be found in U.S. application Ser. No. 12/164,750, entitled “Systems and Methods for Reducing Latency When Downloading While Viewing Samples of Digital Information,” and filed on Jun. 30, 1998, (hereinafter, “the '750 application”) the entirety of which is incorporated by reference herein.

With reference now to FIG. 1, a block diagram depicting an illustrative companion identification environment 100 for use in identifying content that can be synchronized will be described. As illustrated in FIG. 1, the companion identification environment 100 includes a companion identification system 102 for obtaining content information and/or content synchronization information transmitted from one or more network data sources 110 via a network 115, such as the Internet or other communications link. Any of the networks described herein may be any wired network, wireless network or combination thereof. In addition, any of the networks described herein may be a personal area network, local area network, wide area network, cable network, satellite network, cellular telephone network, etc., or any combination thereof. Additionally, the companion identification system 102 can store content information and/or companion content information in an electronic companion data store 120.

As illustrated in FIG. 1, the content identification system 102 can include an external data source interface component 122 for obtaining content information from network-based resources. The content information can be any information from which content can be identified, such as information corresponding to an identifier, title, format, version, content data itself, and/or other information associated with content. The external data source interface component 122 may also be utilized to cause the transmission of information to the one or more network data sources 110 and/or to a content management system, for example, as described in reference to FIG. 2.

The content identification system 102 can also include a companion identification module 124 for processing the content information from the network data sources 110 and determining which contents are companion content that can be synchronized. The companion identification module 124 may use a product identifier and/or metadata (e.g., title, author, edition, etc.) related to the content can be used to identify companion content. For instance, such information can be used to determine that different formats/versions of the same or similar content, such as The Adventures of Tom Sawyer e-book and The Adventures of Tom Sawyer audio book, are companion content. In some implementations, the companion identification module 124 may further process the content information to identify companion content by applying filtering, spell/grammar check, and any other suitable automated algorithms. In addition, the companion identification module 124 can incorporate additional reference materials to identify a content match, for instance, by accessing a uniform resource identifier. Further, the content identification module 124 may compare pairs or other combinations of content to determine whether each pair/combination is companion content, for example, by correlating each pair/combination of content in a common format. More specifically, if the content information corresponds to information related to the presentation of a specific representation of content (e.g., an audio book), the companion identification module 124 may translate at least a portion of the content into a format corresponding to a different version of the content (e.g., translating audio into a specific e-book format) and/or into a generic format (e.g., text). The translated content information can be correlated with other content information to determine whether each pair of content is companion content that can be synchronized. In other implementations, the companion identification module 102 may prompt a user to enter data (e.g., title, author, edition, etc.) for one or more contents. The companion identification module 124 may compare the data in order to identify companion content. In yet other implementations, the companion identification module 124 may prompt a user to confirm that the first and second content are companion content.

Those skilled in the art will appreciate that even though a first content and a second content may be companion content, the first content may not correlate exactly to the second content. For example, the audio book of The Adventures of Tom Sawyer may not exhibit a one-to-one correspondence to the e-book of The Adventures of Tom Sawyer due to differences between the narration script of the audio book and the text of the e-book, differences between editions, differences in “front matter” (e.g., introduction to the audio production, table of contents, index, etc.) and/or “back matter,” differences between unabridged and abridged versions, differences in format of content, differences in device capabilities, etc. Due to the existence of such uncorrelated portions of potential companion content, the companion identification module 124 can be configured to identify companion content amongst pairs/combination of content that include mismatching portions. Although more detail will be provided below with reference to correlating portions of an unabridged version of an e-book with an abridged version of the corresponding audio book, the concepts described may be applied to any application in which a first and second content include mismatching portions.

As noted above, when correlating an unabridged version of an e-book with an abridged version of the corresponding audio book, mismatches can result from a number of sources, such as deletions, modifications, insertion of new material, or any combination thereof. Yet the abridged version of the e-book may include large portions of unmodified material, which may strongly correlate with the abridged version of the audio book. Accordingly, in some embodiments, the companion identification module 124 may detect mismatches between an abridged version and an unabridged version of content using algorithms that solve “longest common sequence” problems, an implementation of which can be found, for example, in the UNIX “diff” operation. The companion identification module 124 can then generate content synchronization information for the correlated portions of the different versions and provide the content synchronization information to the user's computing device for use when synchronizing presentation of the abridged audio book with the unabridged e-book. More specifically, the companion identification module 124 can correlate unmodified material similarly to how a full book and a full audio book are correlated. However, for passages of an abridged version with small-scale modifications, the companion identification module 124 may correlate the modified material and generate an indicator that these portions include some mismatches. Although new and deleted material in the abridged version may not correlate with the full version, these uncorrelated passages and modified material can be handled so as to provide the most useful and natural user experience. This may include disabling a subset of synchronous presentation features and/or providing an indication of small scale mismatches. As a non-limiting example, when a user listens to the abridged audio book while viewing the unabridged e-book with synchronized highlighting of text, small scale modifications may be highlighted differently to indicate that audio playback does not completely match the written text. Similar techniques can be applied when correlating an unabridged audio book with a companion unabridged e-book, as some material may not match between these versions.

An illustrative method that can be implemented by the companion identification module 124 for processing mismatches will now be described in general terms. First, potential companion content can be converted into a common format, such as text and/or phoneme. Then an attempt is made to match content at a small scale (e.g., at a word level) can be performed. Since missing or added passages can include larger portions (e.g., whole sentences or paragraphs) that do not match, a passage mismatch score indicating the frequency of mismatches can be computed for sentences, paragraphs, and/or other units of text. For example, the passage mismatch score may represent a number and/or percentage of word mismatches for a larger portion of text (e.g., a sentence, paragraph, or page). Sequences of larger portions with similarly high mismatch frequencies compared with adjoining sequences (where “high” can be set empirically from analyzing correlation of known companion content) can be identified. These sequences may represent content that should not be synchronized with other content in a companion content pair. The high mismatch passages can be removed in either or both contents, and matching can be reattempted at a smaller scale (e.g., at the word level). Metadata can be generated based on the correlation(s) to determine alignment points for the content synchronization information. The metadata may also include information identifying reference points in at least one of the companion content at which a matching portion begins/ends.

The content identification module 124 can also cause a notification to be sent in response to identifying companion content. For example, when new companion content becomes available (e.g., The Adventures of Tom Sawyer audio book), a notification that companion content is available can be sent to users who already own corresponding content (e.g., The Adventures of Tom Sawyer e-book). Such a notification can be sent, for example, via electronic mail, push notification, telephony message, automatic download request or any network messaging or communication protocol available between a computing device and the content identification module 124. The notification can be sent to a computing device that is configured to present content and/or that stores the corresponding content. This notification may be used by the computing device to inform and/or assist a user in obtaining the second content via purchase (e.g., via a browser used to navigate an electronic shopping service that offers the second content for sale), lending, sharing, and/or transfer of ownership services. Further, notifications, messages, and/or other communications regarding companion content can be sent in a variety of other contexts. Some example contexts can include a user browsing available content before the user has access to any of the companion content, and sending a user a promotional offer to sample companion content (e.g., a chapter of an audio book and a chapter of an e-book) to try a synchronous presentation experience.

Returning to FIG. 1, the companion identification module 124 may also determine a match score indicative of how well a first content correlates with a second content. The match score may apply to the entire first content and second content or to a subset thereof (e.g., a chapter, act, or part). The match score may be indicative of the overall quality of synchronously presenting the companion content, while the passage mismatch score described above may be useful in synchronously presenting the companion content, for example, as will be described below with reference to FIGS. 7 and 8. The match score may be calculated like the passage mismatch score described above. In some instances, the match score can correspond to a percentage or ratio of any unit of the first content correlating to a corresponding unit of the second content. In a specific example, the match score can be the percentage of words in an e-book that correlate to corresponding words in an audio book. The match score may be used to determine whether pairs of content are companion content. For example, a minimum match score can be used as a threshold value for determining that a content pair is companion content for which content synchronization information will be generated.

Since portions of companion content may not correlate with each other, the match score can be used to process companion content with varying ranges of correlations into any number of groups that can be processed differently. For example, using the match score, the companion identification module 124 may synchronize an unabridged e-book with a corresponding unabridged audio book or synchronize the unabridged e-book with a corresponding abridged audio book. Accordingly, the user's computing device can automatically present companion content synchronously when the match score satisfies a threshold and/or provide a subset of features related to synchronizing the companion content when the companion content has a match score below a predetermined threshold.

The content identification system 102 can further be associated with the companion data store 120 for storing content information obtained by the external data source interface component 122, utilized by the companion identification module 124, and/or generated by the companion identification module 124. The companion data store 120 can also store content synchronization information obtained and/or generated by the content management system 202. The companion data store 120 may store content information used to determine whether content pairs are companion content, data identifying companion content, and/or match scores. For instance, the companion data store may store a list, database, or other suitable data structure that identifies companion content as determined by the content identification system 102.

The content identification system 102 may be operable on one or more computing devices, such as server computing devices, cloud nodes, client computing devices, and/or mobile computing devices. Additionally, the external data source interface component 122 and/or the companion identification module 124 may be implemented in a single computing device or across multiple computing devices. Likewise, although the companion data store 120 is illustrated as local to the content management system 102, the data store 120 can correspond to a distributed data store and/or a network based data store. The content identification system 102 may include any one of a number of additional hardware and/or software components that would be utilized in the illustrative computerized network environment to carry out the illustrative functions of the content identification system 102 and/or any of the individually identified components.

Referring to FIG. 2, a block diagram depicting an illustrative content management environment 200 for use in managing content synchronization information and notifying customers of the availability of content synchronization information will be described. As illustrated in FIG. 2, the content management environment 200 includes a content management system 202 for managing content synchronization information. The content match may be determined from content information obtained from one or more computing devices 204 and/or one or more network data sources 208 via the network 206. Additionally, the content management system 202 can store content information, content synchronization information, and/or other information related to content management in an electronic content management data store 210.

The content management environment 200 can include one or more computing devices 204 for presenting content to a user. In an illustrative embodiment, the computing devices 204 can include various hardware and/or software components for obtaining and presenting digital content to a user, including, but not limited to, browser software applications, image viewing software applications, electronic publication viewing software applications, media playing software applications, and the like. The computing devices 204 can correspond to a wide variety of devices or components that are capable of initiating, receiving or facilitating communications over a communication network and/or presenting content. The computing devices 204 can include, but are not limited to, a laptop, personal computer, a tablet computer, personal digital assistant (PDA), hybrid PDA/mobile phone, mobile phone, electronic book reader, digital media player, television, integrated components for inclusion in computing devices, appliances, electronic devices for inclusion in vehicles or machinery, gaming devices, and the like.

The content management system 202 can include an external data source interface component 212 for obtaining content information from network-based resources, such as the network data sources 208 and/or the companion identification system 102. The content management system 202 can also include a computing device interface component 214 for obtaining content information from computing devices 204. The content information obtained from the network data sources 208 and/or the computing devices 204 may include any information that can be used to identify a content match and/or a device to send content synchronization information. For instance, the content information may include information that identifies content, information associating content with a user or group of users, and/or information related to the content itself. By obtaining content information from different sources and/or at different points in time, the content management system 202 can be used to gather data related to decoupled content. In this way, the content management system 202 can identify relationships between decoupled content that may otherwise be unknown due to the decoupled nature of the content.

The content management system 202 can also include a content management module 216 for identifying a content match, identifying a computing device 204 to transmit content synchronization information to, causing transmission of content synchronization information to one or more computing devices 204 via a network 206, or any combination thereof. The external data source interface component 212 and the computing device interface component 214 may be utilized to cause the transmission of information to the one or more network data sources 208 and/or one or more computing devices 204, respectively.

Moreover, the content management system 202 can also include a content notification module 218 for notifying users (e.g., users of computing devices 204) of the availability of companion content based on notification triggers. In some embodiments, the content notification module 218 may further be operable to modify an item of content (e.g., a second content) in order to provide only a portion of the content to a user. For example, the content notification module 218 may create modify content in order to create enable a trial of the content (e.g., by limiting the amount of content possible to consume, the time period in which it may be consumed, etc.). Similarly to as described above, the computing device interface component 214 may be utilized to cause the transmission of notifications to the one or more one or more computing devices 204. The content notification module 218 will be discussed in more detail with respect to FIGS. 10-14, below.

The content management system 202 can further include a content sample generation module 220 for generating a limited portion of companion second content for transmission to users of computing devices 204 (e.g., for evaluation or trial use purposes). In some embodiments, the content sample generation module 220 may operate in conjunction with the content notification module 218 discussed above in order to modify companion content in order to provide only a portion of the companion content to a user. In other embodiments, the content sample generation module 220 may operate independently of the content notification module 218. Illustratively, the content sample generation module 220 may generate a limited portion of an item of content within a companion content pair), as well as to determine or generate synchronization information corresponding to the limited portion. The content sample generation module 220 will be discussed in more detail with respect to FIGS. 15-18, below.

The content management system 202 can further be associated with the content management data store 210 for storing content information, companion content information, device identification information, content synchronization information, other information related to content management, or any combination thereof. Such information may be obtained by the content management system from the computing devices 204 and/or the network data sources 208 via the network 206. In addition, the information stored in the content management data store 210 can be generated by the content management system 202, for example, by the content management module 216.

The content management system 202 may be operable on one or more computing devices, such as server computing devices, personal computing devices, and/or mobile computing devices. Additionally, the external data source interface component 212, the computing device interface component 214, the content management module 216, the content notification module 218, the content sample generation module 220, or any combination thereof may be implemented in a single computing device or across multiple computing devices. Likewise, although the content management data store 210 is illustrated as local to the content management system 202, the data store 210 can correspond to a distributed data store and/or a network based data store. The content management system 202 may include any one of a number of additional hardware and/or software components that would be utilized in the illustrative computerized network environment to carry out the illustrative functions of the content management system 202 and/or any of the individually identified components.

FIG. 3A depicts an illustrative general architecture of a companion identification server 300 for identifying companion content. The companion identification server 300 is an example implementation of the companion identification system 102. The general architecture of the companion identification server 300 depicted in FIG. 3A includes an arrangement of computer hardware and software components that may be used to implement aspects of the present disclosure. The companion identification server 300 may include more (or fewer) components than those shown in FIG. 3A. As illustrated, the companion identification server 300 includes a processing unit 304, a network interface 306, a computer readable medium drive 307, an input/output device interface 320, an optional display 302, and an optional input device 324, all of which may communicate with one another by way of a communication bus. The network interface 306 may provide connectivity to one or more networks or computing systems. The processing unit 304 may thus receive information and instructions from other computing systems or services via a network. The processing unit 304 may also communicate to and from memory 310 and further provide output information for an optional display 302 via the input/output device interface 320. The input/output device interface 320 may also accept input from the optional input device 324, such as a keyboard, mouse, digital pen, etc.

The memory 310 may include computer program instructions that the processing unit 304 executes in order to implement one or more embodiments. The memory 310 generally includes RAM, ROM and/or other persistent or non-transitory memory. The memory 310 may store an operating system 314 that provides computer program instructions for use by the processing unit 304 in the general administration and operation of the companion identification server 300. The memory 310 may further include computer program instructions and other information for implementing aspects of the present disclosure. For example, in one embodiment, the memory 310 includes a user interface module 312 that generates user interfaces (and/or instructions therefor) for display upon a computing device, e.g., via a navigation interface such as a web browser installed on the computing device. In addition, memory 310 may include or communicate with one or more auxiliary data stores, such as companion data store 120.

In addition to the user interface module 312, the memory 310 may include a companion identification module 124 that may be executed by the processing unit 304. In one embodiment, the companion identification module 124 implements various aspects of the present disclosure, e.g., determining which pairs/combinations of content are companion content that can be synchronized and/or computing a match score indicative of how well companion content correlates with each other. While the companion identification module 124 is shown in FIG. 3A as part of the companion identification server 300, in other embodiments, all or a portion of the module may be a part of the computing devices 204. For example, in certain embodiments of the present disclosure, the computing devices 204 may include several components that operate similarly to the components illustrated as part of the companion identification server 300, including a user interface module, companion identification module, processing unit, computer readable medium drive, etc. In such embodiments, the computing devices 204 may communicate with a companion data store, such as the companion data store 120, and the companion identification server 300 may not be needed in certain embodiments.

FIG. 3B depicts an illustrative general architecture of a content management server 330 for managing content synchronization information. The content management server 330 is an example implementation of the content management system 202. The general architecture of the companion identification server 330 depicted in FIG. 3B can include any combination of the features of the companion identification server 300, for example, as described in reference to FIG. 3A, where like reference numbers indicate like parts.

The memory 310 of the content management server 330 may also include a content management module 216 that may be executed by the processing unit 304. The memory may also communicate with the content management data store 210. In one embodiment, the content management module 216 implements various aspects of the present disclosure, e.g., identifying a content match, identifying a device for which to transmit content synchronization information, causing transmission of content synchronization information, or any combination thereof. Further, the memory 310 of the content management server 330 may also include a content notification module 218 that may be executed by the processing unit 304. In one embodiment, the content notification module 218 implements various aspects of the present disclosure, e.g., detecting a notification trigger from a user, notifying a user as to the availability of companion content that may be synchronously presented, providing portions of companion content to the user, or any combination thereof. Still further, the memory 310 of the content management server 330 may also include the content sample generation module 220 for execution by the processing unit 304. In one embodiment, the content sample generation module 220 generates a limited portion of a companion second content for synchronous presentation to a user with a first content (e.g., for sample or trial user purposes).

While the content management module 216, the content notification module 218, and content sample generation module 220 are shown in FIG. 3B as part of the content management server 330, in other embodiments, all or a portion of a content management module 216, the content notification module 218 and/or the content sample generation module 220 may be a part of one or more computing devices 204. For example, in certain embodiments of the present disclosure, the computing devices 204 may include several components that operate similarly to the components illustrated as part of the content management server 330, including a user interface module, content management module, content notification module, content sample generation module, processing unit, computer readable medium drive, etc. In such embodiments, the computing devices 204 may communicate with a content management data store, such as the content management data store 210, and the content management server 330 may not be required.

With reference to FIGS. 4A and 4B, the interaction between various components of the content management environment 200 (FIG. 2) will be described. More specifically, with reference to FIG. 4A, embodiments in which synchronization information is provided at the direction of the content management system 202 will be described. With reference to FIG. 4B, embodiments in which synchronization information is provided at the direction of a computing device 204 will be described.

Due to the decoupled nature of companion content, the content management system 202 can gather content information in a variety of ways and/or at a variety of points in time, in order to identify a content match and/or to identify a particular computing device 204 to which to transmit synchronization information. Synchronization information may include content synchronization information and/or information identifying one or more companion content pairs. The content management system 202 may obtain content information, via the network 206, from network data sources 208 that have access to content information associated with a user and/or information associated with computing devices associated with the user. Similarly, the content management system 202 may obtain content information, via the network 206, from one or more computing devices 204 associated with the user. For example, the content management module 216 may obtain information related to user access to content (e.g., digital ownership history), information related to a user account (e.g., content and/or devices associated with the account), and the like. Such content information may be gathered at the direction of the content management module 216 based on a triggering event. Example triggering events may include, but are not limited to, a change in the user's interaction with content information (e.g., changing privacy settings, updating account information, etc.), a user initiated request, a user purchasing, leasing, sharing, or transferring new content, a user adding content to a new computing device, the content management system 202 identifying that new companion content is available, and the like. Alternatively or additionally, the content management module 216 may gather content information periodically, for example, at predetermined periods of time (e.g., set as a system default or selected at the direction of a user), each time a computing device is activated/deactivated (e.g., when a device is associated with a user account), each time a computing device is powered on/off, and the like. For instance, a computing device 204 may transmit a list of content stored thereon at predetermined intervals (every day, week, two weeks, month, etc.) to the content management system 202 via the network 206. Content information may also be transmitted to the content management system 202 at the direction of a user. Using any combination of these ways of gathering content information, content information for decoupled content can be made available to a common computing system, such as the content management system 202, for identifying content matches. Accordingly, content matches can be determined for potential companion content that is stored on separate computing devices 204, acquired via different transactions (e.g., at different points in time or from different retailers), and the like.

Identifying content matches for decoupled content can vary based on how the content is decoupled. For example, when companion content is decoupled by being purchased at a different point in time from a common retailer, a content match may be identified by the content management system 202 in response to a user buying new content from the common retailer, based on the user's digital ownership history. As another example, when companion content is decoupled by being purchased from different retailers, the content management system 202 can gather information from the different retailers/content providers/distributors and/or from user computing devices storing the content to identify a content match. In yet another example, metadata of content associated with the user can be gathered and analyzed by the content management system 202 to identify content matches for any content that has been decoupled.

Referring to FIG. 4A, once content information for decoupled content is available to the content management system 202, the content management module 216 can identify a content match. Content matches can be identified in response to gathering new content information. Content matches may be identified at predetermined intervals of time (e.g., every day, week, etc.). Alternatively or additionally, content matches can be identified from information available to the content management system 202 on demand in response to a user request or system generated event obtained via the network 206.

The content management module 216 can identify content matches in a variety of ways. The content management module may identify a content match based on comparing metadata and/or a content identifier for each pair of content associated with or owned at a particular time by a user to a list of companion content, for example, as generated by the companion identification module 124. In some implementations, the content management module 216 can identify content matches based on comparing match scores of content pairs (e.g., as computed by the companion identification module 124) to a predetermined threshold. The content management module 216 may also identify whether pairs of content can be synchronized by correlating the digital representations of pairs of content.

After identifying a content match, the content management module 216 may identify a receiving computing device to receive synchronization information. In some instances, the receiving computing device can be a computing device 204 that has provided content information to the content management system 202. In other instances, the receiving computing device may be a different computing device 204 that has not provided content information to the content management system 202. The receiving device may receive synchronization information without obtaining access to any portion of content of a companion content pair associated with the synchronization information and/or prior to obtaining access to any portion of content of a companion content pair associated with the synchronization information. In certain instances, the receiving computing device may request the content synchronization information. The receiving computing device may be associated with a user, user account, or group of users associated with the content match. For example, the content management module 216 can associate a user with the content match by identifying, using content information for the first and second contents, that the user has access to both contents in a companion content pair that make up the content match. Further, the receiving computing device may be configured to synchronously present the companion content. Yet, in some implementations, one or more receiving computing devices may synchronously present companion. The receiving computing device may also be determined based on available content synchronization information and/or compatibility with the receiving computing device. Still further, the receiving computing device may locally store the companion content on memory or stream the content from one or more network resources.

The content management module 216 can cause any portion of the synchronization information (e.g., at least a portion of the content synchronization information) to be transmitted from the content management system 202 and/or the content management data store 210 to the receiving computing device 204 via the network 206. Synchronization information, or any other information transferred via the network 206, may be encrypted or otherwise protected utilizing any number of digital rights management techniques. For instance, synchronization information can be encrypted when content associated with the synchronization information is encrypted. In some implementations, synchronization can be encrypted using information indicative of a device or a group of devices such that an identifier stored on a device receiving the synchronization information can be used to decrypt the synchronization information. The synchronization information can be stored remotely from the receiving computing device 204, for example, in the content management data store 210. When data is stored remotely from the receiving computing device, the content synchronization information can be streamed on the receiving computing device. Alternatively or additionally, the content synchronization information may also be stored locally on the receiving computing device. This can allow the receiving computing device to synchronously present companion content when it is off-line.

With access to synchronization information that includes content synchronization information, the receiving computing device 204 can synchronously present companion content. Synchronously presenting companion content can include, for example, displaying the text of an e-book while playing the corresponding audio book. More details regarding synchronous presentation of companion content will be provided with reference to FIGS. 7-9.

Alternatively or additionally, with access to the synchronization information regarding a companion content pair, the receiving computing device can use the information identifying the companion content pair for a variety of purposes, such as generating content synchronization information, generating a message that the receiving device has access to companion content, and the like. For example, the receiving device may receive a list of companion content pairs to which the receiving device has access. Using the list, the receiving device can then generate content synchronization information for a companion content pair, for example, using any combination of features described herein. Further, the information identifying companion content pairs may also include match scores, which can be used to generate content synchronization information, as described above.

Referring to FIG. 4B, the content management module 216 can identify a content match at the direction of a computing device 204. The computing device 204 can transmit content information to the content management system 202 via the network 206. This can provide the content management system 202 with content information related to at least one content in a companion content pair. By receiving content information from the computing device 204, the content management system 202 can obtain content information for a second content of a companion content pair so that the content management system 202 can identify a content match. In some instances, the content management system 202 may obtain access to content information for the first content from the computing device 204, one or more other computing devices, and one or more network data sources 208, or any combination thereof. The content information for the first content and the content information for the second content may be obtained at different points in time.

The content management module 216 can identify a content match in response to obtaining content information from the computing device 204, for example, using any combination of features described with reference to FIG. 4A. After identifying the content match, the content management system 202 can transmit synchronization information to one or more receiving devices, which may include the computing device 204 that transmitted content information. Using content synchronization information included in the synchronization information, a single computing device can synchronously present companion content. For instance, an e-book can synchronously present text of while playing a corresponding audio book. In other implementations, multiple devices can synchronously present content. For instance, an e-book reader can present text while a media player synchronously plays a corresponding audio book.

In another embodiment, the computing device 204 can identify a content match based on content stored thereon and/or content information obtained, via the network 206, from other computing devices 204 and/or network resources 208. The computing device 204 can then send a request for content synchronization information to the content management system 202 via the network 206. In response to the request, the content management system 202 can transmit content synchronization information to one or more computing device 204 via the network 206.

According to another embodiment, the computing device 204 can identify a content match and generate the content synchronization information. Alternatively or additionally, the computing device can use a list of companion content pairs included in the synchronization information to generate content synchronization information. In some instances, the computing device can generate the content synchronization information based on a metric indicative of how well content in a potential companion content pair correlates, such as the match score described above. When the metric satisfies a predetermined threshold, the content synchronization information can be generated. In some instances, the content synchronization information can be generated in “real time.” The computing device 204 can further be configured to transmit any portion of the content synchronization information to another computing device. Moreover, multiple computing devices 204 can identify a content match and/or generate content synchronization information. The content synchronization information generated by one or more computing devices 204 can be stored locally on the one or more the computing devices 204 and/or in an external data store, such as the content management data store 210.

FIG. 5 is an illustrative interface 500 generated on a computing device 204, such as a computing device that can synchronously present companion content, for selecting options related to a content match identified by the computing device 204. The interface 500 can include a first portion 502 for presentation of available content. The user may select content (e.g., an e-book) via one or more selection elements 510, 512, 514 presented by the interface 500. In response to the selection of content, the computing device 204 may determine whether the user has access to companion content. The computing device 204 may obtain content synchronization information (e.g., from a content management system 202 and/or by generating content synchronization information itself) and/or obtain access to another content that is part of a companion content pair that includes the selected content. The computing device 204 may prompt a user to confirm a desire to synchronously present content companion content and/or to configure the computing device for future preferences related to synchronously presenting companion content. As illustrated in FIG. 5, the interface 500 can include a second portion 504 that presents a notification indicating that there is available companion content that can be presented synchronously with the selected content. Additionally, the second portion 504 can include a control 506 for obtaining a confirmation from the user of his or her desire to synchronously present companion content. Still further, the second portion 504 can include one or more configuration elements 508 for enabling the user to configure the criteria upon which the computing device 204 will automatically synchronize companion content. The configuration elements 508 may also enable the user to a default based a degree of a content match. For example, the user can select to always synchronize companion content on a strong match, as indicated by a match score satisfying a predetermined threshold. Although FIG. 5 has been illustrated with regard to a combination of confirmation and configuration functionality, one skilled in the relevant art will appreciate that any number of separate or combined interfaces can be used to collect the confirmation information or configuration information. Additionally, although interface 500 is illustrated with regard to a display screen of a computing device 204, the interface 500 may be generated by any type of computing device and modified in accordance with resources associated with such alternative computing devices.

FIG. 6 is an illustrative interface 600 generated on a computing device 204 that can synchronously present companion content. The interface 600 identifies a content match at the direction of a user. With reference to FIG. 6, the interface 600 includes a presentation portion 602 that identifies the content available to the user using the computing device 204. In the illustrated example, a list of available content is presented to the user. The available content can include any combination of companion content described herein, as well as content for which no companions have been identified. The available content may include companion content in a number of different versions and/or formats (e.g., e-book, audio book, page image, etc.). Selection elements 604, 606, 608, 610 can enable a user to identify a content match and/or select one or more contents for which to request content synchronization information. The content synchronization information can then be used to synchronously present companion content. For example, as illustrated in FIG. 6, a user can select a first content, e.g., an audio book of The Adventures of Tom Sawyer, and a second content, e.g., an e-book of the same. Then the user may submit a request for content synchronization information via a submission element 612. In response to the submission, the computing device 204 may verify that the selected first and second content can be synchronized. In some implementations, the computing device 204 can further generate content synchronization information for the first and second content. In other implementations, the computing device 204 can transmit a request related to the content synchronization information to one or more other computing devices (e.g., to the content management system 202) via a network (e.g., the network 206). Such a transmission can include a request to determine whether the first and second content are a content match and/or a request for the content synchronization information for the first and second content.

Once a computing device 204 has obtained content synchronization information associated with a content match of a first content and a second content, the computing device 204 can synchronously present the first content and the second content to a user. FIGS. 7 and 8 depict illustrative methods of synchronously presenting companion content. Although these illustrative methods describe synchronously presenting a pair of companion content, the features described with reference to these illustrative methods can be applied to synchronously presenting a larger combination of companion content.

Referring to FIG. 7, a flow diagram of an illustrative method 700 of synchronously presentation companion content will be described. At block 702, a computing device 204 can obtain content synchronization information corresponding to a first content and a second content. The content synchronization information may be obtained, for example, from a data store (e.g., data store 210) and/or a separate computing device. Alternatively or additionally, the content synchronization information may be obtained by the computing device 204 generating the content synchronization information. As previously described, the content synchronization information can include information regarding positions in the first content that correspond to positions in a second content (e.g., a page and line in an e-book and a playback position of an audio book), additional information related to synchronous presentation (e.g., information for highlighting, underlining, etc. a portion e-book that corresponding to the playback of an audio book), information identifying portions of the first and second content that match/mismatch (e.g., information identifying portions of an unabridged e-book that do not correspond to an abridged audio book), or any combination thereof.

At decision block 704, a test may be conducted to determine to what degree companion content matches with each other. For example, the test can include determining whether a content match score satisfies a predetermined threshold. As previously described, the companion identification module 124 can be configured to determine a content match score indicating how well a content pair of companion content correlate with each other. Companion content can be divided into any number of subdivisions based on content match scores. For example, a companion content pair associated with a content match score that satisfies a predetermined threshold can be considered a strong match. In this example, a companion content pair associated with a content match score that does not satisfy the threshold can be considered a weak match. The threshold can be determined programmatically by one of more computing devices and/or set/adjusted at the direction of a user.

If the content match is determined to be weak match, a weak match subroutine can begin at block 706. More detail regarding the weak match subroutine will be provided with reference to FIG. 8. Alternatively, if the content match is determined to be a strong match, the first content can be presented using a computing device 204, at block 708. The first content can be presented in any manner that the computing device 204 is capable of presenting content, such as visually, aurally, tactilely (e.g., via mechanical vibrations and/or by presenting Braille), or any combination of thereof. The first content may be any type of content described herein, for example, an audio book. Further, the first content may include only a portion of a work, for example, a chapter of an audio book.

At block 710, a computing device 204 can begin monitoring a presentation position of the first content. The presentation position may be a reference point or tracking point associated with the first content. For example, the presentation position may represent a textual position, a playback position, and/or any other indicator of a position of the first content that is being presented. In a specific example, the textual position may correspond to a page or any other unit of text within the first content. In another specific example, the playback position may correspond to units of time (e.g., seconds) from a starting point.

The presentation position of the first content can used in combination with content synchronization information to determine a corresponding presentation position in the second content. For example, the content synchronization information may be used to map a presentation position of the first content to a corresponding presentation position in the second content. In some instances, the content synchronization information can include a map of reference points in the first content that correspond with reference points in the second content, which can be used to determine a presentation position in the second content.

The second content can be synchronously presented with the first content based on the presentation position of the first content and the content synchronization information at block 712. Like the first content, the second content can be any of the content described herein and presented in any manner that a computing device 204 is capable of presenting the second content, such as visually, aurally, tactilely, or any combination of thereof. The second content may be, for example, an e-book. In addition, the second content may include only a portion of a work, for example, a chapter of an e-book. In some instances, the second content can be presented using the same computing device used to present the first content. In other instances, the second content is presented using a separate computing device in communication with the computing device that presents the first content.

At block 714, the presentation position of the second content can be updated based on a presentation position of the first content: For example, as the presentation position of the first content changes, the computing device 204 can determine a corresponding presentation position for the second content using the synchronization information. Based this determination, the presentation position of the second content can be synchronized with the presentation position of first content. In a specific example, this may include turning the page of an e-book when the playback of an audio book has advanced beyond the text associated with a page being displayed or to the end of the text associated with the page being displayed. The presentation position of the second content can be continually updated based on the presentation position of the first content to enable an enhanced user experience of synchronously consuming the first content and the second content. When the first content and/or the second content include only a portion of a work, the computing device 204 can disable synchronous presentation of companion content for portions of the first content and second content that content synchronization information indicates do not correspond to each other.

Referring to FIG. 8, a flow diagram depicting an illustrative method 720 of synchronously presenting companion content that are a weak match, e.g., because the companion content includes content mismatches, will be described. As previously described, companion content pairs may include mismatches between some portions of content in a companion content pair. The method 720 may be performed to present companion content considered to be a content match, but having a relatively low degree of correlation, for example, as determined at decision block 704 of the method 700. Accordingly, method 720 can be implemented in connection with any combination of features of method 700.

The illustrative method 720 may begin at block 706 and proceed to block 722, where mismatching segments of the first content and the second content are determined. Alternatively or additionally, matching segments of the first content and the second content can be determined. These mismatching/matching segments of content can be determined using the content synchronization information. For instance, the content synchronization information may include reference or tracking points at which portions of the first content and the second content begin to correlate with each other and/or stop correlating with each other. This information can be used to identify portions of the potential companion content that mismatch.

A portion of first content that matches the second content can be presented at block 724. Then, at block 726, a portion of the second content can be synchronously presented based on the presentation position of the first content and the content synchronization information. The presentation position of the second content can be continually updated based on the content synchronization information and the presentation position of the first content, for example, as previously described. When a mismatching segment is reached by the first content, the presentation position of both the first content and the second content can be updated to the next matching segment at block 728. In this way, the method 720 can continue to synchronously present the first content and the second content even when a significant portion of either content does not match with the other content. In another implementation, when a mismatching portion in either content is presented, synchronous presentation can be disabled until a matching portion is presented, at which point synchronous presentation can resume.

FIG. 9 illustrates an example of computing device 204 synchronously presenting companion content, such as an e-book and a corresponding audio book. As illustrated in FIG. 9, the computing device 204 can visually present text of the e-book on a display 900. The computing device 204 can also aurally present the companion audio book simultaneously via one or more speakers 902 and/or one or more audio outputs, which may be provided to external speaker(s) such as headphones. Content synchronization information may be used to synchronously present and update the presentation position of both the audio book content and the visual e-book content. This may include, for example, any combination of features described in reference to the methods 700, 720 described in reference to FIGS. 7 and 8, respectively.

In addition, the computing device 204 may also present an indicator 906, which can indicate a presentation position of the audio book content in relation to the visual presentation of the e-book content within the visual presentation of the e-book. For example, the text of the e-book presented using the display 900 can be enhanced to indicate the playback position of the audio book presented via the speaker 902. In this regard, text can be highlighted, underlined, and/or presented in different font (e.g., using different color, size, type, effect, etc.). Individual words, lines, sentences, and/or other units of text can be enhanced to indicate an audio playback position. When the playback of the audio book reaches the end of a page of the e-book being presented, the next page of the e-book can be displayed automatically using the content synchronization information.

In some implementations, a user can select any word or group of words of a page of an e-book presented on the display 900 and start playback at a corresponding point in the audio book. Alternatively or additionally, the user can navigate to any point in time in the audio book, and the corresponding page of the e-book can be displayed by the computing device 204, and/or the user can navigate to any position in the e-book and playback of the audio book can begin at the corresponding point in the audio book.

The computing device 204 can also support search and bookmarking functionalities, maintaining the synchronous presentation of both the audio book and the e-book. The computing device 204 can monitor both audio and visual presentation positions, so a user can switch between textual display and audio playback, and resume consumption of the other form of content from the last position.

Although some of the examples were provided in the context of synchronously presenting content, any combination of features described herein may be applied to other content synchronization, as appropriate. For example, content synchronization information can be used to switch back and forth between presenting a first content and a second content. More specifically, in some implementations, a computing device can display the text of an e-book and then switch to playing the audio of an audio book at a corresponding position using the content synchronization information. As another example, the principles and advantages described herein can be used to synchronize companion content on different computing devices outside the context of synchronously presenting companion content. For instance, any combination of features described herein can be applied to any of the examples of synchronizing content on different computing devices such as described in the '473 application incorporated by reference in its entirety above.

Further, although some of the examples were provided in the context of a retail environment in which a user purchases companion content, any combination of features described herein may be applied to other settings, as appropriate. For example, the user need not purchase content of a companion content pair in order to obtain content synchronization information and/or synchronously consume companion content. Instead, the user may obtain access to or acquire one or more individual content of a companion content pair by any number of suitable ways, for example, by borrowing, checking out, renting, permanently leasing, temporarily leasing, downloading, streaming, locally accessing, remotely accessing, or any combination thereof. In a specific example, the user may check out an audio book and synchronously present the audio book with an e-book that the user has purchased. In another specific example, the user may lease an audio book and synchronously present the audio book with a borrowed e-book. As yet another example, in some embodiments, a user may obtain only a portion of a second content (e.g., corresponding to a first content of a companion content pair), and be enabled to synchronously present the first content and the portion of the second content. For example, as will be discussed below, a user that has acquired a first content may be notified that a corresponding second content is available for acquisition. Further, the user may be offered a portion of the second content at a reduced or negated cost. In response, the user may accept the offer, acquire the portion of the second content, and synchronously consume the resultant companion content pair (e.g., the first content and the portion of the second content).

With reference to FIG. 10, an illustrative interaction for providing a notification regarding companion content to a computing device 204 of FIG. 2 will be described. Such a notification may be facilitated, for example, by the content management system 202 of FIG. 2. Illustratively, a notification may be provided in response to a notification trigger, as will be described below.

As shown in FIG. 10, at (1), a computing device 204 may monitor the consumption of a first content. Illustratively, the computing device 204 may monitor the consumption of the e-book of The Adventures of Tom Sawyer. Monitoring consumption of a first content may include, for example, monitoring a current position of consumption of the first content (e.g., a current page read, etc.). Further monitoring consumption of the first content may include monitoring information used to determine a notification trigger, such as the current rate of page turns or font size of an e-book, the current volume of an audio book, the frequency or duration of consumption, etc.

Such monitored information may, alone or in conjunction with additional information, be utilized at (2) to determine a notification trigger. As previously described, a notification trigger may correspond to any action or event, series of actions or events, or user context which indicates a user may desire to be notified of the availability of companion content corresponding to a consumed first content. Moreover, as previously described, notification triggers may be based on additional information, such as a user's purchase history, previous responses to notification triggers, or demographic information. For example, an audio book of The Adventures of Tom Sawyer may be available to the user of the computing device 204 (e.g., via the content management system 202), but not yet be acquired by the user. As such, a trigger event may occur at any point where presentation of the audio book version of The Adventures of Tom Sawyer may be more desirable than presentation of the e-book.

In some embodiments, a trigger event may correspond to a user initiation of a change of presentation format. For example, the user may halt consumption of The Adventures of Tom Sawyer e-book, and begin consumption of an unrelated audio book. Because the user has not yet acquired the audio book version of The Adventures of Tom Sawyer, it may be that the user would prefer to continue consuming The Adventures of Tom Sawyer, but is unable to do so (e.g., because circumstances are not conducive to consumption of an e-book). As such, user initiation of a change in presentation format may constitute a notification trigger. Similarly, a user may utilize a feature of the computing device 204 which automatically converts the e-book of The Adventures of Tom Sawyer into audio, such as via a text-to-speech function. However, the resultant audio may be inferior to the professionally narrated audio book. As such, the user may desire to be notified that such a professionally narrated audio book is available for synchronous playback.

In some embodiments, a notification trigger may be associated with a trigger time. For example, a series of events, actions, or changes in context may be required to occur within a certain period of time. Illustratively, a notification trigger may not be satisfied when a user consumes an e-book on a first day, halts consumption of the e-book, and begins consumption of an audio book on a second day. Similarly, a notification trigger may be satisfied when a user halts consumption of an audio book, and thereafter begins consumption of an e-book within a few minutes. As will be appreciated by one skilled in the art, a trigger time may correspond to any appropriate length of time. Moreover, different notification triggers may be associated with different trigger times.

In addition, though described herein with respect to a single computing device 204, in some embodiments, notification triggers may occur based on activities, events, or contexts of more than one device. For example, a notification trigger may be satisfied when a user halts consumption of an e-book on a first device, and begin consumption of an audio book on a second device. Illustratively, a user may consume an e-book on an e-book reading device, and thereafter begin to consume an audio book on a car stereo system. As such, the user may be notified that an audio version of the consumed e-book is available. In some embodiments, notification triggers occurring over multiple devices may be facilitated by utilizing the same user account over multiple devices, or utilizing associated user accounts. For example, a user's e-book reading device may be associated with a user account. The user's car audio device may also be associated with the same user account. As such, consumption information over both devices may be monitored in order to determine a notification trigger.

In some embodiments, notification triggers may not require the user to explicitly request a format change, but may be based, in whole or in part, on other criteria. For example, monitored consumption information may include a rate of page turns of an e-book. A slowing of the page turns over a period of time may indicate that the user is tired of reading, and may desire to listen to the content instead. As such, a slowing of a reading rate may correspond to a notification trigger. As a further example, a very large font size used to consume a textual content may indicate a difficulty in reading, and therefore the user may desire to be notified that corresponding audio content is available. Similarly, a very loud volume may indicate a difficulty in hearing, and therefore a user may desire to be notified that corresponding textual content is available.

In still more embodiments, notification triggers may be based in whole or in part on the context of a user's device. For example, an e-reader device may detect that the available light level has fallen below a given threshold, and therefore interpret that a user may prefer to listen to the content. As a further example, an audio playback device may detect that headphones are no longer plugged into the device and/or that the external noise level around the device is very high, and may therefore notify the user that a corresponding textual content exists. Moreover, in some embodiments, different formats of presentation may be associated with different computing requirements. For example, it may be more battery efficient to listen to an audio book than to read an e-book when utilizing a computing device with a high power screen (e.g., a high density, full color screen). Alternatively, it may be more battery efficient to read an e-book than listen to an audio book when utilizing a device with a low power screen (e.g., an e-ink screen). As such, a notification trigger may be based on the amount of battery power left to a device, such as the computing device 204. Illustratively, when the computing device 204's battery power drops below a threshold amount, the user may be notified that corresponding content exists in a more power-efficient format. In yet another example, a trigger event may be based on additional context information available to the computing device 204. Illustratively, an accelerometer may indicate that the user is traveling at a high rate of speed. In some instances, this may indicate that the user may wish to consume content in audio, rather than text format. For example, a user may suffer from motion sickness when reading while traveling at a high rate of speed.

In some embodiments, a notification trigger may be based on, or modified based on additional information, such as user preferences. For example, a user may be enabled to opt-in or opt-out of notifications. Further, the user may be enabled to specify certain contexts in which notifications should or should not be delivered (e.g., via certain times of day, at certain locations, etc.). Illustratively, a user may never wish to be notified that companion content is available while at work. As will be discussed below, in some embodiments, notification triggers may be based on an external source of information regarding the user, such as the user's electronic calendar. Further, in some embodiments, notification triggers may be based on additional information regarding a user, such as a user's purchase history, demographic information, previous responses to notification triggers, or any other suitable information that may implicate the user's desire to consume companion content.

Returning to FIG. 10, after a notification trigger has been determined, the computing device 204 may, at (3), transmit an indication of the detection of the notification trigger to the content management system. In some embodiments, this indication may include additional information that may be utilized to create a notification, such as consumption information regarding the consumed first content.

Though notification triggers are discussed above with respect to computing devices 204, in some embodiments, the content management system 202 may be configured to detect notification triggers. For example, the computing device 204 may, periodically or continuously, transmit information regarding the computing device 204 to the content management system 202. Illustratively, the computing device 204 may indicate that the user has halted consuming a given e-book, and has begun consuming an unrelated audio book. The content management system 202 may then determine a notification trigger based on this and/or additional information.

At (4), the content management system 202 may determine a second content corresponding to the consumed first content. Such a determination may be based, for example, on information within the content management data store 210 of FIG. 2, and may include information previously determined by the companion identification system 102 of FIG. 1. In some embodiments, the content management system 202 may be configured to determine a specific second that corresponds to the detected notification trigger. For example, a notification trigger may indicate that a user would rather listen to an audio book than continue reading an e-book. As such, the content management system 202 may be configured to determine an audio book corresponding to the e-book. In some embodiments, each notification trigger may be associated with one or more preferred formats of content. As such, the content management system 202 may attempt to determine a second content of at least one of the preferred formats.

Thereafter, at (5), the content management system 202 may transmit a notification to the computing device 204 regarding the availability of the second content. Illustratively, the notification may inform a user of the computing device 204 of the availability of the second content. In some embodiments, the notification may include an offer to acquire the second content. Illustratively, the notification may correspond to an offer to acquire a trial portion of the second content at a reduced fee or without charge. Accordingly, at (6), the computing device 204 may display the notification to the user of the computing device 204. One example of a displayed notification will be described in more detail with respect to FIG. 13, below.

As will also be described below, in response to a displayed notification, the user may be enabled to accept an offer to acquire the second content. Thereafter, the content management system 202 may deliver all or a portion of the second content to the computing device 204 for playback. In some embodiments, this may include altering the second content (e.g., to enforce usage restrictions) or generating a modified version of the second content (e.g., a trial version).

FIG. 11 is an illustrative interface 1100 generated on a computing device 204, such as a computing device that can synchronously present companion content, for selecting options related to notifications of the availability of companion content. The interface 500 can include a first portion 1102 for presentation of options as to notifications for the availability of companion content. For example, input control 1104 may enable a user to specify that they desire to be immediately notified as to the availability of companion content. Illustratively, immediate notification may occur at any point a content match is identified between an item of content acquired by the user and an item of content not yet acquired by a user. As such, user selection of input control 1104 may enable a user to be immediately notified should a new item of companion content be identified. Input control 1106 may enable a user to specify that they desire notifications according to certain criteria (e.g., notification triggers), as well as according to user specified preferences. As such, user selection of input control 1106 may enable a user to be notified of the availability of companion content according to one or more notification triggers (e.g, switching between consumption of textual and audio content, enabling a text-to-speech function, reduced page turn rate, etc.). Notification triggers are discussed in more detail with respect to FIG. 10, above. The user interface portion 1102 may further enable user customization of preferences regarding notifications, such as by selection of input control 1110. User preferences for notifications trigger-based notifications will be discussed in more detail with reference to FIG. 12, below. Further, input control 1108 may enable a user to specify that they do not desire any notifications regarding companion content. As such, user selection of input control 1106 would allow the user to opt-out of all notifications. After selection of an input control 1104-1108, the user may save their preferences by selection of input control 1112, or discard their input by selection of input control 1114.

FIG. 12 is an illustrative interface 1200 generated on a computing device 204, such as a computing device that can synchronously present companion content, for selecting options related to notification trigger-based notifications. For example, the interface 1200 may be displayed based on user selection of input control 1110 of FIG. 11. The interface 1200 can include a first portion 1202 for enabling user selection of a number of preferences. One or more preferences may be utilized in order to determine notification triggers for transmitting notifications to the computing device 204. For example, input control 1204 may be selectable by a user to configure specific hours during which notifications may be transmitted. The specific range of hours may be input via input controls 1206 and 1207. For example, user selection of input control 1204 in the illustrative user interface displayed would allow notifications to be sent only between the hours of 6 PM and 11 PM.

Input control 1208 may enable a user to specify locations in which notifications may be transmitted. For example, input control 1208 may be associated with a number of additional input controls 1210-1214, each input control 1210-1214 corresponding to a defined location. In some embodiments, one or more of these locations may be user defined. In other embodiments, one or more of these locations may be predefined. For example, in the illustrative interface 1200, input control 1210 corresponds to “At home,” input control 1212 corresponds to “At work,” and input control 1214 corresponds to “Traveling.” Selection of each of input control 1210-1214 may enable notifications to be transmitted while the computing device 204 is at the defined location. In some embodiments, preferences may be synchronized across a number of computing devices 204. In these embodiments, selection of each of input control 1210-1214 may enable notifications to be transmitted to any of the number of computing devices 204, while the device is within the defined location. A computing device 204 may determine its location by any number of inputs known to those skilled in the art, including, but not limited to global positioning systems (GPSs), wireless network location databases, and cellular triangulation.

Input control 1216 may be selectable by a user to enable interaction between the content management system 202 and a user's calendar or other data source. For example, the computing device 204 may include a calendar application that tracks user appointments or activities. In some embodiments, selection of input control 1216 may enable the content management system 202 to interact with a default calendar application. In other embodiments, selection of input control 1216 may enable the content management system 202 to interact with a specified calendar application. The information available within a user's calendar may be used to determine or modify a notification trigger. For example, a calendar may be used to determine a length of time until the user has an appointment. In some embodiments, a threshold amount of time before a next appointment may be required for a notification to be transmitted. Illustratively, a user may not desire to be notified that companion content exists (and potentially to evaluate the use of the companion content) when only five minutes remain until the users next appointment. In still more embodiments, a computing device 204 may be configured to determine a next appropriate time to notify the user of the availability of companion content. For example, a notification trigger may occur shortly before a user has an appointment. As such, the computing device 204 may delay displaying a notification to the user until a next appropriate time (e.g., when a user appears to have more time to consume companion content). As a further example, the user may not desire to be notified of available companion content when the user is marked as “do not disturb” according to their calendar. In some embodiments, a user may be able to specify custom rules for notifications based on calendar information, such as under what conditions the user should be notified of the availability of companion content.

In some embodiments, input controls may be presented that enable a user to limit the type of notifications presented. For example, input control 1218 may be selectable to limit notifications to those corresponding to offers for free trials of companion content. As will be described in more detail below with respect to FIG. 14, notifications may correspond to any number of offers to acquire companion content. In some instances, a notification may correspond to an offer for a free trial of companion content (e.g., limited in time or duration of consumption). In other instances, a notification may correspond to an offer to acquire a portion of companion content at a reduced rate (e.g., the portion corresponding to an unviewed or unheard portion of a first content). In still more instances, a notification may correspond to an offer to acquire the entirety of a companion content (e.g., at a standard rate). As such, input controls may be provided such that a user may specify the types of offers received in notifications. For example, user selection of input control 1218 may limit notifications to only those including offers for free trial of companion content.

After selection of one or more user preferences corresponding to input controls 1204-1218, the user may save their preferences by selection of input control 1112, or discard their input by selection of input control 1114. Though a number of illustrative user preferences are discussed with respect to FIG. 12, one skilled in the art will appreciate that a user may specify preferences corresponding to any aspect of notifications. For example, user preferences may control the applicability of individual notification triggers (e.g., disabling or enabling each notification trigger), as well as any available criteria for each notification trigger (e.g., thresholds for light level to trigger a notification, etc.)

FIG. 13 is an illustrative interface 1300 generated on a computing device 204, such as a computing device that can synchronously present companion content, for displaying a notification regarding the availability of companion content. Illustratively, the interface 1300 may correspond to an application for playback of audio books. As such, the interface 1300 may include portions displaying the title of the currently playing audio book 1301; tabs 1302-1306 for displaying information regarding the audio book (e.g., a “Now Playing” screen, a “Chapters” screen, and a “Bookmarks” screen, respectively); a playback indicator 1310 indicating a current position of playback; and one or more playback controls 1316-1320 (e.g., to jump back in playback, to continue playback, and to view bookmarks, respectively). Though not discussed herein, the interface 1300 may include any number of additional display elements regarding a currently playing audio book.

In addition, the interface 1300 may be configured to display a notification 1324 regarding the availability of companion content. The notification 1324 may be displayed in response to a detection of a notification trigger, as described above with respect to FIG. 10. Illustratively, a user of the computing device 204 may have recently consumed a portion of the e-book of The Adventures of Tom Sawyer. Thereafter, the user may have loaded the user interface 1300 in order to listen to an audio book. As such, the computing device 204 may determine that the user would be interested in synchronously presenting the audio book version of The Adventures of Tom Sawyer. Accordingly, notification 1324 may be displayed. The notification 1324 may convey to the user that: (1) an audio book corresponding to an e-book the user has recently consumed is available for synchronous playback; and (2) the user may acquire a trial portion of the corresponding audio book at no charge, beginning from a point corresponding to the last read portion of the e-book.

The interface 1300 may include input controls 1326 enabling a user to accept or decline the offer included with the notification. For example, if the user were to select input control 1328, the notification may be removed, and the user may continue consuming a current audio book. However, if the user were to select input control 1326, the user may be provided with an audio book corresponding to The Adventures of Tom Sawyer, and may be enabled to immediately (or substantially immediately) begin playback of the audio book from a point corresponding to the last read point within the e-book. As will be described in more detail below with respect to FIG. 14, in order to facilitate such playback of the audio book, the computing device 204 may be provided with synchronization information related to the first content and the second content (e.g., the e-book and the audio book). Further, the computing device 204 may be provided with all or a portion of the second content (e.g., the audio book). Thereafter, synchronized playback of the first content and second content may proceed as described above with respect to FIGS. 4A-9.

With reference to FIG. 14, a flow diagram depicting an illustrative routine 1400 for notifying a computing device, such as a computing device 204 of FIG. 2, of the availability of companion content will be described. For example, in some embodiments, the illustrative routine 1400 may be implemented by a content management system 202 of FIG. 2 (e.g., in communication with the computing device 204). In other embodiments, the routine 1400 may be implemented in part or in its entirety by the computing device 204, itself.

The routine 1400 may begin at block 1402, where the content management system 202 may receive consumption information regarding a first content (e.g., an e-book of The Adventures of Tom Sawyer). As described above with respect to FIG. 10, consumption information may include, but is not limited to, information regarding a position of consumption of the first content and information regarding the context of a user or a computing device 204 (e.g., specific user activity, rate of consumption, duration or frequency of consumption, ambient light or noise levels, rate of travel, location, etc.).

Thereafter, at block 1404, the content management system 202 may determine the occurrence of a notification trigger. A notification trigger may include any individual trigger criteria, or a combination of trigger criteria, as described in more detail above with respect to FIG. 10. In some embodiments, received consumption information may be used to determine the occurrence of a notification trigger. In other embodiments, the computing device 204 may be configured to determine occurrences of notification triggers, and to transmit an indication of such a trigger to the content management system 202. As such, the determination of a notification trigger may correspond to receiving an indication from the computing device 204 that a notification trigger has occurred.

In response to a determination of a notification trigger, the content management system 202 may, at block 1406 transmit a notification to the computing device 204 corresponding to an offer to acquire a corresponding second content. In some embodiments, block 1406 may include determining the availability of a corresponding second content. Still further, in some embodiments, a determination of a second content may be based in part on the determined notification trigger. For example, a given notification trigger may indicate that the user has stopped reading, and would like to listen to an audio book. As such, a second content may be determined that corresponds to a recently read e-book, and that is available in audio format. Illustratively, the transmitted notification may enable a user to accept or decline the offer to acquire the second content. One example of a user interface including such a notification is described above with respect to FIG. 13.

In some embodiments, offers may be associated with various acquisition conditions for acquiring all or a portion of a second content. For example, in some embodiments, a portion of a second content may be offered for trial use, subject to usage restrictions. Usage restrictions may correspond, for example, to a limited time of use (e.g., use over only a given time frame, or use for a given period). One skilled in the art will recognize that various additional usage restrictions may exist. For example, use of a second content may be limited to a single “session” (e.g., a continuous period of use). As a further example, use of a second content may be limited to a single device, a single location, etc.

In other embodiments, all or a portion of a second content may be provided for a purchase amount. For example, in some embodiments, a second content may be offered, via a notification, for the same price that it would otherwise be offered for separately. In other embodiments, a second content may be offered for a different (e.g., lower) fee than would otherwise be associated with acquisition of the second content, or for free. For example, a user that has previously purchased The Adventures of Tom Sawyer e-book may be enabled to purchase a corresponding audio book at a lower price than would normally be required for purchasing the audio book. Accordingly, the combined cost of acquiring or otherwise accessing both a first content and a corresponding second content may be lower than the cost of separately acquiring both the first content and the second content. In still more embodiments, a purchase price may be dependent on current consumption information of the first content. For example, a customer may have previously consumed 50% of a first content (e.g., an e-book of The Adventures of Tom Sawyer). The user may wish to continue consuming the content in audio format, but may also wish to avoid purchasing the first 50% of the content again. As such, the audio content corresponding to The Adventures of Tom Sawyer may be offered to the user at half price, reflecting that the user is only acquiring access to the remaining 50% of content (or whatever percentage of the audio content corresponds to the last 50% of the e-book content). In still more embodiments, a user may acquire a second content according to a per-use fee. For example, the user may be charged based on the amount of content actually consumed. Illustratively, a user that consumes a small portion of the second content but then halts consumption of the content may only be charged for the portion consumed. One skilled in the art will appreciate that any number of fees or licenses may be associated with acquisition of a second content. As such, any fee or license, or combination thereof, may be associated with a transmitted notification.

After transmission of a notification including an offer to a user, a determination may be made as to whether a user has accepted the offer associated with the notification. If the user declines the offer, the routine 1400 may terminate at block 1416. However, if the user accepts the offer, the routine 1400 may continue at block 1410. Specifically, at block 1410, synchronization information corresponding to the second content may be transmitted to the computing device 204. Synchronization information may have been determined, for example, by the companion identification system 100 of FIG. 1, as described in more detail above. Illustratively, the synchronization information may enable to the computing device 204 to synchronously present the second content with the first, previously consumed content. For example, the computing device 204 may begin playback of the second content from a point corresponding to a last consumed position of the first content.

Optionally, at blocks 1412 and 1414, a portion of the second content may be generated and transmitted to the computing device 204. For example, the previously transmitted notification may correspond to an offer to acquire a limited portion of the second content (e.g., for trial use) subject to usage restrictions. As such, at block 1412, the content management system 202 may generate a modified second content including the limited portion. Further, in some embodiments, the content management system 202 may modify the second content in order to enforce usage restrictions (e.g., a limited duration of playback). In other embodiments, usage restrictions may be enforced through other mechanisms, such as through other functions on the computing device 204. At block 1414, the modified second content may be transmitted to the computing device 204, therefore enabling the computing device 204 to synchronously present the first content and the modified second content.

In some embodiments, the computing device 204 may be configured to stream all or a part of the second content (e.g., from the content management system 202). As such, in these embodiments, either or both of blocks 1412 and 1414 may be non-essential, and thus omitted. For example, the content management system 202 may enable the computing device 204 to stream only a trial portion of the second content, therefore negating the requirement that the second content be modified. In still other embodiments, the computing device 204 may be configured to both stream the second content and to download the second content. For example, the computing device 204 may initially stream the second content (e.g., in order to facilitate immediate playback), while downloading the second content for non-streaming playback at a later time. Accordingly, after receiving the second content, as well as synchronization information regarding the first content and the second content, the computing device 204 may enable a user to synchronously playback the first and second content, as described in more detail above.

With reference to FIG. 15, an illustrative interaction for providing a synchronizable portion of content (e.g., a content sample or trial) to a computing device 204 of FIG. 2 will be described. Generation of such a content sample may be facilitated, for example, by the content management system 202 of FIG. 2 (e.g., by use of a content sample generation module 220 and/or additional modules).

As shown in FIG. 15, at (1), a computing device 204 may access a first content capable of being synchronized with a companion second content. Examples of such a first content may include, but are not limited to, the entirety of or any portion of an e-book or an audio book. In the illustrative example of FIG. 15, the computing device 204 accesses an e-book of The Adventures of Tom Sawyer. Thereafter, at (2), the content management system 202 may receive a request for a sample of a companion second content. For example, the second content may be a corresponding audio book of The Adventures of Tom Sawyer, and as such, the request may correspond to a request for a sample of that audio book. The request may be made in response to receipt, by the user, of a notification regarding the availability of the companion content. For example, the management system 202 or some other system may detect or be notified of the purchase, by the user, of the e-book of The Adventures of Tom Sawyer. The management system 202 may determine that the corresponding audio book of The Adventures of Tom Sawyer, or a sample thereof, is to be offered or provided to the user. A notification (e.g., an email) may be generated notifying the user of the existence of the companion second content (the audio. book). The notification may include a link or some other control that may be activated to access a sample of the companion second content. One example of such a notification is discussed above with respect to FIG. 13. In some embodiments, the user may access the notification and/or the companion second content on a different computing device 204 than was used to obtain or consume the first content.

In some embodiments, a request for a content sample may occur automatically, such that the user is not required to initiate the request. For example, a computing device 204 may automatically transmit a request for a sample of companion second content after the first content (e.g., an e-book, and audio book, etc.) is accessed. In still more embodiments, a request for a sample of companion second content may be inferred by the content management system 202 based on a status or action of a user or a corresponding computing device 204. For example, a request for a sample of companion second content may be inferred based on a user notification trigger, described above. As a further example, a request for a sample of companion second content may be inferred during or after purchase or acquisition of a first content (e.g., from the content management system 202 or a related system).

Thereafter, at (3) a sample of the second content corresponding to the first content may be generated. Generally speaking, a content sample may correspond to any portion of the companion second content. In some embodiments, a content sample may be associated with one or more use restrictions. Illustratively, a use restriction for a content sample may limit the number of synchronous playbacks of the content sample by a user. For example, a user may be limited to consuming a synchronous presentation of the first content with the companion content sample a single time, and the access to the sample of companion second content may be removed or further restricted thereafter. As a further example, a content sample of the companion second content may be limited in duration, such that no more than a given percentage or absolute amount of the companion second content may be synchronously presented to the user along with the first content.

In some embodiments, such use restrictions may be utilized in order to provide a complete, companion second content to the user, but to restrict access to that complete, companion second content. For example, a user may be provided with a complete second content, but be limited to synchronous playback of no more than 10% of that second content. Thus, if the user wishes to continue synchronous presentation of the first content and companion second content, the user may obtain permission to do so by request, payment of an additional fee or charge, etc. Where a complete content is associated with use restrictions that limit consumption of that content by a user, such restricted content may still be considered a content sample for the purposes of this disclosure.

Content samples may also be generated using other techniques. For example, in some embodiments, a sample of companion second content may be generated from a first X duration of the second content or the first X percentage of the second content. In yet other embodiments, a sample of companion second content may be generated based at least in part on one or more metrics or units of the second content. For example, a content sample of an e-book may be desired that is approximately 10% of the overall text of the e-book, selected from the beginning of the e-book. However, a selection of exactly 10% of the text of an e-book, when selected from the beginning of the e-book, may end within the middle of a sentence. As such, a content sample may be generated containing slightly more than 10% of the e-book, such that the content sample contains only whole sentences of the e-book. As will be appreciated by one skilled in the art, content samples may be modified to include any identifiable units of the content, such as complete paragraphs, pages, chapters, movements, sections, stanzas, or the like.

In other embodiments, content samples of a companion second content may be generated based on a most recently consumed position of the corresponding first content. For example, the content management system 202 may be configured to determine or maintain a position within the first content most recently consumed by the user corresponding to a computing device 204. Illustratively, where the first content corresponds to an e-book, the content management system 202 may be configured to determine or maintain a page of the e-book most recently read by the user. In some instances, the computing device 204 may be configured to transmit a most recently consumed position to the content management system 202 (e.g., periodically or as part of a request for a synchronized sample). Thereafter, the content management system 202 may utilize the most recently consumed position in order to facilitate generation of a content sample of a corresponding second content. For example, the content management system 202 may utilize synchronization information corresponding to the first and second content to determine a position in the second content corresponding to the most recently consumed position within the first content. Illustratively, if a user has recently consumed up to page 45 in The Adventures of Tom Sawyer e-book, the content management system 202 may generate a sample of a companion audio book beginning at a point corresponding to page 45 of the e-book. Accordingly, a customer may be provided with a sample of a companion second content beginning from a last consumed point of the first content. Though described above with respect to a last consumed point of the first content, in some embodiments, other locations or positions within the first content may be monitored and used as the basis for creation of a sample of a second content. Illustratively, the content management system 202 may be configured to determine or maintain a furthest consumed position within the first content (e.g., the highest page number consumed, the highest audio time stamp listened to, etc.), and to utilize such a furthest consumed position to generate a content sample.

In still further embodiments, a sample of second companion content may be generated based at least in part on one or more user preferences. For example, a user may express interest in specific types of content samples, such as those including action sequences, those including romantic scenes, etc. Accordingly, the content management system 202 may generate (and provide synchronization information for) a sample of the companion second content including portions of the second content corresponding to the user preferences.

In some embodiments, user feedback regarding a previously generated sample may be utilized during generation of a subsequent sample. Illustratively, a previously generated sample of The Adventures of Tom Sawyer e-book may have received negative feedback from users. Accordingly, a new sample for The Adventures of Tom Sawyer e-book may be generated in order to avoid including one or more portions of the e-book found in the previously generated sample. Further, in some embodiments, user feedback may be inspected or reviewed to determine a cause of the user's negative reaction. For example, user feedback may indicate that a generated sample contains an uninteresting portion of the e-book. Accordingly, generation of a new sample may include identification of a more dynamic, popular, or interesting portion of the e-book. Such identification may include either or both of manual identification or automatic identification. In some embodiments, automatic identification of interesting, dynamic, or popular portions may utilize user feedback regarding specific portions (e.g., highly rated portions). In other embodiments, automatic identification of interesting, dynamic, or popular portions may utilize textual or auditory analysis of content. For example, textual analysis for identification of dynamic portions may include identification of a large percentage of verbs within the portion. As a further example, auditory analysis may include identification of aspects of the audio content of an audio book, such as tone, pitch, timbre, or cadence of a narrator's voice, or may include other auditory analysis, such as identification of heightened volume of background music. Further examples of textual and/or auditory analysis may be found within the '235 application, incorporated by reference above.

Still further, user feedback regarding a previously generated sample may be utilized in the generation of samples of different or unrelated content. For example, if user feedback for a previously generated sample of a first content is positive, similar criteria may be used to generate a future sample, even where the content of the future sample is different or unrelated to the content of the previous sample. Illustratively, criteria used to generate a sample of The Adventures of Tom Sawyer that has received positive feedback may also be used to generate a sample of The Adventures of Huckleberry Finn, a sample of Alice in Wonderland, or a sample of any other content, regardless of title, type, author, genre, editor, publisher, etc. Examples of criteria used to generate a sample may include any criteria discussed herein or within the '235 application, incorporated by reference in its entirety above, including but not limited to, location of content from which a sample is generated (e.g., from the beginning, middle, or end of content); size of a generated sample (e.g., a specific size, a percentage of the total size, etc.); modifications of a generated sample (e.g., in order to include only complete sentences, paragraphs, pages, chapters, sections, stanzas, acts, scenes, etc.); use of user generated feedback in generating a sample; and enforcement of use restrictions with respect to a sample.

In still further embodiments, the content management system 202 may cease to generate samples for a given content where feedback for previously generated samples has been negative and/or has not resulted in the acquisition of the companion second content. Similarly, the content management system 202 may select additional content for which to generate samples based at least in part on positive feedback of similar samples (e.g., samples from related titles, the same genre, similar content, the same or similar authors, editors, publishers, etc.)

Though illustrative criteria for generating a sample of companion second content are described above, in some embodiments, different or additional criteria may be utilized. Further examples of systems and methods for generation of content samples may be found in the '235 application, incorporated by reference in its entirety above.

Further, as described above, a given item of content (e.g., a first content) may correspond to more than one item of companion content. For example, an e-book of The Adventures of Tom Sawyer may correspond to both an American English audio book and a British English audio book. As a further example, an audio book of The Adventures of Tom Sawyer may correspond to both an abridged and an unabridged e-book. Accordingly, any of the criteria described herein or within the '235 application may further be applied to select an item of companion second content from which to generate a content sample.

Returning to FIG. 15, at (4), the content management system 202 may generate synchronization information for the generated content sample. Similarly to as described above, synchronization information may generally enable a computing device 204 to synchronously present all or a portion of the first content with the generated sample of companion second content. In some embodiments, synchronization information may be generated for the first content and corresponding sample of the companion second content as described above (e.g., in FIGS. 7 and 8). In other embodiments, synchronization information for a sample of the companion second content may be generated based at least in part on synchronization information previously generated for the second content. For example, a generated content sample may correspond to a portion of an audio book of The Adventures of Tom Sawyer, which corresponds to an e-book of the same name. Accordingly, synchronization information may have previously been generated for enabling synchronous playback of the complete audio book and the complete e-book. Accordingly, the content management system 202 may be configured to modify this previously generated content synchronization information in order to enable synchronous playback of the audio book sample and the e-book. In some instances, such modification may include reducing or filtering the information contained with the synchronization information, such that only information necessary for synchronous playback of the generated content sample is included.

Thereafter, at (5), the generated content sample and corresponding synchronization information may be transmitted to the computing device 204. Accordingly, at (6), the computing device may synchronously present to the user the first content and the sample of companion second content.

Though described above in terms of synchronous presentation of first and second content, in some embodiments, samples of a second content may be provided for independent consumption. For example, a user may be provided with a sample of a second companion content for consumption on a second computing device (e.g., an audio player) that is different than the device used to consume the first content (e.g., an ebook reader). The second computing device may not be capable of synchronous presentation of the first and second content, or the user may not wish to utilize synchronous presentation. In such cases, synchronization information may not be required to be determined and transmitted to the computing device 204.

FIG. 16 is an illustrative interface 1600 generated on a computing device 204 for synchronously presenting a first content with a generated sample of companion second content. In the illustrative interface 1600, the first content corresponds to an e-book of The Adventures of Tom Sawyer, while the content sample corresponds to a portion of the corresponding audio book of the same title. Similarly to user interfaces described above, the user interface 1600 may include a number of display features for presenting information regarding the computing device 204, the first content, or the sample of the companion second content. For example, display feature 1604 reflects information regarding the status of the computing device 204, such as a battery level, a wireless network signal strength, and a title 1602 of the currently displayed e-book. Display feature 1606 reflects options for user interaction with the computing device 204, such as links to settings, options to go to a specific point in the displayed e-book, notes regarding the displayed e-book, options to share portions of the displayed e-book with other computing devices 204, and bookmarks of the displayed e-book. The user interface 1602 further includes a display portion 1608 for displaying text of the e-book, and a page indicator 1618 indicating a current page of the e-book displayed in the display portion 1608. As shown in FIG. 16, the display portion 1608 currently displays page 8 of The Adventures of Tom Sawyer (as reflected by the page indicator 1618). In some embodiments, further display features may be included, such as a consumption indicator 1620 displaying the percentage of the content consumed, and status bar 1616 displaying a location of consumption in the content and enabling rapid relocation of consumption (e.g., by interaction with input control 1614 to select a new location on the status bar 1616). As further shown in FIG. 16, the consumption indicator 1620 currently reflects that the user has consumed 5% of the displayed e-book. As will be appreciated by one skilled in the art, the user interface 1600 may include additional or alternative display features, such as interface panel 1610, including icons selectable by a user of the computing device 204 (e.g., to view additional portions of the user interface 1600).

In addition, the user interface 1600 may include controls for facilitating synchronous playback of a first content with a sample of companion second content. For example, in the user interface 1600 of FIG. 16, input control 1622 is provided to toggle playback of a content sample of The Adventures of Tom Sawyer audio book (e.g., to begin or to pause playback). In the illustrative example of FIG. 16, synchronous playback is currently enabled by the user (e.g., via a prior selection of input control 1622). Accordingly, audio content (e.g., an audio book) corresponding to The Adventures of Tom Sawyer may be output by the computing device 204 (e.g., via a speaker or audio output interface, not shown in FIG. 16). Further, display of the e-book of The Adventures of Tom Sawyer may be synchronized with the aforementioned audio output, such that the audio is output synchronously with display of the corresponding text of The Adventures of Tom Sawyer e-book on the computing device 204. In some embodiments, when the playback of the audio book reaches the end of a page of the e-book being presented by display 1608, the next page of the e-book can be displayed automatically within the display 1608 using synchronization information corresponding to the e-book and audio book content pair. In addition, the user interface 1600 may include an indicator 1609 indicating a presentation position of the audio book content in relation to the visual presentation of the e-book content. For example, the text of the e-book presented using the display feature 1608 can be enhanced to indicate the playback position of the audio book presented by the computing device 204. In this regard, text can be highlighted, underlined, and/or presented in different font (e.g., using different color, size, type, effect, etc.). Individual words, lines, sentences, and/or other units of text can be enhanced to indicate an audio playback position. In further embodiments, additional or alternative input controls may be included within the user interface 1600. For example, input controls (not shown) may be provided for enabling interchangeable playback of a first content and a second content, such that a user may enable playback of a second content from a last consumed portion of a first content, and vice versa.

FIG. 17 is an illustrative user interface 1700 generated on a computing device 204 that provides the user with the option to acquire or access a complete, companion second content if the user has enjoyed the synchronous presentation of the sample with the first content. Illustratively, user interface 1700 may be displayed by a computing device 204 after completing consumption of a generated content sample. For example, user interface 1700 may represent a modified version of user interface 1600 of FIG. 16, described above, after synchronous presentation of The Adventures of Tom Sawyer e-book with the content sample of The Adventures of Tom Sawyer audio book. Accordingly, the display portion 1608 and indicator 1609 of the user interface 1700 may be modified to reflect a different portion of The Adventures of Tom Sawyer e-book, while the page indicator 1618 reflects an updated page of the e-book, and the percentage indicator 1620 reflects an updated percent of consumption of the e-book. Because many of the other display features of FIG. 17 are described above with respect to FIG. 16, they will not be described in more detail herein.

The user interface 1700 has further been modified from the user interface 1600 of FIG. 16 by the inclusion of input control 1702, enabling acquisition of the second content corresponding to the companion second content sample. In some embodiments, user selection of input control 1702 may cause a user to acquire or access the complete The Adventures of Tom Sawyer e-book. In other embodiments, user selection of input control 1702 may cause display of one or more additional user interfaces that facilitate such acquisition or access, including but not limited to user interfaces that prompt the user to provide payment information for, or request further access to, second content. In some embodiments, acquisition or further access to a second content during or after consumption of a sample of that second content may be associated with any number of access conditions. Further, such access conditions may differ from those generally associated with access to the second content (e.g., when the second content is accessed independent of a consumed sample). For example, users consuming a sample of the second content may acquire the complete or additional second content at a lower fee than would generally be required. Thereafter, a complete companion second content may be delivered to the computing device 204 for synchronous presentation with the first content. In some embodiments, systems and methods may be employed for reducing latency when acquiring a complete content. Examples of such systems and methods may be found in the '750 application, incorporated by reference above. Those skilled in the art will also recognize that in yet other embodiments, selection of input control 1702 may cause acquisition or access to only remaining portion (e.g., the remainder of the second content following the sample) of the companion second content or to an additional portion (but less than the remaining portion) of the companion second content.

With reference to FIG. 18, a flow diagram depicting an illustrative routine 1800 for providing a sample of companion second content and corresponding synchronization information to a computing device, such as a computing device 204 of FIG. 2, will be described. In some embodiments, the illustrative routine 1400 may be implemented by the content management system 202 of FIG. 2 (e.g., in communication with the computing device 204). In other embodiments, the routine 1800 may be implemented in part or in its entirety by the computing device 204, itself.

The routine 1800 may begin at block 1802, where the content management system 202 may receive a request for a sample of companion second content corresponding to a first content. For example, the request may be for a sample of an audio book corresponding to an already acquired or accessed e-book, The Adventures of Tom Sawyer. As described above with respect to FIG. 14, a request for a content sample may be generated based on user interaction with the computing device 204, or may be generated automatically by the computing device 204 (e.g., based on recent acquisition of the first content, based on a user notification trigger, or based on other criteria).

Thereafter, at block 1804, the content management system 202 may generate a sample of the companion second content corresponding to the first content. For example, where the first content is The Adventures of Tom Sawyer e-book, the content management system 202 may generate a sample of the companion audio book of the same title. As described above with respect to FIG. 10, and as described within the '235 application, generation of the content sample may be based at least in part on text or audio to be contained within a content sample (e.g., such that the content sample contains only complete words, sentences, paragraphs, chapters, sections, etc.), on user preferences (e.g., such that the content sample contains a desired portion of the audio book), or on additional criteria. For example, in some embodiments, generation of a content sample may be based on licenses, contracts, or agreements with other entities, such as providers of the companion second content. Illustratively, such agreements may limit an amount or percentage of the companion second content that may be included within a content sample.

Thereafter, at block 1806, synchronization information corresponding to the generated sample of companion second content, as well as to the first content, may be generated. As described above with respect to FIG. 10, generation of synchronization information for a content sample may utilize or include the routines described above with respect to FIGS. 7 and 8. Moreover, in some embodiments, generation of synchronization information for a content sample may include modification of previously generated synchronization information. For example, where the content sample is generated from The Adventures of Tom Sawyer audio book, generation of synchronization information for the content sample may include modifying synchronization information previously generated for the complete The Adventures of Tom Sawyer audio book. Such modification of previously generated synchronization information may reduce or eliminate a need to recreate synchronization information for a generated content sample.

At block 1808, the generated sample of the companion second content, as well as the synchronization information, may be transmitted to the computing device 204, thereby enabling the computing device 204 to synchronously present the first content and the generated sample of the companion second content. Such synchronous presentation may be facilitated, for example, by the user interface 1600 of FIG. 16. As described above, in some embodiments, a content sample may be associated with use restrictions (e.g., restricting the portion, amount, or percentage of a content sample that may be synchronously presented to a user). Accordingly, the computing device 204 may be configured to enforce such use restrictions. Further, in some embodiments, the content management system 202 may be configured to stream all or a portion of the content sample to the computing device 204 (either in addition to or exclusive of download of the content sample by the computing device 204). In such embodiments, the content management system 202 may be configured to enforce use restrictions, such as by refusing to stream restricted portions of the content sample.

Optionally, at block 1810, a request may be received for acquisition of the complete second content. Such a request may be facilitated, for example, by the user interface 1700 of FIG. 17. For example, a user may request acquisition of the complete second content either after or during synchronous presentation of the first content and the companion second content sample. Accordingly, at block 1812, the complete second content and corresponding synchronization information may be transmitted to the computing device 204, such that the computing device 204 may synchronously present the first content and the companion second content. Transmission of synchronization information to a computing device 204 is described in more detail above with respect to FIGS. 4A and 4B. In some embodiments, systems and methods for reducing latency, such as those disclosed within the '750 application, may be utilized when transmitting a complete content while viewing the content sample. Thereafter, the routine may end at block 1818.

It is to be understood that not necessarily all objects or advantages may be achieved in accordance with any particular embodiment described herein. Thus, for example, those skilled in the art will recognize that certain embodiments may be configured to operate in a manner that achieves or optimizes one advantage or group of advantages as taught herein without necessarily achieving other objects or advantages as may be taught or suggested herein.

All of the processes described herein may be embodied in, and fully automated via, software code modules executed by one or more general purpose computers or processors. The code modules may be stored in any type of computer-readable medium or other computer storage device. Some or all the methods may alternatively be embodied in specialized computer hardware. In addition, the components referred to herein may be implemented in hardware, software, firmware, or a combination thereof.

Conditional language such as, among others, “can,” “could,” “might” or “may,” unless specifically stated otherwise, are otherwise understood within the context as used in general to convey that certain embodiments include, while other embodiments do not include, certain features, elements and/or steps. Thus, such conditional language is not generally intended to imply that features, elements and/or steps are in any way required for one or more embodiments or that one or more embodiments necessarily include logic for deciding, with or without user input or prompting, whether these features, elements, and/or steps are included or are to be performed in any particular embodiment.

Any process descriptions, elements or blocks in the flow diagrams described herein and/or depicted in the attached figures should be understood as potentially representing modules, segments, or portions of code which include one or more executable instructions for implementing specific logical functions or elements in the process. Alternate implementations are included within the scope of the embodiments described herein in which elements or functions may be deleted, executed out of order from that shown, or discussed, including substantially concurrently or in reverse order, depending on the functionality involved as would be understood by those skilled in the art.

It should be emphasized that many variations and modifications may be made to the above-described embodiments, the elements of which are to be understood as being among other acceptable examples. All such modifications and variations are intended to be included herein within the scope of this disclosure and protected by the following claims.

Number	Name	Date	Kind
5203705	Hardy et al.	Apr 1993	A
5351189	Doi et al.	Sep 1994	A
5657426	Waters et al.	Aug 1997	A
5737489	Chou et al.	Apr 1998	A
5978754	Kumano	Nov 1999	A
6208956	Motoyama	Mar 2001	B1
6356922	Schilit et al.	Mar 2002	B1
6766294	MacGinite et al.	Jul 2004	B2
6912505	Linden et al.	Jun 2005	B2
7107533	Duncan et al.	Sep 2006	B2
7231351	Griggs	Jun 2007	B1
8106285	Gerl et al.	Jan 2012	B2
8109765	Beattie et al.	Feb 2012	B2
8131545	Moreno et al.	Mar 2012	B1
8131865	Rebaud et al.	Mar 2012	B2
8442423	Ryan et al.	May 2013	B1
8548618	Story, Jr. et al.	Oct 2013	B1
8577668	Rosart et al.	Nov 2013	B2
9037956	Goldstein et al.	May 2015	B2
20020002459	Lewis et al.	Jan 2002	A1
20020007349	Yuen	Jan 2002	A1
20020041692	Seto et al.	Apr 2002	A1
20020116188	Amir et al.	Aug 2002	A1
20030061028	Dey et al.	Mar 2003	A1
20030083885	Frimpong-Ansah	May 2003	A1
20030115289	Chinn et al.	Jun 2003	A1
20040261093	Rebaud et al.	Dec 2004	A1
20060148569	Beck	Jul 2006	A1
20070016314	Chan et al.	Jan 2007	A1
20070061487	Moore et al.	Mar 2007	A1
20070136459	Roche et al.	Jun 2007	A1
20070276657	Gournay et al.	Nov 2007	A1
20070282844	Kim et al.	Dec 2007	A1
20080177822	Yoneda	Jul 2008	A1
20080294453	Baird-Smith et al.	Nov 2008	A1
20090047003	Yamamoto	Feb 2009	A1
20090136213	Calisa et al.	May 2009	A1
20090222520	Sloo et al.	Sep 2009	A1
20090228570	Janik et al.	Sep 2009	A1
20090233705	Lemay et al.	Sep 2009	A1
20090276215	Hager	Nov 2009	A1
20090281645	Kitahara et al.	Nov 2009	A1
20090305203	Okumura et al.	Dec 2009	A1
20090319273	Mitsui et al.	Dec 2009	A1
20100042682	Kaye	Feb 2010	A1
20100042702	Hanses	Feb 2010	A1
20100064218	Bull et al.	Mar 2010	A1
20100070575	Bergquist et al.	Mar 2010	A1
20100279822	Ford	Nov 2010	A1
20100286979	Zangvil et al.	Nov 2010	A1
20100287256	Neilio	Nov 2010	A1
20110067082	Walker	Mar 2011	A1
20110087802	Witriol et al.	Apr 2011	A1
20110119572	Jang et al.	May 2011	A1
20110177481	Haff et al.	Jul 2011	A1
20110191105	Spears	Aug 2011	A1
20110231474	Locker et al.	Sep 2011	A1
20110246175	Yi et al.	Oct 2011	A1
20110288861	Kurzweil et al.	Nov 2011	A1
20110288862	Todic	Nov 2011	A1
20110296287	Shahraray et al.	Dec 2011	A1
20120030288	Burckart et al.	Feb 2012	A1
20120109640	Anisimovich et al.	May 2012	A1
20120150935	Frick et al.	Jun 2012	A1
20120166180	Au	Jun 2012	A1
20120197998	Kessel et al.	Aug 2012	A1
20120245719	Story, Jr. et al.	Sep 2012	A1
20120245720	Story, Jr. et al.	Sep 2012	A1
20120245721	Story, Jr. et al.	Sep 2012	A1
20120246343	Story, Jr. et al.	Sep 2012	A1
20120315009	Evans et al.	Dec 2012	A1
20120324324	Hwang et al.	Dec 2012	A1
20130073449	Voynow et al.	Mar 2013	A1
20130073675	Hwang et al.	Mar 2013	A1
20130074133	Hwang et al.	Mar 2013	A1
20130257871	Goldstein et al.	Oct 2013	A1
20130262127	Goldstein et al.	Oct 2013	A1
20140005814	Hwang et al.	Jan 2014	A1
20140039887	Dzik et al.	Jan 2014	A1
20140040713	Dzik et al.	Feb 2014	A1
20140223272	Arora et al.	Aug 2014	A1

Number	Date	Country
103988193	Aug 2014	CN
2689346	Jan 2014	EP
9-265299	Oct 1997	JP
2002-140085	May 2002	JP
2005-189454	Jul 2005	JP
532174	Jan 2007	NZ
WO 2006029458	Mar 2006	WO
WO 2011144617	Nov 2011	WO
WO 2012129438	Sep 2012	WO
WO 2012129445	Sep 2012	WO
WO 2013148724	Oct 2013	WO
WO 20131169670	Nov 2013	WO
WO 2013181158	Dec 2013	WO
WO 2013192050	Dec 2013	WO
WO 2014004658	Jan 2014	WO

	Number	Date	Country
Parent	13552548	Jul 2012	US
Child	13602012		US
Parent	13070313	Mar 2011	US
Child	13552548		US

Synchronized digital content samples

Information

Patent Number

Date Filed

Date Issued

Inventors

Original Assignees

Examiners

Agents

CPC

Field of Search

CPC

International Classifications

Term Extension

Abstract

Description

Claims

CROSS-REFERENCE TO RELATED APPLICATIONS

US Referenced Citations (81)

Foreign Referenced Citations (15)

Non-Patent Literature Citations (30)

Related Publications (1)

Provisional Applications (1)

Continuation in Parts (2)

Entry
Fabio Vignoli, Carlo Braccini, Aug. 7-10, 2009, A Text-Speech Synchronization Technique With Application to Talking Heads, Auitory-Visual Speech Processing, ISCA Archive.
Yardena Arar, Jan. 7, 2010, Blio E-Book Platform: No Reader (Yet), But Great Graphics.
Dzik, et al., U.S. Appl. No. 13/604,482, filed Sep. 5, 2012, entitled “Identifying Corresponding Regions of Content.”
Dzik, et al., U.S. Appl. No. 13/604,486, filed Sep. 5, 2012, entitled “Selecting Content Portions for Alignment.”
Dzik, Steven Charles, U.S. Appl. No. 13/662,306, filed Oct. 26, 2012, entitled “Content Presentation Analysis.”
Enhanced Editions, “Feature: Synched Audio and Text” Aug. 31, 2009, last accessed Nov. 15, 2012, available at http://www.enhanced-editions com/blog/2009/08/enhanced-editions-features-exclusive-soundtracks-and-extracts/.
Hwang et al., U.S. Appl. No. 13/536,711, filed Jun. 28, 2012, entitled “Pacing Content.”
International Search Report issued for PCT/US12/30198 mailed on Jun. 20, 2012, 16 pages.
Roub, Paul, “I'll Buy an E-book Reader When . . . ”, Nov. 16, 2007, available at: http://roub.net/blahg/2007/11/16/ill-buy-an-eboo/ (accessed Sep. 6, 2012). 2 pages.
Weber, Frederick V,. U.S. Appl. No. 13/531,376, fled Jun. 22. 2012, entitled “Modelling Expected Errors for Discriminative Training.”
U.S. Appl. No. 13/070,313, filed Mar. 23, 2011, Synchronizing Digital Content.
U.S. Appl. No. 13/552,548, filed Jul. 18, 2012, Synchronizing Digital Content.
U.S. Appl. No. 13/535,240, filed Jun. 27, 2012, Managing Related Digital Content.
U.S. Appl. No. 13/535,264, filed Jun. 27, 2012, Managing Related Digital Content.
U.S. Appl. No. 13/570,179, filed Aug. 8, 2012, Synchronizing Recorded Audio Content and Companion Content.
U.S. Appl. No. 13/070,422, filed Mar. 23, 2011, Managing Playback of Synchronized Content.
U.S. Appl. No. 13/070,421, filed Mar. 23, 2011, Managing Playback of Synchronized Content.
U.S. Appl. No. 13/070,439, filed Mar. 23, 2011, Managing Playback of Synchronized Content.
U.S. Appl. No. 13/483,883, filed May 30, 2012, Synchronizing Translated Digital Content.
U.S. Appl. No. 13/604,482, filed Sep. 5, 2012, Identifying Corresponding Regions of Content.
U.S. Appl. No. 13/604,486, filed Sep. 5, 2012, Selecting Content Portions for Alignment.
U.S. Appl. No. 13/758,749, filed Feb. 4, 2013, Selective Synchronous Presentation.
Beattie, V., et al., Reading Assistant: Technology for Guided Oral Reading, Scientific Learning, Apr. 10, 2012, 5 pages.
Levinson, S.E., et al., Continuous Speech Recognition from a Phonetic Transcription, Acoustics, Speech, and Signal Processing, Apr. 1990, pp. 190-199.
Office Action in Japanese Application No. 2014-501257 dated Apr. 6, 2015.
Office Action in Japanese Application No. 2014-501257 dated Aug. 25, 2014.
International Search Report and Written Opinion in PCT/US2014/014508 mailed Jun. 25, 2014.
International Search Report issued in connection with International Patent Application No. PCTUS12/30186 mailed on Jun. 20, 2012, 12 pages.
International Search Report and Written Opinion in PCT/US2013/042903 mailed Feb. 7, 2014.
International Search Report issued in connection with International Application No. PCT/US13/53020 mailed on Dec. 16, 2013.