News sources often generate images, articles, graphs, and other similar objects that are used in providing information about a particular event. These events may include financial events, world news events, local news events, among other possible events. The objects generated may include various facts, relevant images, or other similar data that can be used in providing a reader or viewer with information about the particular event. However, although news stories may provide information about a particular event, different news stories may provide different information, and may even provide false information. As a result, readers and viewers of the objects may find it difficult to identify important information within the objects, as well determine the information that is factually correct.
Provided herein are enhancements for managing content items using active listening across computing devices. In one implementation, a method of managing content items for end users includes determining first content items to be presented to an end user and determining a first sequence for the first content items. The method further includes monitoring user interactions with one or more secondary services and determining content of interest for the end user based on the user interactions. The method also provides determining second content items to be presented to the end user and determining a second sequence for the second content items.
Many aspects of the disclosure can be better understood with reference to the following drawings. While several implementations are described in connection with these drawings, the disclosure is not limited to the implementations disclosed herein. On the contrary, the intent is to cover all alternatives, modifications, and equivalents.
In operation, summary service 160 obtains data objects from data sources 140 and provides summaries of the data objects to various end users, such as end user 170. In some implementations, summary service 160 may obtain news articles, social media posts, images, blog posts, or some other similar data object from data sources 140 and extract relevant information from the data objects to generate summaries of events for an associated end user. These events may comprise product release dates, terrorist attacks, financial events (such as an initial public offering), a person of interest, a location of interest, an event for an organization (such as a product recall), or some other similar event. In extracting the relevant information, summary service 160 may determine frequently used data points across multiple data objects, data points that are emphasized and/or placed at particular portions in the data object, data points that introduce values of interest to the particular event topic, data points that are relevant to a particular user based on a profile for the user, or some other similar extraction operation for the data. Once extracted, the data may be aggregated into a content item (or summary) that can be provided to the required end user.
In some examples, to identify the events for the content items, summary service 160 may be used to identify events based on the information in the data objects. For example, if multiple articles referenced the release of a new product, summary service 160 may identify the release of the product as an event and may extract information from the data objects to generate a content item that summarizes the release of the new product. This information may include the date of the product, the business sector for the new product, any reviews of the new product, any persons of interest linked to the new product, or some other similar information. In other implementations, rather than automating the process of identifying the events, an administrator or user may also define information for an event of interest. Using the previous example, rather than summary service 160 identifying the product release, an administrator may define the even and summary service 160 may generate a content item that summarizes the release based on data objects obtained from data sources 140.
Here, in addition to generating summaries about events, summary service 160 is also used to dynamically manage the types of content items that are identified for individual end users and the sequence for which the content items are presented to the individual. Referring to the example in computing environment 100, summary service 160 may dynamically modify the types of content items and the sequencing of the content items that are presented to end user 170 using summary application 130 on end user device 120. In modifying the types and sequencing of the data items, summary service 160 may monitor interactions of end user 170 with other applications on end user device 120, as well as interactions with applications 131-132 on user associated devices 121-122. These interactions may comprise text or voice interactions (e.g. voice commands or text-based searches) and may be obtained directly from the user associated devices or may be obtained from secondary service(s) 110. As an example, summary service 160 may monitor social media posts from end user 170 via an application programming interface (API) with the social media service in secondary service(s) 110. From the posts, summary service 160 may dynamically modify the content items that are presented to end user 170.
As depicted, operation 200 includes determining (201) first content items to be presented to an end user and determining a first sequence for the content items. In some implementations, summary service 160 obtains data objects from data sources 140 and generates summary content items of events identified within the data objects. These summaries may include text-based summaries with various data points of interest included, graphs with various data points of interest, images, or some other similar summary, including combinations thereof. As the content items are identified, summary service 160 may determine a sequence for how the content items should be presented to the user. This sequence may be based on preferences provided by the end user, preferences identified from previously presented content items to the end user, the importance of the event, or some other similar sequencing factor. As an example, a user may indicate that they prefer financial event summaries ahead of sports related summaries. As a result, summary service may sequence the summaries, such that the financial events are prioritized ahead of the sports related events. This sequencing in some examples may include prioritizing or emphasizing the financial events in a list, in font size, in color, or in some other similar prioritization method when providing the content items to the end user.
Once the first content items and the sequencing for the first content items is determined, operation 200 further monitors (202) user interactions with one or more secondary services, wherein the interactions may comprise text-based interactions, voice-based interactions, or any other similar interaction. These interactions may be directly monitored from devices 120-122 or may be identified from secondary service(s) 110. As the user interactions are identified, operation 200 further determines (203) content of interest for the end user based on the user interactions. As an example, user associated device 121 may comprise a “smart” speaker, wherein the user may provide queries to the speaker and receive responses to the queries, the speaker may monitor habits of the user to determine actions to take (e.g. ordering new products), or may provide various other functions for the end user. As the user interacts with user associated device 121, summary service 160 may obtain information about the interactions, and determine whether the interactions correspond to content of interest. For example, summary service 160 may obtain transcripts of various voice communications with user associated device 121, and from the transcripts identify content of interest for the end user. This content of interest may correspond to particular data points of interest, such as values associated with an event, may correspond to particular topics or events of interest, such as financial events, sporting events, and the like, or may comprise any other similar content of interest. In at least one implementation, summary service 160 may identify content of interest for the user based on the frequency that the user interactions include information about particular content. For example, summary service 160 may identify content of interest based on the frequency that the user interactions comprise interactions regarding financial events over sporting events, wherein the increased user interactions may demonstrate a preference that the financial content is more relevant to the end user than sports content. Similarly, summary service 160 may identify content of interest within a particular event topic, wherein user interactions may indicate that the user prefers opinions over facts or values for a particular event topic. As an example, end user 170 may frequently provide user interactions that correspond to opinions about a new product release over the values associated with the new product release (e.g. processor speed, storage, and the like). Consequently, for future events, the summary content item that is generated for a product release event may promote the opinions of reviewers over the specification values associated with the product.
As the content of interest is identified for end user 170, operation 200 further determines (204) second content items to be presented to the end user and a second sequence for the second content items based on the content of interest. As described previously, content of interest may be identified based on the frequency that the user interactions include particular data points, based on the types of queries or user interactions related to particular events, or based on some other similar interest factor for an end user. For example, when an end user generates multiple queries to an application on user associated device 121 (e.g. finance queries), summary service 160 may determine that the end user is most interested in finance content items. Consequently, when summary service 160 determines the second content items, such as event summaries, summary service may identify and promote finance related content items over other types of items. Similarly, based on the user interactions identified by summary service 160, summary service may modify the content in each of the content items to more align with the user interests, wherein values, opinions, and other data points in the content items may be prioritized based on the user interests.
In some implementations, the second content items that are identified for end user 170 may include at least a portion of the first content items. In other implementations, the second content items may comprise entirely different content items related to the same or different events. As an example, based on the interactions of end user 170 using devices 120-122, summary service may promote particular event types (e.g. events related finance) over other event types. As a result, new summary content items may be generated that better suit the end user interests to particular event types.
In some implementations, the determination of the content items and the determination for the sequencing of the data items may occur in response to an end user request for the content items. In other implementations, summary service 160 may determine the first content items and sequencing for the data items periodically, when new events are identified, or at any other interval.
In operation, summary service 160 determines and provides first content in a first sequence to user device 120, wherein user device 120 may execute an application capable of displaying, generating audio, or providing some other user interface means for the first content. The content items may be provided as a list, may be provided one after another, or may be provided in any other manner where at least a portion of the first content items are promoted over other content items. Here, once the first content items are provided to end user device 120, summary service 160 further monitors interactions of the end user (end user 170 of
As the interactions are monitored for the end user, the end user may generate another request for content at end user device 120, which is identified by summary service 160. In response to the request, summary service 160 may update content that is provided to the end user based on the monitored interactions and provide second content in a second sequence to the requesting user at end user device 120. These updated content items may include new content items with different event types, may include the same event types with different content items therein, a reorganization of the event types or the content therein, or some other similar updated content.
While demonstrated in the example of
As described herein, a summary service may obtain information about voice and communication interactions with one or more applications and/or devices outside of an application for the summary service. In some implementations, the interaction information may be obtained from user devices associated with a particular end user, such as a smartphone, a smart speaker, a computer, a tablet, or some other similar device, wherein the device may execute one or more applications capable of capturing user interactions. These interactions may be directly with the device or may monitor conversations or other communications indirectly, such as conversations in a room. In other implementations rather than being provided with the communication directly from the device, the summary service may obtain the communications from services, wherein the services may comprise social media services, shopping services, or some other similar type of services. In some examples, the services may provide all communications, however, it should be understood that only a portion of the communications may be provided in some implementations.
As a communication is identified by the summary service, the summary service may use a language understanding module 410 to determine whether the communication is related to content that is provided to the end user as part of the summary service. In some implementations, a transcript of the communication may be inspected to identify words and phrases of interest related to the content that is provided to the requesting user. For example, if an end user received summaries regarding sports, finance, politics, any terms related to those subjects may classify the communication as content related. In contrast, if the communication were not related to those subjects, the operation of the summary service may end.
If the communication is content related, language understanding module 410 may forward the communication to update content module 420 that is used to update preferences for the content that is supplied to the associated user. In particular, update content module 420 may determine whether the communication causes a modification to the profile for the end user. This update may be triggered based on values, words, phrases, or some other similar information identified in the transcript of the communication. As an example, when an end user cites particular facts about a previously identified event, the fact type (e.g. date, person of interest, monetary values, and the like) may be promoted for future content items that are presented to the end user. Similarly, if a general topic is discussed in the communication by the end user over other topics, such as finance over sports, then update content module 420 may update the content preferences of the user to promote finance over sports. In some implementations, the content of the communication may cause a change in the preferences of the end user, however, it should be understood that the preferences may not change depending on the information in the communication. Thus, when the first content items are generated using a first form of the user profile (e.g. data points of interest in the content items, content item topics or types of interest, or some other similar preference), the profile may not change when the user connections do not indicate differences in content of interest for the user.
In at least one implementation, in determining whether the content preferences for the end user should be modified, the summary service may monitor the frequency that various terms and topics are used by the end user. In particular, rather than monitoring a single communication, the summary service may monitor communications and interactions of the user over time to determine trends in the communication habits of the end user. Based on the information across multiple communications, the summary service may update the preferences of the end user. For example, the end user may frequently have interactions regarding financing during morning hours but may frequently have interactions regarding sports during night hours. As a result, the content service may dynamically adjust the content items that are provided to the end user based on the time of day, where finance content items may be promoted over sports items during morning time periods, while sports may be promoted over finance content items during later periods in the day.
Referring first to
After a first sequence for content items 510-512 is identified (demonstrated as most relevant to least relevant) for the end user, the summary service may monitor user interactions with various applications across one or more computing devices. These devices may include smart speakers, smartphones, computers, tablets, or some other similar computing device. The user interactions may comprise direct interactions with the applications (e.g. requesting an application for a weather report), or may comprise indirect interactions, wherein the application may monitor or provide a communication portal for the end user with other users (e.g. smart speaker monitoring a conversation of the end user with another person). As the user interactions are identified, at least a portion of the user interactions may be provided to the summary service. Once provided, the summary service may process the interactions as described herein. In some implementations, the summary service may identify portions of the interactions that are related to content of interest and modify preferences of the end user based on the content of interest. This content of interest may be identified based on the frequency or trends that the end user interactions correspond to a particular content type (e.g. values, opinions, and the like), may be based on the frequency or trends that correspond to particular subject types, or may be based on any other similar factor to determine content of interest for an end user.
Referring now to
Referring first to
After a first sequence for content items 610-612 is identified (demonstrated as most relevant to least relevant) for the end user, the summary service may monitor user interactions with various applications across one or more computing devices. These devices may include smart speakers, smartphones, computers, tablets, or some other similar computing device. The user interactions may comprise direct interactions with the applications (e.g. requesting an application for a weather report), or may comprise indirect interactions, wherein the application may monitor or provide a communication portal for the end user with other users (e.g. smart speaker monitoring a conversation of the end user with another person). As the user interactions are identified, at least a portion of the user interactions may be provided to the summary service. Once provided, the summary service may process the interactions as described herein. In some implementations, the summary service may identify portions of the interactions that are related to content of interest and modify preferences of the end user based on the content of interest. This content of interest may be identified based on the frequency or trends that the end user interactions correspond to a particular content type (e.g. values, opinions, and the like), may be based on the frequency or trends that correspond to particular subject types, or may be based on any other similar factor to determine content of interest for an end user.
Referring to
Although demonstrated in the examples of
Communication interface 701 comprises components that communicate over communication links, such as network cards, ports, radio frequency (RF), processing circuitry and software, or some other communication devices. Communication interface 701 may be configured to communicate over metallic, wireless, or optical links. Communication interface 701 may be configured to use Time Division Multiplex (TDM), Internet Protocol (IP), Ethernet, optical networking, wireless protocols, communication signaling, or some other communication format—including combinations thereof. In some implementations, communication interface 701 may be configured to communicate with data resources to obtain data objects that correspond to various events, and may further communicate with secondary services (servers, desktop computers, and the like) or user associated devices to obtain user interaction information. Communication interface 701 may further be configured to communicate with client or console devices of end users, wherein the users may request and receive content items (or summaries) from computing system 700. The users may request the content items via a dedicated application on the client device or may request the content items using web browsing application or some other similar application.
User interface 702 comprises components that interact with a user to receive user inputs and to present media and/or information. User interface 702 may include a speaker, microphone, buttons, lights, display screen, touch screen, touch pad, scroll wheel, communication port, or some other user input/output apparatus—including combinations thereof. User interface 702 may be omitted in some examples. In some implementations, user interface 702 may be used in obtaining user summary requests and providing the summary to the requesting user.
Processing circuitry 705 comprises microprocessor and other circuitry that retrieves and executes operating software 707 from memory device 706. Memory device 706 may include volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storage of information, such as computer readable instructions, data structures, program modules, or other data. Memory device 706 may be implemented as a single storage device but may also be implemented across multiple storage devices or sub-systems. Memory device 706 may comprise additional elements, such as a controller to read operating software 707. Examples of storage media include random access memory, read only memory, magnetic disks, optical disks, and flash memory, as well as any combination or variation thereof, or any other type of storage media. In some implementations, the storage media may be a non-transitory storage media. In some instances, at least a portion of the storage media may be transitory. It should be understood that in no case is the storage media a propagated signal.
Processing circuitry 705 is typically mounted on a circuit board that may also hold memory device 706 and portions of communication interface 701 and user interface 702. Operating software 707 comprises computer programs, firmware, or some other form of machine-readable program instructions. Operating software 707 includes content module 708, interaction module 709, and interest module 710, although any number of software modules may provide the same operation. Operating software 707 may further include an operating system, utilities, drivers, network interfaces, applications, or some other type of software. When executed by processing circuitry 705, operating software 707 directs processing system 703 to operate computing system 700 as described herein.
In one implementation, content module 708 directs processing system 703 to determine first content items and a sequence for the content items to be provided to an end user. This determination may be based on preferences provided from the end user, based on previously provided content items and feedback from the end user, based on user interactions with various other services, or based on any other similar information. Once the first content items and sequence are identified, interaction module 709 directs processing system to identify user interactions with one or more secondary services, wherein the secondary services may comprise social media applications, voice or text communication applications, personal assistant applications, or some other similar application. In some implementations, interaction module 709 may receive the information directly from devices associated with the end user, smartphone, smart speaker, computer, or some other similar end user device. In some examples, the information may be obtained from the services hosted on or more servers in data center for the application. These services may provide at least a portion of the user interactions to computing system 700 for processing, wherein the user interactions may comprise communications directly with the application, such as requests to a digital personal assistant application, or may comprise communications that are provided via the application, such as text or voice communications facilitated via the application.
Once the user interactions are identified, interest module 710 directs processing system 703 to determine content of interest based on the user interactions. After the content of interest is identified, content module 708 determines second content items for the end user and a sequence for the second content items to be provided to the end user based on the content of interest. In some implementations, the second content items may share at least a portion of the content items with the first content items. In some examples, the second content items may be provided with different content subjects being prioritized over other content subjects, with different content types in each of the content items being prioritized, or some other similar differentiation in content.
Returning to the elements of
Secondary service(s) 110 may comprise social media platforms, personal assistant platforms, communication platforms, or some other similar service capable of providing services via applications on end user devices. Data sources 140 may each comprise one or more communication interfaces and network interfaces, processing systems, computer systems, microprocessors, storage systems, storage media, or some other processing devices or software systems. Data sources 140 may each comprise one or more serving computing systems, desktop computing systems, or some other similar computing system.
Summary service 160 comprise communication interfaces and network interfaces, processing systems, computer systems, microprocessors, storage systems, storage media, or some other processing devices or software systems, and can be distributed among multiple devices. Summary service 160 may include software such as an operating system, logs, databases, utilities, drivers, networking software, and other software stored on a computer-readable medium.
End user device 120 and user associated devices 121-122 may each comprise smartphones, smart speakers, computers, tablets, or some other similar computing device. End user device 120 and user associated devices 121-122 may each comprise communication interfaces and network interfaces, processing systems, computer systems, microprocessors, storage systems, storage media, or some other processing devices or software systems.
Communication between the summary service 110, data sources 140, secondary service(s) 110, and devices 120-122 may use metal, glass, optical, air, space, or some other material as the transport media. Communication between summary service 110, data sources 140, secondary service(s) 110, and devices 120-122 may use various communication protocols, such as Time Division Multiplex (TDM), asynchronous transfer mode (ATM), Internet Protocol (IP), Ethernet, synchronous optical networking (SONET), hybrid fiber-coax (HFC), circuit-switched, communication signaling, wireless communications, or some other communication format, including combinations, improvements, or variations thereof. Communication between summary service 110, data sources 140, secondary service(s) 110, and devices 120-122 may be a direct link or can include intermediate networks, systems, or devices, and can include a logical network link transported over multiple physical links.
The included descriptions and figures depict specific implementations to teach those skilled in the art how to make and use the best option. For the purpose of teaching inventive principles, some conventional aspects have been simplified or omitted. Those skilled in the art will appreciate variations from these implementations that fall within the scope of the invention. Those skilled in the art will also appreciate that the features described above can be combined in various ways to form multiple implementations. As a result, the invention is not limited to the specific implementations described above, but only by the claims and their equivalents.
This application hereby claims the benefit of and priority to U.S. Provisional Patent Application No. 62/712,104, titled “ACTIVE LISTENING TO MANAGE ADAPTIVE CONTENT ITEMS,” filed Jul. 30, 2018, and which is hereby incorporated by reference in its entirety.
Number | Date | Country | |
---|---|---|---|
62712104 | Jul 2018 | US |