Patent Application
20220060580
The present disclosure relates generally to communication processing using artificial-intelligence (AI). More specifically, techniques are provided to deploy an AI platform to select and manage terminal devices in a communication channel, which enables customers to engage with agents best suited to answer natural language queries.
Various embodiments of the disclosure are discussed in detail below. While specific implementations are discussed, it should be understood that this is done for illustration purposes only. A person skilled in the relevant art will recognize that other components and configurations can be used without parting from the spirit and scope of the disclosure. Thus, the following description and drawings are illustrative and are not to be construed as limiting. Numerous specific details are described to provide a thorough understanding of the disclosure. However, in certain instances, well-known or conventional details are not described in order to avoid obscuring the description. References to one or an embodiment in the present disclosure can be references to the same embodiment or any embodiment; and, such references mean at least one of the embodiments.
Reference to “one embodiment” or “an embodiment” means that a particular feature, structure, or characteristic described in connection with the embodiment is included in at least one embodiment of the disclosure. The appearances of the phrase “in one embodiment” in various places in the specification are not necessarily all referring to the same embodiment, nor are separate or alternative embodiments mutually exclusive of other embodiments. Moreover, various features are described which can be exhibited by some embodiments and not by others.
The terms used in this specification generally have their ordinary meanings in the art, within the context of the disclosure, and in the specific context where each term is used. Alternative language and synonyms can be used for any one or more of the terms discussed herein, and no special significance should be placed upon whether or not a term is elaborated or discussed herein. In some cases, synonyms for certain terms are provided. A recital of one or more synonyms does not exclude the use of other synonyms. The use of examples anywhere in this specification including examples of any terms discussed herein is illustrative only, and is not intended to further limit the scope and meaning of the disclosure or of any example term. Likewise, the disclosure is not limited to various embodiments given in this specification.
Without intent to limit the scope of the disclosure, examples of instruments, apparatus, methods and their related results according to the embodiments of the present disclosure are given below. Note that titles or subtitles can be used in the examples for convenience of a reader, which in no way should limit the scope of the disclosure. Unless otherwise defined, technical and scientific terms used herein have the meaning as commonly understood by one of ordinary skill in the art to which this disclosure pertains. In the case of conflict, the present document, including definitions will control.
Additional features and advantages of the disclosure will be set forth in the description which follows, and in part will be obvious from the description, or can be learned by practice of the herein disclosed principles. The features and advantages of the disclosure can be realized and obtained by means of the instruments and combinations particularly pointed out in the appended claims. These and other features of the disclosure will become more fully apparent from the following description and appended claims, or can be learned by the practice of the principles set forth herein.
According to some embodiments, a computer-implemented method is provided. The computer-implemented method comprises receiving a communication. The communication includes one or more words in a natural language. The method further comprises parsing the communication to identify an operative word. This operative word is related to an available action associated with a user device. The method further comprises identifying a pre-defined intent associated with the operative word and facilitating annotation of the pre-defined intent. The pre-defined intent defines the action associated with the user device. Additionally, the annotation defines a quality of an association between the communication and the pre-defined intent. The method further comprises retrieving one or more agent profiles, wherein agent profiles are associated with an agent and a terminal device. Further, the method comprises selecting an agent profile from the one or more agent profiles. The agent profile is selected based on a correlation of the agent profile to the pre-defined intent and the quality of the association between the communication and the pre-defined intent. The method further comprises routing the communication, wherein when the communication is received at the terminal device associated with the selected agent profile, execution of the action is facilitated.
In some embodiments, identifying the operative word includes querying a database including at least the operative word, wherein the querying is performed using the one or more words as input.
In some embodiments, the pre-defined intent associated with the operative word is identified through a query of a database including associations between stored operative words and intents.
In some embodiments, the annotation is performed based on a correlation of the communication and the pre-defined intent.
In some embodiments, the correlation of the agent profile to the pre-defined intent indicates that the pre-defined intent matches an intent of which an agent associated with the agent profile is knowledgeable.
In some embodiments, the execution of the action includes facilitating a connection between the user device and the terminal device.
In one embodiment, a system comprises one or more processors and memory including instructions that, as a result of being executed by the one or more processors, cause the system to: receive a communication, wherein the communication includes one or more words in a natural language; identify an operative word of the one or more words from the communication, wherein the operative word is related to an available action associated with a user device; identify a pre-defined intent associated with the operative word, wherein the pre-defined intent defines an action available to the user device; annotate the pre-defined intent to define a quality of an association between the communication and the pre-defined intent; select an agent profile from one or more agent profiles, wherein the agent profile is selected based on a correlation of the agent profile to the pre-defined intent and the quality of the association between the communication and the pre-defined intent, wherein agent profiles are associated with an agent and a terminal device; and route the communication, wherein when the communication is received at the terminal device associated with the selected agent profile, execution of the action is facilitated.
In some embodiments, the instructions that cause the system to identify the pre-defined intent further cause the system to perform a semantic analysis of the communication and an analysis of user input and communication statistics to determine the pre-defined intent.
In some embodiments, the correlation of the agent profile to the pre-defined intent and the quality of the association between the communication and the pre-defined intent is determined based on a score that reflects a suitability of the terminal device and an agent associated with the agent profile to respond to the communication.
In some embodiments, the instructions that cause the system to annotate the pre-defined intent to define the quality of an association between the communication and the pre-defined intent further cause the system to: provide the operative word and the pre-defined intent to a computing device to cause a the computing device to perform an evaluation of the quality of the association; and obtain, from the computing device, the evaluation of the quality of the association.
In some embodiments, the instructions that cause the system to identify the pre-defined intent associated with the operative word further cause the system to query a database including stored associations between stored operative words and intents, to identify an association between the operative word and the pre-defined intent.
In some embodiments, the instructions that cause the system to annotate the pre-defined intent to define the quality of an association between the communication and the pre-defined intent further cause the system to calculate the quality based on a second association between the operative word and the pre-defined intent.
In some embodiments, the pre-defined intent is generated using artificial intelligence and an intent model, wherein the artificial intelligence is applied to the intent model to aggregate intent-related data and generate corresponding intents.
In one embodiment, a non-transitory computer-readable storage medium stores thereon executable instructions that, as a result of being executed by one or more processors of a computer system, cause the computer system to: identify an operative word from a communication, wherein the communication includes one or more words in a natural language and wherein the one or more words include the operative word; identify a pre-defined intent associated with the operative word, wherein the pre-defined intent defines an action available to a user device; annotate the pre-defined intent to define a quality of an association between the communication and the pre-defined intent; select an agent profile from one or more agent profiles, wherein the agent profile is selected based on a correlation of the agent profile to the pre-defined intent and the quality of the association between the communication and the pre-defined intent, wherein agent profiles are associated with an agent and a terminal device; and route the communication, wherein when the communication is received at a terminal device associated with the selected agent profile, execution of the action is facilitated.
In some embodiments, the executable instructions that cause the computer system to identify the operative word from the communication further cause the computer system to perform a query of a database including entries corresponding to stored operative words to obtain the operative word, wherein the query is performed using the one or more words as input.
In some embodiments, the correlation of the agent profile to the pre-defined intent indicates that the pre-defined intent matches an intent of which an agent associated with the agent profile is knowledgeable.
In some embodiments, the quality of the association between the communication and the pre-defined intent is determined based on a confidence score that indicates a confidence that the communication is associated with the pre-defined intent.
In some embodiments, the correlation of the agent profile to the pre-defined intent and the quality of the association between the communication and the pre-defined intent is determined based on a score that reflects a suitability of the terminal device and an agent associated with the agent profile to respond to the communication.
In some embodiments, the executable instructions that cause the computer system to route the communication further cause the computer system to establish a connection between the user device and the terminal device.
In some embodiments, the pre-defined intent is generated using artificial intelligence and an intent model, wherein the artificial intelligence is applied to the intent model to aggregate intent-related data and generate corresponding intents.
The present disclosure is described in conjunction with the appended Figures:
In the appended figures, similar components and/or features can have the same reference label. Further, various components of the same type can be distinguished by following the reference label by a dash and a second label that distinguishes among the similar components. If only the first reference label is used in the specification, the description is applicable to any one of the similar components having the same first reference label irrespective of the second reference label.
The ensuing description provides preferred examples of embodiment(s) only and is not intended to limit the scope, applicability or configuration of the disclosure. Rather, the ensuing description of the preferred examples of embodiment(s) will provide those skilled in the art with an enabling description for implementing a preferred examples of embodiment. It is understood that various changes can be made in the function and arrangement of elements without departing from the spirit and scope as set forth in the appended claims.
In some embodiments, a user 110 can be an individual browsing a web site or accessing an online service provided by a remote server 140. In some embodiments, user 110 can be an individual looking to have a service performed on their behalf. Such a service can include having a question answered, operating another device, getting help from an agent with a task or service, conducting a transaction, etc.
A client 125 can be an entity that provides, operates, or runs the website or the online service, or individuals employed by or assigned by such an entity to perform the tasks available to a client 125 as described herein.
The agent 120 can be an individual, such as a support agent or sales associate tasked with providing support or information to the user 110 regarding the website or online service (e.g., information about products available at an online store). Out of a large number of agents, a subset of agents may be appropriate for providing support or information for a particular client 125. The agent 120 may be affiliated or not affiliated with the client 125. Each agent can be associated with one or more clients 125. In some non-limiting examples, a user 110 can be an individual shopping an online store from a personal computing device, a client 125 can be a company that sells products online, and an agent 120 can be a sales associate employed by the company. In various embodiments, the user 110, client 125, and agent 120 can be other individuals or entities.
While
A connection management system 150 can facilitate strategic routing of communications. A communication can include a message with content (e.g., defined based on input from an entity, such as typed or spoken input). The communication can also include additional data, such as data about a transmitting device (e.g., an IP address, account identifier, device type and/or operating system); a destination address; an identifier of a client; an identifier of a webpage or webpage element (e.g., a webpage or webpage element being visited when the communication was generated or otherwise associated with the communication) or online history data; a time (e.g., time of day and/or date); and/or destination address. Other information can be included in the communication. In some embodiments, connection management system 150 routes the entire communication to another device. In some embodiments, connection management system 150 modifies the communication or generates a new communication (e.g., based on the initial communication). The new or modified communication can include the message (or processed version thereof), at least some (or all) of the additional data (e.g., about the transmitting device, webpage or online history and/or time) and/or other data identified by connection management system 150 (e.g., account data associated with a particular account identifier or device). The new or modified communication can include other information as well.
Part of strategic-routing facilitation can include establishing, updating and using one or more connections between network device 105 and one or more terminal devices 115. For example, upon receiving a communication from network device 105, connection management system 150 can estimate to which client (if any) the communication corresponds. Upon identifying a client, connection management system 150 can identify a terminal device 115 associated with the client for communication with network device 105. In some embodiments, the identification can include evaluating a profile of each of a plurality of agents (or experts or delegates), each agent (e.g., agent 120) in the plurality of agents being associated with a terminal device (e.g., terminal device 115). The evaluation can relate to a content in a network-device message. The identification of the terminal device 115 can include a technique described, for example, in U.S. application Ser. No. 12/725,799, filed on Mar. 17, 2010, which is hereby incorporated by reference in its entirety for all purposes.
In some embodiments, connection management system 150 can determine whether any connections are established between network device 105 and an endpoint associated with the client (or remote server 140) and, if so, whether such channels are to be used to exchange a series of communications including the communication.
Upon selecting an endpoint to communicate with network device 105, connection management system 150 can establish connections between the network device 105 and the endpoint. In some embodiments, connection management system 150 can transmit a message to the selected endpoint. The message may request an acceptance of a proposed assignment to communicate with a network device 105 or identify that such an assignment has been generated. The message can include information about network device 105 (e.g., IP address, device type, and/or operating system), information about an associated user 110 (e.g., language spoken, duration of having interacted with client, skill level, sentiment, and/or topic preferences), a received communication, code (e.g., a clickable hyperlink) for generating and transmitting a communication to the network device 105, and/or an instruction to generate and transmit a communication to network device 105.
In some embodiments, communications between network device 105 and endpoint 112 can be routed through connection management system 150. Such a configuration can allow connection management system 150 to monitor the communication exchange and to detect issues (e.g., as defined based on rules) such as non-responsiveness of either device or extended latency. Further, such a configuration can facilitate selective or complete storage of communications, which may later be used, for example, to assess a quality of a communication exchange and/or to support learning to update or generate routing rules so as to promote particular post-communication targets. As will be described further herein, such configurations can facilitate management of conversations between user 110 and one or more endpoints.
In some embodiments, connection management system 150 can monitor the communication exchange in real-time and perform automated actions (e.g., rule-based actions, artificial intelligence originated actions, etc.) based on the live communications. For example, when connection management system 150 determines that a communication relates to a particular product, connection management system 150 can automatically transmit an additional message to the endpoint containing additional information about the product (e.g., quantity of products in stock, links to support documents related to the product, or other information about the product or similar products).
In some embodiments, a designated endpoint can communicate with network device 105 without relaying communications through connection management system 150. One or both devices 105, 115 may (or may not) report particular communication metrics or content to connection management system 150 to facilitate communication monitoring and/or data storage.
As mentioned, connection management system 150 may route select communications to a remote server 140. Remote server 140 can be configured to provide information in a predetermined manner. For example, remote server 140 may access defined one or more text passages, voice recording and/or files to transmit in response to a communication. Remote server 140 may select a particular text passage, recording or file based on, for example, an analysis of a received communication (e.g., a semantic or mapping analysis).
Routing and/or other determinations or processing performed at connection management system 150 can be performed based on rules and/or data at least partly defined by or provided by one or more client devices 130. For example, client device 130 may transmit a communication that identifies a prioritization of agents, terminal-device types, and/or topic/skill matching. As another example, client device 130 may identify one or more weights to apply to various variables potentially impacting routing determinations (e.g., language compatibility, predicted response time, device type and capabilities, and/or terminal-device load balancing). It will be appreciated that which terminal devices and/or agents are to be associated with a client may be dynamic. Communications from client device 130 and/or terminal devices 115 may provide information indicating that a given terminal device and/or agent is to be added or removed as one associated with a client. For example, client device 130 can transmit a communication with IP address and an indication as to whether a terminal device with the address is to be added or removed from a list identifying client-associated terminal devices.
Each communication (e.g., between devices, between a device and connection management system 150, between remote server 140 and connection management system 150 or between remote server 140 and a device) can occur over one or more networks 170. Any combination of open or closed networks can be included in the one or more networks 170. Examples of suitable networks include the Internet, a personal area network, a local area network (LAN), a wide area network (WAN), or a wireless local area network (WLAN). Other networks may be suitable as well. The one or more networks 170 can be incorporated entirely within or can include an intranet, an extranet, or a combination thereof. In some embodiments, a network in the one or more networks 170 includes a short-range communication channel, such as a Bluetooth or a Bluetooth Low Energy channel. In one embodiment, communications between two or more systems and/or devices can be achieved by a secure communications protocol, such as secure sockets layer (SSL) or transport layer security (TLS). In addition, data and/or transactional details may be encrypted based on any convenient, known, or to be developed manner, such as, but not limited to, Data Encryption Standard (DES), Triple DES, Rivest-Shamir-Adleman encryption (RSA), Blowfish encryption, Advanced Encryption Standard (AES), CAST-128, CAST-256, Decorrelated Fast Cipher (DFC), Tiny Encryption Algorithm (TEA), eXtended TEA (XTEA), Corrected Block TEA (XXTEA), and/or RCS, etc.
A network device 105, terminal device 115, and/or client device 130 can include, for example, a portable electronic device (e.g., a smart phone, tablet, laptop computer, or smart wearable device) or a non-portable electronic device (e.g., one or more desktop computers, smart appliances, servers, and/or processors). Connection management system 150 can be separately housed from network, terminal, IOT and client devices or may be part of one or more such devices (e.g., via installation of an application on a device). Remote server 140 may be separately housed from each device and connection management system 150 and/or may be part of another device or system. While each device, server and system in
A software agent or application may be installed on and/or executable on a depicted device, system or server. In one instance, the software agent or application is configured such that various depicted elements can act in complementary manners. For example, a software agent on a device can be configured to collect and transmit data about device usage to a separate connection management system, and a software application on the separate connection management system can be configured to receive and process the data.
In some embodiments, a communication from network device 205 includes destination data (e.g., a destination IP address) that at least partly or entirely indicates which terminal device is to receive the communication. Network interaction system 200 can include one or more inter-network connection components 240 and/or one or more intra-network connection components 255 that can process the destination data and facilitate appropriate routing.
Each inter-network connection components 245 can be connected to a plurality of networks 235 and can have multiple network cards installed (e.g., each card connected to a different network). For example, an inter-network connection component 245 can be connected to a wide-area network 270 (e.g., the Internet) and one or more local-area networks 235. In the depicted instance, in order for a communication to be transmitted from network device 205 to any of the terminal devices, in the depicted system, the communication must be handled by multiple inter-network connection components 245.
When an inter-network connection component 245 receives a communication (or a set of packets corresponding to the communication), inter-network connection component 245 can determine at least part of a route to pass the communication to a network associated with a destination. The route can be determined using, for example, a routing table (e.g., stored at the router), which can include one or more routes that are pre-defined, generated based on an incoming message (e.g., from another router or from another device) or learned.
Examples of inter-network connection components 245 include a router 260 and a gateway 265. An inter-network connection component 245 (e.g., gateway 265) may be configured to convert between network systems or protocols. For example, gateway 265 may facilitate communication between Transmission Control Protocol/Internet Protocol (TCP/IP) and Internetwork Packet Exchange/Sequenced Packet Exchange (IPX/SPX) devices.
Upon receiving a communication at a local-area network 235, further routing may still need to be performed. Such intra-network routing can be performed via an intra-network connection component 255, such as a switch 280 or hub 285. Each intra-network connection component 255 can be connected to (e.g., wirelessly or wired, such as via an Ethernet cable) multiple terminal devices 215. Hub 285 can be configured to repeat all received communications to each device to which it is connected. Each terminal device can then evaluate each communication to determine whether the terminal device is the destination device or whether the communication is to be ignored. Switch 280 can be configured to selectively direct communications to only the destination terminal device.
In some embodiments, a local-area network 235 can be divided into multiple segments, each of which can be associated with independent firewalls, security rules and network protocols. An intra-network connection component 255 can be provided in each of one, more or all segments to facilitate intra-segment routing. A bridge 280 can be configured to route communications across segments 275.
To appropriately route communications across or within networks, various components analyze destination data in the communications. For example, such data can indicate which network a communication is to be routed to, which device within a network a communication is to be routed to or which communications a terminal device is to process (versus ignore). However, In some embodiments, it is not immediately apparent which terminal device (or even which network) is to participate in a communication from a network device.
To illustrate, a set of terminal devices may be configured so as to provide similar types of responsive communications. Thus, it may be expected that a query in a communication from a network device may be responded to in similar manners regardless to which network device the communication is routed. While this assumption may be true at a high level, various details pertaining to terminal devices can give rise to particular routings being advantageous as compared to others. For example, terminal devices in the set may differ from each other with respect to (for example) which communication channels are supported, geographic and/or network proximity to a network device and/or characteristics of associated agents (e.g., knowledge bases, experience, languages spoken, availability, general personality or sentiment, etc.). Accordingly, select routings may facilitate faster responses that more accurately and/or completely respond to a network-device communication. A complication is that static routings mapping network devices to terminal devices may fail to account for variations in communication topics, channel types, agent availability, and so on.
In
A client device 330 can provide client data indicating how routing determinations are to be made. For example, such data can include: indications as to how particular characteristics are to be weighted or matched or constraints or biases (e.g., pertaining to load balancing or predicted response latency). Client data can also include specifications related to when communication channels are to be established (or closed) or when communications are to be re-routed to a different network device. Client data can be used to define various client-specific rules, such as rules for communication routing and so on.
Connection management system 150b executing on remote server 340 can monitor various metrics pertaining to terminal devices (e.g., pertaining to a given client), such as which communication channels are supported, geographic and/or network proximity to a network device, communication latency and/or stability with the terminal device, a type of the terminal device, a capability of the terminal device, whether the terminal device (or agent) has communicated with a given network device (or user) before and/or characteristics of associated agents (e.g., knowledge bases, experience, languages spoken, availability, general personality or sentiment, etc.). Accordingly, communication management system 150b may be enabled to select routings to facilitate faster responses that more accurately and/or completely respond to a network-device communication based on the metrics.
In the example depicted in
In
The embodiment depicted in
It will be appreciated that many variations of
The OSI model can include multiple logical layers 402-414. The layers are arranged in an ordered stack, such that layers 402-412 each serve a higher level and layers 404-414 is each served by a lower layer. The OSI model includes a physical layer 402. Physical layer 402 can define parameters physical communication (e.g., electrical, optical, or electromagnetic). Physical layer 402 also defines connection management protocols, such as protocols to establish and close connections. Physical layer 402 can further define a flow-control protocol and a transmission mode.
A link layer 404 can manage node-to-node communications. Link layer 404 can detect and correct errors (e.g., transmission errors in the physical layer 402) and manage access permissions. Link layer 404 can include a media access control (MAC) layer and logical link control (LLC) layer.
A network layer 406 can coordinate transferring data (e.g., of variable length) across nodes in a same network (e.g., as datagrams). Network layer 406 can convert a logical network address to a physical machine address.
A transport layer 408 can manage transmission and receipt quality. Transport layer 408 can provide a protocol for transferring data, such as a Transmission Control Protocol (TCP). Transport layer 408 can perform segmentation/desegmentation of data packets for transmission and can detect and account for transmission errors occurring in layers 402, 404,406. A session layer 410 can initiate, maintain and terminate connections between local and remote applications. Sessions may be used as part of remote-procedure interactions. A presentation layer 412 can encrypt, decrypt and format data based on data types known to be accepted by an application or network layer.
An application layer 414 can interact with software applications that control or manage communications. Via such applications, application layer 414 can (for example) identify destinations, local resource states or availability and/or communication content or formatting. Various layers 402, 404, 406, 408, 410, 412414 can perform other functions as available and applicable.
Intra-network connection components 422, 424 are shown to operate in physical layer 402 and link layer 404. More specifically, a hub can operate in the physical layer, such that operations can be controlled with respect to receipts and transmissions of communications. Because hubs lack the ability to address communications or filter data, they possess little to no capability to operate in higher levels. Switches, meanwhile, can operate in link layer 404, as they are capable of filtering communication frames based on addresses (e.g., MAC addresses).
Meanwhile, inter-network connection components 426, 428 are shown to operate on higher levels (e.g., layers 406, 408, 410, 412, 414). For example, routers can filter communication data packets based on addresses (e.g., IP addresses). Routers can forward packets to particular ports based on the address, so as to direct the packets to an appropriate network. Gateways can operate at the network layer and above, perform similar filtering and directing and further translation of data (e.g., across protocols or architectures).
A connection management system 150 can interact with and/or operate on, in various embodiments, one, more, all or any of the various layers. For example, connection management system 150 can interact with a hub so as to dynamically adjust which terminal devices the hub communicates. As another example, connection management system 150 can communicate with a bridge, switch, router or gateway so as to influence which terminal device the component selects as a destination (e.g., MAC, logical or physical) address. By way of further examples, a connection management system 150 can monitor, control, or direct segmentation of data packets on transport layer 408, session duration on session layer 410, and/or encryption and/or compression on presentation layer 412. In some embodiments, connection management system 150 can interact with various layers by exchanging communications with (e.g., sending commands to) equipment operating on a particular layer (e.g., a switch operating on link layer 404), by routing or modifying existing communications (e.g., between a network device and a terminal device) in a particular manner, and/or by generating new communications containing particular information (e.g., new destination addresses) based on the existing communication.
Thus, connection management system 150 can influence communication routing and channel establishment (or maintenance or termination) via interaction with a variety of devices and/or via influencing operating at a variety of protocol-stack layers.
In the depicted instance, network device 505 can transmit a communication over a cellular network (e.g., via a base station 510). The communication can be routed to an operative network 515. Operative network 515 can include a connection management system 150 that receives the communication and identifies which endpoint is to respond to the communication. Such determination can depend on identifying a client to which that communication pertains (e.g., based on a content analysis or user input indicative of the client) and determining one or more metrics for each of one or more endpoints associated with the client. For example, in
Connection management system 150 can communicate with various endpoints via one or more routers 525 or other inter-network or intra-network connection components. Connection management system 150 may collect, analyze and/or store data from or pertaining to communications, terminal-device operations, client rules, and/or user-associated actions (e.g., online activity, account data, purchase history, etc.) at one or more data stores. Such data may influence communication routing.
Notably, various other devices can further be used to influence communication routing and/or processing. For example, in the depicted instance, connection management system 150 also is connected to a web server 545. Thus, connection management system 540 can retrieve data of interest, such as technical product details, news, current product offerings, current or predicted weather, and so on.
Network device 505 may also be connected to a web server (e.g., including a streaming web server 545). In some embodiments, communication with such a server provided an initial option to initiate a communication exchange with connection management system 150. For example, network device 505 may detect that, while visiting a particular webpage, a communication opportunity is available and such an option can be presented.
In some embodiments, one or more elements of communication system 500 can also be connected to a social-networking server 550. Social networking server 550 can aggregate data received from a variety of user devices. Thus, for example, connection management system 150 may be able to estimate a general (or user-specific) intent towards a given topic or estimate a general behavior of a given user or class of users. Social networking server 550 can also maintain a social graphs for one or more users. A social graph can consist of first level connections (direct connections) of a social user, and additional levels of connections (indirect connections through the user's direct connections).
In some embodiments, the message can include a message generated based on inputs received at an user interface. For example, the message can include a message that was generated based on button or key presses or recorded speech signals, or speech to text software. In one instance, the message includes an automatically generated message, such as one generated upon detecting that a network device is presenting a particular app page or webpage or has provided a particular input command (e.g., key sequence). The message can include an instruction or request, such as one to initiate a communication exchange.
In some embodiments, the message can be a natural language communication, whether spoken or typed. A natural language communication, as used herein, refers to ordinary use of a language used to communicate amongst humans, and is contrasted with use of language defined by a protocol required for communicating with a specific virtual assistant or artificial intelligence tool. A natural language communication should not require constraints such as the use of a wake word to alert an artificial intelligence tool that a communication is addressed to the artificial intelligence. Additionally, a natural language communication should not require the user to identify particular key words, specific phrases, or explicitly name a service in order to understand how to service the communication.
While the present technology utilizes natural language communications, the communications can identify particular key words, specific phrases, or explicitly name a service. For example, the message can include or be associated with an identifier of a client. For example, the message can explicitly identify the client (or a device associated with the client); the message can include or be associated with a webpage or app associated with the client; the message can include or be associated with a destination address associated with a client; or the message can include or be associated with an identification of an item (e.g., product) or service associated with the client (e.g., being offered for sale by the client, having been sold by the client or being one that the client services). To illustrate, a network device may be presenting an app page of a particular client, which may offer an option to transmit a communication to an agent. Upon receiving user input corresponding to a message, a communication may be generated to include the message and an identifier of the particular client.
A processing engine 610 may process a received communication and/or message. Processing can include, for example, extracting one or more particular data elements (e.g., a message, a client identifier, a network-device identifier, an account identifier, and so on). Processing can include transforming a formatting or communication type (e.g., to be compatible with a particular device type, operating system, communication-channel type, protocol and/or network).
An intent management engine 615 may assess the (e.g., extracted or received) message. The assessment can include identifying, for example, one or more intents for the message. Examples of intents can include (for example) topic, sentiment, complexity, and urgency A topic can include, but it not limited to, a subject, a product, a service, a technical issue, a use question, a complaint, a refund request or a purchase request, etc. An intent can be determined, for example, based on a semantic analysis of a message (e.g., by identifying keywords, sentence structures, repeated words, punctuation characters and/or non-article words); user input (e.g., having selected one or more categories); and/or message-associated statistics (e.g., typing speed and/or response latency).
In some embodiments, the assessment of the message is performed using artificial intelligence or machine learning model configured to conduct a semantic analysis of the message and determine the intent. The semantic meaning for a particular class can be defined using a training data set and the machine learning model. To perform this classification based upon semantic similarity, the message may be encoded using an encoder model that is trained on data that converts the natural language into a vector representation. A convolutional neural network may be used to classify the vectors into different semantic classes. In some embodiments, the message is passed through a keyword matching system to determine whether any of the words in the message correspond to operative words. If no operative words are detected, the message may be processed using the artificial intelligence or the machine learning model to identify the operative words.
In some embodiments, an intent can be clarified by engaging user 110 in a conversation that can include clarifying questions, or simply requesting additional information.
An interaction management engine 625 can determine to which endpoint a communication is to be routed and how the receiving and transmitting devices are to communicate. Each of these determinations can depend, for example, on whether a particular network device (or any network device associated with a particular user) has previously communicated with an endpoint in a set of endpoints (e.g., any endpoint associated with connection management system 150 or any endpoint associated with one or more particular clients).
In some embodiments, when a network device (or other network device associated with a same user or account) has previously communicated with a given endpoint (e.g., about matters relating to a client), communication routing can be generally biased towards the same endpoint. Other factors that may influence routing can include, for example, an inferred or identified user or agent sentiment pertaining to the previous communication; a topic of a present communication (e.g., and an extent to which that relates to a topic of a previous communication and/or a knowledge base associated with one or more endpoints); whether the endpoint is available; and/or a predicted response latency of the endpoint. Such factors may be considered absolutely or relative to similar metrics corresponding to other endpoints. A re-routing rule (e.g., a client-specific or general rule) can indicate how such factors are to be assessed and weighted to determine whether to forego agent consistency.
When a network device (or other network device associated with a same user or account) has not previously communicated with a given endpoint (e.g., about matters relating to a client), an endpoint selection can be performed based on factors such as, for example, an extent to which various agents' knowledge base corresponds to a communication topic, availability of various agents at a given time and/or over a channel type, types and/or capabilities of endpoints, a language match between a user and agents, and/or a personality analyses. In one instance, a rule can identify how to determine a sub-score to one or more factors such as these and a weight to assign to each score. By combining (e.g., summing) weighted sub-scores, a score for each agent can be determined. An endpoint selection can then be made by comparing endpoints' scores (e.g., to select a high or highest score).
With regard to determining how devices are to communicate, interaction management engine 625 can (for example) determine whether an endpoint is to respond to a communication via (for example) email, online chat, SMS message, voice call, video chat, etc. A communication type can be selected based on, for example, a communication-type priority list (e.g., at least partly defined by a client or user); a type of a communication previously received from the network device (e.g., so as to promote consistency), a complexity of a received message, capabilities of the network device, and/or an availability of one or more endpoints. Appreciably, some communication types will result in real-time communication (e.g., where fast message response is expected), while others can result in asynchronous communication (e.g., where delays (e.g., of several minutes or hours) between messages are acceptable).
In some embodiments, the communication type can be a text messaging or chat application. These communication technologies provide the benefit that no new software needs to be downloaded and executed on users' network devices.
Further, interaction management engine 625 can determine whether a continuous channel between two devices should be established, used or terminated. A continuous channel can be structured so as to facilitate routing of future communications from a network device to a specified endpoint. This bias can persist even across message series (e.g., days, weeks or months). In some embodiments, a representation of a continuous channel (e.g., identifying an agent) can be included in a presentation to be presented on a network device. In this manner, a user can understand that communications are to be consistently routed so as to promote efficiency.
In one instance, a score can be generated using one or more factors described herein and a rule (e.g., that includes a weight for each of the one or more factors) to determine a connection score corresponding to a given network device and endpoint. The score may pertain to an overall match or one specific to a given communication or communication series. Thus, for example, the score may reflect a degree to which a given endpoint is predicted to be suited to respond to a network-device communication. In some embodiments, a score analysis can be used to identify each of an endpoint to route a given communication to and whether to establish, use or terminate a connection. When a score analysis is used to both address a routing decision and a channel decision, a score relevant to each decision may be determined in a same, similar or different manner.
Thus, for example, it will be appreciated that different factors may be considered depending on whether the score is to predict a strength of a long-term match versus one to respond to a particular message query. For example, in the former instance, considerations of overall schedules and time zones may be important, while in the latter instance, immediate availability may be more highly weighted. A score can be determined for a single network-device/terminal-device combination, or multiple scores can be determined, each characterizing a match between a given network device and a different endpoint.
To illustrate, a set of three endpoints associated with a client may be evaluated for potential communication routing. A score may be generated for each that pertains to a match for the particular communication. Each of the first two endpoints may have previously communicated with a network device having transmitted the communication. An input from the network device may have indicated satisfaction with an interaction with the communication(s) with the first device. Thus, a past-interact sub-score (as calculated according to a rule) for the first, second and third devices may be 10, 5, and 0, respectively. (Negative satisfaction inputs may result in negative sub-scores.) It may be determined that only the third endpoint is immediately available. It may be predicted that the second endpoint will be available for responding within 15 minutes, but that the first endpoint will not be available for responding until the next day. Thus, a fast-response sub-score for the first, second and third devices may be 1, 3 and 10. Finally, it may be estimated a degree to which an agent (associated with the endpoint) is knowledgeable about a topic in the communication. It may be determined that an agent associated with the third endpoint is more knowledgeable than those associated with the other two devices, resulting in sub-scores of 3, 4 and 9. In this example, the rule does not include weighting or normalization parameters (though, in other instances, a rule may), resulting in scores of 14, 11 and 19. Thus, the rule may indicate that the message is to be routed to a device with the highest score, that being the third endpoint. If routing to a particular endpoint is unsuccessful, the message can be routed to a device with the next-highest score, and so on.
A score may be compared to one or more absolute or relative thresholds. For example, scores for a set of endpoints can be compared to each other to identify a high score to select an endpoint to which a communication can be routed. As another example, a score (e.g., a high score) can be compared to one or more absolute thresholds to determine whether to establish a continuous channel with an endpoint. An overall threshold for establishing a continuous channel may (but need not) be higher than a threshold for consistently routing communications in a given series of messages. This difference between the overall threshold and threshold for determining whether to consistently route communication may be because a strong match is important in the continuous-channel context given the extended utility of the channel. In some embodiments, an overall threshold for using a continuous channel may (but need not) be lower than a threshold for establishing a continuous channel and/or for consistently routing communications in a given series of messages.
Interaction management engine 625 can interact with an account engine 630 in various contexts. For example, account engine 630 may look up an identifier of a network device or endpoint in an account data store 635 to identify an account corresponding to the device. Further, account engine 630 can maintain data about previous communication exchanges (e.g., times, involved other device(s), channel type, resolution stage, topic(s) and/or associated client identifier), communication channels (e.g., indicating—for each of one or more clients—whether any channels exist, an endpoint associated with each channel, an establishment time, a usage frequency, a date of last use, any channel constraints and/or supported types of communication), user or agent preferences or constraints (e.g., related to terminal-device selection, response latency, terminal-device consistency, agent expertise, and/or communication-type preference or constraint), and/or user or agent characteristics (e.g., age, language(s) spoken or preferred, geographical location, interests, and so on).
Further, interaction management engine 625 can alert account engine 630 of various connection-channel actions, such that account data store 635 can be updated to reflect the current channel data. For example, upon establishing a channel, interaction management engine 625 can notify account engine 630 of the establishment and identify one or more of: a network device, an endpoint, an account and a client. Account engine 635 can subsequently notify a user of the channel's existence such that the user can be aware of the agent consistency being availed.
Interaction management engine 625 can further interact with a client mapping engine 640, which can map a communication to one or more clients (and/or associated brands). In some embodiments, a communication received from a network device itself includes an identifier corresponding to a client (e.g., an identifier of a client, product, service, webpage, or app page). The identifier can be included as part of a message (e.g., which client mapping engine 640 may detect) or included as other data in a message-inclusive communication. Client mapping engine 640 may then look up the identifier in a client data store 645 to retrieve additional data about the client and/or an identifier of the client.
In some embodiments, a message may not particularly correspond to any client. For example, a message may include a general query. Client mapping engine 640 may, for example, perform a semantic analysis on the message, identify one or more keywords and identify one or more clients associated with the keyword(s). In some embodiments, a single client is identified.
In some embodiments, multiple clients are identified. An identification of each client may then be presented via a network device such that a user can select a client to communicate with (e.g., via an associated endpoint).
Client data store 645 can include identifications of one or more endpoints (and/or agents) associated with the client. A terminal routing engine 650 can retrieve or collect data pertaining to each of one, more or all such endpoints (and/or agents) so as to influence routing determinations. For example, terminal routing engine 650 may maintain an endpoint data store 655, which can store information such as endpoints' device types, operating system, communication-type capabilities, installed applications accessories, geographic location and/or identifiers (e.g., IP addresses). Information can also include agent information, such as experience level, position, skill level, knowledge bases (e.g., topics that the agent is knowledgeable about and/or a level of knowledge for various topics), personality metrics, working hours, language(s) spoken and/or demographic information. Some information can be dynamically updated. For example, information indicating whether an endpoint is available may be dynamically updated based on (for example) a communication from an endpoint (e.g., identifying whether the device is asleep, being turned off/on, idle/active, or identifying whether input has been received within a time period); a communication routing (e.g., indicative of whether an endpoint is involved in or being assigned to be part of a communication exchange); or a communication from a network device or endpoint indicating that a communication exchange has ended or begun.
It will be appreciated that, in various contexts, being engaged in one or more communication exchanges does not necessarily indicate that an endpoint is not available to engage in another communication exchange. Various factors, such as communication types (e.g., text, message, email, chat, phone), client-identified or user-identified target response times, and/or system loads (e.g., generally or with respect to a user) may influence how many exchanges an endpoint may be involved in.
When interaction management engine 625 has identified an endpoint to involve in a communication exchange or connection, it can notify terminal routing engine 650, which may retrieve any pertinent data about the endpoint from endpoint data store 655, such as a destination (e.g., IP) address, device type, protocol, etc. Processing engine 610 can then modify the message-inclusive communication or generate a new communication (including the message) so as to have a particular format, comply with a particular protocol, and so on. In some embodiments, a new or modified message may include additional data, such as account data corresponding to a network device, a message chronicle, and/or client data.
A message transmitter interface 660 can then transmit the communication to the endpoint. The transmission may include, for example, a wired or wireless transmission to a device housed in a separate housing. The endpoint can include an endpoint in a same or different network (e.g., local-area network) as connection management system 150. Accordingly, transmitting the communication to the endpoint can include transmitting the communication to an inter- or intra-network connection component.
Communication 705 may be provided to a taxonomy engine 710. Communication 705 may be in natural language as described herein and may include one or more words. Taxonomy engine may be configured to, in conjunction with a processor, parse the communication 705 to identify one or more keywords, also referred to herein as “operative words”. The operative words may be related to an action available to a user initiating the communication 705. For example, communication 705 may state, “I want to pay my bill.” The operative words may be “pay bill”. The taxonomy engine 710 may pass the operative words to the intent identification engine.
The intent identification engine 715 may, in conjunction with a processor, receive the operative words from the taxonomy engine 710. The intent identification engine 715 may use the operative words to identify an intent. The intent may define the action available to the user originating the communication 705. In some embodiments, the intents may be predefined and stored in an intent datastore 745. In such embodiments, the intent identification engine 715 may query the intent datastore 745 with the operative words to locate a corresponding predefined intent. For example, the intent identification engine 715 may query the intent datastore 745 with the words “pay bill” to identify a closest matching intent of “pay current bill”. In some embodiments, the operative words may not correspond to an existing intent. In such embodiments, the intent identification engine 715 can create a new intent and save it to the intent datastore 745 in correlation with the operative words received. The intent identification engine 715 may pass the identified intent to the annotation engine 720.
The annotation engine 720 may, in conjunction with a processor, receive the identified intent from the intent identification engine 715. The annotation engine 720 may facilitate annotation of the identified intent. Annotation may define a quality of the association between the communication and the identified intent. In some embodiments, the annotation engine 720 may automatically evaluate the quality of the association by applying a formula. For example, the annotation engine 720 may automatically calculate a quality of 66% between the operative words “pay bill” and the intent “pay current bill”, while a quality of 100% may be assigned to the operative words “pay bill” and the intent “pay bill”. In some embodiments, the annotation engine 720 may provide the operative words and the identified intent to a user interface of a computing device in order to receive a manual evaluation of the quality of the association.
The intent modeling engine 730 is configured to, in conjunction with a processor, build a model of intents based on the taxonomy and annotations made for the intents. The model may be used to help refine the intents, add new intents, associate different taxonomy with an intent, associate different intents with certain taxonomy, and the like.
The artificial intelligence engine 735 is configured to, in conjunction with a processor, apply artificial intelligence to the intent model to aggregate intent-related data and draw conclusions about actions that may be taken based on the results and analysis. The artificial intelligence engine 735 may be implemented by, for example, a Watson computer to learn, apply, and iteratively develop better models for reflecting intents.
The intent data compiler 740 is configured to, in conjunction with a processor, aggregate the information output by the artificial intelligence 735 and formulate it in such a way that can be displayed by the computing device 750. The computing device 750 is able to manipulate and configure the data displayed and analyzed.
At step 810, the communication is parsed to identify one or more operative words of the one or more words. The one or more operative words may be related to an action available to a user of the user device. For example, the communication may state, “I want to speak to a representative.” The operative word in that communication may be “representative”. The operative words may be identified by comparing the words to identified operative words in a database.
At step 815, a pre-defined intent associated with the one or more operative words may be identified. The pre-defined intent may define the action available to the user of the device. For example, for the operative word “representative”, the pre-defined intent may be “transfer to agent”. The pre-defined intent may be identified, in some embodiments, through stored associations between operative words and intents, as stored in a database. Thus, the pre-defined intent may be identified through a search of an intent database.
At step 820, annotation of the pre-defined intent may be facilitated. Annotation may define a quality of an association between the communication and the pre-defined intent. Annotation may be done automatically by applying algorithms in one embodiment. In some embodiments, annotation may be completed manually based on the correlation of the original communication and the identified intent. The quality can be annotated in any suitable form, including words (e.g., “yes” and “no”), percentages (e.g., “80%”), numbers (e.g., on a scale from 1 to 10), etc.
At step 825, one or more agent profiles are retrieved. The one or more agent profiles may each be associated with an agent and a terminal device. An agent profile may comprise information associated with an agent having knowledge in a particular intent, category, subject or topic. The agent profile may further include ratings, resolution times, workload, experience, fee structure, geographical location, intents of interest, training needs, difficulty levels, and the like.
At step 830, an agent profile of the one or more agent profiles may be selected. The agent profile may be selected based on a correlation of the agent profile to the pre-defined intent and the quality of the association between the communication and the pre-defined intent. The correlation of the agent profile to the pre-defined intent may indicate that the pre-defined intent matches, or is closest to, an intent of which the agent is knowledgeable or has experience, for example. The agent profile may further be selected based on the quality of the association between the communication and the pre-defined intent. For example, if there is 100% confidence that the communication is associated with the pre-defined intent, a certain agent very knowledgeable with that intent may be selected. If the confidence is relatively low, e.g., 50%, an agent less knowledgeable with that intent may be selected because it is less likely that the correct intent was identified, and the most knowledgeable agent may not be needed.
At step 835, the communication may be routed. When the communication is received at the terminal device associated with the agent profile, execution of the action is facilitated. For example, if the intent indicates that a user wants to speak to a agent, a communication channel may be opened between the user and the agent.
Specific details are given in the above description to provide a thorough understanding of the embodiments. However, it is understood that the embodiments can be practiced without these specific details. For example, circuits can be shown as block diagrams in order not to obscure the embodiments in unnecessary detail. In other instances, well-known circuits, processes, algorithms, structures, and techniques can be shown without unnecessary detail in order to avoid obscuring the embodiments.
Implementation of the techniques, blocks, steps and means described above can be done in various ways. For example, these techniques, blocks, steps and means can be implemented in hardware, software, or a combination thereof. For a hardware implementation, the processing units can be implemented within one or more application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), processors, controllers, micro-controllers, microprocessors, other electronic units designed to perform the functions described above, and/or a combination thereof.
Also, it is noted that portions of the embodiments can be described as a process which is depicted as a flowchart, a flow diagram, a data flow diagram, a structure diagram, or a block diagram. Although a flowchart can describe the operations as a sequential process, many of the operations can be performed in parallel or concurrently. In addition, the order of the operations can be re-arranged. A process is terminated when its operations are completed, but could have additional steps not included in the figure. A process can correspond to a method, a function, a procedure, a subroutine, a subprogram, etc. When a process corresponds to a function, its termination corresponds to a return of the function to the calling function or the main function.
Furthermore, embodiments can be implemented by hardware, software, scripting languages, firmware, middleware, microcode, hardware description languages, and/or any combination thereof. When implemented in software, firmware, middleware, scripting language, and/or microcode, the program code or code segments to perform the necessary tasks can be stored in a machine readable medium such as a storage medium. A code segment or machine-executable instruction can represent a procedure, a function, a subprogram, a program, a routine, a subroutine, a module, a software package, a script, a class, or any combination of instructions, data structures, and/or program statements. A code segment can be coupled to another code segment or a hardware circuit by passing and/or receiving information, data, arguments, parameters, and/or memory contents. Information, arguments, parameters, data, etc. can be passed, forwarded, or transmitted via any suitable means including memory sharing, message passing, ticket passing, network transmission, etc.
For a firmware and/or software implementation, the methodologies can be implemented with modules (e.g., procedures, functions, and so on) that perform the functions described herein. Any machine-readable medium tangibly embodying instructions can be used in implementing the methodologies described herein. For example, software codes can be stored in a memory. Memory can be implemented within the processor or external to the processor. As used herein the term “memory” refers to any type of long term, short term, volatile, nonvolatile, or other storage medium and is not to be limited to any particular type of memory or number of memories, or type of media upon which memory is stored. In some embodiments, a service can be software that resides in memory of a client device and/or one or more servers of a content management system and perform one or more functions when a processor executes the software associated with the service. In some embodiments, a service is a program, or a collection of programs that carry out a specific function. In some embodiments, a service can be considered a server. The memory can be a non-transitory computer-readable medium.
Moreover, as disclosed herein, the term “storage medium”, “storage” or “memory” can represent one or more memories for storing data, including read only memory (ROM), random access memory (RAM), magnetic RAM, core memory, magnetic disk storage mediums, optical storage mediums, flash memory devices and/or other machine readable mediums for storing information. The term “machine-readable medium” includes, but is not limited to portable or fixed storage devices, optical storage devices, wireless channels, and/or various other storage mediums capable of storing that contain or carry instruction(s) and/or data. In some embodiments the computer-readable storage devices, mediums, and memories can include a cable or wireless signal containing a bit stream and the like. However, when mentioned, non-transitory computer-readable storage media expressly exclude media such as energy, carrier signals, electromagnetic waves, and signals per se.
When machine-readable instructions are utilized to cause a machine to perform certain inventive steps or functions, the machine can be considered to itself be an inventive machine programmed to specifically perform those steps or functions. For example, while the machine might, without the instructions, be considered a general purpose computing device, with the instructions, the machine is considered a specialized device, explicitly configured to carry out the inventive steps of functions.
Devices implementing methods according to these disclosures can comprise hardware, firmware and/or software, and can take any of a variety of form factors. Typical examples of such form factors include servers, laptops, smart phones, small form factor personal computers, personal digital assistants, and so on. Functionality described herein also can be embodied in peripherals or add-in cards. Such functionality can also be implemented on a circuit board among different chips or different processes executing in a single device, by way of further example.
The instructions, media for conveying such instructions, computing resources for executing them, and other structures for supporting such computing resources are means for providing the functions described in these disclosures.
Although a variety of examples and other information was used to explain aspects within the scope of the appended claims, no limitation of the claims should be implied based on particular features or arrangements in such examples, as one of ordinary skill would be able to use these examples to derive a wide variety of implementations. Further and although some subject matter may have been described in language specific to examples of structural features and/or method steps, it is to be understood that the subject matter defined in the appended claims is not necessarily limited to these described features or acts. For example, such functionality can be distributed differently or performed in components other than those identified herein. Rather, the described features and steps are disclosed as examples of components of systems and methods within the scope of the appended claims.
While the principles of the disclosure have been described above in connection with specific apparatuses and methods, it is to be clearly understood that this description is made only by way of example and not as limitation on the scope of the disclosure.
This application is a continuation of U.S. patent application Ser. No. 16/797,779 filed Feb. 21, 2020 which claims the benefit of U.S. Provisional Patent Application No. 62/810,146, filed Feb. 25, 2019, both of which are hereby incorporated by reference in their entirety.
| Number | Date | Country | |
|---|---|---|---|
| 62810146 | Feb 2019 | US |
| Number | Date | Country | |
|---|---|---|---|
| Parent | 16797779 | Feb 2020 | US |
| Child | 17334065 | US |
