The present invention relates to automated conversational systems, and in particular to the optimization of call-flow dialog.
Dialog management systems are a key component in building conversational systems. The closest approach to a human-machine interface is a system that has very good speech recognition and a high level natural language understanding capability. However, due to the limited accuracy of any speech recognition system, known conversational systems must exploit the knowledge of a limited context to improve on recognition accuracy.
A typical conversational system is dialog based. The system asks a question to the user. Based on the user's response, a dialog management system moves in a particular order of further questions—the dialog call-flow—until it gains enough information from the user to perform the desired action. If a user has to go through a large number of questions to complete the call flow, the comfort factor of the system will be low. Therefore, any dialog management system has to balance keeping the number of questions small and asking sufficient questions to correctly determine the user's enquiry.
When such applications are to run on pervasive computing devices, the dialog management system has to additionally take into account the limited resources (including battery power and available memory). These factors will typically constrain the duration of a call-flow or the number of dialogs.
The present invention is concerned with reorganizing dialog call-flow in the presence of resource constraints. A call-flow has a set of dialogs. The set of grammars in a given call-flow set of dialogs is determined. Each grammar has an associated resource requirement. The resource constraint of the device is also determined. The dialogs are reorganized subject to the device resource constraints not being exceeded by a resultant resource requirement of merged dialogs. The grammars can be split into atomic dialogs before the reorganization is performed. The reorganization includes merging at least two of the dialogs.
Dialogs can be represented as a tree structure of elements, and in that case are reorganized to merge one or more said elements to form at least one shorter path. Dialogs also can be represented as a tree structure of elements, and in that case are reorganized to merged one or more elements to shorten at least the longest path.
a) shows all the possible merges on the call-flow of
b) shows the reorganized call-flow of
Definitions
A “call-flow” is a set of dialogs.
A “dialog” is a conversation between two parties. A dialog comprises of a <question, answer-grammar> pair. A “grammar” is a set of possible answers to a question. In a sequential call-flow, each question is independent of the answer to the previous question. In the case of a tree-type call-flow, a question may be dependent on the answer to the previous question.
A “merge” operation refers to a combination of at least two sub-dialogs to form a single dialog. This involves combining the grammars of the original sub-dialogs to generate a grammar that is used in the single dialog.
A “split” operation refers to generation of more than one sub-dialog from the initial dialog. This involves breaking the initial grammar into several smaller grammars which are used in the sub-dialogs.
Overview
The process flow performed by the CFRS 10, shown in
Call-Flow Types
Call-flow applications can be divided into two types, sequential and tree-type. In a sequential call-flow, the next question asked is independent of the answer to the current question. An example is a purchase application that asks for the receiver's address then the receiver's credit card information. Each node in this type of call-flow acts as a input block. A tree-type call-flow is one where a user response determines the next question. Each question in this call-flow acts as a decision block, which results in a tree topology.
Different algorithmic approaches are taken, depending upon which form of modelling is adopted.
One approach—which is a form of preprocessing before reorganization of a call-flow is performed—is that of splitting the call-flow into atomic dialogs. One method for doing this is to use all internal non-terminals in a grammar and treat them as separate grammars.
Reorganization Algorithms—Resequence
We start with the observation that two grammars g1 and g2, comprising |g1| and |g2 elements respectively can be merged into a single grammar g=g1·g2 having |g1|×|g2| elements.
This example represents a very simple call flow of only two dialogs, however it will seldom be the case where there is such simplicity. The reorganization of call-flows by merging will almost never achieve a single dialog, as device and deployment constraints will inevitably come into play.
A call-flow can be represented by a sequence L={1, . . . , n} of atomic dialogs representing the order in which the dialogs are presented. An atomic dialog is one that cannot be split further. Any dialog can be converted to a sequence of atomic dialogs using the split operation. Thus it is assumed that there is a given call-flow represented by an atomic dialog sequence L. Given the atomic sequence, the goal is to merge as many questions as possible while respecting the memory constraint. The memory requirement m(gi) for each gi is known. A graph G is constructed as follows. The vertex set V(G) contains precisely the elements of L. For each vertex i in G, add edge (i, j) if IIjk=i m(gk)≦M (i<j≦n), (i.e., the memory requirement of the merged grammars gi through gj can be accommodated within M). As a result of this, G becomes a directed acyclic graph. Note that G could be disconnected. Now, find the shortest path (or set of paths) from 1 to n, by finding the shortest path for each connected component of G. Each edge in the shortest path (set of paths) denote the subsequence of questions being merged.
Table 1 details the RESEQUENCE algorithm. Lm denotes the output call-flow with the minimum number of dialogs. Lm may contain merged (non-atomic) dialogs.
Reorganization Algorithms—Balancetree
Two grammars g1 and g2 comprising of |g1| and |g2| elements respectively can be merged into a single grammar g=g1+g2 having |g1|+|g2| elements.
The dialog has been reduced to two questions.
The reorganization of the call-flow is performed algorithmically. It is useful to firstly introduce a few concepts, however.
Definition 1. The degree of a vertex is the number of its children.
Definition 2. A 2-subtree of a vertex v is a tree of depth 2 with v as the root.
Definition 3: A 2-subtree of a vertex v is balanced if all the leaves of the 2-subtree are at distance 2 from v, i.e., no child of v is childless. A 2-subtree of a vertex v is 1-balanced if at least one child of v is childless. A 2-subtree is either balanced or 1-balanced.
Definition 4. Let the maximum degree of any vertex in a call-flow tree be denoted by Δ. The vacancy of a vertex v is defined as Δ−degree(v).
Definition 5. The fold operation is defined on the root v of a 2-subtree and allows v to directly inherit all its grandchildren if the vacancy(v)≧Σidegree(childi(v)). As a result of this operation, all the grandchildren of v become its own children, and the original children are removed. This operation reduces the height of the tree by 1.
A bottom-up approach on the longest paths in a tree—one 2-subtree at a time—provides a solution. This is the essence of the BALANCETREE algorithm. At each step, the longest path is found, its height reduced by 1, if a fold operation is possible at any vertex from the grandparent of the leaf in the longest path to the root. Shorten traverses up the tree till it is able to reduce the height by 1. After this reduction, the longest path is calculated again and the same procedure is applied. If at any time, the longest path cannot be reduced, the algorithm terminates. Since the longest path is found globally at each step, and since the height of the tree is reduced only 1 at a time, maximal height reduction is obtained.
The algorithmic expression is given in Table 2.
Specific Example
The specific example given is a flight information call-flow based on voice recognition operating on a hand-held user device, such as a mobile phone.
The voice application corresponding to an atomic flight information call-flow is shown in Table 3. The call-flow is implemented in VXML, a common markup language to author conversational applications. The applications shown in Table 3 is a sequential dialog call-flow. It requires 6 fields (airline, airport, flight number, credit card type, departure city and state) to be provided by the customer. Six different grammars are required corresponding to the six questions in the call-flow. Similarly, Table 4 shows another VXML representation of the same application. However, this requires only one grammar corresponding to the one question in the application. This grammar has been generated by merging the six grammars of application in Table 3. Thus the two applications in Tables 3 and 4 represent the two extremes of dialog call-flows.
The call-flow in Table 3 comprises of atomic grammars only and thus forms an input to RESEQUENCE.
The memory sizes of each grammar is shown in Table 4, and refers to the memory m required by a device to perform speech recognition using grammar g.
These figures were estimated based on the information in a product brief of the Fluent Speech™ software of Sensory Inc., of 1991 Russell Avenue, Santa Clara, Calif. 95054-2035, numbered 80-193-0 “Product Brief—Fluent Speech Recognizer” of Mar. 16, 2001, which specifies the memory requirements for a given vocabulary. The specification mentions that an extra 250 bytes of memory is required for each additional word.
The <m, q> characteristics of the above call-flow is shown in
From the <m, q>—characteristics, we can decide which call-flow should be used for a particular device. Consider the following mobile devices given in Table 5.
For this particular example, given the devices specified in Table 5, it is concluded that the feasible dialog call-flow for Nokia 3100 and Nokia 6585 is the one that would be represented by bar 5 in the chart. For Nokia 6600 and Sony Clie PEG-NX70V the call-flow corresponding to the bar 3 would be optimal.
Computer Hardware
The components of the computer system include a computer, a keyboard and mouse, and a video display. The computer includes a processor, a memory, input/output (I/O) interfaces, a video interface, and a storage device.
The processor is a central processing unit (CPU) that executes the operating system and the computer software executing under the operating system. The memory includes random access memory (RAM) and read-only memory (ROM), and is used under direction of the processor.
The video interface is connected to video display and provides video signals for display on the video display. User input to operate the computer is provided from the keyboard and mouse. The storage device can include a disk drive or any other suitable storage medium.
Each of the components of the computer is connected to an internal bus that includes data, address, and control buses, to allow components of the computer to communicate with each other via the bus.
The computer system can be connected to one or more other similar computers via a input/output (I/O) interface using a communication channel to a network, represented as the Internet.
The computer software may be recorded on a portable storage medium, in which case, the computer software program is accessed by the computer system from the storage device. Alternatively, the computer software can be accessed directly from the Internet by the computer. In either case, a user can interact with the computer system using the keyboard and mouse to operate the programmed computer software executing on the computer.
Other configurations or types of computer systems can be equally well used to execute computer software that assists in implementing the techniques described herein.
Conclusion
Various alterations and modifications can be made to the techniques and arrangements described herein, as would be apparent to one skilled in the relevant art.
Number | Name | Date | Kind |
---|---|---|---|
4682365 | Orita et al. | Jul 1987 | A |
5724406 | Juster | Mar 1998 | A |
6016336 | Hanson | Jan 2000 | A |
6119087 | Kuhn et al. | Sep 2000 | A |
6314084 | Kahale et al. | Nov 2001 | B1 |
6510411 | Norton et al. | Jan 2003 | B1 |
6597705 | Rezaiifar et al. | Jul 2003 | B1 |
6618590 | Howe | Sep 2003 | B1 |
6721697 | Duan et al. | Apr 2004 | B1 |
6823054 | Suhm et al. | Nov 2004 | B1 |
7130391 | Janakiraman et al. | Oct 2006 | B2 |
20020075803 | Zaharychuk et al. | Jun 2002 | A1 |
20020123891 | Epstein | Sep 2002 | A1 |
20020193981 | Keung et al. | Dec 2002 | A1 |
20030046088 | Yuschik | Mar 2003 | A1 |
20030104813 | Julka et al. | Jun 2003 | A1 |
20030148779 | Aravamudan et al. | Aug 2003 | A1 |
20030157889 | Yamada | Aug 2003 | A1 |
20030233230 | Ammicht et al. | Dec 2003 | A1 |
20040136517 | Bjornberg et al. | Jul 2004 | A1 |
20050041788 | Jan et al. | Feb 2005 | A1 |
Number | Date | Country |
---|---|---|
WO 0232090 | Apr 2002 | WO |
Number | Date | Country | |
---|---|---|---|
20050243986 A1 | Nov 2005 | US |