Selective mapping of callers in a call center routing system

Information

  • Patent Grant
  • 10051125
  • Patent Number
    10,051,125
  • Date Filed
    Monday, June 1, 2015
    8 years ago
  • Date Issued
    Tuesday, August 14, 2018
    5 years ago
Abstract
Techniques for benchmarking performance in a contact center system are disclosed. In one particular embodiment, the techniques may be realized as a method for benchmarking performance in a contact center system including pairing a first portion of a plurality of contacts with a plurality of agents using rank-based matching or pattern matching, pairing a remaining portion of the plurality of contacts with the plurality of agents using a random matching strategy, and determining a first amount of performance gain for the contact center system by comparing a first plurality of call outcomes associated with the first portion of the plurality of contacts with a second plurality of call outcomes associated with the remaining portion of the plurality of contacts.
Description
BACKGROUND

1. Field


The present invention relates generally to the field of routing phone calls and other telecommunications in a contact center system.


2. Related Art


The typical contact center consists of a number of human agents, with each assigned to a telecommunication device, such as a phone or a computer for conducting email or Internet chat sessions, that is connected to a central switch. Using these devices, the agents are generally used to provide sales, customer service, or technical support to the customers or prospective customers of a contact center or a contact center's clients.


Typically, a contact center or client will advertise to its customers, prospective customers, or other third parties a number of different contact numbers or addresses for a particular service, such as for billing questions or for technical support. The customers, prospective customers, or third parties seeking a particular service will then use this contact information, and the incoming caller will be routed at one or more routing points to a human agent at a contact center who can provide the appropriate service. Contact centers that respond to such incoming contacts are typically referred to as “inbound contact centers.”


Similarly, a contact center can make outgoing contacts to current or prospective customers or third parties. Such contacts may be made to encourage sales of a product, provide technical support or billing information, survey consumer preferences, or to assist in collecting debts. Contact centers that make such outgoing contacts are referred to as “outbound contact centers,”


In both inbound contact centers and outbound contact centers, the individuals (such as customers, prospective customers, survey participants, or other third parties) that interact with contact center agents using a telecommunication device are referred to in this application as a “caller.” The individuals acquired by the contact center to interact with callers are referred to in this application as an “agent.”


Conventionally, a contact center operation includes a switch system that connects callers to agents. In an inbound contact center, these switches route incoming callers to a particular agent in a contact center, or, if multiple contact centers are deployed, to a particular contact center for further routing. In an outbound contact center employing telephone devices, dialers are typically employed in addition to a switch system. The dialer is used to automatically dial a phone number from a list of phone numbers, and to determine whether a live caller has been reached from the phone number called (as opposed to obtaining no answer, a busy signal, an error message, or an answering machine). When the dialer obtains a live caller, the switch system routes the caller to a particular agent in the contact center.


Routing technologies have accordingly been developed to optimize the caller experience. For example, U.S. Pat. No. 7,236,584 describes a telephone system for equalizing caller waiting times across multiple telephone switches, regardless of the general variations in performance that may exist among those switches. Contact routing in an inbound contact center, however, is a process that is generally structured to connect callers to agents that have been idle for the longest period of time. In the case of an inbound caller where only one agent may be available, that agent is generally selected for the caller without further analysis. In another example, if there are eight agents at a contact center, and seven are occupied with contacts, the switch will generally route the inbound caller to the one agent that is available. If all eight agents are occupied with contacts, the switch will typically put the contact on hold and then route it to the next agent that becomes available. More generally, the contact center will set up a queue of incoming callers and preferentially route the longest-waiting callers to the agents that become available over time. Such a pattern of routing contacts to either the first available agent or the longest-waiting agent is referred to as “round-robin” contact routing. In round robin contact routing, eventual matches and connections between a caller and an agent are essentially random.


Some attempts have been made to improve upon these standard yet essentially random processes for connecting a caller to an agent. For example, U.S. Pat. No. 7,209,549 describes a telephone routing system wherein an incoming caller's language preference is collected and used to route their telephone call to a particular contact center or agent that can provide service in that language. In this manner, language preference is the primary driver of matching and connecting a caller to an agent, although once such a preference has been made, callers are almost always routed in “round-robin” fashion.


BRIEF SUMMARY

Systems and methods of the present invention can be used to improve or optimize the routing of callers to agents in a contact center. According to one aspect, a method for routing callers to agents in a call-center routing system includes mapping a first portion or fraction of callers to agents based on agent performance data and/or a pattern matching algorithm. The agent performance data may include grades or a ranking for different agents based on desired performance outcomes. The pattern matching algorithm may operate to compare caller data associated with each caller to agent data associated with each agent. The method further includes mapping a second portion or fraction of the callers to agents differently than the first portion of callers. For example, the second portion of callers may be mapped to agents based on a random process such as an Automatic Call Distribution (ACD) queue order or according to a performance based order of the agents, where the second portion of callers may serve as a control group or benchmark to assist in accessing the performance of the performance and/or pattern matching algorithms for mapping the first portion of callers to agents.


In one example, the method further includes causing the display of a graphical element for adjusting the number or fraction of callers mapped via performance and/or pattern matching algorithms. The method may further display the estimated effect of the number of callers or a change thereto on one or more outcome variables of the performance and/or pattern matching algorithms for mapping the callers.


According to another aspect, an interface is provided for use with an inbound or outbound call routing center for routing callers based on performance of agents and/or pattern matching algorithms between callers and agents. In one example, the interface includes a graphical element (e.g., a selector, slider, text field, or the like) for setting and adjusting the portion or number of callers that are routed based on the performance of agents and/or pattern matching algorithms as opposed to a random or conventional routing method (e.g., based on queue order of the agents and/or callers). For instance, the graphical element allowing a contact center operator the ability to route a first portion or fraction of the callers to agents via a pattern matching algorithm and route the remaining callers by a different process, e.g., based on queue order or the like. Such a system and method may allow for a control group of caller-agent pairs to be connected for comparing and analyzing the effects of routing based on the pattern matching algorithm.


In one example the interface is further operable to display an estimated effect of the number or percentage of callers mapped on at least one outcome variable. For instance, the interface operates to display estimated revenue generation, cost, customer satisfaction, first call resolution, cancellation, or other outcome variables of the performance and/or pattern matching algorithm(s) based on a particular setting of the number of calls to be mapped according to the performance and/or pattern matching algorithm(s). The outcome variables may be estimated based on past call history data, stored algorithms, look-up tables, or the like. Further, the interface may be operable to display an estimated change in the at least one outcome variable if the selection of the number of calls mapped is changed.


According to another aspect, apparatus is provided comprising logic for mapping and routing callers to agents. The apparatus may include logic for mapping a first portion (or fraction) of callers to agents according to a pattern matching algorithm based on comparing caller data associated with the callers and agent data associated with the agents. The apparatus may further include mapping a second portion of the callers (e.g., the remaining portion or fraction of all callers) to agents differently than the first portion of the callers (e.g., mapping based on queue order, a random process, or based on performance alone), which may provide a control group for monitoring or analyzing the effect of the pattern matching algorithm. Further, the apparatus may operate to cause the display of a graphical element with an interface for adjusting the portion or number of callers routed or mapped via a performance and/or pattern matching algorithm.


Many of the techniques described here may be implemented in hardware, firmware, software, or combinations thereof. In one example, the techniques are implemented in computer programs executing on programmable computers that each includes a processor, a storage medium readable by the processor (including volatile and nonvolatile memory and/or storage elements), and suitable input and output devices. Program code is applied to data entered using an input device to perform the functions described and to generate output information. The output information is applied to one or more output devices. Moreover, each program is preferably implemented in a high level procedural or object-oriented programming language to communicate with a computer system. However, the programs can be implemented in assembly or machine language, if desired. In any case, the language may be a compiled or interpreted language.





BRIEF DESCRIPTION OF THE DRAWINGS


FIG. 1 is a diagram reflecting the general setup of a contact center operation.



FIG. 2 illustrates an exemplary routing system having a routing engine for routing callers based on performance and/or pattern matching algorithms.



FIG. 3 illustrates an exemplary routing system having a mapping engine for routing callers based on performance and/or pattern matching algorithms.



FIG. 4 illustrates an exemplary method for matching a first portion of callers and agents using caller data and agent data in a pattern matching algorithm and a second portion of callers using queue order.



FIG. 5 illustrates an exemplary interface having a graphic element for adjusting the number or fraction of callers for routing based on performance and/or pattern matching algorithms.



FIG. 6 illustrates a typical computing system that may be employed to implement some or all processing functionality in certain embodiments of the invention.





DETAILED DESCRIPTION OF THE INVENTION

The following description is presented to enable a person of ordinary skill in the art to make and use the invention, and is provided in the context of particular applications and their requirements. Various modifications to the embodiments will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other embodiments and applications without departing from the spirit and scope of the invention. Moreover, in the following description, numerous details are set forth for the purpose of explanation. However, one of ordinary skill in the art will realize that the invention might be practiced without the use of these specific details. In other instances, well-known structures and devices are shown in block diagram form in order not to obscure the description of the invention with unnecessary detail. Thus, the present invention is not intended to be limited to the embodiments shown, but is to be accorded the widest scope consistent with the principles and features disclosed herein.


While the invention is described in terms of particular examples and illustrative figures, those of ordinary skill in the art will recognize that the invention is not limited to the examples or figures described. Those skilled in the art will recognize that the operations of the various embodiments may be implemented using hardware, software, firmware, or combinations thereof, as appropriate. For example, some processes can be carried out using processors or other digital circuitry under the control of software, firmware, or hard-wired logic. (The term “logic” herein refers to fixed hardware, programmable logic and/or an appropriate combination thereof, as would be recognized by one skilled in the art to carry out the recited functions.) Software and firmware can be stored on computer-readable storage media. Some other processes can be implemented using analog circuitry, as is well known to one of ordinary skill in the art. Additionally, memory or other storage, as well as communication components, may be employed in embodiments of the invention.


According to one aspect of the present invention systems, methods, and displayed computer interfaces are provided for selectively routing a first portion of callers to agents within a call center based on performance and/or pattern matching algorithms and routing a second portion of callers to agents based on a different method (e.g., queue based routing or the like). The systems, methods, and interfaces further include allowing a user to set and change the number or fraction of callers that are mapped based on performance and/or pattern matching algorithms. Routing a portion of the calls by conventional queue based routing may provide information regarding the effectiveness and performance of applied performance and/or pattern matching algorithms on desired outcomes of the call center.


Initially, exemplary call routing systems and methods utilizing performance and/or pattern matching algorithms (either of which may be used within generated computer models for predicting the changes of desired outcomes) are described for routing callers to available agents. This description is followed by exemplary interfaces and methods for setting and adjusting the number of callers routed based on performance and/or pattern matching algorithms as well as displaying results of the performance and/or pattern matching algorithms on one or more outcome variables.



FIG. 1 is a diagram reflecting the general setup of a contact center operation 100. The network cloud 101 reflects a specific or regional telecommunications network designed to receive incoming callers or to support contacts made to outgoing callers. The network cloud 101 can comprise a single contact address, such as a telephone number or email address, or multiple contract addresses. The central router 102 reflects contact routing hardware and software designed to help route contacts among call centers 103. The central router 102 may not be needed where there is only a single contact center deployed. Where multiple contact centers are deployed, more routers may be needed to route contacts to another router for a specific contact center 103. At the contact center level 103, a contact center router 104 will route a contact to an agent 105 with an individual telephone or other telecommunications equipment 105. Typically, there are multiple agents 105 at a contact center 103, though there are certainly embodiments where only one agent 105 is at the contact center 103, in which case a contact center router 104 may prove to be unnecessary.



FIG. 2 illustrates an exemplary contact center routing system 200 (which may be included with contact center router 104 of FIG. 1). Broadly speaking, routing system 200 is operable to match callers and agents based, at least in part, on agent performance or pattern matching algorithms using caller data and/or agent data. Routing system 200 may include a communication server 202 and a routing engine 204 (referred to at times as “SatMap” or “Satisfaction Mapping”) for receiving and matching callers to agents (referred to at times as “mapping” callers to agents).


Routing engine 204 may operate in various manners to match callers to agents based on performance data of agents, pattern matching algorithms, and computer models, which may adapt over time based on the performance or outcomes of previous caller-agent matches. In one example, the routing engine 204 includes a neural network based adaptive pattern matching engine. Various other exemplary pattern matching and computer model systems and methods which may be included with content routing system and/or routing engine 204 are described, for example, in U.S. patent application Ser. No. 12/021,251, filed Jan. 28, 2008, and U.S. patent application Ser. No. 12/202,091, filed Aug. 29, 2008, both of which are hereby incorporated by reference in their entirety. Of course, it will be recognized that other performance based or pattern matching algorithms and methods may be used alone or in combination with those described here.


Routing system 200 may further include other components such as collector 206 for collecting caller data of incoming callers, data regarding caller-agent pairs, outcomes of caller-agent pairs, agent data of agents, and the like. Further, routing system 200 may include a reporting engine 208 for generating reports of performance and operation of routing system 200. Various other servers, components, and functionality are possible for inclusion with routing system 200. Further, although shown as a single hardware device, it will be appreciated that various components may be located remotely from each other (e.g., communication server 202 and routing engine 204 need not be included with a common hardware/server system or included at a common location). Additionally, various other components and functionality may be included with routing system 200, but have been omitted here for clarity.



FIG. 3 illustrates detail of exemplary routing engine 204. Routing engine 204 includes a main mapping engine 304, which receives caller data and agent data from databases 310 and 312. In some examples, routing engine 204 may route callers based solely or in part on performance data associated with agents. In other examples, routing engine 204 may make routing decisions based solely or in part on comparing various caller data and agent data, which may include, e.g., performance based data, demographic data, psychographic data, and other business-relevant data. Additionally, affinity databases (not shown) may be used and such information received by routing engine 204 for making routing decisions.


In one example, routing engine 204 includes or is in communication with one or more neural network engines 306. Neural network engines 306 may receive caller and agent data directly or via routing engine 204 and operate to match and route callers based on pattern matching algorithms and computer models generated to increase the changes of desired outcomes. Further, as indicated in FIG. 3, call history data (including, e.g., caller-agent pair outcomes with respect to cost, revenue, customer satisfaction, etc.) may be used to retrain or modify the neural network engine 306.


Routing engine 204 further includes or is in communication with hold queue 308, which may store or access hold or idle times of callers and agents, and operate to map callers to agents based on queue order of the callers (and/or agents). Mapping engine 304 may operate, for example, to map callers based on a pattern matching algorithm, e.g., as included with neural network engine 306, or based on queue order, e.g., as retrieved from hold queue 308. In particular, mapping engine 304 mapping a first portion of callers based on one or more of performance based data, pattern matching algorithm(s), or computer model(s). Additionally, mapping engine 304 may route a second portion of callers based on a queue order of the callers, preferentially routing those callers that have been held the longest (a similar queue and preferentially routing may be used if multiple agents are available for a caller). It should be noted that other essentially random routing methods may be used in place of queue routing, and which generally serve as a control for comparing with the performance and/or pattern matching mapping methods described.



FIG. 4 illustrates an exemplary method for mapping and routing callers to agents where a first portion or fraction of callers is routed based on a performance based and/or pattern matching algorithm and a second portion or fraction of callers is routed based on conventional, essentially random, routing method such as queue based routing. Accordingly, a routing system first determines how the caller is to be routed at 420. For instance, the system may map callers and agents in various ratios depending on the settings input by the contact center. For example, if the setting is at 80, or 80%, the system would map 80% of the caller-agent pairs based on performance and/or pattern matching algorithms and the remaining 20% of caller-agent pairs based on other methods such as queue order.


Exemplary performance based and/or pattern matching methods for routing callers to agents includes rating agents on performance, comparing agent data and caller data and matching per a pattern matching algorithm, creating computer models to predict outcomes of agent-caller pairs, or combinations thereof. In particular, one exemplary method for increasing the chances of an optimal interaction includes combining agent grades (which may be determined from grading or ranking agents on desired outcomes), agent demographic data, agent psychographic data, and other business-relevant data about the agent (individually or collectively referred to in this application as “agent data”), along with demographic, psychographic, and other business-relevant data about callers (individually or collectively referred to in this application as “caller data”). Agent and caller demographic data can comprise any of: gender, race, age, education, accent, income, nationality, ethnicity, area code, zip code, marital status, job status, credit score, and the like. Agent and caller psychographic data can comprise any of introversion, sociability, desire for financial success, film and television preferences, and the like.


The exemplary method may include determining caller data associated with one or more callers (e.g., a caller on hold), determining agent data associated with one or more agents (e.g., one or more available agents), comparing the agent data and the caller data (e.g., via a pattern matching algorithm), and matching the caller to an agent to increase the chance of an optimal interaction. In particular, at 422, caller data (such as a caller demographic or psychographic data) is determined or identified for a caller. One way of accomplishing this is by retrieving caller data from available databases by using the caller's contact information as an index. Available databases include, but are not limited to, those that are publicly available, those that are commercially available, or those created by a contact center or a contact center client. In an outbound contact center environment, the caller's contact information is generally known beforehand. In an inbound contact center environment, the caller's contact information can be retrieved by examining the caller's CallerID information or by requesting this information of the caller at the outset of the contact, such as through entry of a caller account number or other caller-identifying information. Other business-relevant data such as historic purchase behavior, current level of satisfaction as a customer, or volunteered level of interest in a product may also be retrieved from available databases.


At 424, agent data for one or more agents is identified or determined. One method of determining agent demographic or psychographic data can involve surveying agents at the time of their employment or periodically throughout their employment. Such a survey process can be manual, such as through a paper or oral survey, or automated with the survey being conducted over a computer system, such as by deployment over a web-browser. In some example, the method uses agent grades, demographic, psychographic, and other business-relevant data, along with caller demographic, psychographic, and other business-relevant data, other embodiments of the exemplary methods and systems can eliminate one or more types or categories of caller or agent data to reduce the time to answer, computing power, or storage necessary.


The agent data and caller data may then be compared at 426. For instance, the agent data and caller data can be passed to a computational system for comparing caller data to agent data for each agent-caller pair, e.g., the caller data and agent data is compared in a pair-wise fashion for each potential routing decision. In one example, the comparison is achieved by passing the agent and caller data to a pattern matching algorithm to create a computer model that matches each caller with each agent and estimates the probable outcome of each matching along a number of optimal interactions, such as the generation of a sale, the duration of contact, or the likelihood of generating an interaction that a customer finds satisfying.


The pattern matching algorithm to be used in the exemplary methods and system can comprise any correlation algorithm, such as a neural network algorithm or a genetic algorithm. To generally train or otherwise refine the algorithm, actual contact results (as measured for an optimal interaction) are compared against the actual agent and caller data for each contact that occurred. The pattern matching algorithm can then learn, or improve its learning of, how matching certain callers with certain agents will change the chance of an optimal interaction. In this manner, the pattern matching algorithm can then be used to predict the chance of an optimal interaction in the context of matching a caller with a particular set of caller data, with an agent of a particular set of agent data. Preferably, the pattern matching algorithm is periodically refined as more actual data on caller interactions becomes available to it, such as periodically training the algorithm every night after a contact center has finished operating for the day.


The pattern matching algorithm may create or use a computer model reflecting the predicted chances of an optimal interaction for each agent and caller matching. Preferably, the computer model will comprise the predicted chances for a set of optimal interactions for every agent that is logged in to the contact center as matched against every available caller. Alternatively, the computer model can comprise subsets of these, or sets containing the aforementioned sets. For example, instead of matching every agent logged into the contact center with every available caller, examples can match every available agent with every available caller, or even a narrower subset of agents or callers. Likewise, the present invention can match every agent that ever worked on a particular campaign—whether available or logged in or not—with every available caller. Similarly, the computer model can comprise predicted chances for one optimal interaction or a number of optimal interactions.


A computer model can also comprise a suitability score for each matching of an agent and a caller. The suitability score can be determined by taking the chances of a set of optimal interactions as predicted by the pattern matching algorithm, and weighting those chances to place more or less emphasis on a particular optimal interaction as related to another optimal interaction. The suitability score can then be used in the exemplary methods and systems to determine which agents should be connected to which callers.


Based on the pattern matching algorithm and/or computer model, the method further includes determining the agent having the best match to the caller at 428. As will be understood, the best matching agent may depend on the pattern matching algorithm, computer model, and desired output variables and weightings selected by a particular call center. The caller is then routed to the best matching agent at 430.


If the caller is selected at 420 for mapping to an agent by a different method (e.g., not based on a performance and/or pattern matching algorithm), this particular exemplary method includes routing via an Automatic Call Distribution (ACD) queue order or the like by determining a queue order of the caller, if applicable, at 450. For example, if other callers are on hold waiting for an available agent, the caller may be queued with other callers, e.g., a system may order the callers in terms of hold time and preferentially map those callers that have been holding the longest. Similarly, the exemplary method includes determining a queue order of the agents, if applicable, at 452 (for example, in a situation where multiple agents are available). Accordingly, the system generally operates to map the agent that has been waiting or idle the longest with the caller that has been holding the longest. The caller may then be routed to the agent at 454.


It is noted that in other examples, where callers are matched with at least a pattern matching algorithm (e.g., alone or in combination with performance based ranking of the agents), the different method may include performance based routing. This allows for comparing or benchmarking the pattern matching algorithm against performance based routing.


According to another aspect of the exemplary systems and methods described, a visual computer interface and printable reports may be provided to the contact center or their clients to allow them to, in a real-time or a past performance basis, monitor the statistics of agent to caller matches, measure the optimal interactions that are being achieved versus the interactions predicted by the computer model, as well as any other measurements of real time or past performance using the methods described herein. A visual computer interface for changing the number or portion of callers that are mapped via performance and/or pattern matching algorithms (as well as the weighting on an optimal interaction) can also be provided to the contact center or the contact center client, such that they can, as discussed herein, monitor the effect of the performance based data and/or pattern matching algorithms on one or more outcome variables.



FIG. 5 illustrates an exemplary interface 500 having a graphic element 502 for adjusting the fraction or portion of callers that are mapped according to performance and/or pattern matching algorithms. It will be recognized that interface 500 may be displayed within a browser page, portal page, or standalone user interface for a contact center routing system. Additionally, various other information and functionality may be included with interface 500, but is omitted here for clarity.


In this example, interface 500 displays a report of call center performance broken down by different output variables at 510, 512, and 514. In particular, cost, revenue generation, and customer satisfaction are illustrated, but other output variables such as first call resolution, cancellation, or other variable outputs from the pattern matching algorithm(s) or computer model(s) of the system may be displayed. Interface 500 further includes settings for desired weightings of different outcome variables of the pattern matching algorithms and computer models being used for routing callers to agents at 504. In particular, selector 504 includes selectors for adjusting the weighting of revenue, cost, and customer satisfaction in the call center routing algorithms and computer models. Various weighting methods and algorithms are described, for example, in copending U.S. patent application Ser. No. 12/202,091, filed Aug. 29, 2008, which is incorporated herein by reference in its entirety. Of course, various other pattern matching algorithms, computer models, and weighting methods for adjusting the desired outcomes are possible and contemplated.


Selector 502 operates to adjust the “power” of the mapping system, e.g., the portion or percentage of callers that are mapped via performance and/or pattern matching algorithms as described. In this example, if selector 502 is set to “100” the system routes all callers via the performance and/or pattern matching algorithms; alternatively, if selector 502 is set to “0” the system does not route any callers via the performance and/or pattern matching algorithms. Selector 502 may be adjusted in response to input from a mouse, input to a key board (e.g., arrow keys, numerical entries, and so on), or the like. Further, selector 502 may be replaced or further include a “slider” element, drop-down selector, entry field for manually entering numbers or values, up-and-down arrows, and so on.


As described, routing a fraction of callers by an essentially random process provides an evaluation of the performance and/or pattern matching algorithms of the mapping system. For example, outcome variables can be compared for callers routed via the mapping system and those routed otherwise. For instance, interface 500 includes a display 510 of cost over time for the routing system with the mapping system on and off (i.e., “SatMap On” and “SatMap Off) as indicated by 51la and 51lb respectively. Display 510 illustrates that the cost is lower for callers routed via the mapping system than those mapped differently (e.g., by queue order or essentially randomly). As indicated in display 512, revenue for callers routed via the mapping system, shown by 513a, is greater than for other callers, shown by 513b. Further, as indicated in display 514, customer satisfaction for callers routed via the mapping system, shown by 515a, is greater than for other callers, shown by 515b.


It is noted that the information displayed by displays 510, 512, and 514 are of past performance data; however, in other examples, interface 500 may further operate to display estimated effects on one or more outcome variables by changing selector 502. For instance, displaying the probable change in one or more of cost, revenue generation, or customer satisfaction by changing selector 502. Various estimation methods and algorithms for estimating outcome variables are described, for example, in copending U.S. provisional Patent application Ser. No. 61/084,201, filed on Jul. 28, 2008, and which is incorporated herein by reference in its entirety. In one example, the estimate includes evaluating a past time period of the same (or similar) set of agents and constructing a distribution of agent/caller pairs. Using each pair, an expected success rate can be computed via the pattern matching algorithm and applied to current information to estimate current performance (e.g., with respect to one or more of sales, cost, customer satisfaction, etc.). Accordingly, taking historical call data and agent information the algorithm can compute estimates of changing the power or number of callers mapped via the performance and/or pattern matching algorithms. It is noted that a comparable time (e.g., time of day, day of the week etc.) for the historical information may be important as performance will likely vary with time.


Many of the techniques described here may be implemented in hardware or software, or a combination of the two. Preferably, the techniques are implemented in computer programs executing on programmable computers that each includes a processor, a storage medium readable by the processor (including volatile and nonvolatile memory and/or storage elements), and suitable input and output devices. Program code is applied to data entered using an input device to perform the functions described and to generate output information. The output information is applied to one or more output devices. Moreover, each program is preferably implemented in a high level procedural or object-oriented programming language to communicate with a computer system. However, the programs can be implemented in assembly or machine language, if desired. In any case, the language may be a compiled or interpreted language.


Each such computer program is preferably stored on a storage medium or device (e.g., CD-ROM, hard disk or magnetic diskette) that is readable by a general or special purpose programmable computer for configuring and operating the computer when the storage medium or device is read by the computer to perform the procedures described. The system also may be implemented as a computer-readable storage medium, configured with a computer program, where the storage medium so configured causes a computer to operate in a specific and predefined manner.



FIG. 6 illustrates a typical computing system 600 that may be employed to implement processing functionality in embodiments of the invention. Computing systems of this type may be used in clients and servers, for example. Those skilled in the relevant art will also recognize how to implement the invention using other computer systems or architectures. Computing system 600 may represent, for example, a desktop, laptop or notebook computer, hand-held computing device (PDA, cell phone, palmtop, etc.), mainframe, server, client, or any other type of special or general purpose computing device as may be desirable or appropriate for a given application or environment. Computing system 600 can include one or more processors, such as a processor 604. Processor 604 can be implemented using a general or special purpose processing engine such as, for example, a microprocessor, microcontroller or other control logic. In this example, processor 604 is connected to a bus 602 or other communication medium.


Computing system 600 can also include a main memory 608, such as random access memory (RAM) or other dynamic memory, for storing information and instructions to be executed by processor 604. Main memory 608 also may be used for storing temporary variables or other intermediate information during execution of instructions to be executed by processor 604. Computing system 600 may likewise include a read only memory (“ROM”) or other static storage device coupled to bus 602 for storing static information and instructions for processor 604.


The computing system 600 may also include information storage system 610, which may include, for example, a media drive 612 and a removable storage interface 620. The media drive 612 may include a drive or other mechanism to support fixed or removable storage media, such as a hard disk drive, a floppy disk drive, a magnetic tape drive, an optical disk drive, a CD or DVD drive (R or RW), or other removable or fixed media drive. Storage media 618 may include, for example, a hard disk, floppy disk, magnetic tape, optical disk, CD or DVD, or other fixed or removable medium that is read by and written to by media drive 612. As these examples illustrate, the storage media 618 may include a computer-readable storage medium having stored therein particular computer software or data.


In alternative embodiments, information storage system 610 may include other similar components for allowing computer programs or other instructions or data to be loaded into computing system 600. Such components may include, for example, a removable storage unit 622 and an interface 620, such as a program cartridge and cartridge interface, a removable memory (for example, a flash memory or other removable memory module) and memory slot, and other removable storage units 622 and interfaces 620 that allow software and data to be transferred from the removable storage unit 618 to computing system 600.


Computing system 600 can also include a communications interface 624. Communications interface 624 can be used to allow software and data to be transferred between computing system 600 and external devices. Examples of communications interface 624 can include a modem, a network interface (such as an Ethernet or other NIC card), a communications port (such as for example, a USB port), a PCMCIA slot and card, etc. Software and data transferred via communications interface 624 are in the form of signals which can be electronic, electromagnetic, optical or other signals capable of being received by communications interface 624. These signals are provided to communications interface 624 via a channel 628. This channel 628 may carry signals and may be implemented using a wireless medium, wire or cable, fiber optics, or other communications medium. Some examples of a channel include a phone line, a cellular phone link, an RF link, a network interface, a local or wide area network, and other communications channels.


In this document, the terms “computer program product,” “computer-readable medium” and the like may be used generally to refer to physical, tangible media such as, for example, memory 608, storage media 618, or storage unit 622. These and other forms of computer-readable media may be involved in storing one or more instructions for use by processor 604, to cause the processor to perform specified operations. Such instructions, generally referred to as “computer program code” (which may be grouped in the form of computer programs or other groupings), when executed, enable the computing system 600 to perform features or functions of embodiments of the present invention. Note that the code may directly cause the processor to perform specified operations, be compiled to do so, and/or be combined with other software, hardware, and/or firmware elements (e.g., libraries for performing standard functions) to do so.


In an embodiment where the elements are implemented using software, the software may be stored in a computer-readable medium and loaded into computing system 600 using, for example, removable storage media 618, drive 612 or communications interface 624. The control logic (in this example, software instructions or computer program code), when executed by the processor 604, causes the processor 604 to perform the functions of the invention as described herein.


It will be appreciated that, for clarity purposes, the above description has described embodiments of the invention with reference to different functional units and processors. However, it will be apparent that any suitable distribution of functionality between different functional units, processors or domains may be used without detracting from the invention. For example, functionality illustrated to be performed by separate processors or controllers may be performed by the same processor or controller. Hence, references to specific functional units are only to be seen as references to suitable means for providing the described functionality, rather than indicative of a strict logical or physical structure or organization.


The above-described embodiments of the present invention are merely meant to be illustrative and not limiting. Various changes and modifications may be made without departing from the invention in its broader aspects. The appended claims encompass such changes and modifications within the spirit and scope of the invention.

Claims
  • 1. A method for benchmarking performance in a contact center system comprising: applying, by at least one computer processor communicatively coupled to and configured to operate in the contact center system, a first matching strategy for pairing a first portion of a first plurality of contacts with a first plurality of agents for connection in the contact center system;applying, by the at least one computer processor, a second matching strategy for pairing a second portion of the first plurality of contacts for connection with the first plurality of agents for connection in the contact center system, wherein the second matching strategy is different from the first matching strategy;establishing, by the at least one computer processor, in a telecommunication switch of the contact center system, communication channels between communication equipment of the first plurality of contacts and communication equipment of the first plurality of agents according to the pairings resulting from the applications of the first and second matching strategies;retrieving, by the at least one computer processor, a first plurality of contact outcomes from an electronic database communicatively coupled to the contact center system, wherein the first plurality of contact outcomes indicates outcome results associated with connecting the first portion of the first plurality of contacts with the first plurality of agents;retrieving, by the at least one computer processor, a second plurality of contact outcomes from the electronic database communicatively coupled to the contact center system, wherein the second plurality of contact outcomes indicates outcome results associated with connecting the second portion of the first plurality of contacts with the first plurality of agents;comparing, by the at least one computer processor, the first plurality of contact outcomes with the second plurality of contact outcomes to determine a first amount of performance gain for the contact center system attributable to the first matching strategy;adjusting, by the at least one computer processor, at least one parameter of the first matching strategy based on the first amount of performance gain; andapplying, by the at least one computer processor, the first matching strategy with the at least one adjusted parameter to pair a second plurality of contacts with a second plurality of agents for connection in the contact center system to further increase performance of the contact center system relative to applying the second matching strategy.
  • 2. The method of claim 1, wherein the second matching strategy is a random matching strategy comprising queue-order routing.
  • 3. The method of claim 1, further comprising adjusting a ratio of the first portion and the remaining portion of the plurality of contacts.
  • 4. The method of claim 3, further comprising receiving a selected adjustment to a ratio of the first portion and the remaining portion of the plurality of contacts via a graphical user interface.
  • 5. The method of claim 1, further comprising: receiving a requested adjustment to a ratio of the first portion and the remaining portion of the plurality of contacts; andestimating a second amount of performance gain for the contact center system based on the requested adjustment.
  • 6. The method of claim 1, further comprising displaying the first amount of performance gain in a graphical user interface.
  • 7. The method of claim 1, further comprising: indicating that a system for performance-based routing is on for the first plurality of contact outcomes; andindicating that the system for performance-based routing is off for the second plurality of contact outcomes.
  • 8. A system for benchmarking performance in a contact center system comprising: at least one computer processor communicatively coupled to and configured to operate in the contact center system, wherein the at least one computer processor is configured to:apply a first matching strategy for pairing a first portion of a first plurality of contacts for connection with a first plurality of agents for connection in the contact center system;apply a second matching strategy for pairing a second portion of the first plurality of contacts with the first plurality of agents for connection in the contact center system, wherein the second matching strategy is different from the first matching strategy;establish, in a telecommunications switch of the contact center system, communication channels between communication equipment of the first plurality of contacts and communication equipment of the first plurality of agents according to the pairings resulting from the applications of the first and second matching strategies;retrieve a first plurality of contact outcomes from an electronic database communicatively coupled to the contact center system, wherein the first plurality of contact outcomes indicates outcome results associated with connecting the first portion of the first plurality of contacts with the first plurality of agents;retrieve a second plurality of contact outcomes from the electronic database communicatively coupled to the contact center system, wherein the second plurality of contact outcomes indicates outcome results associated with connecting the second portion of the first plurality of contacts with the first plurality of agents;compare the first plurality of contact outcomes with the second plurality of contact outcomes to determine a first amount of performance gain for the contact center system attributable to the first matching strategy;adjust at least one parameter of the first matching strategy based on the first amount of performance gain; andapply the first matching strategy with the at least one adjusted parameter to pair a second plurality of contacts with a second plurality of agents for connection in the contact center system to further increase performance of the contact center system relative to applying the second matching strategy.
  • 9. The system of claim 8, wherein the second matching strategy is a random matching strategy comprising queue-order routing.
  • 10. The system of claim 8, wherein the at least one computer processor is further configured to adjust a ratio of the first portion and the remaining portion of the plurality of contacts.
  • 11. The system of claim 10, wherein the at least one computer processor is further configured to receive a selected adjustment to a ratio of the first portion and the remaining portion of the plurality of contacts via a graphical user interface.
  • 12. The system of claim 8, wherein the at least one computer processor is further configured to: receive a requested adjustment to a ratio of the first portion and the remaining portion of the plurality of contacts; andestimate a second amount of performance gain for the contact center system based on the requested adjustment.
  • 13. The system of claim 8, wherein the at least one computer processor is further configured to display the first amount of performance gain in a graphical user interface.
  • 14. The system of claim 8, wherein the at least one computer processor is further configured to: indicate that a system for performance-based routing is on for the first plurality of contact outcomes; andindicate that the system for performance-based routing is off for the second plurality of contact outcomes.
  • 15. An article of manufacture for benchmarking performance in a contact center system comprising: a non-transitory computer processor readable medium; and instructions stored on the medium;wherein the instructions are configured to be readable from the medium by at least one computer processor communicatively coupled to and configured to operate in the contact center system and thereby cause the at least one computer processor to operate so as to:apply a first matching strategy for pairing a first portion of a first plurality of contacts for connection with a first plurality of agents for connection in the contact center system;apply a second matching strategy for pairing a second portion of the first plurality of contacts with the first plurality of agents for connection in the contact center system, wherein the second matching strategy is different from the first matching strategy;establish, in a telecommunications switch of the contact center system, communication channels between communication equipment of the first plurality of contacts and communication equipment of the first plurality of agents according to the pairings resulting from the applications of the first and second matching strategies;retrieve a first plurality of contact outcomes from an electronic database communicatively coupled to the contact center system, wherein the first plurality of contact outcomes indicates outcome results associated with connecting the first portion of the first plurality of contacts with the first plurality of agents;retrieve a second plurality of contact outcomes from the electronic database communicatively coupled to the contact center system, wherein the second plurality of contact outcomes indicates outcome results associated with connecting the second portion of the first plurality of contacts with the first plurality of agents;compare the first plurality of contact outcomes with the second plurality of contact outcomes to determine a first amount of performance gain for the contact center system attributable to the first matching strategy;adjust at least one parameter of the first matching strategy based on the first amount of performance gain; andapply the first matching strategy with the at least one adjusted parameter to pair a second plurality of contacts with a second plurality of agents for connection in the contact center system to further increase performance of the contact center system relative to applying the second matching strategy.
  • 16. The article of manufacture of claim 15, wherein the second matching strategy is a random matching strategy comprising queue-order routing.
  • 17. The article of manufacture of claim 15, wherein the at least one computer processor is caused to operate further so as to adjust a ratio of the first portion and the remaining portion of the plurality of contacts.
  • 18. The article of manufacture of claim 17, wherein the at least one computer processor is caused to operate further so as to receive a selected adjustment to a ratio of the first portion and the remaining portion of the plurality of contacts via a graphical user interface.
  • 19. The article of manufacture of claim 15, wherein the at least one computer processor is caused to operate further so as to: receive a requested adjustment to a ratio of the first portion and the remaining portion of the plurality of contacts; andestimate a second amount of performance gain for the contact center system based on the requested adjustment.
  • 20. The article of manufacture of claim 15, wherein the at least one computer processor is caused to operate further so as to: indicate that a system for performance-based routing is on for the first plurality of contact outcomes; andindicate that the system for performance-based routing is off for the second plurality of contact outcomes.
CROSS REFERENCE TO RELATED APPLICATIONS

This application is a continuation of U.S. patent application Ser. No. 14/472,998, filed Aug. 29, 2014, which is a continuation of U.S. patent application Ser. No. 12/266,446, filed Nov. 6, 2008, each of which is incorporated by reference in its entirety as if fully set forth herein.

US Referenced Citations (235)
Number Name Date Kind
5155763 Bigus et al. Oct 1992 A
5206903 Kohler et al. Apr 1993 A
5327490 Cave Jul 1994 A
5537470 Lee Jul 1996 A
5702253 Bryce et al. Dec 1997 A
5825869 Brooks et al. Oct 1998 A
5903641 Tonisson May 1999 A
5907601 David et al. May 1999 A
5926538 Deryugin et al. Jul 1999 A
6049603 Schwartz et al. Apr 2000 A
6052460 Fisher et al. Apr 2000 A
6064731 Flockhart et al. May 2000 A
6088444 Walker et al. Jul 2000 A
6163607 Bogart et al. Dec 2000 A
6222919 Hollatz et al. Apr 2001 B1
6292555 Okamoto Sep 2001 B1
6324282 McIllwaine et al. Nov 2001 B1
6333979 Bondi et al. Dec 2001 B1
6389132 Price May 2002 B1
6389400 Bushey et al. May 2002 B1
6408066 Andruska et al. Jun 2002 B1
6411687 Bohacek et al. Jun 2002 B1
6424709 Doyle et al. Jul 2002 B1
6434230 Gabriel Aug 2002 B1
6496580 Chack Dec 2002 B1
6504920 Okon et al. Jan 2003 B1
6519335 Bushnell Feb 2003 B1
6526135 Paxson Feb 2003 B1
6535601 Flockhart et al. Mar 2003 B1
6570980 Baruch May 2003 B1
6587556 Judkins et al. Jul 2003 B1
6603854 Judkins et al. Aug 2003 B1
6639976 Shellum et al. Oct 2003 B1
6661889 Flockhart et al. Dec 2003 B1
6704410 McFarlane et al. Mar 2004 B1
6707904 Judkins et al. Mar 2004 B1
6714643 Gargeya et al. Mar 2004 B1
6763104 Judkins et al. Jul 2004 B1
6774932 Ewing et al. Aug 2004 B1
6775378 Villena et al. Aug 2004 B1
6798876 Bala Sep 2004 B1
6829348 Schroeder et al. Dec 2004 B1
6832203 Villena et al. Dec 2004 B1
6859529 Duncan et al. Feb 2005 B2
6922466 Peterson et al. Jul 2005 B1
6937715 Delaney Aug 2005 B2
6956941 Duncan et al. Oct 2005 B1
6970821 Shambaugh et al. Nov 2005 B1
6978006 Polcyn Dec 2005 B1
7023979 Wu et al. Apr 2006 B1
7039166 Peterson et al. May 2006 B1
7050566 Becerra et al. May 2006 B2
7050567 Jensen May 2006 B1
7062031 Becerra et al. Jun 2006 B2
7068775 Lee Jun 2006 B1
7092509 Mears et al. Aug 2006 B1
7103172 Brown et al. Sep 2006 B2
7158628 McConnell et al. Jan 2007 B2
7184540 Dezonno et al. Feb 2007 B2
7209549 Reynolds et al. Apr 2007 B2
7231032 Nevman et al. Jun 2007 B2
7231034 Rikhy et al. Jun 2007 B1
7236584 Torba Jun 2007 B2
7245716 Brown et al. Jul 2007 B2
7245719 Kawada et al. Jul 2007 B2
7266251 Rowe Sep 2007 B2
7269253 Wu et al. Sep 2007 B1
7353388 Gilman et al. Apr 2008 B1
7398224 Cooper Jul 2008 B2
7593521 Becerra et al. Sep 2009 B2
7676034 Wu et al. Mar 2010 B1
7725339 Aykin May 2010 B1
7734032 Kiefhaber et al. Jun 2010 B1
7798876 Mix Sep 2010 B2
7826597 Berner et al. Nov 2010 B2
7864944 Khouri et al. Jan 2011 B2
7899177 Bruening et al. Mar 2011 B1
7916858 Heller et al. Mar 2011 B1
7940917 Lauridsen et al. May 2011 B2
7961866 Boutcher et al. Jun 2011 B1
7995717 Conway et al. Aug 2011 B2
8000989 Kiefhaber et al. Aug 2011 B1
8010607 McCormack et al. Aug 2011 B2
8094790 Conway et al. Jan 2012 B2
8126133 Everingham et al. Feb 2012 B1
8140441 Cases et al. Mar 2012 B2
8175253 Knott et al. May 2012 B2
8229102 Knott et al. Jul 2012 B2
8249245 Jay et al. Aug 2012 B2
8295471 Spottiswoode et al. Oct 2012 B2
8300798 Wu et al. Oct 2012 B1
8359219 Chishti et al. Jan 2013 B2
8433597 Chishti et al. Apr 2013 B2
8472611 Chishti Jun 2013 B2
8565410 Chishti et al. Oct 2013 B2
8634542 Spottiswoode et al. Jan 2014 B2
8644490 Stewart Feb 2014 B2
8670548 Xie et al. Mar 2014 B2
8699694 Chishti et al. Apr 2014 B2
8712821 Spottiswoode Apr 2014 B2
8718271 Spottiswoode May 2014 B2
8724797 Chishti et al. May 2014 B2
8731178 Chishti et al. May 2014 B2
8737595 Chishti et al. May 2014 B2
8750488 Spottiswoode et al. Jun 2014 B2
8781100 Spottiswoode et al. Jul 2014 B2
8781106 Afzal Jul 2014 B2
8792630 Chishti et al. Jul 2014 B2
8824658 Chishti Sep 2014 B2
8879715 Spottiswoode et al. Nov 2014 B2
8903079 Xie et al. Dec 2014 B2
8929537 Chishti et al. Jan 2015 B2
8995647 Li et al. Mar 2015 B2
9020137 Chishti et al. Apr 2015 B2
9025757 Spottiswoode et al. May 2015 B2
9215323 Chishti Dec 2015 B2
9277055 Spottiswoode et al. Mar 2016 B2
9300802 Chishti Mar 2016 B1
9426296 Chishti et al. Aug 2016 B2
9712676 Chishti Jul 2017 B1
9712679 Chishti et al. Jul 2017 B2
20010032120 Stuart et al. Oct 2001 A1
20020018554 Jensen et al. Feb 2002 A1
20020046030 Haritsa et al. Apr 2002 A1
20020059164 Shtivelman May 2002 A1
20020082736 Lech et al. Jun 2002 A1
20020110234 Walker et al. Aug 2002 A1
20020111172 DeWolf et al. Aug 2002 A1
20020131399 Philonenko Sep 2002 A1
20020138285 DeCotiis et al. Sep 2002 A1
20020143599 Nourbakhsh et al. Oct 2002 A1
20020161765 Kundrot et al. Oct 2002 A1
20020184069 Kosiba et al. Dec 2002 A1
20020196845 Richards et al. Dec 2002 A1
20030002653 Uckun Jan 2003 A1
20030081757 Mengshoel et al. May 2003 A1
20030095652 Mengshoel et al. May 2003 A1
20030169870 Stanford Sep 2003 A1
20030174830 Boyer et al. Sep 2003 A1
20030217016 Pericle Nov 2003 A1
20040028211 Culp et al. Feb 2004 A1
20040057416 McCormack Mar 2004 A1
20040096050 Das et al. May 2004 A1
20040098274 Dezonno et al. May 2004 A1
20040101127 Dezonno et al. May 2004 A1
20040109555 Williams Jun 2004 A1
20040133434 Szlam et al. Jul 2004 A1
20040210475 Starnes et al. Oct 2004 A1
20040230438 Pasquale et al. Nov 2004 A1
20040267816 Russek Dec 2004 A1
20050013428 Walters Jan 2005 A1
20050043986 McConnell et al. Feb 2005 A1
20050047581 Shaffer et al. Mar 2005 A1
20050047582 Shaffer et al. Mar 2005 A1
20050071223 Jain et al. Mar 2005 A1
20050129212 Parker Jun 2005 A1
20050135593 Becerra et al. Jun 2005 A1
20050135596 Zhao Jun 2005 A1
20050187802 Koeppel Aug 2005 A1
20050195960 Shaffer et al. Sep 2005 A1
20050286709 Horton et al. Dec 2005 A1
20060098803 Bushey et al. May 2006 A1
20060110052 Finlayson May 2006 A1
20060124113 Roberts Jun 2006 A1
20060184040 Keller et al. Aug 2006 A1
20060222164 Contractor et al. Oct 2006 A1
20060233346 McIlwaine et al. Oct 2006 A1
20060262918 Karnalkar et al. Nov 2006 A1
20060262922 Margulies et al. Nov 2006 A1
20070036323 Travis Feb 2007 A1
20070071222 Flockhart et al. Mar 2007 A1
20070116240 Foley et al. May 2007 A1
20070121602 Sin et al. May 2007 A1
20070121829 Tal et al. May 2007 A1
20070136342 Singhai et al. Jun 2007 A1
20070154007 Bernhard Jul 2007 A1
20070174111 Anderson et al. Jul 2007 A1
20070198322 Bourne et al. Aug 2007 A1
20070219816 Van Luchene et al. Sep 2007 A1
20070274502 Brown Nov 2007 A1
20080002823 Fama et al. Jan 2008 A1
20080008309 Dezonno et al. Jan 2008 A1
20080046386 Pieraccinii et al. Feb 2008 A1
20080065476 Klein et al. Mar 2008 A1
20080118052 Houmaidi et al. May 2008 A1
20080152122 Idan et al. Jun 2008 A1
20080181389 Bourne et al. Jul 2008 A1
20080199000 Su et al. Aug 2008 A1
20080267386 Cooper Oct 2008 A1
20080273687 Knott et al. Nov 2008 A1
20090043670 Johansson et al. Feb 2009 A1
20090086933 Patel et al. Apr 2009 A1
20090190740 Chishti et al. Jul 2009 A1
20090190743 Spottiswoode Jul 2009 A1
20090190744 Xie et al. Jul 2009 A1
20090190745 Xie et al. Jul 2009 A1
20090190746 Chishti et al. Jul 2009 A1
20090190747 Spottiswoode Jul 2009 A1
20090190748 Chishti et al. Jul 2009 A1
20090190749 Xie et al. Jul 2009 A1
20090190750 Xie et al. Jul 2009 A1
20090232294 Xie et al. Sep 2009 A1
20090234710 Belgaied Hassine et al. Sep 2009 A1
20090245493 Chen et al. Oct 2009 A1
20090304172 Becerra et al. Dec 2009 A1
20090318111 Desai et al. Dec 2009 A1
20090323921 Spottiswoode et al. Dec 2009 A1
20100020959 Spottiswoode Jan 2010 A1
20100020961 Spottiswoode Jan 2010 A1
20100054431 Jaiswal et al. Mar 2010 A1
20100054452 Afzal Mar 2010 A1
20100054453 Stewart Mar 2010 A1
20100086120 Brussat et al. Apr 2010 A1
20100111285 Chishti May 2010 A1
20100111286 Chishti May 2010 A1
20100111287 Xie et al. May 2010 A1
20100111288 Afzal et al. May 2010 A1
20100142698 Spottiswoode et al. Jun 2010 A1
20100183138 Spottiswoode et al. Jul 2010 A1
20110022357 Vock et al. Jan 2011 A1
20110031112 Birang et al. Feb 2011 A1
20110069821 Korolev et al. Mar 2011 A1
20110125048 Causevic et al. May 2011 A1
20120051536 Chishti et al. Mar 2012 A1
20120051537 Chishti et al. Mar 2012 A1
20120224680 Spottiswoode et al. Sep 2012 A1
20120278136 Flockhart et al. Nov 2012 A1
20130003959 Nishikawa et al. Jan 2013 A1
20130251137 Chishti et al. Sep 2013 A1
20140044246 Klemm et al. Feb 2014 A1
20140079210 Kohler et al. Mar 2014 A1
20140119531 Tuchman et al. May 2014 A1
20140341370 Li et al. Nov 2014 A1
20150055772 Klemm et al. Feb 2015 A1
20160080573 Chishti Mar 2016 A1
Foreign Referenced Citations (47)
Number Date Country
2008349500 May 2014 AU
2009209317 May 2014 AU
2009311534 Aug 2014 AU
ZL200980153730.2 May 2014 CN
ZL200980111060.8 Nov 2014 CN
0 493 292 Jul 1992 EP
0 949 793 Oct 1999 EP
1 032 188 Aug 2000 EP
1335572 Aug 2003 EP
11-098252 Apr 1999 JP
2000-069168 Mar 2000 JP
2000-078291 Mar 2000 JP
2000-078292 Mar 2000 JP
2000-092213 Mar 2000 JP
2000-236393 Aug 2000 JP
2001-292236 Oct 2001 JP
2001-518753 Oct 2001 JP
2002-297900 Oct 2002 JP
3366565 Jan 2003 JP
2003-187061 Jul 2003 JP
2004-056517 Feb 2004 JP
2004-227228 Aug 2004 JP
2006-345132 Dec 2006 JP
2007-324708 Dec 2007 JP
2011-511533 Apr 2011 JP
2011-511536 Apr 2011 JP
5421928 Feb 2014 JP
5631326 Nov 2014 JP
5649575 Jan 2015 JP
2015-514371 May 2015 JP
316118 Dec 2013 MX
322251 Jul 2014 MX
587100 Jul 2013 NZ
587101 Jul 2013 NZ
587100 Oct 2013 NZ
587101 Oct 2013 NZ
591486 Oct 2013 NZ
592781 Dec 2013 NZ
591486 Jan 2014 NZ
1-2010-501704 Feb 2014 PH
1-2010-501705 Feb 2015 PH
WO-1999017517 Apr 1999 WO
WO-2001063894 Aug 2001 WO
WO-2006124113 Nov 2006 WO
WO-2009097018 Aug 2009 WO
WO-2010053701 May 2010 WO
WO-2011081514 Jul 2011 WO
Non-Patent Literature Citations (38)
Entry
Cleveland, William S., “Robust Locally Weighted Regression and Smoothing Scatterplots,” Journal of the American Statistical Association, vol. 74, No. 368, pp. 829-836 (Dec. 1979).
Press, W. H. and Rybicki, G. B., “Fast Algorithm for Spectral Analysis of Unevenly Sampled Data,” The Astrophysical Journal, vol. 338, pp. 277-280 (Mar. 1, 1989).
Anonymous. (2006) “Performance Based Routing in Profit Call Centers,” The Decision Makers' Direct, located at www.decisioncraft.com, Issue Jan. 6, 2012 (3 pages).
Gans, N. et al. (2003), “Telephone Call Centers: Tutorial, Review and Research Prospects,” Manufacturing & Service Operations Management, vol. 5, No. 2, pp. 79-141.
International Preliminary Report on Patentability issued in connection with PCT Application No. PCT/US2009/066254 dated Jun. 14, 2011 (6 pages).
International Search Report issued in connection with International Application No. PCT/US13/33268 dated May 31, 2013 (2 pages).
International Search Report issued in connection with PCT Application No. PCT/US/2009/054352 dated Mar. 12, 2010, 5 pages.
International Search Report issued in connection with PCT Application No. PCT/US2008/077042 dated Mar. 13, 2009 (3 pages).
International Search Report issued in connection with PCT Application No. PCT/US2009/031611 dated Jun. 3, 2009 (5 pages).
International Search Report issued in connection with PCT Application No. PCT/US2009/066254 dated Feb. 24, 2010 (4 pages).
International Search Report issued in connection with PCT/US2009/061537 dated Jun. 7, 2010 (5 pages).
International Search Report issued in connection with PCT/US2013/033261 dated Jun. 14, 2013 (3 pages).
International Search Report issued in connection with PCT/US2013/33265 dated Jul. 9, 2013 (2 pages).
Koole, G. (2004). “Performance Analysis and Optimization in Customer Contact Centers,” Proceedings of the Quantitative Evaluation of Systems, First International Conference, Sep. 27-30, 2004 (4 pages).
Koole, G. et al. (Mar. 6, 2006). “An Overview of Routing and Staffing Algorithms in Multi-Skill Customer Contact Centers,” Manuscript, 42 pages.
Ntzoufras, “Bayesian Modeling Using Winbugs”. Wiley Interscience, Chapter 5, Normal Regression Models, Oct. 18, 2007, pp. 155-220 (67 pages).
Riedmiller, M. et al. (1993). “A Direct Adaptive Method for Faster Back Propagation Learning: The RPROP Algorithm,” 1993 IEEE International Conference on Neural Networks, San Francisco, CA, Mar. 28-Apr. 1, 1993, 1:586-591.
Stanley et al., “Improving call center operations using performance-based routing strategies,” Calif. Journal of Operations Management, 6(1), 24-32, Feb. 2008; retrieved from http://userwww.sfsu.edu/saltzman/Publist.html.
Subsequent Substantive Examination Report issued in connection with Philippines Application No. 1-2010-501705 dated Jul. 14, 2014 (1 page).
Substantive Examination Report issued in connection with Philippines Application No. 1/2011/500868 dated May 2, 2014 (1 page).
Written Opinion of the International Searching Authority issued in connection with PCT Application No. PCT/US2008/077042 dated Mar. 13, 2009, 6 pages.
Written Opinion of the International Searching Authority issued in connection with International Application No. PCT/US13/33268 dated May 31, 2013, 7 pages.
Written Opinion of the International Searching Authority issued in connection with PCT Application No. PCT/US/2009/054352 dated Mar. 12, 2010, 5 pages.
Written Opinion of the International Searching Authority issued in connection with PCT Application No. PCT/US2009/031611 dated Jun. 3, 2009, 7 pages.
Written Opinion of the International Searching Authority issued in connection with PCT Application No. PCT/US2009/066254 dated Feb. 4, 2010, 5 pages.
Written Opinion of the International Searching Authority issued in connection with PCT/US2009/061537 dated Jun. 7, 2010, 10 pages.
Written Opinion of the International Searching Authority issued in connection with PCT/US2013/033261 dated Jun. 14, 2013, 7 pages.
Written Opinion of the International Searching Authority issued in connection with PCT/US2013/33265 dated Jul. 9, 2013, 7 pages.
Japanese Office Action issued by the Japan Patent Office for Application No. 2015-503396 dated Jun. 29, 2016 (7 pages).
Canadian Office Action issued in Canadian Patent Application No. 2713526, dated Oct. 25, 2016, 7 pages.
International Search Report and Written Opinion issued by the European Patent Office as International Searching Authority for International Application No. PCT/IB2016/001762 dated Feb. 20, 2017 (15 pages).
International Search Report and Written Opinion issued by the European Patent Office as International Searching Authority for International Application No. PCT/IB2016/001776 dated Mar. 3, 2017 (16 pages).
Extended European Search Report issued by the European Patent Office for European Application No. 17154781.3 dated May 4, 2017 (7 pages).
Extended European Search Report issued by the European Patent Office for European Application No. 17171761.4 dated Aug. 30, 2017 (8 pages).
International Search Report and Written Opinion issued by the European Patent Office as International Searching Authority for International Application No. PCT/IB2017/000570 dated Jun. 30, 2017 (13 pages).
Japanese Office Action issued by the Japanese Patent Office for Japanese Application No. 2016-159338 dated Oct. 11, 2017 (12 pages).
Japanese Office Action issued by the Japanese Patent Office for Japanese Application No. 2016-189126 dated Oct. 19, 2017 (24 pages).
Extended European Search Report issued by the European Patent Office for European Application No. 18168620.5 dated Jun. 12, 2018 (9 pages).
Related Publications (1)
Number Date Country
20150264178 A1 Sep 2015 US
Continuations (2)
Number Date Country
Parent 14472998 Aug 2014 US
Child 14727271 US
Parent 12266446 Nov 2008 US
Child 14472998 US