Patent Grant
10104233
The invention relates to a method and system for analyzing an electronic communication, more particularly, to analyzing a communication between a customer and a contact center by applying a psychological behavioral model thereto to obtain behavioral assessment data and to calculate a customer satisfaction score based on the assessment data.
It is known to utilize telephone call centers to facilitate the receipt, response and routing of incoming telephone calls relating to customer service, retention, and sales. Generally, a customer is in contact with a customer service representative (“CSR”) or call center agent who is responsible for answering the customer's inquiries and/or directing the customer to the appropriate individual, department, information source, or service as required to satisfy the customer's needs.
It is also well known to monitor calls between a customer and a call center agent. Accordingly, call centers typically employ individuals responsible for listening to the conversation between the customer and the agent. Many companies have in-house call centers to respond to customers' complaints and inquiries. In many case, however, it has been found to be cost effective for a company to hire third party telephone call centers to handle such inquiries. As such, the call centers may be located thousands of miles away from the actual sought manufacturer or individual. This often results in use of inconsistent and subjective methods of monitoring, training and evaluating call center agents. These methods also may vary widely from call center to call center.
While monitoring such calls may occur in real time, it is often more efficient and useful to record the call for later review. Information gathered from the calls is typically used to monitor the performance of the call center agents to identify possible training needs. Based on the review and analysis of the conversation, a monitor will make suggestions or recommendations to improve the quality of the customer interaction. Improvements typically relate to an agent's performance, which generally leads to higher customer satisfaction.
Accordingly, there is a need in customer relationship management (“CRM”) for an objective tool useful in improving the quality of customer interactions with agents and ultimately customer relationships. In particular, a need exists for an objective monitoring and analysis tool which provides information about a customer's perception of an interaction during a call. In the past, post-call data collection methods have been used to survey callers for feedback. This feedback may be subsequently used by a supervisor or trainer to evaluate an agent. Although such surveys have enjoyed some degree of success, their usefulness is directly tied to a customer's willingness to provide post-call data.
More “passive” methods have also been employed to collect data relating to a customer's in-call experience. For example, U.S. Pat. No. 6,724,887 to Eilbacher et al. is directed to a method and system for analyzing a customer communication with a contact center. According to Eilbacher, a contact center may include a monitoring system which records customer communications and a customer experience analyzing unit which reviews the customer communications. The customer experience analyzing unit identifies at least one parameter of the customer communications and automatically determines whether the identified parameter of the customer communications indicates a negative or unsatisfactory experience. According to Eilbacher, a stress analysis may be performed on audio telephone calls to determine a stress parameter by processing the audio portions of the telephone calls. From this, it can then be determined whether the customer experience of the caller was satisfactory or unsatisfactory.
While the method of Eilbacher provides some benefit with respect to reaching an ultimate conclusion as to whether a customer's experience was satisfactory or unsatisfactory, the method provides little insight into the reasons for an experiential outcome. As such, the method of Eilbacher provides only limited value in training agents for future customer communications. Accordingly, there exists a need for a system that analyzes the underlying behavioral characteristics of a customer and agent so that data relating to these behavioral characteristics can be used for subsequent analysis and training.
Systems such as stress analysis systems, spectral analysis models and word-spotting models also exist for determining certain characteristics of audible sounds associated with a communication. For example, systems such as those disclosed in U.S. Pat. No. 6,480,826 to Pertrushin provide a system and method for determining emotions in a voice signal. However, like Eilbacher, these systems also provide only limited value in training customer service agents for future customer interactions. Moreover, such methods have limited statistical accuracy in determining stimuli for events occurring throughout an interaction.
It is well known that certain psychological behavioral models have been developed as tools to evaluate and understand how and/or why one person or a group of people interacts with another person or group of people. The Process Communication Model™ (“PCM”) developed by Dr. Taibi Kahler is an example of one such behavioral model. Specifically, PCM presupposes that all people fall primarily into one of six basic personality types: Reactor, Workaholic, Persister, Dreamer, Rebel and Promoter. Although each person is one of these six types, all people have parts of all six types within them arranged like a “six-tier configuration.” Each of the six types learns differently, is motivated differently, communicates differently, and has a different sequence of negative behaviors in which they engage when they are in distress. Importantly each PCM personality type responds positively or negatively to communications that include tones or messages commonly associated with another of the PCM personality types. Thus, an understanding of a communicant's PCM personality type offers guidance as to an appropriate responsive tone or message. There exists a need for a system and method that analyzes the underlying behavioral characteristics of a customer and agent communication by automatically applying a psychological behavioral model such as, for example PCM, to the communication.
Devices and software for recording and logging calls to a call center are well known. However, application of word-spotting analytical tools to recorded audio communications can pose problems. Devices and software that convert recorded or unrecorded audio signals to text files are also known the art. But, translation of audio signals to text files often results in lost voice data due to necessary conditioning and/or compression of the audio signal. Accordingly, a need also exists to provide a system that allows a contact center to capture audio signals and telephony events with sufficient clarity to accurately apply a linguistic-based psychological behavioral analytic tool to a telephonic communication.
Moreover, it is generally known to store and/or record telephone calls for later review. However, due to the high volume of recorded calls within, for example, a call center, it is difficult to find meaningful examples of calls to drive improvements at a later time. Call centers typically hire individuals to manually sift or sort through calls to find good examples. Typically, an individual must typically manually listen to a call and manually rank or categorize the call.
A need exists, therefore, for a systematic way to automatically categorize and sort calls so as to search and find or otherwise navigate to call examples that may be utilized to drive improvements. Further, a need exists for a method and system for inputting multiple metrics for determining call examples, and navigation to call examples based on these metrics.
The present invention is provided to solve the problems discussed above and other problems, and to provide advantages and aspects not previously provided. A full discussion of the features and advantages of the present invention is deferred to the following detailed description, which proceeds with reference to the accompanying drawings.
A first aspect of the disclosure encompasses an embodiment including an interface portal system that includes a non-transitory computer readable medium comprising a plurality of instructions stored therein adapted to generate a coaching portal based on behavioral assessment data, the plurality of instructions including instructions that, when executed, analyze one or more communications between a customer and an agent, wherein the analysis includes instructions that, when executed, apply a linguistic-based psychological behavioral model to separated voice data for the customer, the agent, or both, from each communication by analyzing behavioral characteristics of the customer, the agent, or both, based on the one or more communications, instructions that, when executed, identify one or more customer-agent interaction events based on the analyzed behavioral characteristics, and instructions that, when executed, display a time-based graphic representation including a plurality of the identified customer-agent interaction events across a selected time interval based on one or more communications.
A second aspect of the disclosure encompasses an embodiment including a method of providing coaching assessment based on behavioral assessment data across one or more recorded communications, which includes analyzing, by a server, one or more communications between a customer and an agent, wherein the analysis comprises instructions that, when executed, apply a linguistic-based psychological behavioral model to separated voice data for the customer, the agent, or both, from each communication by analyzing behavioral characteristics of the customer, the agent, or both, based on the one or more communications, identifying one or more customer-agent interaction events based on the analyzed behavioral characteristics, and displaying a time-based graphic representation including a plurality of the identified customer-agent interaction events across a selected time interval based on one or more communications.
In a third aspect of the disclosure, the disclosure encompasses a non-transitory computer readable medium including a plurality of instructions stored therein adapted to generate a customer satisfaction score based on behavioral assessment data, the plurality of instructions including instructions that, when executed, analyze one or more communications between a customer and an agent, wherein the analysis includes instructions that, when executed, apply a linguistic-based psychological behavioral model to each communication to determine a personality type of the customer by analyzing behavioral characteristics of the customer based on the one or more communications; instructions that, when executed, select at least one filter criterion which includes a customer, an agent, a team, or a call type, instructions that, when executed, calculate a customer satisfaction score using the at least one selected filter criterion across a selected time interval and based on one or more communications, and instructions that, when executed, display a report including the calculated customer satisfaction score to a user that matches the at least one selected filter criterion for the selected time interval.
In a fourth aspect of the disclosure, the disclosure encompasses a method of generating a customer satisfaction score based on behavioral assessment data across one or more recorded communications that includes by analyzing one or more communications between a customer and an agent, wherein the analyzing includes applying a linguistic-based psychological behavioral model to each communication to determine a personality type of the customer by analyzing behavioral characteristics of the customer based on the one or more communications, selecting at least one filter criterion which includes a customer, an agent, a team, or a call type, calculating a customer satisfaction score using the at least one selected filter criterion across a selected time interval and based on one or more communications, and displaying a report including the calculated customer satisfaction score to a user that matches the at least one selected filter criterion for the selected time interval.
In a fifth aspect, the disclosure encompasses a system configured to generate a customer satisfaction score based on behavioral assessment data across one or more recorded communications, which includes a non-transitory computer readable medium operably coupled to one or more processors, the non-transitory computer readable medium including a plurality of instructions stored therein that are accessible to, and executable by, the one or more processors, wherein the plurality of instructions includes instructions that, when executed, analyze one or more communications between a customer and an agent, wherein the analysis includes instructions that, when executed, apply a linguistic-based psychological behavioral model to each communication to determine a personality type of the customer by analyzing behavioral characteristics of the customer based on the one or more communications, instructions that, when executed, select at least one filter criterion which includes a customer, an agent, a team, or a call type, instructions that, when executed, calculate a customer satisfaction score using the at least one selected filter criterion across a selected time interval and based on one or more communications, and instructions that, when executed, display a report including the calculated customer satisfaction score to a user that matches the at least one selected filter criterion for the selected time interval.
According to a further aspect of the present invention, a method for analyzing a communication between a customer and a contact center is provided. According to the method, a communication is separated into at least first constituent voice data and second constituent voice data. One of the first and second constituent voice data is analyzed by mining the voice data and applying a predetermined linguistic-based psychological behavioral model to one of the separated first and second constituent voice data. Behavioral assessment data is generated which corresponds to the analyzed voice data.
According to another aspect of the present invention, the communication is received in digital format. The step of separating the communication into at least a first and second constituent voice data comprises the steps of identifying a communication protocol associated with the communication, and recording the communication to a first electronic data file. The first electronic data file is comprised of a first and second audio track. The first constituent voice data is automatically recorded on the first audio track based on the identified communication protocol, and the second constituent voice data is automatically recorded on the second audio track based on the identified communication protocol. At least one of the first and second constituent voice data recorded on the corresponding first and second track is separated from the first electronic data file. It is also contemplated that two first data files can be created, wherein the first audio track is recorded to one of the first data file and the second audio track is recorded to the other first data file.
According to another aspect of the present invention, the method described above further comprises the step of generating a text file before the analyzing step. The text file includes a textual translation of either or both of the first and second constituent voice data. The analysis is then performed on the translated constituent voice data in the text file.
According to another aspect of the present invention, the predetermined linguistic-based psychological behavioral model is adapted to assess distress levels in a communication. Accordingly, the method further comprises the step of generating distress assessment data corresponding to the analyzed second constituent voice data.
According to yet another aspect of the present invention event data is generated. The event data corresponds to at least one identifying indicia and time interval. The event data includes at least one of behavioral assessment data or distress assessment data. It is also contemplated that both behavioral assessment data and distress assessment data are included in the event data.
According to still another aspect of the present invention, the communication is one of a plurality of communications. Accordingly, the method further comprises the step of categorizing the communication as one of a plurality of call types and/or customer categories. The communication to be analyzed is selected from the plurality of communications based upon the call type and/or the customer category in which the communication is categorized.
According to still another aspect of the present invention, a responsive communication to the communication is automatically generated based on the event data generated as result of the analysis.
According to another aspect of the present invention, a computer program for analyzing a communication is provided. The computer program is embodied on a computer readable storage medium adapted to control a computer. The computer program comprises a plurality of code segments for performing the analysis of the communication. In particular, a code segment separates a communication into first constituent voice data and second constituent voice data. The computer program also has a code segment that analyzes one of the first and second voice data by applying a predetermined psychological behavioral model to one of the separated first and second constituent voice data. And, a code segment is provided for generating behavioral assessment data corresponding to the analyzed constituent voice data.
According to yet another aspect of the present invention, the computer program comprises a code segment for receiving a communication in digital format. The communication is comprised of a first constituent voice data and a second constituent voice data. A code segment identifies a communication protocol associated with the communication. A code segment is provided for separating the first and second constituent voice data one from the other by recording the communication in stereo format to a first electronic data file. The first electronic data file includes a first and second audio track. The first constituent voice data is automatically recorded on the first audio track based on the identified communication protocol, and the second constituent voice data is automatically recorded on the second audio track based on the identified communication protocol.
A code segment applies a non-linguistic based analytic tool to the separated first constituent voice data and generates phone event data corresponding to the analyzed first constituent voice data. A code segment is provided for translating the first constituent voice data into text format and storing the translated first voice data in a first text file. A code segment analyzes the first text file by mining the text file and applying a predetermined linguistic-based psychological behavioral model to the text file. Either or both of behavioral assessment data and distress assessment data corresponding to the analyzed first voice data is generated therefrom.
According to another aspect of the present invention, the above analysis is performed on the second constituent voice data. Additionally, a code segment is provided for generating call assessment data by comparatively analyzing the behavioral assessment data and distress assessment data corresponding to the analyzed first voice data and the behavioral assessment data and distress assessment data corresponding to the analyzed second voice data. The computer program has a code segment for outputting event data which is comprised of call assessment data corresponding to at least one identifying indicia and at least one predetermined time interval.
According to still another aspect of the present invention, a method for analyzing an electronic communication is provided. The method comprises the step of receiving an electronic communication in digital format. The electronic communication includes communication data. The communication data is analyzed by applying a predetermined linguistic-based psychological behavioral model thereto. Behavioral assessment data corresponding to the analyzed communication data is generated therefrom.
The method described can be embodied in a computer program stored on a computer readable media. The a computer program would include code segments or routines to enable all of the functional aspects of the interface described or shown herein.
According to another aspect of the invention, a computer program for training a customer service representative by analyzing a communication between a customer and a contact center is provided. A code segment selects at least one identifying criteria. A code segment identifies a pre-recorded first communication corresponding to the selected identifying criteria. The first communication has first event data associated therewith. A code segment generates coaching assessment data corresponding to the identified pre-recorded first communication. A code segment identifies a pre-recorded second communication corresponding to the selected identifying criteria. The second communication has second event data associated therewith. A code segment compares the identified pre-recorded second communication to the identified first communication within the coaching assessment data. A code segment generates a notification based on the comparison of the identified pre-recorded second communication with the identified first communication within the coaching assessment data.
According to yet another aspect of the present invention, a code segment generates a first performance score for the coaching assessment. A code segment generates a second performance score for the pre-recorded second communication. The notification is generated based on a comparison of first performance score with the second performance score.
According to still another aspect of the present invention, a code segment identifies a plurality of pre-recorded first communications based on at least one identifying criteria. Each of the first communications has first event data associated therewith. A code segment for identifies a plurality of pre-recorded second communications based on at least one identifying criteria. Each of the second communications having second event data associated therewith. A code segment generates a first performance score for each of the plurality of prerecorded first communications and a code segment generates a second performance score for each of the plurality of prerecorded second communications. A code segment generates a notification if a predetermined number of second performance scores are at least one of less than a predetermined threshold of the first performance scores and greater than a predetermined threshold of the first performance scores.
According to another aspect of the present invention, a computer program for training a customer service representative by analyzing a communication between a customer and a contact center is provided. A code segment selects at least one identifying criteria. A code segment identifies a pre-recorded first communications corresponding to the selected identifying criteria. The first communication having first event data associated therewith. A code segment generates coaching assessment data corresponding to the identified pre-recorded first communication. A code segment compares the identified first communication within the coaching assessment data with a predetermined identifying criteria value threshold. A code segment generates a notification based on the comparison of the identified first communication with the coaching assessment data with a predetermined identifying criteria value threshold.
According to yet another aspect of the invention, a code segment generates a first performance score for the coaching assessment data. A code segment generates a second performance for the identifying criteria value threshold. A code segment generates a notification. The notification is generated based on a comparison of first performance score and the second performance score.
According to another aspect of the invention, a code segment identifies a plurality of pre-recorded first communications based on at least one identifying criteria. Each of the first communications having first event data associated therewith. A code segment generates a first performance score for each of the plurality of prerecorded first communications based on the at least one identifying criteria. A code segment generates a second performance score based on the identifying criteria value threshold. A code segment generates a notification. The notification is generated if a predetermined threshold of first performance scores are at least one of less than the second performance score and greater than the second performance scores.
According to still another aspect of the present invention, the computer program further comprises a code segment for generating a graphical user interface (“GUI”). The GUI is adapted to display a first field for enabling identification of customer interaction event information on a display. The customer interaction event information includes call assessment data based on the psychological behavioral model applied to the analyzed constituent voice data of each customer interaction event. The computer program also includes a code segment for receiving input from a user for identifying at least a first customer interaction event. A code segment is also provided for displaying the customer interaction event information for the first customer interaction event.
According to one aspect of the present invention, the GUI enables a user of the system to locate one or more caller interaction events (i.e., calls between a caller and the call center), and to display information relating to the event. In particular, the graphical user interface provides a visual field showing the results of the psychological behavioral model that was applied to a separated voice data from the caller interaction event. Moreover, the interface can include a link to an audio file of a selected caller interaction event, and a visual representation that tracks the portion of the caller interaction that is currently heard as the audio file is being played.
According to one aspect of the invention, the graphical user interface is incorporated in a system for identifying one or more caller interaction events and displaying a psychological behavioral model applied to a separated voice data of a customer interaction event. The system comprises a computer coupled to a display and to a database of caller interaction event information. The caller interaction event information includes data resulting from application of a psychological behavioral model to a first voice data separated from an audio wave form of a caller interaction event. Additionally, the caller event information can also include additional information concerning each call, such as statistical data relating to the caller interaction event (e.g., time, date and length of call, caller identification, agent identification, hold times, transfers, etc.), and a recording of the caller interaction event.
The system also includes a processor, either at the user's computer or at another computer, such as a central server available over a network connection, for generating a graphical user interface on the display. The graphical user interface comprises a selection visual field for enabling user input of caller interaction event parameters for selection of at least a first caller interaction event and/or a plurality of caller interaction events. The caller interaction event parameters can include one or more caller interaction event identifying characteristic. These characteristics can include, for example, the caller's name or other identification information, a date range, the agent's name, the call center identification, a supervisor identifier, etc. For example, the graphical user interface can enable a user to select all caller interaction events for a particular caller; or all calls handled by a particular agent. Both examples can be narrowed to cover a specified time period or interval. The interface will display a selected caller interaction event field which provides identification of caller interaction events corresponding to the user input of caller interaction event parameters.
The graphical user interface also includes a conversation visual field for displaying a time-based representation of characteristics of the caller interaction event(s) based on the psychological behavioral model. These characteristics were generated by the application of a psychological behavioral model to a first voice data separated from an audio wave form of a caller interaction event which is stored as part of the caller interaction event information.
The conversation visual field can include a visual link to an audio file of the caller interaction event(s). Additionally, it may also include a graphical representation of the progress of the first caller interaction event that corresponds to a portion of the audio file being played. For example, the interface may show a line representing the call and a moving pointer marking the position on the line corresponding to the portion of the event being played. Additionally, the time-based representation of characteristics of the caller interaction event can include graphical or visual characteristic elements which are also displayed in the conversation visual field. Moreover, the characteristic elements are located, or have pointers to, specific locations of the graphical representation of the progress of the event corresponding to where the element was generated by the analysis.
The graphical user interface further includes a call statistics visual field selectable by a user for displaying statistics pertaining to the caller interaction events. The statistics in the call statistics visual field can include, for example: call duration, caller talk time, agent talk time, a caller satisfaction score, an indication of the number of silences greater than a predetermined time period, and an agent satisfaction score.
The graphical user interface can also include a number of other visual fields. For example, the graphical user interface can include a caller satisfaction report field for displaying one or more caller satisfaction reports, or a user note field for enabling a user of the system to place a note with the first caller interaction event.
In accordance with another embodiment of the invention, a method for identifying one or more caller interaction events and displaying an analysis of a psychological behavioral model applied to a separated voice data from the caller interaction event comprises providing a graphical user interface for displaying a first field for enabling identification of caller interaction event information on a display, the caller interaction event information including analysis data based on a psychological behavioral model applied to a first separated voice data of each caller interaction event; receiving input from a user for identifying at least a first caller interaction event; and, displaying the caller interaction event information for the first caller interaction event on the display. The step of receiving input from a user can include receiving at least one or more of a caller identifier, a call center identifier, an agent identifier, a supervisor identifier, and a date range.
The step of displaying the caller interaction event information for the first caller interaction event on the display can include displaying a time-based representation of characteristics of the first caller interaction event based on the psychological behavioral model. The method can also include providing an audio file of the first caller interaction event. In this regard, the displaying of the time-based representation of characteristics of the first caller event based on the psychological behavioral model can include displaying a graphical representation of the progress of the first caller interaction event that corresponds to a portion of the audio file being played.
The graphical user interface can be generated by a user's local computer, or from a remote server coupled to the user's computer via a network connection. In this latter instance, the method can further include creating a web page containing the graphical user interface that is downloadable to a user's computer, and downloading the page via the network connection.
The method can include providing other visual fields for enabling other functions of the system. For example, the method can include providing a field in the graphical user interface for enabling a user to place a note with the information for the first caller interaction event.
The graphical user interface described can be embodied in a computer program stored on a computer readable media. The a computer program would include code segments or routines to enable all of the functional aspects of the interface described or shown herein.
Other features and advantages of the invention will be apparent from the following specification taken in conjunction with the following drawings.
To understand the present invention, it will now be described by way of example, with reference to the accompanying drawings in which:
While this invention is susceptible of embodiments in many different forms, there is shown in the drawings and will herein be described in detail preferred embodiments of the invention with the understanding that the present disclosure is to be considered as an exemplification of the principles of the invention and is not intended to limit the broad aspect of the invention to the embodiments illustrated.
Referring to
As shown in
Process descriptions or blocks in figures should be understood as representing modules, segments, or portions of code which include one or more executable instructions for implementing specific logical functions or steps in the process. Alternate implementations are included within the scope of the embodiments of the present invention in which functions may be executed out of order from that shown or discussed, including substantially concurrently or in reverse order, depending on the functionality involved, as would be understood by those having ordinary skill in the art.
Generally, in terms of hardware architecture, as shown in
The processor 16 is a hardware device for executing software, particularly software stored in memory 18. The processor 16 can be any custom made or commercially available processor, a central processing unit (CPU), an auxiliary processor among several processors associated with the computer 12, a semiconductor based microprocessor (in the form of a microchip or chip set), a macroprocessor, or generally any device for executing software instructions. Examples of suitable commercially available microprocessors are as follows: a PA-RISC series microprocessor from Hewlett-Packard Company, an 80.times.8 or Pentium series microprocessor from Intel Corporation, a PowerPC microprocessor from IBM, a Sparc microprocessor from Sun Microsystems, Inc., or a 8xxx series microprocessor from Motorola Corporation.
The memory 18 can include any one or a combination of volatile memory elements (e.g., random access memory (RAM, such as DRAM, SRAM, SDRAM, etc.)) and nonvolatile memory elements (e.g., ROM, hard drive, tape, CDROM, etc.). Moreover, memory 18 may incorporate electronic, magnetic, optical, and/or other types of storage media. The memory 18 can have a distributed architecture where various components are situated remote from one another, but can be accessed by the processor 16.
The software in memory 18 may include one or more separate programs, each of which comprises an ordered listing of executable instructions for implementing logical functions. In the example of
The control system 14 may be a source program, executable program (object code), script, or any other entity comprising a set of instructions to be performed. When a source program, the program needs to be translated via a compiler, assembler, interpreter, or the like, which may or may not be included within the memory 18, so as to operate properly in connection with the O/S 24. Furthermore, the control system 14 can be written as (a) an object oriented programming language, which has classes of data and methods, or (b) a procedure programming language, which has routines, subroutines, and/or functions, for example but not limited to, C, C++, Pascal, Basic, Fortran, Cobol, Perl, Java, and Ada. In one embodiment, the control system 14 is written in C++. The I/O devices 20 may include input devices, for example but not limited to, a keyboard, mouse, scanner, microphone, touch screens, interfaces for various medical devices, bar code readers, stylus, laser readers, radio-frequency device readers, etc. Furthermore, the I/O devices 20 may also include output devices, for example but not limited to, a printer, bar code printers, displays, etc. Finally, the I/O devices 20 may further include devices that communicate both inputs and outputs, for instance but not limited to, a modulator/demodulator (modem; for accessing another device, system, or network), a radio frequency (RF) or other transceiver, a telephonic interface, a bridge, a router, etc.
If the computer 12 is a PC, workstation, PDA, or the like, the software in the memory 18 may further include a basic input output system (BIOS) (not shown in
When the computer 12 is in operation, the processor 16 is configured to execute software stored within the memory 18, to communicate data to and from the memory 18, and to generally control operations of the computer 12 pursuant to the software. The control system 14 and the O/S 24, in whole or in part, but typically the latter, are read by the processor 16, perhaps buffered within the processor 16, and then executed.
When the control system 14 is implemented in software, as is shown in
In another embodiment, where the control system 14 is implemented in hardware, the control system 14 can be implemented with any or a combination of the following technologies, which are each well known in the art: a discrete logic circuit(s) having logic gates for implementing logic functions upon data signals, an application specific integrated circuit (ASIC) having appropriate combinational logic gates, a programmable gate array(s) (PGA), a field programmable gate array (FPGA), etc.
The method of the present invention is configured to postpone audio compression until analysis of the audio data is complete. This delay allows the system to apply the analytic tools to a truer and clearer hi-fidelity signal. The system employed in connection with the present invention also minimizes audio distortion, increases fidelity, eliminates gain control and requires no additional filtering of the signal.
As shown in
The telephonic communication 2 being analyzed can be one of numerous calls stored within a contact center server 12, or communicated to a contact center during a given time period. Accordingly, the present method contemplates that the telephonic communication 2 being subjected to analysis is selected from the plurality of telephonic communications. The selection criteria for determining which communication should be analyzed may vary. For example, the communications coming into a contact center can be automatically categorized into a plurality of call types using an appropriate algorithm. For example, the system may employ a word-spotting algorithm that categorizes communications 2 into particular types or categories based on words used in the communication. In one embodiment, each communication 2 is automatically categorized as a service call type (e.g., a caller requesting assistance for servicing a previously purchased product), a retention call type (e.g., a caller expressing indignation, or having a significant life change event), or a sales call type (e.g., a caller purchasing an item offered by a seller). In one scenario, it may be desirable to analyze all of the “sales call type” communications received by a contact center during a predetermined time frame. In that case, the user would analyze each of the sales call type communications from that time period by applying the predetermined psychological behavioral model to each such communication.
Alternatively, the communications 2 may be grouped according to customer categories, and the user may desire to analyze the communications 2 between the call center and communicants within a particular customer category. For example, it may be desirable for a user to perform an analysis only of a “platinum customers” category, consisting of high end investors, or a “high volume distributors” category comprised of a user's best distributors.
In one embodiment the telephonic communication 2 is telephone call in which a telephonic signal is transmitted. As many be seen in
When analyzing voice data, it is preferable to work from a true and clear hi-fidelity signal. This is true both in instances in which the voice data is being translated into a text format for analysis using a linguistic-based psychological behavioral model thereto, or in instance in which a linguistic-based psychological behavioral model is being applied directly to an audio waveform, audio stream or file containing voice data.
The PBX switch 205 provides an interface between the PSTN 203 and a local network. Preferably, the interface is controlled by software stored on a telephony server 207 coupled to the PBX switch 205. The PBX switch 205, using interface software, connects trunk and line station interfaces of the public switch telephone network 203 to stations of a local network or other peripheral devices contemplated by one skilled in the art. Further, in another embodiment, the PBX switch may be integrated within telephony server 207. The stations may include various types of communication devices connected to the network, including the telephony server 207, a recording server 209, telephone stations 211, and client personal computers 213 equipped with telephone stations 215. The local network may further include fax machines and modems.
Generally, in terms of hardware architecture, the telephony server 207 includes a processor, memory, and one or more input and/or output (I/O) devices (or peripherals) that are communicatively coupled via a local interface. The processor can be any custom-made or commercially available processor, a central processing unit (CPU), an auxiliary processor among several processors associated with the telephony server 207, a semiconductor based microprocessor (in the form of a microchip or chip set), a macroprocessor, or generally any device for executing software instructions. The memory of the telephony server 207 can include any one or a combination of volatile memory elements (e.g., random access memory (RAM, such as DRAM, SRAM, SDRAM, etc.)) and nonvolatile memory elements (e.g., ROM, hard drive, tape, CDROM, etc.). The telephony server 207 may further include a keyboard and a mouse for control purposes, and an attached graphic monitor for observation of software operation.
The telephony server 207 incorporates PBX control software to control the initiation and termination of connections between stations and via outside trunk connections to the PSTN 203. In addition, the software may monitor the status of all telephone stations 211 in real-time on the network and may be capable of responding to telephony events to provide traditional telephone service. This may include the control and generation of the conventional signaling tones such as dial tones, busy tones, ring back tones, as well as the connection and termination of media streams between telephones on the local network. Further, the PBX control software may use a multi-port module 223 and PCs to implement standard PBX functions such as the initiation and termination of telephone calls, either across the network or to outside trunk lines, the ability to put calls on hold, to transfer, park and pick up calls, to conference multiple callers, and to provide caller ID information. Telephony applications such as voice mail and auto attendant may be implemented by application software using the PBX as a network telephony services provider.
Referring to
The control processor 221 may include buffer storage and control logic to convert media streams from one format to another, if necessary, between the trunk interface 217 and local network. The trunk interface 217 provides interconnection with the trunk circuits of the PSTN 203. The local network interface 219 provides conventional software and circuitry to enable the telephony server 207 to access the local network. The buffer RAM and control logic implement efficient transfer of media streams between the trunk interface 217, the telephony server 207, the digital signal processor 225, and the local network interface 219.
The trunk interface 217 utilizes conventional telephony trunk transmission supervision and signaling protocols required to interface with the outside trunk circuits from the PSTN 203. The trunk lines carry various types of telephony signals such as transmission supervision and signaling, audio, fax, or modem data to provide plain old telephone service (POTS). In addition, the trunk lines may carry other communication formats such Ti, ISDN or fiber service to provide telephony or multimedia data images, video, text or audio.
The control processor 221 manages real-time telephony event handling pertaining to the telephone trunk line interfaces, including managing the efficient use of digital signal processor resources for the detection of caller ID, DTMF, call progress and other conventional forms of signaling found on trunk lines. The control processor 221 also manages the generation of telephony tones for dialing and other purposes, and controls the connection state, impedance matching, and echo cancellation of individual trunk line interfaces on the multi-port PSTN module 223.
Preferably, conventional PBX signaling is utilized between trunk and station, or station and station, such that data is translated into network messages that convey information relating to real-time telephony events on the network, or instructions to the network adapters of the stations to generate the appropriate signals and behavior to support normal voice communication, or instructions to connect voice media streams using standard connections and signaling protocols. Network messages are sent from the control processor 221 to the telephony server 207 to notify the PBX software in the telephony server 207 of real-time telephony events on the attached trunk lines. Network messages are received from the PBX Switch 205 to implement telephone call supervision and may control the set-up and elimination of media streams for voice transmission.
The local network interface 219 includes conventional circuitry to interface with the local network. The specific circuitry is dependent on the signal protocol utilized in the local network. In one embodiment, the local network may be a local area network (LAN) utilizing IP telephony. IP telephony integrates audio and video stream control with legacy telephony functions and may be supported through the H.323 protocol. H.323 is an International Telecommunication Union-Telecommunications protocol used to provide voice and video services over data networks. H.323 permits users to make point-to-point audio and video phone calls over a local area network. IP telephony systems can be integrated with the public telephone system through a local network interface 219, such as an IP/PBX-PSTN gateway, thereby allowing a user to place telephone calls from an enabled computer. For example, a call from an IP telephony client to a conventional telephone would be routed on the LAN to the IP/PBX-PSTN gateway. The IP/PBX-PSTN gateway translates H.323 protocol to conventional telephone protocol and routes the call over the conventional telephone network to its destination. Conversely, an incoming call from the PSTN 203 is routed to the IP/PBX-PSTN gateway and translates the conventional telephone protocol to H.323 protocol.
As noted above, PBX trunk control messages are transmitted from the telephony server 207 to the control processor 221 of the multi-port PSTN. In contrast, network messages containing media streams of digital representations of real-time voice are transmitted between the trunk interface 217 and local network interface 219 using the digital signal processor 225. The digital signal processor 225 may include buffer storage and control logic. Preferably, the buffer storage and control logic implement a first-in-first-out (FIFO) data buffering scheme for transmitting digital representations of voice audio between the local network to the trunk interface 217. It is noted that the digital signal processor 225 may be integrated with the control processor 221 on a single microprocessor.
The digital signal processor 225 may include a coder/decoder (CODEC) connected to the control processor 221. The CODEC may be a type TCM29c13 integrated circuit made by Texas Instruments, Inc. In one embodiment, the digital signal processor 225 receives an analog or digital voice signal from a station within the network or from the trunk lines of the PSTN 203. The CODEC converts the analog voice signal into in a digital from, such as digital data packets. It should be noted that the CODEC is not used when connection is made to digital lines and devices. From the CODEC, the digital data is transmitted to the digital signal processor 225 where telephone functions take place. The digital data is then passed to the control processor 221 which accumulates the data bytes from the digital signal processor 225. It is preferred that the data bytes are stored in a first-in-first-out (FIFO) memory buffer until there is sufficient data for one data packet to be sent according to the particular network protocol of the local network. The specific number of bytes transmitted per data packet depends on network latency requirements as selected by one of ordinary skill in the art. Once a data packet is created, the data packet is sent to the appropriate destination on the local network through the local network interface 219. Among other information, the data packet contains a source address, a destination address, and audio data. The source address identifies the location the audio data originated from and the destination address identifies the location the audio data is to be sent.
The system permits bidirectional communication by implementing a return path allowing data from the local network, through the local network interface 219, to be sent to the PSTN 203 through the multi-line PSTN trunk interface 217. Data streams from the local network are received by the local network interface 219 and translated from the protocol utilized on the local network to the protocol utilized on the PSTN 203. The conversion of data may be performed as the inverse operation of the conversion described above relating to the IP/PBX-PSTN gateway. The data stream is restored in appropriate form suitable for transmission through to either a connected telephone 211, 215 or an interface trunk 217 of the PSTN module 223, or a digital interface such as a TI line or ISDN. In addition, digital data may be converted to analog data for transmission over the PSTN 203.
Generally, the PBX switch of the present invention may be implemented with hardware or virtually. A hardware PBX has equipment located local to the user of the PBX system. The PBX switch 205 utilized may be a standard PBX manufactured by Avaya, Siemens AG, NEC, Nortel, Toshiba, Fujitsu, Vodavi, Mitel, Ericsson, Panasonic, or InterTel. In contrast, a virtual PBX has equipment located at a central telephone service provider and delivers the PBX as a service over the PSTN 203.
As illustrated in
Generally, hardware architecture is the same as that discussed above and shown in
As noted above, the recording server 209 incorporates recording software for recording and separating a signal based on the source address and/or destination address of the signal. The method utilized by the recording server 209 depends on the communication protocol utilized on the communication lines to which the recording server 209 is coupled. In the communication system contemplated by the present invention, the signal carrying audio data of a communication between at least two users may be an analog signal or a digital signal in the form of a network message. In one embodiment, the signal is an audio data transmitted according to a signaling protocol, for example the H.323 protocol described above.
An example of a communication between an outside caller and a call center agent utilizing the present system 200 is illustrated in
Similar to the process described above, when the call center agent speaks, their voice is digitized (if needed) and converted into digital data packet 235 according to the communication protocol utilized on the local network. The data packet 235 comprises a source address identifying the address of the call center agent, a destination address identifying the address of the outside caller, and second constituent audio data comprising at least a portion of the call center agent's voice. The data packet 235 is received by the local network interface 219 and translated from the communication protocol utilized on the local network to the communication protocol utilized on the PSTN 203. The conversion of data can be performed as described above. The data packet 235 is restored in appropriate form suitable for transmission through to either a connected telephone 211, 215 or an interface trunk 217 of the PSTN module 223, or a digital interface such as a Ti line or ISDN. In addition, digital data can be converted to analog data for transmission through the PSTN 203.
The recording server 209 receives either a data packet 235 comprising: the source address identifying the address of the outside caller, a destination address identifying the address of the call center agent, and the first constituent audio data comprising at least a portion of the outside callers voice; or a data packet 235 comprising a source address identifying the address of the call center agent, a destination address identifying the address of the outside caller, and second constituent audio data comprising at least a portion of the customer's agent voice. It is understood by one of ordinary skill in the art that the recording server 209 is programmed to identify the communication protocol utilized by the local network and extract the audio data within the data packet 235. In one embodiment, the recording server 209 can automatically identify the utilized communication protocol from a plurality of communication protocols. The plurality of communication protocols can be stored in local memory or accessed from a remote database.
The recording server 209 comprises recording software to record the communication session between the outside caller and the call center agent in a single data file in a stereo format. The first data file 241 has at least a first audio track 237 and a second audio track 237. Once a telephone connection is established between an outside caller and a call center agent, the recording software creates a first data file 241 to record the communication between the outside caller and the call center agent. It is contemplated that the entire communication session or a portion of the communication session can be recorded.
Upon receiving the data packet 235, the recording server 209 determines whether to record the audio data contained in the data packet 235 in either the first audio track 237 or the second audio track 239 of the first data file 241 as determined by the source address, destination address, and/or the audio data contained within the received data packet 235. Alternatively, two first data files can be created, wherein the first audio track is recorded to the one of the first data file and the second audio track is recorded to the second first data file. In one embodiment, if the data packet 235 comprises a source address identifying the address of the outside caller, a destination address identifying the address of the call center agent, and first constituent audio data, the first constituent audio data is recorded on the first audio track 237 of the first data file 241. Similarly, if the data packet 235 comprises a source address identifying the address of the call center agent, a destination address identifying the address of the outside caller, and second constituent audio data, the second constituent audio data is recorded on the second audio track 239 of the first data file 241. It should be noted the first and second constituent audio data can be a digital or analog audio waveform or a textual translation of the digital or analog waveform. The recording process is repeated until the communication link between the outside caller and call center agent is terminated.
As noted above, the recording server 209 can be connected to the trunk lines of the PSTN 203 as seen in
As shown in
Further, as illustrated in
It is known in the art that “cradle-to-grave” recording may be used to record all information related to a particular telephone call from the time the call enters the contact center to the later of: the caller hanging up or the agent completing the transaction. All of the interactions during the call are recorded, including interaction with an IVR system, time spent on hold, data keyed through the caller's key pad, conversations with the agent, and screens displayed by the agent at his/her station during the transaction.
As shown in
Even with conventional audio mining technology, application of linguistic-based psychological behavioral models directly to an audio file can be very difficult. In particular, disparities in dialect, phonemes, accents and inflections can impede or render burdensome accurate identification of words. And while it is contemplated by the present invention that mining and analysis in accordance with the present invention can be applied directly to voice data configured in audio format, in a preferred embodiment of the present invention, the voice data to be mined and analyzed is first translated into a text file. It will be understood by those of skill that the translation of audio to text and subsequent data mining may be accomplished by systems known in the art. For example, the method of the present invention may employ software such as that sold under the brand name Audio Mining SDK by Scansoft, Inc., or any other audio mining software suitable for such applications.
As shown in
According to a one embodiment of the present invention, the psychological behavioral model used to analyze the voice data is the Process Communication Model™ (“PCM”) developed by Dr. Taibi Kahler. PCM is a psychological behavioral analytic tool which presupposes that all people fall primarily into one of six basic personality types: Reactor, Workaholic, Persister, Dreamer, Rebel and Promoter. Although each person is one of these six types, all people have parts of all six types within them arranged like a six-tier configuration. Each of the six types learns differently, is motivated differently, communicates differently, and has a different sequence of negative behaviors they engage in when they are in distress. Importantly, according to PCM, each personality type of PCM responds positively or negatively to communications that include tones or messages commonly associated with another of the PCM personality types. Thus, an understanding of a communicant's PCM personality type offers guidance as to an appropriate responsive tone or message or wording.
According to the PCM Model the following behavioral characteristics are associated with the respective personality types:
These behavioral characteristics may be categorized by words, tones, gestures, postures and facial expressions, can be observed objectively with significantly high interjudge reliability. According to one embodiment shown in
In another embodiment, the present method mines for such significant words within the merged second data file 247 described above, and apply PCM to the identified words. Alternatively, the first data file 241 can be mined for significant words. As shown in
In one embodiment, the behavioral assessment data 55 includes sales effectiveness data. According to such an embodiment, the voice data is mined for linguist indicators to determine situations in which the call center agent made a sale or failed at an opportunity to make a sale. The failed opportunities may include failure to make an offer for a sale, making an offer and failure in completing the sale, or failure to make a cross-sale.
The resultant behavioral assessment data 55 is stored in a database so that it may subsequently be used to comparatively analyze against behavioral assessment data derived from analysis of the other of the first and second constituent voice data 56. The software considers the speech segment patterns of all parties in the dialog as a whole to refine the behavioral and distress assessment data of each party, making sure that the final distress and behavioral results are consistent with patterns that occur in human interaction. Alternatively, the raw behavioral assessment data 55 derived from the analysis of the single voice data may be used to evaluate qualities of a single communicant (e.g., the customer or agent behavioral type, etc.). The results generated by analyzing voice data through application of a psychological behavioral model to one or both of the first and second constituent voice data can be graphically illustrated as discussed in further detail below.
It should be noted that, although one preferred embodiment of the present invention uses PCM as a linguistic-based psychological behavioral model, it is contemplated that any known linguistic-based psychological behavioral model be employed without departing from the present invention. It is also contemplated that more than one linguistic-based psychological behavioral model be used to analyze one or both of the first and second constituent voice data.
In addition to the behavioral assessment of voice data, the method of the present invention may also employ distress analysis to voice data. As may be seen in
As shown in
According to a preferred embodiment of the invention as shown in
Generally, call assessment data is comprised of behavioral assessment data, phone event data and distress assessment data. The resultant call assessment data may be subsequently viewed to provide an objective assessment or rating of the quality, satisfaction or appropriateness of the interaction between an agent and a customer. In the instance in which the first and second constituent voice data are comparatively analyzed, the call assessment data may generate resultant data useful for characterizing the success of the interaction between a customer and an agent.
Thus, as shown in
The software also includes a code segment for separately applying a non-linguistic based analytic tool to each of the separated first and second constituent voice data, and to generate phone event data corresponding to the analyzed voice data 50. A code segment translates each of the separated first and second constituent voice data into text format and stores the respective translated first and second constituent voice data in a first and second text file 52. A code segment analyzes the first and second text files by applying a predetermined linguistic-based psychological behavioral model thereto 54. The code segment generates either or both of behavioral assessment data and distress assessment data corresponding to each of the analyzed first and second constituent voice data 54.
A code segment is also provided for generating call assessment data 56. The call assessment data is resultant of the comparative analysis of the behavioral assessment data and distress assessment data corresponding to the analyzed first voice data and the behavioral assessment data and distress assessment data corresponding to the analyzed second voice data. A code segment then transmits an output of event data corresponding to at least one identifying indicia (e.g., call type, call time, agent, customer, etc.) 58. This event data is comprised of a call assessment data corresponding to at least one identifying indicia (e.g., a CSR name, a CSR center identifier, a customer, a customer type, a call type, etc.) and at least one predetermined time interval. Now will be described in detail the user interface for accessing and manipulating the event data of an analysis.
In one embodiment of the present invention shown in
The method and system of the present invention is useful in improving the quality of customer interactions with agents and ultimately customer relationships. In use, a customer wishing to engage in a service call, a retention call or a sales will call into (or be called by) a contact center. When the call enters the contact center it will be routed by appropriate means to a call center agent. As the interaction transpires, the voice data will be recorded as described herein. Either contemporaneously with the interaction, or after the call interaction has concluded, the recorded voice data will be analyzed as described herein. The results of the analysis will generate call assessment data comprised of behavioral assessment data, distress assessment data and phone event data. This data may be subsequently used by a supervisor or trainer to evaluate or train an agent, or take other remedial action such as call back the customer, etc.
As indicated above, it is often desirable to train call center agents to improve the quality of customer interactions with agents. Thus, as shown in
The pre-recorded first communications to be used in training the call center agent are identified by comparatively analyzing the identifying criteria in view of event data 602. The event data can include behavioral assessment data, phone event data, and/or distress assessment data of the communications. For example, the identifying criteria can be phone event data such as excessive hold/silence time (e.g., caller is placed on hold for greater than predetermined time—e.g., 90 seconds—or there is a period of silence greater than a predetermined amount time—e.g., 30 seconds) or long duration for call type (i.e., calls that are a predetermined percentage—e.g., 150%—over the average duration for a given call type). Additionally, the identifying criteria can be distress assessment data such as upset customer, unresolved issue or program dissatisfaction or another data associated with distress assessment data. It is contemplated that the system identify potential identifying criteria based on an analysis of the behavioral assessment data, phone event data, and/or distress assessment data of the communications.
From this comparative analysis, coaching assessment data is generated. The coaching assessment data relates to the identified pre-recorded first communications corresponding to the identifying criteria 604. For example, if the identifying criteria is excessive hold/silence time, the coaching assessment data includes pre-recorded first communications having excessive hold/silence time. The resulting coaching assessment data is stored in a database so that it subsequently can be used to evaluate and/or train the call center agent to improve performance in view of the identifying criteria. Thus, if the identifying criteria were excessive hold/silence time, the call center agent would be trained to reduce the amount of excessive hold/silence time calls.
The coaching assessment data can further include first performance data related to the overall performance of the call center agent with respect to the identifying criteria. The first performance data can be derived from an analysis of the identified prerecorded first communication with respect to all communications—i.e., identified pre-recorded first communication percentage (the percentage of identified pre-recorded first communications out of total number of communications) or identified pre-recorded communication (total number of identified pre-recorded first communications). A first performance score for each identified pre-recorded first communication may be generated by analyzing each identified pre-recorded first communication and the corresponding first performance data. A composite first performance score may be generated corresponding to the aggregate of the first performance scores of the plurality of identified pre-recorded first communications.
The coaching assessment data can be comparatively analyzed against a predetermined criteria value threshold to evaluate the call center agent's performance or against event data derived from a plurality of identified second pre-recorded communications to determine if training was effective 606. As discussed above, the threshold may be a predetermined criteria set by the call center, the customer, or other objective or subjective criteria. Alternatively, the threshold may set by the performance score.
In order to evaluate a call center agent, the coaching assessment data is comparatively analyzed against a predetermined identifying criteria value threshold. In one embodiment, the first performance data related to the identified pre-recorded first communication is comparatively analyzed with the predetermined identifying criteria value threshold 614. Based on the resultant comparative analysis, a notification is generated 616. For example, the percentage of excessive hold/silence calls in the pre-recorded first communications is compared with the identifying criteria value threshold. If the percentage of excessive hold/silence calls in the pre-recorded first communications is greater than the identifying criteria value threshold, the call center agent is underperforming and a notification is automatically generated 616.
In one embodiment, the coaching assessment data includes sales effectiveness data. The sales effectiveness data related to the identified pre-recorded first communications is comparatively analyzed against a predetermined identifying criteria value threshold. For example, the percentage of calls that the call center agent failed to make an offer for a cross-sale is compared with the identifying criteria value threshold. If the percentage of calls that the call center agent failed to make an offer for a cross-sale is greater than the identifying criteria value threshold, the call center agent is underperforming, and a notification is generated.
In another embodiment, the first performance score for each identified pre-recorded first communication is compared with the second performance score for the identifying criteria value threshold. In this case, if a predetermined number of first performance scores are less than (or greater than) the identifying criteria value threshold, a notification is generated. In another embodiment, the composite first performance score for the identified pre-recorded first communications is compared with the second performance score for the identifying criteria value threshold. If the first composite performance score is less than (or greater than) the second composite performance score, a notification is generated.
Preferably, the notification is an electronic communication, such as an email transmitted to a supervisor or trainer indicating that the call center agent is underperforming. The notification may be any other type of communication, such as a letter, a telephone call, or an automatically generated message on a website. The notification permits the supervisor or trainer to take remedial action, such as set up a training session for the call center agent. In one embodiment, the coaching assessment data related to an identifying criteria can be comparatively analyzed against the identifying criteria value threshold for a plurality call center agents. Based on the collective comparative analysis, a notification is generated if a predetermined number or percentage of call center agents are underperforming. In this manner, the trainer or supervisor is notified that multiple call center agents need to be trained with respect to the same criteria.
As noted above, the identifying criteria of the coaching assessment data can also be used to train a call center agent. In order to determine if the call center agent training was effective, the coaching assessment data can be comparatively analyzed against event data derived from a plurality of identified second pre-recorded communications. To determine if the training was effective, the second pre-recorded communications should have taken place after the call center agent training session. The pre-recorded second communications are identified according to the same identifying criteria used to identify the pre-recorded first communications in the coaching assessment data 608. Similar to the pre-recorded first communications, the pre-recorded second communications can be one of the separated constituent voiced data or the subsequently generated audio file containing at least some of the remerged audio waveform of the original audio waveform.
Second performance data related to the overall performance of the call center agent with respect to the pre-recorded second communications can be generated. As with the first performance data, the second performance data can be derived from an analysis of the identified pre-recorded second communication with respect to all communications—i.e., identified pre-recorded second communication percentage (the percentage of identified pre-recorded second communications out of total number of communications) or identified pre-recorded communication (total number of identified pre-recorded second communications). A second performance score for each identified pre-recorded second communication may be generated by analyzing each identified pre-recorded second communication and the corresponding second performance data. A composite second performance score may be generated corresponding to the aggregate second performance score for each of the plurality of identified pre-recorded second communications.
The second performance data related to the identified pre-recorded second communications is comparatively analyzed with the first performance data of the coaching assessment data 610. Based on the resultant comparative analysis, a notification is generated 612.
In one embodiment, the identified pre-recorded second communication percentage is compared with the identified pre-recorded first communication percentage. For example, the percentage of excessive hold/silence calls in the pre-recorded first communications that took place before the training session is compared with the percentage of excessive hold/silence calls in the pre-recorded second communications that took place after the training session 610. If the percentage of excessive hold/silence calls in the pre-recorded second communications is less than the percentage of excessive hold/silence calls in the pre-recorded first communications, the training session was successful. Conversely, if the percentage of excessive hold/silence calls in the pre-recorded second communications is greater than the percentage of excessive hold/silence calls in the pre-recorded first communications, the training session was unsuccessful and a notification is automatically generated 612.
In another embodiment, the first performance score for each identified pre-recorded first communication is compared with the second performance score for each identified pre-recorded second communication. In this case, if a predetermined number of second performance scores are less than (or greater than) a predetermined number of first performance scores, a notification is generated. In another embodiment, the composite first performance score for the identified pre-recorded first communications is compared with the composite second performance score for the identified pre-recorded second communications. If the second composite performance score is less than (or greater than) the first composite performance score, a notification is generated.
Preferably, the notification is an electronic communication, such as an email transmitted to a supervisor or trainer indicating that the training session for the call center agent was unsuccessful. The notification permits the supervisor or trainer to take remedial action, such as set up another training session for the call center agent. In one embodiment, the coaching assessment data related to an identifying criteria can be comparatively analyzed against event data derived from a plurality of identified second pre-recorded communications for a plurality of call center agents. Based on the collective comparative analysis, a notification is generated if a predetermined number or percentage of call center agents have unsuccessful training sessions. In this manner, the trainer or supervisor is notified that multiple call center agents need to be trained with respect to the same criteria.
Graphical and pictorial analysis of the call assessment data (and event data) is accessible through a portal by a subsequent user (e.g., a supervisor, training instructor or monitor) through a graphical user interface. A user of the system 1 described above interact with the system 1 via a unique graphical user interface (“GUI”) 400. The GUI 400 enables the user to navigate through the system 1 to obtain desired reports and information regarding the caller interaction events stored in memory. The GUI 400 can be part of a software program residing in whole or in part in the a computer 12, or it may reside in whole or in part on a server coupled to a computer 12 via a network connection, such as through the Internet or a local or wide area network (LAN or WAN). Moreover, a wireless connection can be used to link to the network.
In the embodiment shown in
As shown in
Referring to
The computer program associated with the present invention can be utilized to generate a large variety of reports relating to the recorded call interaction events, the statistical analysis of each event and the analysis of the event from the application of the psychological model. The GUI 400 is configured to facilitate a user's request for a specific report and to visually display the reports on the user's display.
The REVIEW tab 412 enables the user to locate one or more caller interaction events (a caller interaction event is also herein referred to as a “call”) stored in the memory. The REVIEW tab 412 includes visual date fields or links 416, 418 for inputting a “from” and “to” date range, respectively. Clicking on the links 416, 418 will call a pop-up calendar for selecting a date. A drop down menu or input field for entering the desired date can also be used.
The caller interaction events are divided into folders and listed by various categories. The folders can be identified or be sorted by the following event types: upset customer/issue unresolved; upset customer/issued resolved; program dissatisfaction; long hold/silence (e.g., caller is placed on hold for greater than a predetermined time—e.g., 90 seconds—or there is a period of silence greater than a predetermined amount of time—e.g., 30 seconds); early hold (i.e., customer is placed on hold within a predetermined amount of time—e.g., 30 seconds—of initiating a call); no authentication (i.e., the agent does not authorize or verify an account within a predetermined time—e.g., the first three minutes of the call); inappropriate response (e.g., the agent exhibits inappropriate language during the call); absent agent (i.e., incoming calls where the agent does not answer the call); long duration for call type (i.e., calls that are a predetermined percentage over—e.g., 150%—the average duration for a given call type); and transfers (i.e., calls that end in a transfer). The categories include: customers, CSR agents, and customer service events.
The REVIEW tab 412 includes a visual link to a customer's folder 420. This includes a list of calls subdivided by customer type. The customer folder 420 may include subfolders for corporate subsidiaries, specific promotional programs, or event types (i.e., upset customer/issue unresolved, etc.).
The REVIEW tab 412 also includes a visual link to call center or CSR agent folders 422. This includes a list of calls divided by call center or CSR agents. The initial breakdown is by location, followed by a list of managers, and then followed by the corresponding list of agents. The REVIEW tab 412 also includes a visual link to a customer service folders 424. This includes a list of calls subdivided by caller events, call center or CSR agent, and other relevant events.
The REVIEW tab 412 also includes a visual SEARCH link 426 to enable the user to search for calls based on a user-defined criteria. This includes the date range as discussed above. Additionally, the user can input certain call characteristics or identifying criteria. For example, the user can input a specific call ID number and click the SEARCH link 426. This returns only the desired call regardless of the date of the call. The user could choose an agent from a drop down menu or list of available agents. This returns all calls from the selected agent in the date range specified. The user could also choose a caller (again from a drop down menu or list of available callers). This returns all calls from the selected caller(s) within the date range.
The results from the search are visually depicted as a list of calls 428 as shown in
The call page 432 also includes a conversation visual field 434 for displaying a time-based representation of characteristics of the call based on the psychological behavioral model. The call page 432 displays a progress bar 436 that illustrates call events marked with event data shown as, for example, colored points and colored line segments. A key 440 is provided explaining the color-coding.
The call page 432 further includes visual control elements for playing the recorded call. These include: BACK TO CALL LIST 442; PLAY 444; PAUSE 446; STOP 448; RELOAD 450; REFRESH DATA 452 and START/STOP/DURATION 454. The START/STOP/DURATION 454 reports the start, stop and duration of distinct call segments occurring in the call. The distinct call segments occur when there is a transition from a caller led conversation to an agent led conversation—or vice versa—and/or the nature of the discussion shifts to a different topic).
The REVIEW tab 412 also provides a visual statistics link 456 for displaying call statistics as shown in
The REVIEW tab 412 also provides a comments link 458. This will provide a supervisor with the ability to document comments for each call that can be used in follow-up discussions with the appropriate agent.
The METRICS tab 414 allows the user to generate and access Reports of caller interaction event information. The METRICS tab 414 includes two folders: a standard Reports folder 460 and an on-demand Reports folder. The standard reports folder 460 includes pre-defined call performance reports generated by the analytics engine for daily, weekly, monthly, quarterly, or annual time intervals. These Reports are organized around two key dimensions: caller satisfaction and agent performance. The on-demand reports folder 462 includes pre-defined call performance reports for any time interval based around two key dimensions: caller and agent.
The GUI 400 facilitates generating summary or detailed Reports as shown in
A CLIENT SATISFACTION REPORT 466 is shown in
The CLIENT SATISFACTION REPORT 466 includes a number of calls column 470 (total number of calls analyzed for the associated client during the specified reporting interval), an average duration column 472 (total analyzed talk time for all calls analyzed for the associated client divided by the total number of calls analyzed for the client), a greater than (“>”) 150% duration column 474 (percentage of calls for a client that exceed 150% of the average duration for all calls per call type), a greater than 90 second hold column 476 (percentage of calls for a client where the call center agent places the client on hold for greater than 90 seconds), a greater than 30 second silence column 478 (percentage of calls for a client where there is a period of continuous silence within a call greater than 30 seconds), a customer dissatisfaction column 480 (percentage of calls for a client where the caller exhibits dissatisfaction or distress—these calls are in the dissatisfied caller and upset caller/issue unresolved folders), a program dissatisfaction column 482 (percentage of calls where the caller exhibits dissatisfaction with the program), and a caller satisfaction column 484 (a composite score that represents overall caller satisfaction for all calls for the associated client).
The caller satisfaction column 484 is defined by a weighted percentage of the following criteria as shown in
The user can generate a summary by CALL TYPE REPORT 486 as shown in
The user can generate a NON-ANALYZED CALLS REPORT 492 as shown in
As shown in
A PROGRAM REPORT 498 is shown in
The user can also generate a number of CALL CENTER or CSR AGENT REPORTS. These include the following summary reports: corporate summary by location; CSR agent performance; and non-analyzed calls. Additionally, the user can generate team reports. The team Reports can be broken down by location, team or agent.
A CORPORATE SUMMARY BY LOCATION REPORT 502 is shown in
The values 526 in the score column 524 are based on the weighted criteria shown in
A CSR PERFORMANCE REPORT 528 is shown in
A LOCATION BY TEAM REPORT 532 is shown in
The COACHING tab 620 enables a user to locate one of more caller interaction events to evaluate and train call center agents to improve the quality of customer interactions with the agents. The COACHING tab 620 includes visual date fields 622, 624 for inputting a “from” and “to date”, respectively. Clicking on the links 416, 418 will call a pop-up calendar for selecting a date. A drop down menu or input field for entering the desired date can also be used.
The COACHING tab 620 displays caller interaction event information. The caller interaction event information includes check boxes for selecting the caller interaction event information as the identifying criteria 626. Based on the selection of the identifying criteria 626, a plurality of pre-recorded first communications between outside caller and a specific call center agent are identified 628. Information relating to the identified criteria is also displayed 630. A value may be entered in visual call field 632 to specify the number of pre-identified calls to display.
The COACHING tab 620 includes a coaching page 634 to train the call center agent to improve performance in view of the identifying criteria, as illustrated in
Referring to
In a still further embodiment of the present invention, a method and system for searching and selecting and/or navigating to specific telephone communications is provided. Specifically, stored communications may be searched based on metrics, or conditions, of interest. For example, a user may provide search criteria to the computer program of the present invention, and all telephone communications that satisfy the search criteria may be listed and displayed for the user to select. Alternatively, a specific number of communication that are less than the total number of communications may be listed and displayed for selection by the user.
In one embodiment, a method for searching and selecting and/or navigating to specific recorded communications is provided. As stated above, communications between a customer and a contact center may be digitized and analyzed, and assessment data is assigned to the communication. For example, agent performance information may be assigned to the digitized communication indicating specific information relating to how the contact center agent performed on the communication. Other data assigned to the communication may relate to customer satisfaction information, business process improvement information, or any other information created after analysis of the communication using the methods and systems provided herein.
In a first step of this embodiment, all communications, typically telephonic communications, may be recorded over a given time period. For example, the time period may be any time period, such as minutes, hours, days, etc., and assessment data may be assigned to each communication using the analysis systems and methods of the present invention as described above. Of that set of communications that are recorded over a specified time period, a number of communications may be culled based on high level criteria, in a second step of this embodiment. In a third step of this embodiment, the communications may be selected based on their categorization according to the present invention. For example, communications based on whether they relate to “service coaching” may be cut from the set of communications over the given time period. These communications may related to how the agent provided service to customers, such as whether the call was designated as too long, or whether the agent was given a low agent score based on analysis of the communication. In addition, communications based on whether they relate to “sales coaching” may be culled from the set of communications over the given time period. These communications may relate to whether the communication related to a sales opportunity.
Further, communications based on whether they related to “collections coaching” may be culled from the set of communications over the given time period. These communications may relate to whether the communication related to a collections opportunity. In addition, communications based on “voice of the customer” may be culled from the set of communications over the given time period. These communications may relate to whether the communication related to customer satisfaction or dissatisfaction. Of course, any high level criteria may be established and utilized to cull the set of communications from a given time period, and the invention should not be limited as herein described.
After the first cut of communications in the third step, the computer program may proceed under a “manual path” or an “automatic path”. If the manual path is designated or otherwise selected by a user, a graphical user interface (GUI) may be displayed to select conditions or metrics of interest in the culled communications from the given time period in a fourth step. Examples of GUIs useful for the present embodiment of the invention described herein, and further described below. In yet a fifth step, a user may select one or more conditional metrics that may be utilized to select communications that match the one or more conditional metrics. For example, a user may wish to find communications based on whether the call was inbound or outbound, whether the customer had previously contacted the company before, the gender of the customer, or other criteria that may be utilized to find and display communications having characteristics or assessment data matching the criteria selected.
If the “automatic path” is selected by the user, than previously determined or programmed metric conditions or criteria may be applied against the communications culled from the given time period via an automated criteria selection step.
Whether the “manual” path or the “automatic” path is chosen, the computer program of the present embodiment described herein may then display a list of communications that meet or otherwise match with the specified criterion or criteria designated by the user. The list may be displayed in the GUI, whereupon the user may then select one or more of the communications, and navigate to the specific communication examples for playback or for further analysis.
In another embodiment related to the logic, the system described herein may utilize “best fit” logic to search for and list communications that match the specified criterion or criteria. Specifically, a method is provided for determining the “best fit” of communications to specified criteria or metrics. In a first step, a “bit map” for each communication is constructed to specify which metric conditions or criteria are met. For example, there may be nine metric conditions or criteria utilized to determine matches of communications. The “bit map” may simply be a string of bits or logic characters, designating whether the communication matches the specific metric conditions or criteria designated. If all nine metric conditions or criteria are met, then each bit within the bit map may have a positive or “1” designation. Alternatively, if no metric conditions or criteria are met by the communication, each bit within the bit map may be designated with a negative or “0” designation. If, for example, the first six metric conditions or criteria match the communication, but the last three do not, then the bit map may have 6 positive or “1” bits followed by 3 negative or “0” bits.
The bit map may then be utilized to determine the communications that best fit the metric conditions or criteria. Specifically, the computer program may then build a result set based on all calls that have the appropriate “bit map” signature. All communications in the result set may be provided in the result set, or only those communications having a certain number of positive or “1” bits may be ordered. For example, a user may wish to only include those communications with an “all true” result (i.e., the bit map consists of all “1s” in the bit map. Alternatively, the user may decide to build a set of communications having 8 “1s”.
After the computer program builds the result set, the result set is then ordered from “best to worst.” The order is provided with the communications having the best fit provided first and the worst fit provided last. In the event of a bit set “tie” (where the bit set has the same number of positive results or 1s, each bit may be weighted so that certain positive bits cause the communication to rank higher than other communications with the same number of positive bits, but for different metric conditions or criteria. Alternatively, communications having the same number of positive bits may be ordered randomly, or by date, or by any other condition apparent to one having ordinary skill in the art.
The user may further designate or select a specific number of results to display, whereupon the list is cutoff at the specified number of examples. The list is then displayed to the user via the GUI. For example, the user may wish to have displayed only one communication that best matches the metric conditions or criteria applied thereto. The communication having the best bit map is then displayed for the user to select for viewing assessment data assigned thereto, for listening to or otherwise further analyzing.
In yet another embodiment, an exemplary sample GUI can illustrate a set of metric conditions or criteria that may be selected and applied to find matching communications. In this example, a time period is selected by inputting a date into a FROM field and a date into a TO field, thereby designating a time period. A first cut of calls has been done by user selected high-level criteria, with the user selecting “Voice of the People” under calls relating to “Customer Service.” In this exemplary GUI embodiment, the computer program has displayed on the GUI that within that time period, the “agents received 1470 calls of which 29% had customer dissatisfaction” and proceeds to list user-selectable characteristics. Any one, some or all of these characteristics provided in the list of user-selectable characteristics may then be selected by the user, and specified to provide metric conditions or criteria for searching for communications that match the selected and specified metric conditions or criteria. In the GUI example, one metric condition or criterion is selected, “Had the following personalities: 25% Thoughts.” The number of calls is designated as “1” by the user, so the list generated by the computer program and displayed on the GUI displays only one result, which result has the best fit for matching the selected metric condition or criterion. The displayed result in the list generated by the computer program based on the metric condition or criterion selected by the user may then be selected for viewing assessment data assigned thereto, listening thereto, or otherwise analyzing the same.
While the specific embodiments have been illustrated and described, numerous modifications come to mind without significantly departing from the spirit of the invention, and the scope of protection is only limited by the scope of the accompanying claims.
This application is a continuation of U.S. patent application Ser. No. 15/230,032, filed Aug. 5, 2016, now allowed, which is a continuation of U.S. patent application Ser. No. 14/960,194, filed Dec. 4, 2015, now U.S. Pat. No. 9,432,511, which is a continuation of U.S. patent application Ser. No. 12/079,828, filed Mar. 28, 2008, now U.S. Pat. No. 9,225,841, which claims priority to U.S. Provisional Patent Application No. 60/921,109, filed Mar. 30, 2007, and which is also a continuation-in-part of U.S. patent application Ser. No. 11/365,432, filed Mar. 1, 2006, now U.S. Pat. No. 8,094,790, which is a continuation-in-part of U.S. patent application Ser. No. 11/131,844, filed May 18, 2005, now abandoned, the disclosure of each of which is hereby incorporated herein by reference thereto.
| Number | Name | Date | Kind |
|---|---|---|---|
| 3851121 | Marvin | Nov 1974 | A |
| 3855416 | Fuller | Dec 1974 | A |
| 3855418 | Fuller | Dec 1974 | A |
| 3971034 | Bell, Jr. et al. | Jul 1976 | A |
| 4093821 | Williamson | Jun 1978 | A |
| 4142067 | Williamson | Feb 1979 | A |
| 4377158 | Friedman et al. | Mar 1983 | A |
| 4490840 | Jones | Dec 1984 | A |
| 4694483 | Cheung | Sep 1987 | A |
| 4811131 | Sander et al. | Mar 1989 | A |
| 4827461 | Sander | May 1989 | A |
| 4835630 | Freer | May 1989 | A |
| 4851937 | Sander | Jul 1989 | A |
| 4853952 | Jachmann et al. | Aug 1989 | A |
| 4864432 | Freer | Sep 1989 | A |
| 4873592 | Dulaff et al. | Oct 1989 | A |
| 4888652 | Sander | Dec 1989 | A |
| 4891835 | Leung et al. | Jan 1990 | A |
| 4893197 | Howells et al. | Jan 1990 | A |
| 4958367 | Freer et al. | Sep 1990 | A |
| 5003575 | Chamberlin et al. | Mar 1991 | A |
| 5008835 | Jachmann et al. | Apr 1991 | A |
| 5148483 | Silverman | Sep 1992 | A |
| 5148493 | Bruney | Sep 1992 | A |
| 5206903 | Kohler et al. | Apr 1993 | A |
| 5216744 | Alleyne et al. | Jun 1993 | A |
| 5239460 | LaRoche | Aug 1993 | A |
| 5274738 | Daly et al. | Dec 1993 | A |
| 5299260 | Shaio | Mar 1994 | A |
| 5339203 | Henits et al. | Aug 1994 | A |
| 5396371 | Henits et al. | Mar 1995 | A |
| 5446603 | Henits et al. | Aug 1995 | A |
| 5448420 | Henits et al. | Sep 1995 | A |
| 5457782 | Daly et al. | Oct 1995 | A |
| 5467391 | Donaghue et al. | Nov 1995 | A |
| 5500795 | Powers et al. | Mar 1996 | A |
| 5535256 | Maloney et al. | Jul 1996 | A |
| 5559875 | Bieselin et al. | Sep 1996 | A |
| 5561707 | Katz | Oct 1996 | A |
| 5577254 | Gilbert | Nov 1996 | A |
| 5590171 | Howe et al. | Dec 1996 | A |
| 5590188 | Crockett | Dec 1996 | A |
| 5594790 | Curren et al. | Jan 1997 | A |
| 5594791 | Szlam et al. | Jan 1997 | A |
| 5621789 | McCalmont et al. | Apr 1997 | A |
| 5633916 | Goldhagen et al. | May 1997 | A |
| 5646981 | Klein | Jul 1997 | A |
| 5696811 | Maloney et al. | Dec 1997 | A |
| 5710884 | Dedrick | Jan 1998 | A |
| 5712954 | Dezonno | Jan 1998 | A |
| 5717742 | Hyde-Thomson | Feb 1998 | A |
| 5721827 | Logan et al. | Feb 1998 | A |
| 5724420 | Torgrim | Mar 1998 | A |
| 5732216 | Logan et al. | Mar 1998 | A |
| 5734890 | Case et al. | Mar 1998 | A |
| 5737405 | Dezonno | Apr 1998 | A |
| 5757904 | Anderson | May 1998 | A |
| 5764728 | Ala et al. | Jun 1998 | A |
| 5768513 | Kuthyar et al. | Jun 1998 | A |
| 5784452 | Carney | Jul 1998 | A |
| 5790798 | Beckett, II et al. | Aug 1998 | A |
| 5799063 | Krane | Aug 1998 | A |
| 5809250 | Kisor | Sep 1998 | A |
| 5815551 | Katz | Sep 1998 | A |
| 5818907 | Maloney et al. | Oct 1998 | A |
| 5818909 | Van Berkum et al. | Oct 1998 | A |
| 5819005 | Daly et al. | Oct 1998 | A |
| 5822306 | Catchpole | Oct 1998 | A |
| 5822400 | Smith | Oct 1998 | A |
| 5822410 | McCausland et al. | Oct 1998 | A |
| 5822744 | Kesel | Oct 1998 | A |
| 5825869 | Brooks et al. | Oct 1998 | A |
| 5828730 | Zebryk et al. | Oct 1998 | A |
| 5841966 | Irribarren | Nov 1998 | A |
| 5845290 | Yoshii | Dec 1998 | A |
| 5848396 | Gerace | Dec 1998 | A |
| 5854832 | Dezonno | Dec 1998 | A |
| 5857175 | Day et al. | Jan 1999 | A |
| 5859898 | Checco | Jan 1999 | A |
| 5864616 | Hartmeier | Jan 1999 | A |
| 5870549 | Bobo, II | Feb 1999 | A |
| 5875436 | Kikinis | Feb 1999 | A |
| 5878384 | Johnson et al. | Mar 1999 | A |
| 5884032 | Bateman et al. | Mar 1999 | A |
| 5884262 | Wise et al. | Mar 1999 | A |
| 5894512 | Zenner | Apr 1999 | A |
| 5897616 | Kanevsky et al. | Apr 1999 | A |
| 5903641 | Tonisson | May 1999 | A |
| 5910107 | Iliff | Jun 1999 | A |
| 5911776 | Guck | Jun 1999 | A |
| 5914951 | Bentley et al. | Jun 1999 | A |
| 5915001 | Uppaluru | Jun 1999 | A |
| 5915011 | Miloslavsky | Jun 1999 | A |
| 5923746 | Baker | Jul 1999 | A |
| 5926538 | Deryugen | Jul 1999 | A |
| 5930764 | Melchione et al. | Jul 1999 | A |
| 5937029 | Yosef | Aug 1999 | A |
| 5940476 | Morgenstein et al. | Aug 1999 | A |
| 5940494 | Rafacz | Aug 1999 | A |
| 5940792 | Hollier | Aug 1999 | A |
| 5943416 | Gisby | Aug 1999 | A |
| 5945989 | Freishtat | Aug 1999 | A |
| 5946375 | Pattison et al. | Aug 1999 | A |
| 5946388 | Walker et al. | Aug 1999 | A |
| 5951643 | Shelton et al. | Sep 1999 | A |
| 5953389 | Pruett | Sep 1999 | A |
| 5953406 | LaRue et al. | Sep 1999 | A |
| 5964839 | Johnson et al. | Oct 1999 | A |
| 5978465 | Corduroy et al. | Nov 1999 | A |
| 5987415 | Breese et al. | Nov 1999 | A |
| 5991735 | Gerace | Nov 1999 | A |
| 6003013 | Boushy et al. | Dec 1999 | A |
| 6006188 | Bogdashevsky et al. | Dec 1999 | A |
| 6009163 | Nabkel et al. | Dec 1999 | A |
| 6014647 | Nizzari et al. | Jan 2000 | A |
| 6021428 | Miloslavsky | Feb 2000 | A |
| 6026397 | Sheppard | Feb 2000 | A |
| 6029153 | Bauchner et al. | Feb 2000 | A |
| 6058163 | Pattison et al. | May 2000 | A |
| 6064731 | Flockhart et al. | May 2000 | A |
| 6078891 | Riordan | Jun 2000 | A |
| 6108711 | Beck et al. | Aug 2000 | A |
| 6128380 | Shaffer et al. | Oct 2000 | A |
| 6151571 | Petrushin | Nov 2000 | A |
| 6173053 | Bogart et al. | Jan 2001 | B1 |
| 6185534 | Breese et al. | Feb 2001 | B1 |
| 6195426 | Bolduc et al. | Feb 2001 | B1 |
| 6205215 | Dombakly | Mar 2001 | B1 |
| 6212502 | Ball et al. | Apr 2001 | B1 |
| 6243684 | Stuart et al. | Jun 2001 | B1 |
| 6246752 | Escheider et al. | Jun 2001 | B1 |
| 6249570 | Glowny et al. | Jun 2001 | B1 |
| 6252946 | Glowny et al. | Jun 2001 | B1 |
| 6252947 | Diamond et al. | Jun 2001 | B1 |
| 6275806 | Pertrushin | Aug 2001 | B1 |
| 6286030 | Wenig et al. | Sep 2001 | B1 |
| 6289094 | Miloslavsky | Sep 2001 | B1 |
| 6295353 | Flockhart et al. | Sep 2001 | B1 |
| 6330025 | Arazi et al. | Dec 2001 | B1 |
| 6334110 | Walter et al. | Dec 2001 | B1 |
| 6345094 | Khan et al. | Feb 2002 | B1 |
| 6353810 | Petrushin | Mar 2002 | B1 |
| 6363145 | Shaffer et al. | Mar 2002 | B1 |
| 6363346 | Walters | Mar 2002 | B1 |
| 6366658 | Bjornberg et al. | Apr 2002 | B1 |
| 6366666 | Bengston et al. | Apr 2002 | B2 |
| 6370574 | House et al. | Apr 2002 | B1 |
| 6389132 | Price | May 2002 | B1 |
| 6392666 | Hong et al. | May 2002 | B1 |
| 6404857 | Blair et al. | Jun 2002 | B1 |
| 6404883 | Hartmeier | Jun 2002 | B1 |
| 6411687 | Bohacek et al. | Jun 2002 | B1 |
| 6411708 | Kahn | Jun 2002 | B1 |
| 6424709 | Doyle et al. | Jul 2002 | B1 |
| 6427137 | Perturshin | Jul 2002 | B2 |
| 6434230 | Gabriel | Aug 2002 | B1 |
| 6434231 | Neyman et al. | Aug 2002 | B2 |
| 6446119 | Olah et al. | Sep 2002 | B1 |
| 6466663 | Ravenscroft et al. | Oct 2002 | B1 |
| 6480601 | McLaughlin | Nov 2002 | B1 |
| 6480826 | Petrushin | Nov 2002 | B2 |
| 6490560 | Ramaswamy et al. | Dec 2002 | B1 |
| 6510220 | Beckett et al. | Jan 2003 | B1 |
| 6535601 | Flockhart et al. | Mar 2003 | B1 |
| 6542156 | Hong et al. | Apr 2003 | B1 |
| 6542602 | Elazar | Apr 2003 | B1 |
| 6553112 | Ishikawa | Apr 2003 | B2 |
| 6556976 | Callen | Apr 2003 | B1 |
| 6567504 | Kercheval et al. | May 2003 | B1 |
| 6567787 | Walker et al. | May 2003 | B1 |
| 6574605 | Sanders et al. | Jun 2003 | B1 |
| 6598020 | Kleindienst et al. | Jul 2003 | B1 |
| 6600821 | Chan et al. | Jul 2003 | B1 |
| 6601031 | O'Brien | Jul 2003 | B1 |
| 6611498 | Baker et al. | Aug 2003 | B1 |
| 6628777 | McIllwaine et al. | Sep 2003 | B1 |
| 6643622 | Stuart et al. | Nov 2003 | B2 |
| 6647372 | Brady et al. | Nov 2003 | B1 |
| 6658388 | Kleindienst et al. | Dec 2003 | B1 |
| 6658391 | Williams et al. | Dec 2003 | B1 |
| 6662156 | Bartosik | Dec 2003 | B2 |
| 6665644 | Kanevsky et al. | Dec 2003 | B1 |
| 6674447 | Chiang et al. | Jan 2004 | B1 |
| 6691073 | Erten et al. | Feb 2004 | B1 |
| 6697457 | Perturshin | Feb 2004 | B2 |
| 6700972 | McGugh et al. | Mar 2004 | B1 |
| 6711543 | Cameron | Mar 2004 | B2 |
| 6721417 | Saito et al. | Apr 2004 | B2 |
| 6721704 | Strubbe et al. | Apr 2004 | B1 |
| 6724887 | Eilbacher | Apr 2004 | B1 |
| 6728345 | Glowny et al. | Apr 2004 | B2 |
| 6731307 | Strubbe et al. | May 2004 | B1 |
| 6731744 | Khuc et al. | May 2004 | B1 |
| 6735298 | Keyman et al. | May 2004 | B2 |
| 6741697 | Benson et al. | May 2004 | B2 |
| 6744877 | Edwards | Jun 2004 | B1 |
| 6751297 | Nelkenbaum | Jun 2004 | B2 |
| 6757361 | Blair et al. | Jun 2004 | B2 |
| 6760414 | Schurko et al. | Jul 2004 | B1 |
| 6760727 | Schroeder et al. | Jul 2004 | B1 |
| 6766012 | Crossley | Jul 2004 | B1 |
| 6775372 | Henits | Aug 2004 | B1 |
| 6782093 | Uckun | Aug 2004 | B2 |
| 6785369 | Diamond et al. | Aug 2004 | B2 |
| 6785370 | Glowny et al. | Aug 2004 | B2 |
| 6788768 | Saylor et al. | Sep 2004 | B1 |
| 6798876 | Bala | Sep 2004 | B1 |
| 6839671 | Attwater et al. | Jan 2005 | B2 |
| 6842405 | D'Agosto, III | Jan 2005 | B1 |
| 6853966 | Bushey et al. | Feb 2005 | B2 |
| 6864901 | Chang et al. | Mar 2005 | B2 |
| 6865604 | Nisani et al. | Mar 2005 | B2 |
| 6868392 | Ogasawara | Mar 2005 | B1 |
| 6870920 | Henits | Mar 2005 | B2 |
| 6871229 | Nisani et al. | Mar 2005 | B2 |
| 6880004 | Nisani et al. | Apr 2005 | B2 |
| 6937706 | Escheider et al. | Aug 2005 | B2 |
| 6959078 | Eilbacher et al. | Oct 2005 | B1 |
| 6959079 | Elazar | Oct 2005 | B2 |
| 7010106 | Gritzer et al. | Mar 2006 | B2 |
| 7010109 | Gritzer et al. | Mar 2006 | B2 |
| 7027708 | Nygren et al. | Apr 2006 | B2 |
| 7043745 | Nygren et al. | May 2006 | B2 |
| 7076427 | Scarano et al. | Jul 2006 | B2 |
| 7103553 | Applebaum | Sep 2006 | B2 |
| 7149788 | Gundla et al. | Dec 2006 | B1 |
| 7184540 | Dezonno et al. | Feb 2007 | B2 |
| 7203285 | Blair | Apr 2007 | B2 |
| 7216162 | Amit et al. | May 2007 | B2 |
| 7219138 | Straut et al. | May 2007 | B2 |
| 7222075 | Petrushin | May 2007 | B2 |
| 7263474 | Fables et al. | Aug 2007 | B2 |
| 7305082 | Elazar et al. | Dec 2007 | B2 |
| 7305345 | Bares et al. | Dec 2007 | B2 |
| 7317789 | Comerford | Jan 2008 | B2 |
| 7333445 | Ilan et al. | Feb 2008 | B2 |
| 7346151 | Erhart et al. | Mar 2008 | B2 |
| 7346186 | Sharoni et al. | Mar 2008 | B2 |
| 7349944 | Vernon et al. | Mar 2008 | B2 |
| 7376735 | Straut et al. | May 2008 | B2 |
| 7386105 | Wasserblat et al. | Jun 2008 | B2 |
| 7424718 | Dutton | Sep 2008 | B2 |
| 7466816 | Blair | Dec 2008 | B2 |
| 7474633 | Halbraich et al. | Jan 2009 | B2 |
| 7478051 | Nourbakhsh et al. | Jan 2009 | B2 |
| 7545803 | Halbraich | Jun 2009 | B2 |
| 7546173 | Wasserblat et al. | Jun 2009 | B2 |
| 7570755 | Williams et al. | Aug 2009 | B2 |
| 7574000 | Blair | Aug 2009 | B2 |
| 7587041 | Blair | Sep 2009 | B2 |
| 7613290 | Williams et al. | Nov 2009 | B2 |
| 7613635 | Blumenau | Nov 2009 | B2 |
| 7633930 | Spohrer et al. | Dec 2009 | B2 |
| 7660297 | Fisher et al. | Feb 2010 | B2 |
| 7660307 | Byrd et al. | Feb 2010 | B2 |
| 7665114 | Safran et al. | Feb 2010 | B2 |
| 7680264 | Dong et al. | Mar 2010 | B2 |
| 7714878 | Gabay et al. | May 2010 | B2 |
| 7725318 | Gavalda et al. | May 2010 | B2 |
| 7752043 | Watson | Jul 2010 | B2 |
| 7769176 | Watson et al. | Aug 2010 | B2 |
| 7787974 | Blair et al. | Aug 2010 | B2 |
| 7817795 | Gupta et al. | Oct 2010 | B2 |
| 7822018 | Williams et al. | Oct 2010 | B2 |
| 7848524 | Watson et al. | Dec 2010 | B2 |
| 7853800 | Watson et al. | Dec 2010 | B2 |
| 7881216 | Blair | Feb 2011 | B2 |
| 7881471 | Spohrer et al. | Feb 2011 | B2 |
| 7885813 | Blair et al. | Feb 2011 | B2 |
| 7899178 | Williams et al. | Mar 2011 | B2 |
| 7899180 | Blair | Mar 2011 | B2 |
| 7903568 | Byrd et al. | Mar 2011 | B2 |
| 7920482 | Calahan et al. | Apr 2011 | B2 |
| 7925889 | Blair et al. | Apr 2011 | B2 |
| 7930314 | Gupta | Apr 2011 | B2 |
| 7940914 | Petrushin | May 2011 | B2 |
| 7949552 | Korenblit et al. | May 2011 | B2 |
| 7953219 | Freedman et al. | May 2011 | B2 |
| 7965828 | Calahan et al. | Jun 2011 | B2 |
| 7966397 | Dong et al. | Jun 2011 | B2 |
| 7991613 | Blair | Aug 2011 | B2 |
| 7995612 | Spohrer et al. | Aug 2011 | B2 |
| 8000465 | Williams et al. | Aug 2011 | B2 |
| 8005675 | Wasserblat et al. | Aug 2011 | B2 |
| 8005676 | Duke et al. | Aug 2011 | B2 |
| 8050923 | Blair | Nov 2011 | B2 |
| 8060364 | Bachar et al. | Nov 2011 | B2 |
| 8078463 | Wasserblat et al. | Dec 2011 | B2 |
| 8108237 | Bourne et al. | Jan 2012 | B2 |
| 8112298 | Bourne et al. | Feb 2012 | B2 |
| 8112306 | Lyerly et al. | Feb 2012 | B2 |
| 8117064 | Bourne et al. | Feb 2012 | B2 |
| 8130938 | Williams et al. | Mar 2012 | B2 |
| 8160233 | Keren et al. | Apr 2012 | B2 |
| 8165114 | Halbraich et al. | Apr 2012 | B2 |
| 8199886 | Calahan et al. | Jun 2012 | B2 |
| 8204056 | Dong et al. | Jun 2012 | B2 |
| 8255514 | DeHaas et al. | Aug 2012 | B2 |
| 8285833 | Blair | Oct 2012 | B2 |
| 8331549 | Fama et al. | Dec 2012 | B2 |
| 8442033 | Williams et al. | May 2013 | B2 |
| 8594313 | Dong et al. | Nov 2013 | B2 |
| 8670552 | Keren et al. | Mar 2014 | B2 |
| 8713428 | Blumenau | Apr 2014 | B2 |
| 8724891 | Kiryati et al. | May 2014 | B2 |
| 8725518 | Wasserblat et al. | May 2014 | B2 |
| 8782541 | Hayner et al. | Jul 2014 | B2 |
| 8837697 | Calahan et al. | Sep 2014 | B2 |
| 8861707 | Beckett, II et al. | Oct 2014 | B2 |
| 9225841 | Conway et al. | Dec 2015 | B2 |
| 9432511 | Conway et al. | Aug 2016 | B2 |
| 20030069780 | Hailwood et al. | Apr 2003 | A1 |
| 20030072463 | Chen | Apr 2003 | A1 |
| 20030142122 | Straut et al. | Jul 2003 | A1 |
| 20030144900 | Whitmer | Jul 2003 | A1 |
| 20030145140 | Straut et al. | Jul 2003 | A1 |
| 20030154092 | Bouron et al. | Aug 2003 | A1 |
| 20040041830 | Chiang et al. | Mar 2004 | A1 |
| 20040054715 | Cesario | Mar 2004 | A1 |
| 20040073569 | Knott et al. | Apr 2004 | A1 |
| 20040100507 | Hayner et al. | May 2004 | A1 |
| 20040162724 | Hill et al. | Aug 2004 | A1 |
| 20040190687 | Baker | Sep 2004 | A1 |
| 20050010411 | Rigazio et al. | Jan 2005 | A1 |
| 20050010415 | Hagen et al. | Jan 2005 | A1 |
| 20050204378 | Gabay | Sep 2005 | A1 |
| 20060089837 | Adar et al. | Apr 2006 | A1 |
| 20060168188 | Dutton | Jul 2006 | A1 |
| 20070083540 | Gundla et al. | Apr 2007 | A1 |
| 20070094408 | Gundla et al. | Apr 2007 | A1 |
| 20070195945 | Korenblit et al. | Aug 2007 | A1 |
| 20070198284 | Korenblit et al. | Aug 2007 | A1 |
| 20070198325 | Lyerly et al. | Aug 2007 | A1 |
| 20070198330 | Korenblit et al. | Aug 2007 | A1 |
| 20070206767 | Keren et al. | Sep 2007 | A1 |
| 20070237525 | Spohrer et al. | Oct 2007 | A1 |
| 20070282807 | Ringelman et al. | Dec 2007 | A1 |
| 20070297578 | Blair et al. | Dec 2007 | A1 |
| 20080004945 | Watson et al. | Jan 2008 | A1 |
| 20080040110 | Pereg et al. | Feb 2008 | A1 |
| 20080052535 | Spohrer et al. | Feb 2008 | A1 |
| 20080080685 | Barnes et al. | Apr 2008 | A1 |
| 20080260122 | Conway et al. | Oct 2008 | A1 |
| 20160344868 | Conway et al. | Nov 2016 | A1 |
| Number | Date | Country |
|---|---|---|
| 0862304 | Sep 1998 | EP |
| 0863678 | Sep 1998 | EP |
| 0998108 | May 2000 | EP |
| 1361739 | Nov 2003 | EP |
| 1377907 | Jan 2004 | EP |
| 1635534 | Mar 2006 | EP |
| 2331201 | May 1999 | GB |
| 2389736 | Dec 2003 | GB |
| WO 2001074042 | Oct 2001 | WO |
| WO 2002017165 | Feb 2002 | WO |
| Number | Date | Country | |
|---|---|---|---|
| 20170289352 A1 | Oct 2017 | US |
| Number | Date | Country | |
|---|---|---|---|
| 60921109 | Mar 2007 | US |
| Number | Date | Country | |
|---|---|---|---|
| Parent | 15230032 | Aug 2016 | US |
| Child | 15624401 | US | |
| Parent | 14960194 | Dec 2015 | US |
| Child | 15230032 | US | |
| Parent | 12079828 | Mar 2008 | US |
| Child | 14960194 | US |
| Number | Date | Country | |
|---|---|---|---|
| Parent | 11365432 | Mar 2006 | US |
| Child | 12079828 | US | |
| Parent | 11131844 | May 2005 | US |
| Child | 11365432 | US |
