The present disclosure is generally related to recording communications data.
Customer centers typically record communications between employees and between employees and customers to monitor quality of performance, among others. Some customer centers have recording components used for such recording that are specific to certain types of communications, such as time division multiplexing (TDM) and Internet Protocol (IP). For example, a customer center that records TDM audio has a TDM recorder. If that customer center records both TDM and IP communications data, the customer center also has an IP recorder that is separate and independent from a TDM recorder. In addition, if that customer center would like to record agent desktop screens, the customer center would need a screen capture recorder that is also separate and independent from the TDM and IP recorders. In addition, some customer centers have both TDM and IP infrastructures associated with recording communications at the customer centers. However, there are various communications protocols available that can be implemented in both the TDM and IP infrastructures. If the customer centers would like to change protocols, the customer centers may need different recording-related components associated with the changed protocol to implement the change, which may be expensive and time consuming.
Systems and methods for capturing communications data are provided. An exemplary method comprises the steps of: establishing connection with a customer center, the customer center being associated with a communications infrastructure; obtaining information that is related to the communications infrastructure, the information obtained being related to a communications protocol that is associated with the communications infrastructure; determining the type of communications protocol based on the information obtained; determining whether the type of communications protocol is supported by a recording system; responsive to determining that the type of communications protocol is supported, receiving communications data using the determined communications protocol; determining whether to record the received communications data; and responsive to determining that the received communications data are to be recorded, recording the received communications data.
An exemplary recording system that captures communications data comprises an interface device that is operative to establish connection with a customer center via a communications infrastructure and a capture engine that communicates with the interface device. The capture engine has at least one interface library and is operative to receiving information related to the communications infrastructure, the information of which is related to a communications protocol that is associated with the communications infrastructure. The capture engine is further operative to determine the type of communications protocol based on the information obtained and determine whether the at least one interface library has a set of rules for the communications protocol, the set of rules of which is associated with at least one of the following: data representation, signaling, authentication and error detection, any of which is needed to send information over a communications channel. The capture engine is further operative to receive communications data using the communications protocol, determine whether to record the received communications data, and responsive to determining that the received communications data are to be recorded, record the communications data.
Other systems, methods, features, and advantages of the present disclosure will be or become apparent to one with skill in the art upon examination of the following drawings and detailed description. It is intended that all such additional systems, methods, features, and advantages be included within this description, be within the scope of the present disclosure, and be protected by the accompanying claims.
Many aspects of the disclosure can be better understood with reference to the following drawings. The components in the drawings are not necessarily to scale, emphasis instead being placed upon clearly illustrating the principles of the present disclosure. Moreover, in the drawings, like reference numerals designate corresponding parts throughout the several views.
Disclosed herein are systems and methods for capturing communications data at a customer center. In particular, embodiments of such a system incorporate a recording system that includes at least one interface library that facilitates receiving and recording of communications data. The recording system can be deployed at a centralized location, e.g., within a company premises, and/or embedded into a network as a service on the network and/or as intelligence in the network infrastructure.
It should be noted that a customer center can include, by way of example, but is not limited to, outsourced contact centers, outsourced customer relationship management, customer relationship management, voice of the customer, customer interaction, contact center, multi-media contact center, trading center, remote office, distributed enterprise, work-at-home agents, remote agents, branch office, back office, performance optimization, workforce optimization, hosted contact centers, and speech analytics, for example.
Additionally, included in this disclosure are embodiments of integrated workforce optimization platforms, as discussed in U.S. application Ser. No. 11/359,356, filed on Feb. 22, 2006, entitled “Systems and Methods for Workforce Optimization,” which is hereby incorporated by reference in its entirety. At least one embodiment of an integrated workforce optimization platform integrates: (1) Quality Monitoring/Call Recording—voice of the customer; the complete customer experience across multimedia touch points; (2) Workforce Management—strategic forecasting and scheduling that drives efficiency and adherence, aids in planning, and helps facilitate optimum staffing and service levels; (3) Performance Management—key performance indicators (KPIs) and scorecards that analyze and help identify synergies, opportunities and improvement areas; (4) e-Learning—training, new information and protocol disseminated to staff, leveraging best practice customer interactions and delivering learning to support development; and/or (5) Analytics—deliver insights from customer interactions to drive business performance. By way of example, the integrated workforce optimization process and system can include planning and establishing goals—from both an enterprise and center perspective—to ensure alignment and objectives that complement and support one another. Such planning may be complemented with forecasting and scheduling of the workforce to ensure optimum service levels. Recording and measuring performance may also be utilized, leveraging quality monitoring/call recording to assess service quality and the customer experience.
Exemplary systems are first discussed with reference to the figures. Although these systems are described in detail, they are provided for purposes of illustration only and various modifications are feasible. After the exemplary systems are described, examples of flow diagrams of the systems are provided to explain the manner in which data can be recorded.
Incoming communications from a communications network 155 can be routed to the switch 110, which can route the communications to the computing device 115 and/or phones 125, 130, 135. The communication network can be a Public Switch Telephony Network (PSTN) and/or IP-based network, among others. The incoming communications can include, but are not limited to, voice, text, and video communications, among others. The customer center network 120 can include, but is not limited to, a wide area network (WAN), a local area network (LAN), a virtual private network (VPN) and the Internet.
The switch 110 is operative to process the communications at the customer center 105 and transmit the communications to a recording system 150 via, for example, an IP infrastructure 140 and/or a TDM infrastructure 145, among others. The customer center 105 is further described in relation to
The IP infrastructure 140 of the customer center 105 can include, but is not limited to, a Pseudowire Emulation Edge to Edge (PWE3) protocol, Session Initiation Protocol (SIP), and Real-Time Transport Protocol (RTP), among others. The objective of PWE3 protocol is to support many Layer 1 and Layer 2 services over a common packet switched network (PSN) infrastructure. The Layer 1 and Layer 2 services include, but are not limited to, frame relay, Ethernet, Asynchronous Transfer Mode (ATM), Synchronous Optical Network (SONET), and Time Division Multiplexing (TDM). The PWE3 protocol defines framework and architecture with particular requirements to satisfy the service-specific protocol that defines how each Layer 1 or Layer 2 is encapsulated in PSN frames. Examples of PSN include, but are not limited to, MultiProtocol Label Switching (MPLS), Internet Protocol (IP) such as RTP, IPv4, or IPv6, and Layer 2 Tunneling Protocol (L2TP). The PWE 3 protocol also defines control protocol to establish connectivity across the PSN.
TDM infrastructure includes a circuit mode communication with a fixed number of channels and constant bandwidth per channel. In circuit switched networks, such as the Public Switched Telephone Network (PSTN), among others, multiple subscribers' calls are transmitted along the same transmission medium. To accomplish this, network designers make use of TDM. TDM allows switches to create channels, also known as tributaries, within a transmission stream. A standard voice signal generally has a data bit rate of 64 kbit/s, determined using Nyquist's Sampling Criterion. TDM takes frames of the voice signals and multiplexes them into a TDM frame which runs at a higher bandwidth.
The Voice over Internet Protocol (VoIP) system 106 can be connected to the PSTN 146. The VoIP system 106 receives and transmits communications data via gateway/router 156. If the gateway 156 receives the communications data from the PSTN 146, the gateway 156 converts the communications data to digital communications data. Additionally or alternatively, the gateway 156 can receive digital communications data from an Internet Protocol Wide Area Network (IP WAN) 153. In either or both situations, the gateway 156 sends the digital communications data to a VoIP network/switch 159, which distributes the signal to VoIP phones 163, 166, 169.
A recording system 203 can be a single recording server or a cluster of recording servers, for example. The recording system 203 can receive various types of communication signals from the communication network and store the communication signals in an allocated resource (not shown). The recording system 203 can receive and store, for example, data 206 from the agent desktops 129, 133, 139, such as screen capture, instant message, and business data through the corporate LAN 143; audio data 209 from the punchdown block 126 by way of extension taps; service observation data 213 from the switch/ACD 109; communications data 216 between the switch 109 and PSTN 146 by way of TDM truck taps; IP data 223 between the gateway 156 and the VoIP Network/switch 159 by way of IP trunk taps; IP data 226 from the switch by way of IP extension taps; IP data 229 from IP phones 163, 166 by way of IP monitoring, media data 239 from the media application server 236, and video conference data 233 from the IP phone 169. Additionally or alternatively, the recording system 203 can receive and store communication signals in either 32-bit or 128-bit scheme, or both.
The recording system 203 can further receive various types of external contact center events 219 from the multiple servers 173, 176, 179. The recording system enables continued use of the multiple servers 173, 176, 179 by receiving the various types of external contact center events 219 and determines whether to record communications data based on the received events. Additionally or alternatively, the recording system 203 can receive and store data from media servers with recorder capabilities (“media server/recorder”). The recording system 203 includes interfaces that communicate with the media servers/recorder to manage the data stored in the media server/recorder, such as archive, data management, and search and mine. In other words, the recording system 203 can integrate with the media server/recorder as a cluster of subsystems. Additionally or alternatively, the recording system 203 receives and stores data stored in the media server/recorder.
The IP mixer 350 is operative to receive IP stream 330, IP stream 335, and IP stream 340, and mix the IP streams 330, 335, 340 in various combinations. In this example, the IP mixer 350 mixes the streams 335, 340 and transmits the mixed streams 335, 340 on channel 365, and the stream 330, which is not mixed with the other IP streams, is processed and transmitted on channel 370. The channels 365, 370 are transmitted to an IP network card 380, e.g., an Internet Protocol Switch Interface (IPSI) card, which transmits the channels on an IP context 390 to the recording system. Each context can have approximately 32 or more virtual channels. A single IP network card 380 may have one or more contexts. In general, the IPSI card is a hardware device on a Telephony Relay Service (TRS) backplane that communicates between the TRS system and IP-based phones and/or recorders. Alternatively or additionally, the IPSI card can be a dual-purpose IPSI card that communicates with both phones and recorders, or a special purpose version of the card that communicates only with recorders. The IPSI card can use PWE3 protocol or any other IP protocol to transmit voice to/from IP-based phones.
The interface devices 405, 410 transmit the abstracted information to a capture engine 415 that provides the information to an interface library database 427. The interface library database 427 includes, but is not limited to, IP interface library 423 and TDM interface library 425, among others. The recording system 420 determines whether the protocols used in the IP and TDM infrastructures 440, 445 are supported by the recording system 420 based on the information abstracted. That is, the recording system 420 determines whether the protocols can be utilized to facilitate communication with the customer center. For example, the recording system 420 searches through the interface library database 427, and determines whether an interface library 423, 425 with a set of rules for the communications protocol exists in the interface library database 427. The set of rules is associated with data representation, signaling, authentication and error detection, that are generally needed to send information over a communications channel. Once the recording system 420 determines that interchanging data with the customer center over the communications channel can be achieved, the recording system 420 can receive and record the communications data from the customer center. In general, each library includes code developed to interface with a communications infrastructure.
At least one interface library can be stored in the database of the recording system such that the recording system 420 can search through the database to determine whether the interface library can facilitate interfacing a communications infrastructure of the customer center. Alternatively or additionally, an interface library can be developed and downloaded into the database to update the database. The database includes, but is not limited to, a text file, eXtensible Markup Language (XML) file, and Oracle™ or Structured Query Language (SQL) Server, among others.
Alternatively or additionally, each interface library 423, 425 can include, but is not limited to, at least one of a size buffer parameter and a callback period parameter. The size buffer parameter controls the size of the buffer used to hold communications data for each virtual channel. The size of the buffer can be larger than the callback period. The callback period parameter controls the frequency of callbacks. For example, each interface library 423, 425 can be configured with one callback per second for each channel. The size buffer parameter and callback period parameter facilitate initializing and shutting down the interface library 423, 425. The parameters are available for the interface library 423, 425 to setup and teardown any necessary resources for use. The interface library 423, 425 can be initialized and shutdown multiple times during the same process. Alternatively or additionally, the interface library 423, 425 can be initialized multiple times without interrupting any functionality.
Alternatively or additionally, each interface library 423, 425 can further include, but is not limited to, at least one of a context parameter and an adapter parameter. The context parameter identifies the contexts (PWE3 stream of several virtual channels) and facilitates streaming the contexts and reporting errors associated with the contexts. The adapter parameter identifies the network adapters that are used to connect to the network cards. The context parameter and adapter parameter facilitate causing the interface library 423, 425 to begin streaming data via the callback. If the connection associated with the streaming data is lost, the interface library 423, 425 signals warning and error callbacks to the main service code 430 indicating that the connection is lost. It should be noted that some forms of IP recording can use the adapter parameter to facilitate connection between the recorder and customer center.
The interface library 423, 425 can receive configuration information supplied by a main service code 430 from a recorder configuration 435. The interface library 423, 425 can further receive the external contact center events from a customer center. The interface library 423, 425 can signal the main service code 430 via a callback when the communications data are available to be received by the recording system 420, and signals the main service code 430 via the callback when the IP infrastructure 440 is disconnected from the recording system 420.
Some events include, but are not limited to: buffer ready, partial connection lost, all connection lost, and buffer overflow, among others. In general, the buffer ready event indicates that a buffer of the communications data is ready to be gathered and processed. The partial connection lost event indicates that one of the redundant connections is lost, but not all of them. The all connection lost event indicates that all of the redundant connections are lost. In both connection lost events, the recording system 420 can provide an alarm alerting a user that either a partial connection or all connections are lost. The buffer overflow event indicates that at least some communications data was lost because the recording system 420 was not able to gather the communications data before the buffer overflowed.
The main service code 430 loads configuration information from the recording system configuration 435 and configures the interface library 423, 425 with the configuration information. The main service code 430 further copies the communications data from the infrastructures 440, 445 into a buffer and processes the communications data, signals to standby recorders when the infrastructures 440, 445 are disconnected from the recording system 420, and communicates with the standby recorders of the recording system 420 to determine whether a standby recorder should take over recording the communication data from the disconnected recorder. In general, the main service code 430 includes capture engine codes that are loaded into the interface library 423, 425, which uses the capture engine code to facilitate obtaining the communications data to be recorded. The main service code 430 is further described in relation to
Alternatively or additionally, the overall architecture of recording the TDM and IP communications data can be potentially similar except for the small differences of the interface libraries 423, 425. Therefore, the customer center and the recording system 420 can leverage the similarities and reduce overall development and costs. In addition, this similarity can facilitate either upgrade of customers from a TDM-based to an IP-based TRS system and allow for the combination of TDM and IP phones and switches at the customer center.
Each recorder 550, 555 can be configured to be assigned at least one identification code associated with at least one context to be recorded. The recorder 550, 555 can identify and record its assigned context by using the identification code. For example, the recorder 550 can include NIC adapters 530, 535, which are configured to receive and facilitate recording contexts 1 and 3, respectively. The recorder 555 can include a NIC adapter 540, which is configured to receive and facilitate recording context 2. The recorder 555 further includes a NIC adapter 545, which communicates with other adapters 530, 535, 540 and determines whether any of the other adapters loses connection with the customer center 505. If the NIC adapter 545 determines that a connection is lost, the NIC adapter 545 takes over recording the communications data from the disconnected NIC adapter.
Alternatively or additionally, the customer center 505 can include an in-process interface (not shown) that is operative to change different protocols, such as, for example, from PWE3 protocol to an RTP protocol, without extensive development and high cost. For example, the communications data can be packaged in a G711 format, and instead of sending the G711 communications data using a PWE3 header, the customer center 505 replaces the PWE3 header with an RTP header using RTP compatible components. With this capability, the customer center 505 can control the changes to the IP interface without having to involve the recording system 150 to a significant degree.
If a recorder loses its ability to record one or more contexts, the recorder can communicate with the spare recorder 657 via the pinging mechanism so that the spare recorder 657 can take over recording the one or more contexts. The spare recorder 657 can be configured to not acquire any contexts by default but only in the event that one recorder loses its ability to record its assigned context.
An event interface application 713 of the recording controller 709 receives the external contact center events. An administration application 716 of the recording controller 709 processes the external contact center events 706. After the processing is completed, the recorder controller 709 determines whether to record the communications data associated with the external contact center events 706. If the recorder controller 709 determines that the communications data is to be recorded, the recorder controller 709 transmits start/stop commands 719 and contact attributes 723 to a capture engine 726 or an archive 759. The recorder controller 709 can selectively record one (1) to one hundred (100) percent of the communications data. The recorder controller 709 can use business rule engines (not shown) to further selectively record audio/video, the business rule engines of which prioritize events above random recordings. The recorder controller 709 can record on demand, allocate optimum recording of a media channel, and monitor post-call activities.
Retrieve, record and administration applications 729, 733, 736 of the capture engine 726 receive and process the commands 719 and attributes 723 from the recorder controller 709. Specifically, the retrieve application 729 facilitates retrieving stored communications data (e.g., meta data) from the capture engine 726 and transmitting the stored communications data to an application enterprise datastore 739. Customer center applications 743 can access the information in the datastore 739 for analysis and optimization of the performance of the customer center.
The record application 733 instructs the capture engine 726 to start/stop recording the communications data that the capture engine 726 receives from various types of communication interfaces. The communication interfaces facilitate receiving and storing TDM audio 746, IP audio 749, screen data 753, IM chat (not shown), e-mail (not shown), video conference (not shown), and/or other multimedia data. The communication interfaces also facilitate tapping into the switches of the network (e.g., extension taps, TDM trunk taps, IP trunk taps, and IP extension taps) and communicating with a customer center to receive the communications data. The capture engine 726 can transmit audio, video, and meta data to a recorder local storage 756. The capture engine 726 can be a single platform with extendable interface types. The capture engine 726 includes, but is not limited to, as many as 736 concurrent channels and can be self-sufficient in a closed box with fault tolerance feature, minimum connection lost, and passive tap sense driven recording.
Additionally or alternatively, the recorder controller 709 can instruct the capture engine 726 to transmit the stored communications data to the archive 759. The recorder controller 709 can further instruct the archive 759 to store the communications data to a local disk 763, tape 766, and DVD 769. The recorder controller 709 can further instruct the archive 759 to retrieve the stored communications data from the local disk 763, tape 766, and DVD 769. The archive 759 can transmit the stored communications data to the capture engine 726, which transmits the communications data to a desirable location. The archive 759 can be a fault-tolerant storage of contact data and meta data. The archive 759 can manage multiple local storage media or integrate to a third party server. The archive 759 further supports the retrieval of contact data for playback applications.
The local storage interface 823 receives and stores audio/video data in a storage medium. The media channel framework 803 further outputs meta data to customer center applications 743 for optimization of customer centers or other applications that utilize the stored communications data. The capture engine 826 further includes a workflow engine 826 that can perform consolidation 829, compression 833, archive 836, disk management 839, and other processes 843 of stored data in the capture engine 826. The capture engine 826 is capable of content segment recording, which can support content level security at an application layer.
Alternative or additionally, a customer center may have a hybrid environment that includes communications devices operative to communicate data with a 32-bit or 128-bit packet header, the communications devices of which include, but are not limited to, 32-bit and 128-bit soft phones, gateways, routers, recording system, and switches, among others. In particular, the recording system includes the TDM terminated interface 813, IP terminated interface 816, and VoIP filtering 819 that can receive and record the communications data.
The recording channel state machine 925 manages recording-idle state based on commands and tap-sense controls from a recorder controller 909, the management of which is generally performed at the beginning and the end of recordings. The recording channel state machine 925 controls tagging of meta data to the communications data.
The control commands from the recorder controller 909 are transmitted by a controller handler 935 to the recording channel state machine 925. The controller handler 935 can parse commands and maintain connections to the recorder controller 909. Such recorder controller 909 can direct the recording system based on external events, such as Computer Telephony Integration (CTI) events. The recorder controller 909 can send commands, such as start, stop, and tag, among others, to the control handler 935. The recording channel state machine 925 can transmit meta data to the server disk system 940.
In block 1009, the recording system determines the type of communications protocol that is used by the customer center based on the obtained information. Responsive to determining the type of communication protocol, the recording system determines whether it supports the communication protocol. For example, the recording system includes various interface libraries that facilitate interfacing the recording system with the customer center and recording the communications data from the customer center. The various interface libraries can support TDM protocols and IP protocols. The recording system 420 can search through the various interface libraries and determines whether it 420 has an interface library with a set of rules for the communications protocol. The set of rules are associated with data representation, signaling, authentication and error detection, that are generally needed to send information over a communications channel.
In block 1013, responsive to determining that the recording system supports the determined type of communications protocol, the recording system receives various types of communications data at the customer center. As mentioned above, the recording system uses the various types of communication interfaces for receiving corresponding types of communications data. For example, the capture engine can use the E1/T1 trunk tap interface 406, extension tap interface 409 and TDM terminated interface 413 to record TDM communications data.
In block 1016, the recording system receives external contact center events associated with corresponding types of communications data at the customer center. In block 1019, the recording system determines whether to record the various types of communications data based on the events. In block 1023, responsive to determining that the communications data are to be recorded, the recording system determines the types of communications data associated with the received communications data. In block 1026, the recording system determines the communication interfaces for receiving and storing the received communications data based on the determined types of communications data. In block 1029, the recording system allocates resources to record the received communications data.
In block 1033, the recording system records the received communications data via the determined communication interfaces.
In some embodiments, various applications are able to access and analyze all the various types of communications data from the customer center in a recording system with one repository. This reduces steps that would otherwise be present if the various types of communications data are recorded in multiple recording systems. For example, if two types of communications data are recorded in the recording system instead of two servers, then applications that analyze the two types of the communications data can communicate, access, and search in one recording system instead of two recording systems.
It should be emphasized that the above-described embodiments are merely possible examples of implementations, merely set forth for a clear understanding of the principles of the disclosure. Many variations and modifications may be made to the above-described embodiments without departing substantially from the spirit and principles of the disclosure. All such modifications and variations are intended to be included herein within the scope of this disclosure and protected by the following claims.
Number | Name | Date | Kind |
---|---|---|---|
3594919 | De Bell et al. | Jul 1971 | A |
3705271 | De Bell et al. | Dec 1972 | A |
4510351 | Costello et al. | Apr 1985 | A |
4684349 | Ferguson et al. | Aug 1987 | A |
4694483 | Cheung | Sep 1987 | A |
4763353 | Canale et al. | Aug 1988 | A |
4815120 | Kosich | Mar 1989 | A |
4924488 | Kosich | May 1990 | A |
4953159 | Hayden et al. | Aug 1990 | A |
5016272 | Stubbs et al. | May 1991 | A |
5101402 | Chiu et al. | Mar 1992 | A |
5117225 | Wang | May 1992 | A |
5210789 | Jeffus et al. | May 1993 | A |
5239460 | LaRoche | Aug 1993 | A |
5241625 | Epard et al. | Aug 1993 | A |
5267865 | Lee et al. | Dec 1993 | A |
5299260 | Shaio | Mar 1994 | A |
5311422 | Loftin et al. | May 1994 | A |
5315711 | Barone et al. | May 1994 | A |
5317628 | Misholi et al. | May 1994 | A |
5347306 | Nitta | Sep 1994 | A |
5388252 | Dreste et al. | Feb 1995 | A |
5396371 | Henits et al. | Mar 1995 | A |
5432715 | Shigematsu et al. | Jul 1995 | A |
5465286 | Clare et al. | Nov 1995 | A |
5475625 | Glaschick | Dec 1995 | A |
5485569 | Goldman et al. | Jan 1996 | A |
5491780 | Fyles et al. | Feb 1996 | A |
5499291 | Kepley | Mar 1996 | A |
5535256 | Maloney et al. | Jul 1996 | A |
5572652 | Robusto et al. | Nov 1996 | A |
5577112 | Cambray et al. | Nov 1996 | A |
5590171 | Howe et al. | Dec 1996 | A |
5597312 | Bloom et al. | Jan 1997 | A |
5619183 | Ziegra et al. | Apr 1997 | A |
5696906 | Peters et al. | Dec 1997 | A |
5717879 | Moran et al. | Feb 1998 | A |
5721842 | Beasley et al. | Feb 1998 | A |
5742670 | Bennett | Apr 1998 | A |
5748499 | Trueblood | May 1998 | A |
5778182 | Cathey et al. | Jul 1998 | A |
5784452 | Carney | Jul 1998 | A |
5790798 | Beckett, II et al. | Aug 1998 | A |
5796952 | Davis et al. | Aug 1998 | A |
5809247 | Richardson et al. | Sep 1998 | A |
5809250 | Kisor | Sep 1998 | A |
5825869 | Brooks et al. | Oct 1998 | A |
5835572 | Richardson, Jr. et al. | Nov 1998 | A |
5862330 | Anupam et al. | Jan 1999 | A |
5864772 | Alvarado et al. | Jan 1999 | A |
5884032 | Bateman et al. | Mar 1999 | A |
5907680 | Nielsen | May 1999 | A |
5918214 | Perkowski | Jun 1999 | A |
5923746 | Baker et al. | Jul 1999 | A |
5933811 | Angles et al. | Aug 1999 | A |
5944791 | Scherpbier | Aug 1999 | A |
5946375 | Pattison et al. | Aug 1999 | A |
5948061 | Merriman et al. | Sep 1999 | A |
5958016 | Chang et al. | Sep 1999 | A |
5964836 | Rowe et al. | Oct 1999 | A |
5978648 | George et al. | Nov 1999 | A |
5982857 | Brady | Nov 1999 | A |
5987466 | Greer et al. | Nov 1999 | A |
5990852 | Szamrej | Nov 1999 | A |
5991373 | Pattison et al. | Nov 1999 | A |
5991796 | Anupam et al. | Nov 1999 | A |
6005932 | Bloom | Dec 1999 | A |
6009429 | Greer et al. | Dec 1999 | A |
6014134 | Bell et al. | Jan 2000 | A |
6014647 | Nizzari et al. | Jan 2000 | A |
6018619 | Allard et al. | Jan 2000 | A |
6035332 | Ingrassia et al. | Mar 2000 | A |
6038544 | Machin et al. | Mar 2000 | A |
6039575 | L'Allier et al. | Mar 2000 | A |
6057841 | Thurlow et al. | May 2000 | A |
6058163 | Pattison et al. | May 2000 | A |
6061798 | Coley et al. | May 2000 | A |
6072860 | Kek et al. | Jun 2000 | A |
6076099 | Chen et al. | Jun 2000 | A |
6078894 | Clawson et al. | Jun 2000 | A |
6091712 | Pope et al. | Jul 2000 | A |
6108711 | Beck et al. | Aug 2000 | A |
6122665 | Bar et al. | Sep 2000 | A |
6122668 | Teng et al. | Sep 2000 | A |
6130668 | Stein | Oct 2000 | A |
6138139 | Beck et al. | Oct 2000 | A |
6144991 | England | Nov 2000 | A |
6146148 | Stuppy | Nov 2000 | A |
6151622 | Fraenkel et al. | Nov 2000 | A |
6154771 | Rangan et al. | Nov 2000 | A |
6157808 | Hollingsworth | Dec 2000 | A |
6171109 | Ohsuga | Jan 2001 | B1 |
6182094 | Humpleman et al. | Jan 2001 | B1 |
6195679 | Bauersfeld et al. | Feb 2001 | B1 |
6201948 | Cook et al. | Mar 2001 | B1 |
6211451 | Tohgi et al. | Apr 2001 | B1 |
6225993 | Lindblad et al. | May 2001 | B1 |
6230197 | Beck et al. | May 2001 | B1 |
6236977 | Verba et al. | May 2001 | B1 |
6244758 | Solymar et al. | Jun 2001 | B1 |
6282548 | Burner et al. | Aug 2001 | B1 |
6286030 | Wenig et al. | Sep 2001 | B1 |
6286046 | Bryant | Sep 2001 | B1 |
6288753 | DeNicola et al. | Sep 2001 | B1 |
6289340 | Puram et al. | Sep 2001 | B1 |
6301462 | Freeman et al. | Oct 2001 | B1 |
6301573 | McIlwaine et al. | Oct 2001 | B1 |
6324282 | McIlwaine et al. | Nov 2001 | B1 |
6347374 | Drake et al. | Feb 2002 | B1 |
6351467 | Dillon | Feb 2002 | B1 |
6353851 | Anupam et al. | Mar 2002 | B1 |
6360250 | Anupam et al. | Mar 2002 | B1 |
6370574 | House et al. | Apr 2002 | B1 |
6404857 | Blair et al. | Jun 2002 | B1 |
6411989 | Anupam et al. | Jun 2002 | B1 |
6418471 | Shelton et al. | Jul 2002 | B1 |
6459787 | McIlwaine et al. | Oct 2002 | B2 |
6487195 | Choung et al. | Nov 2002 | B1 |
6493758 | McLain | Dec 2002 | B1 |
6502131 | Vaid et al. | Dec 2002 | B1 |
6510220 | Beckett, II et al. | Jan 2003 | B1 |
6535909 | Rust | Mar 2003 | B1 |
6542602 | Elazer | Apr 2003 | B1 |
6546405 | Gupta et al. | Apr 2003 | B2 |
6560328 | Bondarenko et al. | May 2003 | B1 |
6583806 | Ludwig et al. | Jun 2003 | B2 |
6606657 | Zilberstein et al. | Aug 2003 | B1 |
6651042 | Field et al. | Nov 2003 | B1 |
6665644 | Kanevsky et al. | Dec 2003 | B1 |
6674447 | Chiang et al. | Jan 2004 | B1 |
6683633 | Holtzblatt et al. | Jan 2004 | B2 |
6697858 | Ezerzer et al. | Feb 2004 | B1 |
6724887 | Eilbacher et al. | Apr 2004 | B1 |
6738456 | Wrona et al. | May 2004 | B2 |
6757361 | Blair et al. | Jun 2004 | B2 |
6772396 | Cronin et al. | Aug 2004 | B1 |
6775377 | McIlwaine et al. | Aug 2004 | B2 |
6792575 | Samaniego et al. | Sep 2004 | B1 |
6810414 | Brittain | Oct 2004 | B1 |
6820083 | Nagy et al. | Nov 2004 | B1 |
6823384 | Wilson et al. | Nov 2004 | B1 |
6870916 | Henrikson et al. | Mar 2005 | B2 |
6901438 | Davis et al. | May 2005 | B1 |
6959078 | Eilbacher et al. | Oct 2005 | B1 |
6965886 | Govrin et al. | Nov 2005 | B2 |
7274685 | Peters | Sep 2007 | B1 |
7570755 | Williams et al. | Aug 2009 | B2 |
7822018 | Williams et al. | Oct 2010 | B2 |
20010000962 | Rajan | May 2001 | A1 |
20010032335 | Jones | Oct 2001 | A1 |
20010043697 | Cox et al. | Nov 2001 | A1 |
20020038363 | MacLean | Mar 2002 | A1 |
20020052948 | Baudu et al. | May 2002 | A1 |
20020065911 | Von Klopp et al. | May 2002 | A1 |
20020065912 | Catchpole et al. | May 2002 | A1 |
20020128925 | Angeles | Sep 2002 | A1 |
20020143925 | Pricer et al. | Oct 2002 | A1 |
20020165954 | Eshghi et al. | Nov 2002 | A1 |
20030007613 | Macklin | Jan 2003 | A1 |
20030055883 | Wiles et al. | Mar 2003 | A1 |
20030079020 | Gourraud et al. | Apr 2003 | A1 |
20030144900 | Whitmer | Jul 2003 | A1 |
20030154240 | Nygren et al. | Aug 2003 | A1 |
20040100507 | Hayner et al. | May 2004 | A1 |
20040165717 | McIlwaine et al. | Aug 2004 | A1 |
20050031101 | Renton et al. | Feb 2005 | A1 |
20050138560 | Lee et al. | Jun 2005 | A1 |
20060067303 | Murakami et al. | Mar 2006 | A1 |
20080080482 | Calahan et al. | Apr 2008 | A1 |
20080080685 | Barnes et al. | Apr 2008 | A1 |
20080137814 | Williams et al. | Jun 2008 | A1 |
Number | Date | Country |
---|---|---|
0453128 | Oct 1991 | EP |
0773687 | May 1997 | EP |
0989720 | Mar 2000 | EP |
2369263 | May 2002 | GB |
WO 9843380 | Nov 1998 | WO |
WO 0016207 | Mar 2000 | WO |
Entry |
---|
“Customer Spotlight: Navistar International,” Web page, unverified print date of Apr. 1, 2002. |
“DKSystems Integrates QM Perception with OnTrack for Training,” Web page, unverified print date of Apr. 1, 2002, unverified cover date of Jun. 15, 1999. |
“OnTrack Online” Delivers New Web Functionality, Web page, unverified print date of Apr. 2, 2002, unverified cover date of Oct. 5, 1999. |
“Price WaterouseCoopers Case Study” The Business Challenge, Web page, unverified cover date of 2000. |
Abstract, net.working: “An Online Webliography,” Technical Training pp. 4-5 (Nov.-Dec. 1998). |
Adams et al., “Our Turn-of-the-Century Trend Watch” Technical Training pp. 46-47 (Nov./Dec. 1998). |
Barron, “The Road to Performance: Three Vignettes,” Technical Skills and Training pp. 12-14 (Jan. 1997). |
Bauer, “Technology Tools: Just-in-Time Desktop Training is Quick, Easy, and Affordable,” Technical Training pp. 8-11 (May/Jun. 1998). |
Beck et al., “Applications of A1 in Education,” AMC Crossroads vol. 1: 1-13 (Fall 1996) Web page, unverified print date of Apr. 12, 2002. |
Benson and Cheney, “Best Practices in Training Delivery,” Technical Training pp. 14-17 (Oct. 1996). |
Bental and Cawsey, “Personalized and Adaptive Systems for Medical Consumer Applications,” Communications ACM 45(5): 62-63 (May 2002). |
Blumenthal et al., “Reducing Development Costs with Intelligent Tutoring System Shells,” pp. 1-5, Web page, unverified print date of Apr. 9, 2002, unverified cover date of Jun. 10, 1996. |
Brusilosy et al., “Distributed intelligent tutoring on the Web,” Proceedings of the 8th World Conference of the AIED Society, Kobe, Japan, Aug. 18-22, pp. 1-9 Web page, unverified print date of Apr. 12, 2002, unverified cover date of Aug. 18-22, 1997. |
Brusilovsky and Pesin, ISIS-Tutor: An Intelligent Learning Environment for CD/ISIS Users, pp. 1-15 Web page, unverified print date of May 2, 2002. |
Brusilovsky, “Adaptive Educational Systems on the World-Wide-Web: A Review of Available Technologies,” pp. 1-10, Web Page, unverified print date of Apr. 12, 2002. |
Byrnes et al., “The Development of a Multiple-Choice and True-False Testing Environment on the Web,” pp. 1-8, Web page, unverified print date of Apr. 12, 2002, unverified cover date of 1995. |
Calvi and DeBra, “Improving the Usability of Hypertext Courseware through Adaptive Linking,” ACM, unknown page numbers (1997). |
Coffey, “Are Performance Objectives Really Necessary?” Technical Skills and Training pp. 25-27 (Oct. 1995). |
Cohen, “Knowledge Management's Killer App,” pp. 1-11, Web page, unverified print date of Sep. 12, 2002, unverified cover date of 2001. |
Cole-Gomolski, “New Ways to manage E-Classes,” Computerworld 32(48):4344 (Nov. 30, 1998). |
Cross: “Sun Microsystems—the SunTAN Story,” Internet Time Group 8 (© 2001). |
De Bra et al., “Adaptive Hypermedia: From Systems to Framework,” ACM (2000). |
De Bra, “Adaptive Educational Hypermedia on the Web,” Communications ACM 45(5):60-61 (May 2002). |
Dennis and Gruner, “Computer Managed Instruction at Arthur Andersen & Company: A Status Report,” Educational Technical pp. 7-16 (Mar. 1992). |
Diessel et al., “Individualized Course Generation: A Marriage Between CAL and ICAL,” Computers Educational 22(1/2) 57-65 (1994). |
Dyreson, “An Experiment in Class Management Using the World Wide Web,” pp. 1-12, Web page, unverified print date of Apr. 12, 2002. |
E Learning Community, “Excellence in Practice Award: Electronic Learning Technologies,” Personal Learning Network pp. 1-11, Web page, unverified print date of Apr. 12, 2002. |
Eklund and Brusilovsky, “The Value of Adaptivity in Hypermedia Learning Environments: A Short Review of Empirical Evidence,” pp. 1-8, Web page, unverified print date of May 2, 2002. |
e-Learning the future of learning THINQ Limited, London, Version 1.0 (2000). |
Eline, “A Trainer's Guide to Skill Building,” Technical Training pp. 34-41 (Sep./Oct. 1998). |
Eline, “Case Study: Briding the Gap in Canada's IT Skills,” Technical Skills and Training pp. 23-25 (Jul. 1997). |
Eline “Case Study: IBT's Place in the Sun,” Technical Training pp. 12-17 (Aug./Sep. 1997). |
Fritz, “CB templates for productivity: Authoring system templates for trainers,” Emedia Professional 10(8):6678 (Aug. 1997). |
Fritz, “ToolBook II: Asymetrix's updated authoring software tackles the Web,” Emedia Professional 10(20): 102106 (Feb. 1997). |
Gibson et al., “A Comparative Analysis of Web-Based Testing and Evaluation Systems,” pp. 1-8, Web page, unverified print date of Apr. 11, 2002. |
Halberg and DeFiore, “Curving Toward Performance: Following a Hierarchy of Steps Toward a Performance Orientation,” Technical Skills and Training pp. 9-11 (Jan. 1997). |
Harsha, “Online Training ‘Sprints’ Ahead,” Technical Training pp. 27-29 (Jan./Feb. 1999). |
Heideman, “Training Technicians for a High-Tech Future: These six steps can help develop technician training for high-tech work,” pp. 11-14 (Feb./Mar. 1995). |
Heideman, “Writing Performance Objectives Simple as A-B-C (and D),” Technical Skills and Training pp. 5-7 (May/Jun. 1996). |
Hollman, “Train Without Pain: The Benefits of Computer-Based Training Tools,” pp. 1-11, Web page, unverified print date of Mar. 20, 2002, unverified cover date of Jan. 1, 2000. |
Klein, “Command Decision Training Support Technology,” Web page, unverified print date of Apr. 12, 2002. |
Koonce, “Where Technology and Training Meet,” Technical Training pp. 10-15 (Nov./Dec. 1998). |
Kursh, “Going the distance with Web-based training,” Training and Development 52(3): 5053 (Mar. 1998). |
Larson, “Enhancing Performance Through Customized Online Learning Support,” Technical Skills and Training pp. 25-27 (May/Jun. 1997). |
Linton, et al. “OWL: A Recommender System for Organization-Wide Learning,” Educational Technical Society 3(1): 62-76 (2000). |
Lucadamo and Cheney, “Best Practices in Technical Training,” Technical Training pp. 21-26 (Oct. 1997). |
McNamara, “Monitoring Solutions: Quality Must be Seen and Heard,” Inbound/Outbound pp. 66-67 (Dec. 1989). |
Merrill, “The New Component Design Theory: Instruction design for courseware authoring,” Instructional Science 16:19-34 (1987). |
Minton-Eversole, “IBT Training Truths Behind the Hype,” Technical Skills and Training pp. 15-19 (Jan. 1997). |
Mizoguchi, “Intelligent Tutoring Systems: The Current State of the Art,” Trans. IEICE E73(3):297-307 (Mar. 1990). |
Mostow and Aist, “The Sounds of Silence: Towards Automated Evaluation of Student Leaning a Reading Tutor that Listens” American Association for Artificial Intelligence, Web page, unknown date Aug. 1997. |
Mullier et al., “A Web base Intelligent Tutoring System,” pp. 1-6, Web page, unverified print date of May 2, 2002. |
Nash, Database Marketing, 1993, pp. 158-165, 172-185, McGraw Hill, Inc. USA. |
Nelson et al. “The Assessment of End-User Training Needs,” Communications ACM 38(7):27-39 (Jul. 1995). |
O'Herron, “CenterForce Technologies CenterForce Analyzer,” Web page unverified print dateof Mar. 2, 2002, unverified cover date of Jun. 1, 1999. |
O'Roark, “Basic Skills Get a Boost,” Technical Training pp. 10-13 (Jul./Aug. 1998). |
Pamphlet, On Evaluating Educational Innovations , authored by Alan Lesgold, unverified cover date of Mar. 5, 1998. |
Papa et al., “A Differential Diagnostic Skills Assessment and Tutorial Tool,” Computer Education 18(1-3):45-50 (1992). |
PCT International Search Report, International Application No. PCT/US03/02541, mailed May 12, 2003. |
Phaup, “New Software Puts Computerized Tests on the Internet: Presence Corporation announces breakthrough Question Mark™ Web Product,” Web page, unverified print date of Apr. 1, 2002. |
Phaup, “QM Perception™ Links with Integrity Training's WBT Manager™ to Provide Enhanced Assessments of Web Based Courses,” Web page, unverified print date of Apr. 1, 2002, unverified cover date of Mar. 25, 1999. |
Phaup, “Question Mark Introduces Access Export Software,” Web page, unverified print date of Apr. 2, 2002, unverified cover date of Mar. 1, 1997. |
Phaup, “Question Mark Offers Instant Online Feedback for Web Quizzes and Questionnaires: Univerity of California assist with Beta Testing, Server scripts now available on high-volume users,” Web page, unverified print date of Apr. 1, 2002, unverified cover date of May 6, 1996. |
Piskurich, Now-You-See-'Em, Now-You-Don't Learning Centers, Technical Training pp. 18-21 (Jan./Feb. 1999). |
Read, “Sharpening Agents' Skills,” pp. 1-15, Web page, unverified print date of Mar. 20, 2002, unverified cover date of Oct. 1, 1999. |
Reid, “On Target: Assessing Technical Skills,” Technical Skills and Training pp. 6-8 (May/Jun. 1995). |
Stormes, “Case Study: Restructuring Technical Training Using ISD,” Technical Skills and Training pp. 23-26 (Feb./Mar. 1997). |
Tennyson, “Artificial Intelligence Methods in Computer-Based Instructional Design,” Journal of Instructional Development 7(3): 17-22 (1984). |
The Editors, Call Center, “The Most Innovative Call Center Products We Saw in 1999,” Web page, unverified print date of Mar. 20, 2002, unverified cover date of Feb. 1, 2000. |
Tinoco et al., “Online Evaluation in WWW-based Courseware,” ACM pp. 194-198 (1997). |
Uiterwijk et al., “The virtual classroom,” InfoWorld 20(47):6467 (Nov. 23, 1998). |
Unknown Author, “Long-distance learning,” InfoWorld 20(36):7676 (1998). |
Untitled, 10th Mediterranean Electrotechnical Conference vol. 1 pp. 124-126 (2000). |
Watson and Belland, “Use of Learner Data in Selecting Instructional Content for Continuing Education,” Journal of Instructional Development 8(4):29-33 (1985). |
Weinschenk, “Performance Specifications as Change Agents,” Technical Training pp. 12-15 (Oct. 1997). |
Witness Systems promotional brochure for eQuality entitled “Building Customer Loyalty Through BusinessDriven Recording of Multimedia Interactions in your Contact Center,” (2000). |
Aspect Call Center Product Specification, “Release 2.0”, Aspect Telecommuications Corporation, May 23, 1998 798. |
Metheus X Window Record and Playback, XRP Features and Benefits, 2 pages Sep. 1994 LPRs. |
“Keeping an Eye on Your Agents,” Call Center Magazine, pp. 32-34, Feb. 1993 LPRs & 798. |
Anderson: Interactive TVs New Approach, The Standard, Oct. 1, 1999. |
Ante, Everything You Ever Wanted to Know About Cryptography Legislation . . . (But Were to Sensible to Ask), PC world Online, Dec. 14, 1999. |
Berst, It's Baa-aack. How Interative TV is Sneaking Into Your Living Room, The AnchorDesk, May 10, 1999. |
Berst, Why Interactive TV Won't Turn You On (Yet), The AnchorDesk, Jul. 13, 1999. |
Borland and Davis, US West Plans Web Services on TV, CNETNews.com, Nov. 22, 1999. |
Brown, Let PC Technology Be Your TV Guide, PC Magazine, Jun. 7, 1999. |
Brown, Interactive TV: The Sequel, NewMedia, Feb. 10, 1998. |
Cline, Déjà vu—Will Interactive TV Make It This Time Around?, DevHead, Jul. 9, 1999. |
Crouch, TV Channels on the Web, PC World, Sep. 15, 1999. |
D'Amico, Interactive TV Gets $99 set-top box, IDG.net, Oct. 6, 1999. |
Davis, Satellite Systems Gear Up for Interactive TV Fight, CNETNews.com, Sep. 30, 1999. |
Diederich, Web TV Data Gathering Raises Privacy Concerns, ComputerWorld, Oct. 13, 1998. |
EchoStar, MediaX Mix Interactive Multimedia With Interactive Television, PRNews Wire, Jan. 11, 1999. |
Furger, The Internet Meets the Couch Potato, PCWorld, Oct. 1996. |
Hong Kong Comes First with Interactive TV, SCI-TECH, Dec. 4, 1997. |
Needle, Will the Net Kill Network TV? PC World Online, Mar. 10, 1999. |
Kane, AOL-Tivo: You've Got Interactive TV, ZDNN, Aug. 17, 1999. |
Kay, E-Mail in Your Kitchen, PC World Online, 093/28/96. |
Kenny, TV Meets Internet, PC World Online, Mar. 28, 1996. |
Linderholm, Avatar Debuts Home Theater PC, PC World Online, Dec. 1, 1999. |
Rohde, Gates Touts Interactive TV, InfoWorld, Oct. 14, 1999. |
Ross, Broadcasters Use TV Signals to Send Data, PC World Oct. 1996. |
Stewart, Interactive Television at Home: Television Meets the Internet, Aug. 1998. |
Wilson, U.S. West Revisits Interactive TV, Interactive Week, Nov. 28, 1999. |