Patent Grant
10698647
The present disclosure relates to digital data processing, and more particularly, to methods, apparatus, systems, and computer-readable media for enabling users of different computers to share a user experience in an application executing on one of the computers by selectively sharing user interface elements. The teachings herein have application, by way of non-limiting example, to providing improved support for using applications.
Individuals needing assistance or support with an application have few options. They can place a call to a support phone line and speak with a technician, enter search queries into a search engine, or use electronic assistance. Collaborative screen sharing can help resolve issues by sharing a customer's screen with a remote customer service representative. Similarly, collaborative browsing, or co-browsing, can allow a customer and a customer service representative to navigate a web site collaboratively. However, these screen sharing systems can require large amounts of computing resources. For example, large amounts of information associated with the shared screen are often exchanged over the network, straining network communication resources. These screen sharing systems can also burden customers' individual computers during the screen sharing session while screen or web browser contents are transmitted to the customer service representative, adversely affecting performance of the customer's computer. In addition to requiring computing resources, screen share or co-browse systems can require high levels of attention from customer service representatives. That is, with screen share or co-browse systems, customer service representatives are focused on an individual customer, and thereby limited in the number of customers they can assist at a time.
Additionally, collaborative screen share and co-browsing environments can raise privacy concerns. Basic screen share applications allow the customer service representative to view everything on the customer's screen. Other screen share applications allow the customer to specify an individual application such as a web browser to share while keeping private the customer's other applications. However, even when the screen share applications focus on an individual application, the customer may not want to share certain information such as a social security number or credit card number. Still more advanced co-browse environments may allow customers or administrators to mask individual fields. However, the customer must remember that the masking feature exists and use the feature, or the administrator must configure the application or the co-browse session to perform the masking.
An object of this invention is to provide improved systems, apparatus, methods, and computer-readable media for digital data processing. A more particular object is to provide improved systems, apparatus, methods, and computer-readable media for selectively sharing UI elements for collaborative application usage.
The foregoing are among the objects attained by the invention which provides, in one aspect, a digital data processing system, apparatus, method, and computer-readable medium for selectively sharing UI elements between a first and second digital data processor for collaborative application usage. A further object is to provide such improved systems, apparatus, methods, and computer-readable media as to suggest UI elements for selective sharing. The systems, apparatus, methods, and computer-readable media further provide for remote highlighting of UI elements selected in an application executing on the second digital data processor.
In one aspect, the present disclosure includes a system for selectively sharing elements in a UI running on a first digital data processor. The system includes a server digital data processor. The server digital data processor is configured to receive, from the first digital data processor, a collection of UI elements associated with the UI. The collection of UI elements is identified by the first digital data processor based on at least one of: one or more markup attributes corresponding to the UI elements, a content position of the UI elements, a UI definition, or historical data about the UI running on the first or a second digital data processor. The server digital data processor is further configured to transmit, to the second digital data processor, the collection of UI elements for selection on the second digital data processor.
In another aspect, the present disclosure includes a system for selectively sharing UI elements in a UI running on a first digital data processor. The system includes a server digital data processor. The server digital data processor is configured to receive, from the first digital data processor, a collection of elements associated with the UI. The server digital data processor is further configured to identify a subset of the collection of UI elements. The subset of UI elements is identified by the server digital data processor based on at least one of: one or more markup attributes corresponding to the UI elements, a content position of the UI elements, a UI definition, or historical data about the UI running on the first or a second digital data processor. The server digital data processor is configured to transmit, to the second digital data processor, the subset of UI elements for selection on the second digital data processor.
In other aspects, the present disclosure includes a method for selectively sharing UI elements in a UI running on a first digital data processor. The method includes receiving, from the first digital data processor, a collection of UI elements associated with the UI. The method further includes identifying a subset of the collection of user interface elements. The subset of user interface elements is identified by a server digital data processor based on at least one of: one or more markup attributes corresponding to the user interface elements, a content position of the user interface elements, a user interface definition, or historical data about the user interface running on the first or a second digital data processor. The method additionally includes transmitting, to the second digital data processor, the subset of user interface elements for selection on the second digital data processor.
Related aspects of the present disclosure facilitate remote highlighting of the selectively shared UI elements. The server digital data processor is configured to receive, from the second digital data processor, one or more UI elements selected among the collection of UI elements. The server digital data processor is further configured to transmit, to the first digital data processor, an event containing the selected one or more UI elements. A UI definition for the UI running on the first digital data processor is updated to visibly identify at least one of the selected UI elements on the UI based on a size and a position of the at least one of the selected UI elements in the UI definition.
In a further aspect, the present disclosure includes updating the UI definition to include at least one new element to visibly identify the at least one of the selected UI elements by identifying a bounding box size of the selected one or more UI elements, determining a corresponding bounding box size and a corresponding position for one or more regions of visible identification based on the size and the position of the selected one or more UI elements, creating the one or more regions of visible identification using the corresponding bounding box size and the corresponding position, and inserting the one or more regions of visible identification into the UI definition.
Other aspects of the present disclosure provide systems, apparatus, methods, and computer-readable media for suggesting UI elements for selection on the second digital data processor. The UI elements suggested for selection may be determined by identifying related UI elements based on initial validation data, and filtering the related UI elements to retain UI elements identified based on at least one of: the one or more markup attributes corresponding to the user interface elements, the content position of the user interface elements, the user interface definition, or the historical data about the user interface running on the first or second digital data processor.
In a related aspect, the identifying the related user interface elements based on the initial validation data includes identifying one or more unique phrases by performing text mining on the subset of user interface elements, and searching the subset of user interface elements for one or more user interface elements containing the one or more unique phrases.
In other aspects, the markup attributes corresponding to the UI elements may include at least one of <b>, <strong>, <i>, <em>, <u>, <ins>, <mark>, <del>, <font>, color, align, text-align, or text-decoration.
In another aspect, the UI definition includes at least one of a document object model (DOM) tree, hypertext markup language (HTML), or extensible markup language (XML).
In a related aspect, the UI definition includes a tree structure of the DOM tree.
The foregoing and other aspects of the invention are evident in the description that follows and in the drawings.
Various objects, features, and advantages of the present disclosure can be more fully appreciated with reference to the following detailed description when considered in connection with the following drawings, in which like reference numerals identify like elements. The following drawings are for the purpose of illustration only and are not intended to be limiting of the invention, the scope of which is set forth in the detailed description that follows.
The systems, apparatus, methods, and computer-readable media described herein allow for selective sharing of user interface (UI) elements to facilitate collaborative application usage. The selective sharing system described herein can be used in any application that supports collaborative usage.
In a non-limiting example usage scenario, a customer can be using a web browser application and attempting to complete a purchase using an online shopping cart. The customer is unable to complete his purchase and selects a “chat” link for assistance. A customer service representative working remote from the customer receives a request for collaboration. Selected UI elements shown in the customer's application are shared with an application executing on the customer service representative's computer, for example appearing in a collection in the representative's application. The UI elements can be selected for sharing from all UI elements based on UI characteristics, a UI definition, or historical data for a customer or a customer service representative. The application executing on the customer service representative's computer is sometimes referred to herein as a “collaboration application.” One non-limiting example collaboration application on the customer service representative's computer can be a chat window for help.
Included in the collection can be an error message currently displayed in the customer's application, such as “Please enter a valid phone number.” In some embodiments, upon seeing this error message in the collection the customer service representative can select the error message along with a phone number field in the collaboration application. Accordingly, the customer service representative's selections can cause the customer's application to highlight remotely or otherwise visibly identify the error message and phone number field directly in the customer's user interface.
The selective sharing system is configured for selectively sharing UI elements of an application running on a first digital data processor. The system includes a server digital data processor configured to receive, from the first digital data processor, a collection of elements associated with the UI. In some embodiments, the collection of UI elements represents a subset of all available elements in the UI running on the first digital data processor. The subset of UI elements can be selected for sharing from all UI elements based on UI characteristics, a UI definition, or historical data for a customer or a customer service representative. The server digital data processor, or first or second digital data processor can identify the collection of UI elements. In further embodiments, the server digital data processor, or first or second digital data processor are configured to suggest UI elements for a customer service representative to select. The selective sharing system can suggest the UI elements based on initial validation data. The server digital data processor is configured to transmit, to a second digital data processor, the collection of UI elements for selection on the second digital data processor.
In some embodiments, the server digital data processor is further configured to receive, from the second digital data processor, one or more UI elements selected among the collection of UI elements. The server digital data processor is still further configured to transmit, to the first digital data processor, an event containing the selected one or more UI elements. A UI definition for the UI running on the first digital data processor is updated to visibly identify at least one of the selected UI elements on the UI based on a size and a position of the at least one of the selected UI elements in the UI definition.
Customer 102 uses application 106. In some embodiments, customer application 106 can be a web browser configured to render and display a user interface. In this regard, customer application 106 can be implemented, for example, on one or more digital data processing systems in the conventional manner known in the art, as adapted in accord with the teachings herein. Customer application 106 can display an online shopping cart for completing a purchase. Customer 102 has entered his information into customer application 106 and selected the Submit link, but the online shopping cart fails to advance. Customer 102 selects Chat link 136 to request assistance.
Representative 104 receives the request for collaboration from customer 102 via collaboration application 108. In some embodiments, collaboration application 108 can be a chat application. The chat application is configured to display message section 110, and UI elements section 114. Message section 110 lists a transcript of messages exchanged between representative 104 and customer 102. For example, upon receiving the request for collaboration, representative 104 sends a message to customer 102 asking “How may I help you?” Customer 102 replies “I can't complete my order.”
UI elements section 114 displays a collection of UI elements identified from customer application 106. However, modern user interfaces have hundreds or thousands of elements on one screen or page that could potentially be listed in UI elements section 114. Accordingly, one problem is that the collection may become unwieldy if the selective sharing system displays all elements from the UI for customer application 106. One solution is for some embodiments of the selective sharing system to identify a subset of UI elements for selective sharing and display in UI elements section 114. For example, the selective sharing system can identify the subset of UI elements to include in UI elements section 114 based on characteristics of the UI or historical data for the customer or representative. The UI characteristics can include markup attributes, content position, UI definition structure, or any combination of the above.
In some embodiments, representative 104 selects one or more UI elements 116a-b in the user interface of collaboration application 108. The selection causes the selective sharing system to highlight or otherwise visibly identify corresponding UI elements 138, 140 in customer application 106. Customer 102 sees that error message 140 is now highlighted, and customer 102 is able to correct the error in phone number field 138 (one missing digit) and proceed to complete the online order.
In some embodiments, the selective sharing system uses initial validation data received from customer application 106, along with UI characteristics or historical data to suggest UI elements for representative 104 to select. For example, before receiving any selection in collaboration application 108, the selective sharing system may first suggest that representative 104 should select error message element 116b, based on initial validation data and UI characteristics in customer application 106. Non-limiting example initial validation data can be that the Phone number field has too few digits. Non-limiting example UI characteristics can include markup attributes and content position of the error message. For example, the error message may be toward the top of the web page in red text. Remote application 108 may display suggested UI elements in a different color, font, or other visible identification from UI elements actually selected by representative 104. After representative 104 selects error message element 116b, the selective sharing system may further suggest that representative 104 should select phone number field element 116a, based on parsing the content of error message 116b and performing text analytics or text mining on the result to identify unique words or phrases in error message 116b.
Advantageously, the selective sharing system improves response time for customer service representatives. Traditional screen share or co-browse systems can require high levels of attention from customer service representatives. That is, with traditional screen share or co-browse systems, customer service representatives are focused on assisting an individual customer, and limited in the number of customers they can assist at a given time. In contrast, the selective sharing system allows representative 104 to have multiple collaboration applications 108 open at a time assisting multiple customers at a time using selective sharing. Because the selective sharing system selects, shares, and suggests a selected subset of elements in UI elements section 114 compared to a full screen share or co-browse session, collaboration application 104 does not require as high levels of attention to select remote UI elements for highlighting and provide service to an individual customer. Collaboration application 104 also uses fewer computing resources such as lower central processing unit (CPU) usage and less memory. This responsiveness can improve customer service performance metrics such as lowering average handle time.
Additionally, the selective sharing system can address privacy issues. Some embodiments of the selective sharing system transmit only field labels to the representative, without transmitting values entered in those fields. For example, the selective sharing system may transmit the field labels Name, Address, Phone number, Card number, and Expiration date from customer application 106 for display in UI elements section 114. However, the values of the credit card number and expiration date of customer 102 are not transmitted, thereby protecting the privacy of customer 102. Traditional co-browse systems may mask field values to provide privacy. However, masking can add complexity in implementation and use. Customer 102 must remember the masking feature exists and use the feature, or the administrator must configure the application or co-browse session to perform the masking. In contrast, these embodiments allow a customer service representative to provide assistance of a similar quality to screen sharing or co-browsing, without privacy risks, complexity, or resource intensive performance found in traditional screen share or co-browse architectures.
Customer client 122 initiates a selective sharing session by sending request 126 for collaboration to representative client 132. Upon receiving request 126 for collaboration, representative client 132 and customer client 122 exchange application messages 128. Non-limiting example application messages 128 may include chat messages transmitted and received to an application running on representative client 132. In some embodiments, customer client 122 may receive UI element highlighting events 130 from representative client 132. UI element highlighting events 130 may represent selections made by a customer service representative or other assistant where the collaboration application displays a broader collection of UI elements. The customer service representative selects a subset or all elements in the application running on representative client 132.
Some embodiments of customer client 122 and representative client 132 include one or more client digital data processors. The client digital data processors can be of the type commercially available in the marketplace suitable for operation in selective sharing system 142 and adapted in accord with the teachings herein, for example, in communication with applications executing on one or more server 120. Customer client 122 and representative client 132 may be implemented in desktop computers, laptop computers, workstations, mobile computers executing on mobile phones, tablet computers, personal digital assistants (PDAs), or other suitable apparatus adapted based on the systems and methods described herein. The client digital data processors include central processing, memory, storage using a non-transitory computer-readable medium (e.g., a magnetic disk, solid state drive, or other storage medium), and input/output units and other constituent components (not shown) of the type conventional in the art that are programmed or otherwise configured in accord with the teachings herein.
In some embodiments, server 120 or web server 134 include one or more server digital data processors. The server digital data processors can be digital processors of the type commercially available in the marketplace suitable for operation in selective sharing system 142 and adapted in accord with the teachings herein. Some embodiments of selective sharing system 142 may include web server 134 in communication with server 120. For example, server 120 or web server 134 can execute web applications or enterprise applications that directly or indirectly generate UI definitions for display on customer client 122 or representative client 132. In some embodiments, the UI definition can include hypertext markup language (HTML), a document object model (DOM) tree for a web page of the enterprise application or web application, or extensible markup language (XML) representing the enterprise application or web application. Web server 134 may provide or transfer web page assets such as content, text, images, or style sheets in coordination with server 120. In other embodiments of selective sharing system 142, web server 134 may be omitted or optional. Some embodiments of server 120 can utilize rules forming enterprise applications that execute in one or more rules engines, e.g. as discussed elsewhere herein. Though server 120 or web server 134 can be typically implemented in server-class computers such as a minicomputer, server 120 or web server 134 may also be implemented in desktop computers, workstations, laptop computers, tablet computers, personal digital assistants (PDAs), mobile computers, or other suitable apparatus adapted based on the systems and methods described herein. The server digital data processor includes central processing, memory, storage using a non-transitory computer-readable medium (e.g., a magnetic disk, solid state drive, or other storage medium), and input/output units and other constituent components (not shown) of the type conventional in the art that are programmed or otherwise configured in accord with the teachings herein.
In some embodiments, an enterprise can deploy selective sharing system 142 in support of enterprise applications executing on server 120 remote to customer client 122 or representative client 132. Such enterprise applications can include specialized software or hardware used within a specific industry or business function (e.g., human resources, finance, healthcare, telecommunications, insurance, etc.). Alternatively, the enterprise applications can include cross-industry applications (e.g., project management), or other types of software or hardware applications.
In some embodiments, rules define the enterprise applications. Server 120 can be in communication with a rules engine (not shown). The rules engine can be in communication with a rules base and a transactional database (not shown). As the enterprise application executes on a server digital data processor (e.g., server 120), selective sharing system 142 may retrieve any portion of the rules that define the enterprise application from the rules base and process or execute the rules in response to requests or events signaled to or detected by the server digital data processors or customer or representative digital data processors at run-time (e.g., using the rules engine).
The rules base can include a rules base of the type known in the art (albeit configured in accord with the teachings herein) for storing rules (e.g., scripts, logic, controls, instructions, metadata, etc.) and other application-related information in tables, database records, database objects, and so forth. Preferred rules and rules bases can be of the type described in U.S. Pat. No. 5,826,250, entitled “Rules Bases and Methods of Access Therein” and U.S. Pat. No. 7,640,222, entitled “Rules Base Systems and Methods with Circumstance Translation,” the entire contents of both of which are incorporated by reference herein in their entirety. In other embodiments, rules and rules bases that are architected or operated differently may be used as well.
Some embodiments of selective sharing system 142 may utilize multiple rules bases. For example, the rules base may be an enterprise-wide rules base in communication with the rules engine, and domain-specific rules bases may be accessible to server 120, customer client 122, or representative client 132 via network 124. If multiple rules bases are provided in a given embodiment, the rules bases may be of like architecture and operation or may differ in architecture and operation as well.
In some embodiments, rules may comprise meta-information structures. For example, the rules can include data elements or method elements. The method elements can be procedural or declarative. For example, method elements in a rule may be procedural insofar as the rule comprises one or more of a series of ordered steps. Declarative elements in a rule may set forth (i.e., declare) a relation between variables or values (e.g., a loan rate calculation or a decision-making criterion). Alternatively, declarative elements may declare a desired computation or result without specifying how the computations should be performed or how the result should be achieved. In one non-limiting example, a declarative portion of a rule may declare a desired result of retrieving a specified value without specifying a data source for the value or a particular query language for such retrieval (e.g., SQL, CQL, .QL, etc.). In other cases, the declarative portion of a meta-information structure may comprise declarative programming language statements (e.g., SQL). Still other types of declarative meta-information structures are possible.
While some rules may comprise meta-information structures that are wholly procedural and other rules may comprise meta-information structures that are wholly declarative, selective sharing system 142 can also include rules that comprise both procedural and declarative meta-information structures. That is, such rules can have meta-information structure portions that are declarative, as well as meta-information structure portions that are procedural. Furthermore, rules of the illustrated embodiments that comprise meta-information structures may also reference or incorporate other rules. Those other rules may themselves in turn reference or incorporate still other rules. As a result, editing such a rule may affect one or more rules that incorporate it (if any).
An advantage of rules that comprise meta-information structures over conventional rules is that meta-information structures provide administrators with flexibility to apply code-based or model-driven techniques in development and modification of applications or computing platforms. Particularly, like models in a model-driven environment, meta-information structures comprise data elements that can be used to define aspects of a complex system at a higher level of abstraction than source code written in programming languages such as Java or C++. On the other hand, administrators may also embed programming language statements into meta-information structures if the administrators deem that to be the most efficient design for the system being developed or modified. At run-time, the rules engine can convert the data elements of the meta-information structures along with programming language statements (if any) automatically into executable code for the application.
Thus, in some embodiments rules may be the primary artifacts that get created, stored (e.g., in the rules base) or otherwise manipulated to define or modify the overall functionality of rules-based enterprise applications. The enterprise applications may automate or manage various types of work in different business domains at run-time. By way of non-limiting example, rules stored in the rules base may be configured to define aspects of an enterprise application. For example, rules can define the user interface, decision logic, integration framework, process definition, data model, reports, or security settings of a given enterprise application.
The transactional database can include databases of the type known in the art (albeit configured in accord with the teachings herein) for storing corporate, personal, governmental, or other data. Rules such as in the rules base may generate, update, transform, delete, store, or retrieve the data (herein collectively referred to as “processing” the data). Example data may include financial data; customer records; personal data; design-time, development-time, or runtime data related to an application; or other types of data. The transactional database may store the data in tables, database records, or database objects, for example.
The transactional database may be present in any given embodiment. Conversely, some embodiments may use multiple transactional databases, e.g., an enterprise-wide database accessible to server 120 and branch-office specific databases accessible to customer client 122 or representative client 132, by way of non-limiting example. If multiple transactional databases are provided in a given embodiment, the transactional databases may be of like architecture and operation; though, they may have differing architecture or operation, as well.
The rules engine can be of the type conventionally known in the art (albeit configured in accord with the teachings herein) for use in processing or executing rules from the rules base to process data in (or for storage to) the transactional database, e.g. in connection with events signaled to or detected by the rules engine. Preferred such rules engines are of the type described in U.S. Pat. No. 5,826,250, entitled “Rules Bases and Methods of Access Therein,” U.S. Pat. No. 7,640,222, entitled “Rules Base Systems and Methods with Circumstance Translation,” and U.S. Pat. No. 8,250,525, entitled “Proactive Performance Management For Multi-User Enterprise Software Systems,” all of which are incorporated by reference in their entirety herein. The rules engine may be implemented in a single software program, multiple software programs or modules, or a combination of software modules or programs. The rules engine may comprise programming instructions, scripts, or rules (e.g., rules stored in the rules base) or a combination therein.
Some embodiments of the rules engine may execute on or over multiple digital data processors. For example, selective sharing system 142 may invoke the rules engine for execution on a single digital data processor (e.g., a digital data processor on server 120, customer client 122, or representative client 132). Subsequently, selective sharing system 142 may apportion, distribute, or execute portions of the rules engine (or, potentially, the entirety of the rules engine) over multiple digital data processors.
Other ways of implementing or executing the rules engine are also possible. By way of non-limiting example, the rules engine may have additional distinct components or portions that can be apportioned and distributed separately. Non-limiting example components include a data access component for processing data during rule execution, a session management component for keeping track of activity across sessions of interaction with a digital data processor, or a performance monitoring component for monitoring and interacting with various system resources or event logs to manage performance thresholds.
Network 124 can include one or more networks of the type commercially available in the marketplace or otherwise suitable for supporting communication between customer client 122 or representative client 132, web server 134, and server 120 in accord with the teachings herein. Network 124 can be wired or wireless, a cellular network, a Local Area Network (LAN), a Wireless LAN (WLAN), a Metropolitan Area Network (MAN), a Wireless MAN (WMAN), a Wide Area Network (WAN), a Wireless WAN (WWAN), a Personal Area Network (PAN), a Wireless PAN (WPAN), or a network operating in accordance with existing IEEE 802.11, 802.11a, 802.11b, 802.11g, 802.11n, 802.11ac, 802.16, 802.16d, 802.16e, 802.16m standards or future versions or derivatives of the above standards.
Server 120 receives a request 126 for collaboration from customer client 122. Upon receiving request 126 for collaboration, server 120 transmits a request 204 for collaboration to representative client 132. Some embodiments of requests 126, 204 for collaboration may reference or contain a customer identifier representing the customer using customer client 122, or a page identifier, section identifier, or other identification of the UI section over which the customer desires to collaborate. Server 120 transmits a request 206 for UI elements to customer client 122. In some embodiments, when the customer application and collaboration application operate using web pages, customer client 122 and representative client 132 interact with requests and events by importing a JavaScript library configured to parse objects and events, and ultimately perform the selective sharing described herein.
Upon receiving request 206 for UI elements, customer client 122 identifies and selectively shares UI elements for display 208 in a collaboration application executing on representative client 132. In one embodiment, customer client 122 identifies all UI elements displayed in the customer application. For example, if the customer application is an online shopping cart displayed in a web browser, customer client 122 might identify and transmit all document object model (DOM) elements in the DOM tree. However, doing so may present an overly long and unwieldy collection in the collaboration application executing on representative client 132. Accordingly, some embodiments of customer client 122 identify a subset of all UI elements. For example, one such embodiment of customer client 122 might provide a client-side application programming interface (API) allowing administrators to tag or otherwise identify UI elements of interest in advance. Accordingly, when rendering a UI for the customer application in a web browser, the client-side API might result in adding a unique class to each tagged UI element in the DOM tree. One non-limiting example class might be “xray.” Customer client 122 can thus identify each UI element using cascading style sheet (CSS) selectors to select all DOM tree elements with class “xray.” The “xray” class name can refer to a characterization that the UI elements identified from customer client 122 represent an x-ray “inside” the customer application. In other embodiments, customer client 122 may store and reference historical data about previously highlighted UI elements. For example, customer client 122 may track historical data based on the same section of the user interface where previously highlighted UI elements have assisted other customers, or based on a customer identifier where previously highlighted UI elements have assisted the specific customer. In further embodiments, customer client 122 uses initial validation data received from the customer application to suggest UI elements for selection. Customer client 122 may include suggested UI elements in the collection, with properties or metadata that indicate the UI elements are suggested selections.
Server 120 receives event 210 containing the identified and selectively shared UI elements from customer client 122. For example, customer client 122 may transmit the identified UI elements using a JavaScript object notation (JSON) object. Upon receiving event 210 with the identified UI elements, server 120 transmits event 212 containing the received UI elements to representative client 132 for display in the collaboration application. For example, the collaboration application may be a chat application, and representative client 132 may display the received UI elements in a list for selection by the customer service representative. In some embodiments, instead of creating a new event 212, server 120 forwards event 210 containing the identified UI elements from customer client 122 to representative client 132 as event 212.
Some embodiments of customer client 122 may identify the UI elements 208 for selection prior to transmitting request 126 for collaboration. The identified UI elements may be included in the initial request for collaboration, and selective sharing message flow 200 may combine request 126 for collaboration with event 210 containing the identified UI elements. In such embodiments, server 120 may also omit request 206 for UI elements, and combine request 204 for collaboration with event 212 containing the received UI elements, transmitting a combined request to representative client 132.
Representative client 132 and customer client 122 proceed to exchange application messages 128. Non-limiting example application messages may include chat messages exchanged between the customer and customer service representative. The chat messages may be transmitted and received according to a chat protocol such as session initiation protocol or session initiation protocol for instant messaging and presence leveraging extensions (SIP/SIMPLE), or extensible messaging and presence protocol (XMPP) and displayed using the respective JavaScript libraries for customer client 122 and representative client 132. Other chat protocols as known in the art are within the scope of selective sharing message flow 200. Application messages 128 may also include messages that facilitate collaborative application usage such as full collaborative web browsing or co-browsing, or screen sharing with the customer service representative as is known in the art.
Server 120 may receive event 214 containing selected UI elements from representative client 132. For example, event 214 containing selected UI elements may be a JSON object containing each UI element that the customer service representative has selected. Server 120 transmits a UI element highlighting event 130 containing the selected UI elements to customer client 122. Customer client 122 retrieves the UI elements from UI element highlighting event 130 selected by the customer service representative, and proceeds to highlight the selected UI elements in the user interface of the customer application executing on customer client 122.
Requests 126, 204 for collaboration, request 206 for UI elements for selection, events 210, 212 containing identified UI elements, application messages 128, event 214 containing selected UI elements, and UI element highlighting event 130 may be transmitted to and from server 120, customer client 122, and representative client 132 using, for example, a communication protocol such as transmission control protocol/Internet protocol (TCP/IP). Other communication protocols are known in the art and are within the scope of selective sharing message flow 200.
Upon receiving, from a customer client, a request for collaboration, the server transmits a request for UI elements to the customer client (step 310). The server receives, from the customer client, a collection of UI elements associated with a user interface displayed in a customer application on the customer client (step 320). The customer client identifies the collection of UI elements. In some embodiments, the customer client transmits all UI elements displayed in the customer application, or all UI elements displayed in a viewport or window of the customer application. In other embodiments, the customer client identifies and selectively shares a subset of UI elements for transmission to the server. For example, if the user interface is a web page defined using hypertext markup language (HTML), then the customer client can identify UI elements for the collection based on UI characteristics such as markup attributes or content position on the web page. The customer client can also identify UI elements for the collection based on a UI definition such as a document object model (DOM) tree structure for the web page. Additionally, the customer client can use historical data from the customer client or the representative client to identify UI elements. In further embodiments, the customer client uses initial validation data received from the customer application to suggest UI elements for selection. The customer client may include suggested UI elements in the collection, using properties or metadata that indicate the UI elements are suggested selections. In some embodiments, the server receives the collection of UI elements in a JSON object.
The server transmits, to the representative client, the collection of UI elements for the customer service representative to select (step 330). In some embodiments, the server transmits a JSON object that contains the UI elements or forwards the JSON object received from the customer client. The representative client may display the collection of UI elements in a UI on the collaboration application. The selective sharing system allows the customer service representative to indicate a selection among the selectively shared UI elements displayed in the collaboration application. The server receives, from the representative client, a selection for highlighting among the collection of UI elements (step 340). The server transmits, to the customer client, the selected UI elements for highlighting (step 350). The customer client may proceed to highlight or otherwise visibly identify the UI elements selected by the customer service representative. In some embodiments, the highlighting may include updating a UI definition of the customer application executing on the customer client.
Server 120 receives a request 126 for collaboration from customer client 122. Upon receiving request 126 for collaboration, server 120 transmits a request 404 for collaboration to representative client 132. Some embodiments of requests 126, 404 for collaboration may reference or contain a page identifier, section identifier, or other identification of the user interface section over which the customer desires to collaborate. Further embodiments of requests 126, 404 for collaboration may also reference or contain a customer identifier representing the customer who is using customer client 122. In some embodiments, when the customer application and collaboration application operate using web pages, customer client 122 and representative client 132 interact with requests and events by importing a JavaScript library configured to parse objects and events, and ultimately perform the selective sharing described herein.
In some embodiments, server 120 transmits request 406 for UI elements to customer client 122. Server 120 receives response 408 from customer client 122 containing the requested UI elements. Response 408 containing the requested UI elements can contain a collection of all UI elements displayed by the user interface corresponding to the customer application. Alternatively, response 408 can include a subset of UI elements identified by customer client 122. Some embodiments of server 120 proceed to identify a subset of UI elements 410 for selective sharing and transmission to representative client 132. For example, server 120 may identify the UI elements based on historical data about previously highlighted UI elements and prior customer collaboration or representative collaboration, UI characteristics, or a UI definition. The UI characteristics can include markup attributes or properties, or content position in the user interface for the customer application. The UI definition can include a tree structure for the UI. In further embodiments, server 120 receives initial validation data from the customer application on customer client 122 and uses the validation data to suggest UI elements for selection. Server 120 may then include suggested UI elements in the collection, with properties or metadata that indicate the UI elements are suggested selections.
In still further embodiments, server 120 omits transmitting request 406 for UI elements and receiving response 408 containing the requested UI elements. Instead, server 120 identifies UI elements 410 for selective sharing and selection based on the page identifier or section identifier for the UI section displayed by the customer application. For example, an administrator may configure a data structure that maps between page or section identifiers, and UI elements to transmit for selection. Some embodiments of server 120 may further apply the criteria described above regarding historical data, UI characteristics, or UI definition structure to filter the UI elements identified from the data structure.
Server 120 proceeds to transmit event 412 containing the identified UI elements to representative client 132 for display in the collaboration application. For example, the collaboration application may be a chat application, and representative client 132 may display the received UI elements in a list for selection by the customer service representative.
Representative client 132 and customer client 122 proceed to exchange application messages 128. Non-limiting example application messages may include chat messages sent between the customer and customer service representative. The chat messages may be transmitted and received according to a chat protocol such as session initiation protocol or session initiation protocol for instant messaging and presence leveraging extensions (SIP/SIMPLE), or extensible messaging and presence protocol (XMPP). Other chat protocols as known in the art are within the scope of selective sharing message flow 400. Application messages 128 may also include messages that facilitate collaborative application usage such as collaborative web browsing or co-browsing, or screen sharing with the customer service representative as is known in the art.
Server 120 may receive event 414 containing selected UI elements from representative client 132. For example, event 414 containing selected UI elements may be a JSON object containing each UI element that the customer service representative has selected. Server 120 transmits UI element highlighting event 130 containing the selected UI elements to customer client 122. Customer client 122 retrieves the UI elements from UI element highlighting event 130 selected by the customer service representative, and proceeds to highlight the selected UI elements in the user interface of the customer application executing on customer client 122.
Requests 126, 404 for collaboration, request 406 and response 408 for UI elements for selection, response 412 containing identified UI elements, application messages 128, event 414 containing selected UI elements, and UI element highlighting event 130 may be transmitted to and from server 120, customer client 122, and representative client 132, for example, using a communication protocol such as transmission control protocol/Internet protocol (TCP/IP). Other communication protocols as known in the art are within the scope of selective sharing message flow 400.
A server receives, from a customer client, a request for collaboration (step 510). Based on the request, the server determines a collection of UI elements associated with a user interface displayed in a customer application on the customer client (step 520). In some embodiments, the received request includes an enumeration of UI elements from the customer client in a JSON object. The received request may contain all or a subset of UI elements displayed in the customer application or in a viewport or window of the user interface.
Based on the collection, the server identifies UI elements for display in the remote collaboration application (step 530). Some embodiments of the server identify all UI elements. Other embodiments of the server identify a subset of UI elements. In still further embodiments, the selective sharing system allows an administrator to configure the collection of UI elements for selective sharing. The server may retrieve the pre-configured collection of UI elements based on a page identifier or section identifier received in the request. In yet further embodiments, if the user interface in the customer application is a web page defined using hypertext markup language (HTML), then the received request may include partial or full HTML and the server may identify UI elements for selective sharing based on UI characteristics including markup attributes or content position on the web page. In some embodiments, the received request may include a partial or full UI definition based on a tree structure, such as a document object model (DOM) tree structure for the customer application user interface. The server may identify UI elements for selective sharing based on the tree structure received in the request. Additionally, the server may identify UI elements for selective sharing using historical data available from the customer client or the representative client. In further embodiments, the server uses initial validation data received from the customer application to suggest UI elements for selection. The server may include suggested UI elements in the collection, using properties or metadata that indicate the UI elements are suggested selections.
The server transmits, to the representative client, the collection of UI elements for the customer service representative to select. In some embodiments, the server transmits a JSON object that contains the UI elements. The representative client may display the collection of UI elements in a user interface on the collaboration application. The selective sharing system allows the customer service representative to indicate a selection among the UI elements displayed in the collaboration application.
The server receives, from the representative client, a selection of UI elements for highlighting in the customer application (step 540). The server transmits, to the customer client, the selected UI elements for highlighting (step 550). The customer client may proceed to highlight the UI elements selected by the customer service representative. In some embodiments, the highlighting may include updating a UI definition of the customer application executing on the customer client.
Method 600 begins with scanning UI elements from the customer client (step 610). In some embodiments, the customer client enumerates all UI elements displayed in the user interface for the customer application, or all UI elements displayed in a viewport or window of the user interface.
The selective sharing system proceeds to analyze the scanned UI elements from the customer client. The customer client, server, or representative client may perform the analysis. In some embodiments, the selective sharing system identifies UI elements for selective sharing based on markup attributes or position in content displayed in the customer application (step 620). For example, if the UI definition for the customer application is implemented in hypertext markup language (HTML), the selective sharing system may determine important links or text on the user interface based on <ul>, <ol>, <li>, or <dl> HTML tags that identify UI elements being displayed in a list. The selective sharing system may also identify UI elements enclosed in HTML text formatting tags such as <b>, <strong> for bold, <i> or <em> for italics or emphasis, <u> or <ins> tag for underlining, <mark> tag for highlighting, <del> tag for strikethrough, “align” attributes in <p> tags for text alignment, or <font> tags and attributes for text colors, fonts, and other attributes. If the UI definition is further implemented using cascading stylesheets, the selective sharing system may identify UI elements based on analyzing the CSS. For example, the selective sharing system may identify UI elements based on CSS “color” for text color, “text-align” for text alignment, “text-decoration” for other text decorations such as overlines, underlines, or strikethrough, or other CSS properties that modify text.
In some embodiments, the selective sharing system identifies UI elements for selective sharing based on a UI definition corresponding to the UI of the customer application (step 630). If the customer application is implemented using a web page, a non-limiting example UI definition may include a document object model (DOM) tree for the web page. The markup attributes described earlier may be represented in a web browser using a DOM tree. Accordingly, the selective sharing system may traverse the tree structure of the DOM to identify potential UI elements for selective sharing. The tree structure allows the selective sharing system to react to HTML events in the web page that might not be able to be represented as markup attributes. For example, the selective sharing system might determine based on the tree structure that the customer's mouse pointer is resting over an error message, and identify the error message as a UI element for the customer service representative to highlight remotely. Furthermore, some embodiments of the selective sharing system can also analyze the UI definition to identify UI elements corresponding to required fields or user-interactable fields (e.g., fields that accept user input). In still further embodiments, the selective sharing system may analyze the UI definition to identify a “checkout” or “submit” link or button, difficult-to-find links or elements in the UI, or video or audio.
In some embodiments, the selective sharing system identifies UI elements for selective sharing based on historical data for customer clients or representative clients (step 640). For example, based on historical data for customer clients, the selective sharing system may identify UI elements that other customers, either individually or in the aggregate, have frequently requested collaboration on previously. Alternatively, based on historical data for representative clients, the selective sharing system may identify UI elements that other customer service representatives, either individually or in the aggregate, have remotely highlighted previously. Accordingly, some embodiments of the selective sharing system can analyze the UI definition to identify UI elements corresponding to frequently used fields.
In some embodiments, the selective sharing system suggests UI elements for selection using initial validation data (step 650). Traditionally, customer applications and web pages can perform client-side validation on field values in the web browser, without needing to transmit the field values to a server. For example, traditional validation can include verifying the number of digits in a phone number or credit card, verifying password requirements such as password length and number of uppercase or lowercase characters or symbols, verifying the type of data that the customer has entered (e.g., text in a numeric or date field), verifying minimum or maximum values, or verifying that required UI fields are filled in with values prior to submission of the form. Some embodiments of the selective sharing system are able to use results of initial validation to suggest UI elements for selection in the collaboration application. For example, the selective sharing system can determine the field and field label corresponding to an initial validation error (e.g., Phone number, Credit card number). The selective sharing system can suggest the UI element for selection that caused the initial validation error. For example, the selective sharing system may suggest the Phone number UI element for selection in the collaboration application. Traditional client-side validation might stop after identifying a field that fails to validate. In contrast, based on the corresponding field label, the selective sharing system may search the collection of UI elements to identify related UI elements that contain a portion of the field label. For example, if the selective sharing system receives an initial validation error relating to the Phone number field, the selective sharing system can suggest UI elements for selection that contain a portion of the field label “Phone number.” One example might be a related error message UI element “Credit card error (phone number).” The selective sharing system is able to provide improved assistance to the customer by suggesting all related UI elements to the representative for selective sharing in the customer application UI. In some embodiments, the selective sharing system may allow an administrator to pre-configure related UI elements, and retrieve the pre-configured related UI elements from a mapping between UI elements in the collection.
The selective sharing system retrieves UI elements based on the identified tags and attributes (step 720). For example, an administrator may pre-configure tags and attributes that indicate important links or text in the user interface. The administrator may create a collection of allowed tags and attributes, such as a whitelist. The whitelist may include <ul>, <ol>, <li>, or <dl> HTML tags that identify UI elements being displayed in a list. The whitelist may also include HTML text formatting tags such as <b>, <strong> for bold, <i> or <em> for italics or emphasis, <u> or <ins> tag for underlining, <mark> tag for highlighting, <del> tag for strikethrough, “align” attributes in <p> tags for text alignment, or <font> tags and attributes for text colors, fonts, and other attributes. For each tag or attribute, the selective sharing system may retrieve elements in the DOM tree using JavaScript function calls such as Document.getElementsByTagName( ) or Element.getElementsByTagName( ). These functions return DOM elements with a given tag name as identified UI elements, either all DOM elements in the HTML document, or DOM elements that are children of a given DOM element. To identify UI elements corresponding to attributes and attribute values, the selective sharing system can use JavaScript functions Document.querySelectorAll( ) or Element.querySelectorAll( ) to return DOM elements that match a given set of selectors. In some embodiments, the administrator may pre-configure the selectors to select attributes or attribute values of interest. If the UI definition is further implemented using cascading stylesheets, the selective sharing system may identify UI elements based on attributes defined in the CSS. For example, the selective sharing system may identify UI elements based on CSS “color” for text color, “text-align” for text alignment, “text-decoration” for other text decorations such as overlines, underlines, or strikethrough, or other CSS properties that modify text. The selective sharing system can create selectors that retrieve UI elements having the attributes described above.
In some embodiments, the selective sharing system determines a relative position of UI elements in the received UI definition (step 730). For example, the selective sharing system can request a length or count of all elements that use a given tag, attribute, or attribute value. Based on the length of the selected elements, the selective sharing system may determine that the relative position should be length/2. That is, the selective sharing system determines that the customer application has rendered elements with an index lower than length/2 relatively higher on the HTML page, and elements with an index higher than length/2 relatively lower on the page. Other relative positions may be used based on the length of the selected elements, such as length/5, length/4, or length/3. The selective sharing system identifies UI elements based on the relative position (step 740). For example, the selective sharing system may iterate through the UI elements until the selective sharing system reaches an index higher than the relative position.
If the customer application is implemented using a web page, a non-limiting example UI definition may include a document object model (DOM) tree for the web page. The markup attributes described earlier may be represented in a web browser using a DOM tree. Accordingly, the selective sharing system may retrieve and traverse the tree structure of the DOM to identify potential UI elements for selective sharing (step 810). The tree structure allows the selective sharing system to identify UI elements by reacting to hypertext markup language (HTML) events or DOM events in the web page (step 820). The HTML events and DOM events might not be able to be represented as markup attributes. For example, the selective sharing system may register an event listener to be notified of mouse events. The selective sharing system might thereby determine based on the tree structure that the customer's mouse pointer is resting over an error message, and identify the error message as a UI element for the customer service representative to highlight remotely.
Some embodiments of the selective sharing system can identify UI elements based on input field types (step 830). For example, the selective sharing system can analyze the UI definition to identify UI elements corresponding to input field properties, such as fields that require user input, or user-interactable fields that are capable of accepting user input. To identify fields that require user input, the remote system may check the value of the property HTMLInputElement.required. This property returns true if a field requires user input, and false otherwise. To identify fields capable of accepting user input, the remote system may check the value of the property HTMLInputElement.disabled or HTMLInputElement.readonly. These properties return true if a field does not accept user input, and false if the field is capable of accepting user input.
Some embodiments of the selective sharing system can identify UI elements based on table structure (step 840). Some customer applications can use a table structure to identify and display error messages. For example, the customer application UI definition might display multiple error messages using multiple table rows with one error message UI element per table row. The selective sharing system can use a JavaScript function Document.getElementsByTagName(“tr”) and Document.getElementsByTagName(“td”) to retrieve table rows with a <tr> HTML tag and individual table cells with a <td> tag.
Method 640 begins by retrieving a customer identifier or a representative identifier from a received event (step 910). The selective sharing system requests and receives, from the server, UI elements corresponding to historical data based on the retrieved customer identifier or representative identifier (step 920). For example, based on historical data for customer clients, the server may identify UI elements that other customers, either individually or in the aggregate, have frequently requested collaboration on previously. Alternatively, based on historical data for representative clients, the server may identify UI elements that other customer service representatives, either individually or in the aggregate, have remotely highlighted previously. Accordingly, some embodiments of the selective sharing system can identify UI elements corresponding to frequently used fields for customers or customer service representatives.
However, historical data for a given customer or representative can include a large and overwhelming number of UI elements. Accordingly, some embodiments of the selective sharing system may identify error messages in the customer application UI based on characteristics of the UI (step 930). The UI characteristics may include tags or attribute values, relative content position, or aspects of the UI definition. The selective sharing system may perform text analytics or text mining such as parsing the error messages to identify unique phrases or class names. For example, the selective sharing system may determine that an error message contains the unique phrases “credit card” or “phone number.” Alternatively, the selective sharing system may determine that an error message is identified by the class name “address-error,” representing an error message that might be displayed for an error corresponding to an Address field in the UI. Accordingly, the selective sharing system filters the list of UI elements identified by historical data based on the identified error message (step 940). For example, the selective sharing system may retain only UI elements that mention “credit card” or “phone number” based on the unique phrases in the identified error message, and remove other UI elements. Alternatively, the selective sharing system may retain only UI elements having the unique class name “address-error” based on the identified error message.
Method 650 begins with receiving initial validation data (step 1010). In some embodiments, the selective sharing system may perform initial validation using JavaScript form validation, hypertext markup language (HTML) validation such as provided in HTML version 5, Ajax form validation, or client-side validation provided by other third-party libraries such as Drupal. The initial validation data can include client-side validation results, such as input validation or pattern matching. Non-limiting example input validation includes confirming an input type of text, date, number, telephone number, or uniform resource locator (URL). Non-limiting example pattern matching includes using regular expressions to represent patterns for matching. If the UI definition for the application executing on the customer client uses a document object model (DOM) tree in a web browser, the selective sharing system can identify initial validation data using JavaScript functions such as HTMLFormElement.checkValidity( ) or HTMLFormElement.reportValidity( ). The checkValidity( ) and reportValidity( ) methods return true if the element's child controls are subject to constraint validation and satisfy those constraints, or false if some controls do not satisfy their constraints. The methods can also fire an event named “invalid” corresponding to any control that does not satisfy its constraints, thus reporting client-side validity errors to the selective sharing system.
The selective sharing system identifies related UI elements based on the initial validation data (step 1020). For example, based on initial validation data identifying that a Home phone number field is invalid, the selective sharing system can identify related UI elements. Some embodiments of the selective sharing system can use text analytics or text mining to identify unique words and phrases from the initial validation data, such as “home phone” and “phone number.” The selective sharing system can use the unique words and phrases to iterate through the customer application UI elements and parse the corresponding fields to identify related UI elements that mention “home phone” or “phone number.” While the phrase “home phone” may not match any related UI elements, the phrase “phone number” may match the following UI elements: “Mobile phone number,” “Work phone number,” “Billing phone number,” and an error message “Credit card error (phone number).”
However, identifying related UI elements can still result in a large list of potential UI elements to suggest for selection to the representative. The selective sharing system filters the collection of related UI elements based on UI characteristics and historical data (step 1030). For example, UI characteristics such as markup attributes and content position can identify the error message UI element “Credit card error (phone number)” as a related UI element that the selective sharing system should keep in the collection. The error message UI element may have different markup attributes such as being in a different text color and presented in close proximity to the “Billing phone number” field. Furthermore, historical data can confirm that the error message UI element “Credit card error (phone number)” is a UI element that other customer service representatives frequently select for selective sharing in the customer's application UI.
For the customer client, the selective sharing system assigns a customer-side unique identifier to each UI element displayed in the customer application. For example, the selective sharing system may assign a customer-side unique identifier to each document object model (DOM) element in the DOM tree. For the representative client, upon selecting a UI element for remote highlighting, the selective sharing system determines the corresponding customer-side unique identifier associated with the selected UI element in the customer's application. The selective sharing system constructs a remote highlighting event such as a JSON object including the customer-side unique identifier for the selected UI element. The selective sharing system transmits the remote highlighting event directly or indirectly from the representative client to the customer client. As a non-limiting example of indirect transmission, the selective sharing system may transmit the remote highlighting event from the representative client to the server, and from the server to the customer client.
The customer client receives the remote highlighting event containing the selected UI element to highlight (step 1110). For example, the customer client retrieves the customer-side unique identifier from the received event of the UI element selected by the representative. The customer client uses the customer-side unique identifier to look up the corresponding UI element in the tree structure for the user interface of the customer application (step 1120). For example, if the user interface for the customer application is implemented as a web page, the customer client retrieves the selected UI element from the DOM tree based on the customer-side unique identifier. The customer client can use a JavaScript function document.getElementById( ) to retrieve a DOM element that corresponds to a given identifier. The customer client uses JavaScript functions to determine a bounding box, position, and z-index for the selected UI element. The customer client determines a corresponding bounding box, position, and layer for the new highlight based on the selected UI element (step 1130). If the user interface for the customer application is implemented in a DOM tree, the customer client creates a new <div> element into the DOM tree. The <div> HTML tag is generally used to define a division or section in a web page. The division can have its own size, position, and layering on the web page. For example, the customer client may define the new division to be slightly wider (e.g., one pixel) along each side of the bounding box for the selected UI element, with the same center position as the selected UI element. For layering, the customer client may also configure the new division to have a z-index with a larger or smaller value than the z-index of the selected UI element, so as to display the new division in front of the selected UI element. The customer client can configure the new division to be partially transparent in color so that the selected UI element can be seen behind the new division. The customer client then inserts the newly created highlight into the tree structure (step 1140). For example, the customer client may insert the new division element into the DOM tree at the appropriate location in the tree, near the selected UI element. In some embodiments, the customer client modifies existing attributes or properties of the selected UI element to create the highlight, rather than inserting a new element into the DOM tree. For example, the customer client may modify background color or text color attributes or properties to create the highlight.
The web page corresponding to the UI for the customer application contains root document node 1202. Root document node 1202 contains head node 1204 and body node 1206. Head node 1204 contains metadata such as title 1208 of “Payment Info—Shopping Cart” 1210, author, and search terms for the web page. Body node 1206 contains example UI elements displayed in the customer application. Font element 1214 indicates that color attribute 1218 of the corresponding text will be red 1220. Emphasis element 1216 indicates that the corresponding text will be italicized, and text element 1222 contains the error message introduced in
The elements may have attributes for display in the UI, such as a size, position, bounding box size, or layer. Some embodiments of the selective sharing system also assign a customer-side unique identifier to some or all elements in the tree structure. The customer-side unique identifier allows the selective sharing system to identify a UI element selected by the customer service representative. For example, the customer service representative may select the error message corresponding to text 1222. The selective sharing system determines the smallest DOM element as selected UI element 1224, which is emphasis element 1216. The selective sharing system determines the bounding box size, position, and layer for emphasis element 1216. The selective sharing system creates insertion 1226 as new div element 1212 based on the bounding box size, position, and layer for emphasis element 1216. The selective sharing system inserts new div element 1212 into tree structure 1200. Alternative embodiments of the selective sharing system can highlight the selected UI element by modifying attributes or properties of an existing element, such as background color or color, instead of inserting a new div element.
Other embodiments are within the scope and spirit of the selective sharing systems and methods. For example, the selective sharing functionality described above can be implemented using software, hardware, firmware, hardwiring, or combinations of any of these. One or more digital data processors operating in accordance with instructions may implement the functions associated with selective sharing in accordance with the present disclosure as described above. If such is the case, it is within the scope of the selective sharing systems and methods that such instructions may be stored on one or more non-transitory computer-readable storage media (e.g., a magnetic disk, solid state drive, or other storage medium). Additionally, as described earlier, modules implementing functions may also be physically located at various positions, including being distributed such that portions of functions are implemented at different physical locations.
The selective sharing systems and methods are not to be limited in scope by the specific embodiments described herein. Indeed, other various embodiments of and modifications to the shape connecting, in addition to those described herein, will be apparent to those of ordinary skill in the art from the foregoing description and accompanying drawings. Thus, such other embodiments and modifications are intended to fall within the scope of the shape connecting systems and methods described herein. Furthermore, although the shape connecting has been described herein in the context of a particular implementation in a particular environment for a particular purpose, those of ordinary skill in the art will recognize that its usefulness is not limited thereto and that the shape connecting may be beneficially implemented in any number of environments for any number of purposes.
| Number | Name | Date | Kind |
|---|---|---|---|
| 4047059 | Rosenthal | Sep 1977 | A |
| 4344142 | Diehr, II et al. | Aug 1982 | A |
| 4602168 | Single | Jul 1986 | A |
| 4607232 | Gill, Jr. | Aug 1986 | A |
| 4659944 | Miller, Sr. et al. | Apr 1987 | A |
| 4701130 | Whitney et al. | Oct 1987 | A |
| 4866634 | Reboh et al. | Sep 1989 | A |
| 4884217 | Skeirik et al. | Nov 1989 | A |
| 4895518 | Arnold et al. | Jan 1990 | A |
| 4930071 | Tou et al. | May 1990 | A |
| 4953106 | Gansner et al. | Aug 1990 | A |
| 5062060 | Kolnick | Oct 1991 | A |
| 5077491 | Heck et al. | Dec 1991 | A |
| 5093794 | Howie et al. | Mar 1992 | A |
| 5119465 | Jack et al. | Jun 1992 | A |
| 5129043 | Yue | Jul 1992 | A |
| 5136184 | Deevy | Aug 1992 | A |
| 5136523 | Landers | Aug 1992 | A |
| 5140671 | Hayes et al. | Aug 1992 | A |
| 5193056 | Boes | Mar 1993 | A |
| 5199068 | Cox | Mar 1993 | A |
| 5204939 | Yamazaki et al. | Apr 1993 | A |
| 5228116 | Harris et al. | Jul 1993 | A |
| 5259766 | Sack et al. | Nov 1993 | A |
| 5262941 | Saladin et al. | Nov 1993 | A |
| 5267175 | Hooper | Nov 1993 | A |
| 5267865 | Lee et al. | Dec 1993 | A |
| 5270920 | Pearse et al. | Dec 1993 | A |
| 5276359 | Chiang | Jan 1994 | A |
| 5276885 | Milnes et al. | Jan 1994 | A |
| 5291394 | Chapman | Mar 1994 | A |
| 5291583 | Bapat | Mar 1994 | A |
| 5295256 | Bapat | Mar 1994 | A |
| 5297279 | Bannon et al. | Mar 1994 | A |
| 5301270 | Steinberg et al. | Apr 1994 | A |
| 5310349 | Daniels et al. | May 1994 | A |
| 5311422 | Loftin et al. | May 1994 | A |
| 5326270 | Ostby et al. | Jul 1994 | A |
| 5333254 | Robertson | Jul 1994 | A |
| 5337407 | Bates | Aug 1994 | A |
| 5339390 | Robertson et al. | Aug 1994 | A |
| 5374932 | Wyschogrod et al. | Dec 1994 | A |
| 5379366 | Noyes | Jan 1995 | A |
| 5379387 | Carlstedt et al. | Jan 1995 | A |
| 5381332 | Wood | Jan 1995 | A |
| 5386559 | Eisenberg et al. | Jan 1995 | A |
| 5395243 | Lubin et al. | Mar 1995 | A |
| 5412756 | Bauman et al. | May 1995 | A |
| 5421011 | Camillone et al. | May 1995 | A |
| 5421730 | Lasker, III et al. | Jun 1995 | A |
| 5446397 | Yotsuyanagi | Aug 1995 | A |
| 5446885 | Moore et al. | Aug 1995 | A |
| 5450480 | Man et al. | Sep 1995 | A |
| 5463682 | Fisher et al. | Oct 1995 | A |
| 5473732 | Chang | Dec 1995 | A |
| 5477170 | Yotsuyanagi | Dec 1995 | A |
| 5481647 | Brody et al. | Jan 1996 | A |
| 5499293 | Behram et al. | Mar 1996 | A |
| 5504879 | Eisenberg et al. | Apr 1996 | A |
| 5512849 | Wong | Apr 1996 | A |
| 5519618 | Kastner et al. | May 1996 | A |
| 5537590 | Amado | Jul 1996 | A |
| 5542024 | Balint et al. | Jul 1996 | A |
| 5542078 | Martel et al. | Jul 1996 | A |
| 5548506 | Srinivasan | Aug 1996 | A |
| 5561740 | Barrett et al. | Oct 1996 | A |
| 5579223 | Raman | Nov 1996 | A |
| 5579486 | Oprescu et al. | Nov 1996 | A |
| 5586311 | Davies et al. | Dec 1996 | A |
| 5596752 | Knudsen et al. | Jan 1997 | A |
| 5597312 | Bloom et al. | Jan 1997 | A |
| 5608789 | Fisher et al. | Mar 1997 | A |
| 5611076 | Durflinger et al. | Mar 1997 | A |
| 5627979 | Chang et al. | May 1997 | A |
| 5630127 | Moore et al. | May 1997 | A |
| 5649192 | Stucky | Jul 1997 | A |
| 5655118 | Heindel et al. | Aug 1997 | A |
| 5664206 | Murow et al. | Sep 1997 | A |
| 5675753 | Hansen et al. | Oct 1997 | A |
| 5678039 | Hinks et al. | Oct 1997 | A |
| 5689663 | Williams | Nov 1997 | A |
| 5715450 | Ambrose et al. | Feb 1998 | A |
| 5732192 | Malin et al. | Mar 1998 | A |
| 5754740 | Fukuoka et al. | May 1998 | A |
| 5761063 | Jannette et al. | Jun 1998 | A |
| 5761673 | Bookman et al. | Jun 1998 | A |
| 5765140 | Knudson et al. | Jun 1998 | A |
| 5768480 | Crawford, Jr. et al. | Jun 1998 | A |
| 5788504 | Rice et al. | Aug 1998 | A |
| 5795155 | Morrel-Samuels | Aug 1998 | A |
| 5809212 | Shasha | Sep 1998 | A |
| 5815415 | Bentley et al. | Sep 1998 | A |
| 5819243 | Rich | Oct 1998 | A |
| 5819257 | Monge et al. | Oct 1998 | A |
| 5822780 | Schutzman | Oct 1998 | A |
| 5825260 | Ludwig et al. | Oct 1998 | A |
| 5826077 | Blakeley et al. | Oct 1998 | A |
| 5826239 | Du et al. | Oct 1998 | A |
| 5826250 | Trefler | Oct 1998 | A |
| 5826252 | Wolters, Jr. et al. | Oct 1998 | A |
| 5829983 | Koyama et al. | Nov 1998 | A |
| 5831607 | Brooks | Nov 1998 | A |
| 5832483 | Barker | Nov 1998 | A |
| 5841435 | Dauerer et al. | Nov 1998 | A |
| 5841673 | Kobayashi et al. | Nov 1998 | A |
| 5864865 | Lakis | Jan 1999 | A |
| 5873096 | Lim et al. | Feb 1999 | A |
| 5875334 | Chow et al. | Feb 1999 | A |
| 5875441 | Nakatsuyama et al. | Feb 1999 | A |
| 5880614 | Zinke et al. | Mar 1999 | A |
| 5880742 | Rao et al. | Mar 1999 | A |
| 5886546 | Hwang | Mar 1999 | A |
| 5890146 | Wavish et al. | Mar 1999 | A |
| 5890166 | Eisenberg et al. | Mar 1999 | A |
| 5892512 | Donnelly et al. | Apr 1999 | A |
| 5907490 | Oliver | May 1999 | A |
| 5907837 | Ferrel et al. | May 1999 | A |
| 5909213 | Martin | Jun 1999 | A |
| 5910748 | Reffay et al. | Jun 1999 | A |
| 5911138 | Li et al. | Jun 1999 | A |
| 5918222 | Fukui et al. | Jun 1999 | A |
| 5920717 | Noda | Jul 1999 | A |
| 5930795 | Chen et al. | Jul 1999 | A |
| 5945852 | Kosiec | Aug 1999 | A |
| 5974441 | Rogers et al. | Oct 1999 | A |
| 5974443 | Jeske | Oct 1999 | A |
| 5978566 | Plank et al. | Nov 1999 | A |
| 5983267 | Shklar et al. | Nov 1999 | A |
| 5983369 | Bakoglu | Nov 1999 | A |
| 5987415 | Breese et al. | Nov 1999 | A |
| 5990742 | Suzuki | Nov 1999 | A |
| 5995948 | Whitford et al. | Nov 1999 | A |
| 5995958 | Xu | Nov 1999 | A |
| 6008673 | Glass et al. | Dec 1999 | A |
| 6008808 | Almeida et al. | Dec 1999 | A |
| 6012098 | Bayeh et al. | Jan 2000 | A |
| 6020768 | Lim | Feb 2000 | A |
| 6023704 | Gerard et al. | Feb 2000 | A |
| 6023714 | Hill et al. | Feb 2000 | A |
| 6023717 | Argyroudis | Feb 2000 | A |
| 6028457 | Tihanyi | Feb 2000 | A |
| 6037890 | Glass et al. | Mar 2000 | A |
| 6044373 | Gladney et al. | Mar 2000 | A |
| 6044466 | Anand et al. | Mar 2000 | A |
| 6078982 | Du et al. | Jun 2000 | A |
| 6085188 | Bachmann et al. | Jul 2000 | A |
| 6085198 | Skinner et al. | Jul 2000 | A |
| 6091226 | Amano | Jul 2000 | A |
| 6092036 | Hamann | Jul 2000 | A |
| 6092083 | Brodersen et al. | Jul 2000 | A |
| 6094652 | Faisal | Jul 2000 | A |
| 6098172 | Coss et al. | Aug 2000 | A |
| 6105035 | Monge et al. | Aug 2000 | A |
| 6108004 | Medl | Aug 2000 | A |
| 6122632 | Botts et al. | Sep 2000 | A |
| 6125363 | Buzzeo et al. | Sep 2000 | A |
| 6130679 | Chen et al. | Oct 2000 | A |
| 6137797 | Bass et al. | Oct 2000 | A |
| 6144997 | Lamming et al. | Nov 2000 | A |
| 6151595 | Pirolli et al. | Nov 2000 | A |
| 6151624 | Teare et al. | Nov 2000 | A |
| 6154738 | Call | Nov 2000 | A |
| 6167441 | Himmel | Dec 2000 | A |
| 6177932 | Galdes et al. | Jan 2001 | B1 |
| 6185516 | Hardin et al. | Feb 2001 | B1 |
| 6185534 | Breese et al. | Feb 2001 | B1 |
| 6192371 | Schultz | Feb 2001 | B1 |
| 6194919 | Park | Feb 2001 | B1 |
| 6212502 | Ball et al. | Apr 2001 | B1 |
| 6216135 | Brodersen et al. | Apr 2001 | B1 |
| 6233332 | Anderson et al. | May 2001 | B1 |
| 6233617 | Rothwein et al. | May 2001 | B1 |
| 6240417 | Eastwick et al. | May 2001 | B1 |
| 6243713 | Nelson et al. | Jun 2001 | B1 |
| 6246320 | Monroe | Jun 2001 | B1 |
| 6275073 | Tokuhiro | Aug 2001 | B1 |
| 6275790 | Yamamoto et al. | Aug 2001 | B1 |
| 6281896 | Alimpich et al. | Aug 2001 | B1 |
| 6282547 | Hirsch | Aug 2001 | B1 |
| 6300947 | Kanevsky | Oct 2001 | B1 |
| 6304259 | DeStefano | Oct 2001 | B1 |
| 6308163 | Du et al. | Oct 2001 | B1 |
| 6310951 | Wineberg et al. | Oct 2001 | B1 |
| 6311324 | Smith et al. | Oct 2001 | B1 |
| 6313834 | Lau et al. | Nov 2001 | B1 |
| 6314415 | Mukherjee | Nov 2001 | B1 |
| 6324693 | Brodersen et al. | Nov 2001 | B1 |
| 6330554 | Altschuler et al. | Dec 2001 | B1 |
| 6338074 | Poindexter et al. | Jan 2002 | B1 |
| 6341277 | Coden et al. | Jan 2002 | B1 |
| 6341293 | Hennessey | Jan 2002 | B1 |
| 6344862 | Williams et al. | Feb 2002 | B1 |
| 6349238 | Gabbita et al. | Feb 2002 | B1 |
| 6351734 | Lautzenheiser et al. | Feb 2002 | B1 |
| 6356286 | Lawrence | Mar 2002 | B1 |
| 6356897 | Gusack | Mar 2002 | B1 |
| 6359633 | Balasubramaniam et al. | Mar 2002 | B1 |
| 6366299 | Lanning et al. | Apr 2002 | B1 |
| 6369819 | Pitkow et al. | Apr 2002 | B1 |
| 6370537 | Gilbert et al. | Apr 2002 | B1 |
| 6380910 | Moustakas et al. | Apr 2002 | B1 |
| 6380947 | Stead | Apr 2002 | B1 |
| 6381738 | Choi et al. | Apr 2002 | B1 |
| 6389460 | Stewart et al. | May 2002 | B1 |
| 6389510 | Chen et al. | May 2002 | B1 |
| 6393605 | Loomans | May 2002 | B1 |
| 6396885 | Ding et al. | May 2002 | B1 |
| 6405211 | Sokol et al. | Jun 2002 | B1 |
| 6405251 | Bullard et al. | Jun 2002 | B1 |
| 6415259 | Wolfinger et al. | Jul 2002 | B1 |
| 6415283 | Conklin | Jul 2002 | B1 |
| 6418448 | Sarkar | Jul 2002 | B1 |
| 6421571 | Spriggs et al. | Jul 2002 | B1 |
| 6426723 | Smith et al. | Jul 2002 | B1 |
| 6429870 | Chen et al. | Aug 2002 | B1 |
| 6430571 | Doan et al. | Aug 2002 | B1 |
| 6430574 | Stead | Aug 2002 | B1 |
| 6437799 | Shinomi et al. | Aug 2002 | B1 |
| 6446065 | Nishioka et al. | Sep 2002 | B1 |
| 6446089 | Brodersen et al. | Sep 2002 | B1 |
| 6446200 | Ball et al. | Sep 2002 | B1 |
| 6446256 | Hyman et al. | Sep 2002 | B1 |
| 6448964 | Isaacs et al. | Sep 2002 | B1 |
| 6453038 | McFarlane et al. | Sep 2002 | B1 |
| 6463346 | Flockhart et al. | Oct 2002 | B1 |
| 6463440 | Hind et al. | Oct 2002 | B1 |
| 6469715 | Carter et al. | Oct 2002 | B1 |
| 6469716 | Carter et al. | Oct 2002 | B1 |
| 6473467 | Wallace et al. | Oct 2002 | B1 |
| 6473748 | Archer | Oct 2002 | B1 |
| 6493331 | Walton et al. | Dec 2002 | B1 |
| 6493399 | Xia et al. | Dec 2002 | B1 |
| 6493731 | Jones et al. | Dec 2002 | B1 |
| 6493754 | Rosborough et al. | Dec 2002 | B1 |
| 6496812 | Campaigne et al. | Dec 2002 | B1 |
| 6496833 | Goldberg et al. | Dec 2002 | B1 |
| 6502239 | Zgarba et al. | Dec 2002 | B2 |
| 6509898 | Chi et al. | Jan 2003 | B2 |
| 6513018 | Culhane | Jan 2003 | B1 |
| 6526440 | Bharat | Feb 2003 | B1 |
| 6526457 | Birze | Feb 2003 | B1 |
| 6529217 | Maguire, III et al. | Mar 2003 | B1 |
| 6529899 | Kraft et al. | Mar 2003 | B1 |
| 6529900 | Patterson et al. | Mar 2003 | B1 |
| 6530079 | Choi et al. | Mar 2003 | B1 |
| 6532474 | Iwamoto et al. | Mar 2003 | B2 |
| 6539374 | Jung | Mar 2003 | B2 |
| 6542912 | Meltzer et al. | Apr 2003 | B2 |
| 6546381 | Subramanian et al. | Apr 2003 | B1 |
| 6546406 | DeRose et al. | Apr 2003 | B1 |
| 6549904 | Ortega et al. | Apr 2003 | B1 |
| 6556226 | Gould et al. | Apr 2003 | B2 |
| 6556983 | Altschuler et al. | Apr 2003 | B1 |
| 6556985 | Karch | Apr 2003 | B1 |
| 6559864 | Olin | May 2003 | B1 |
| 6560592 | Reid et al. | May 2003 | B1 |
| 6560649 | Mullen et al. | May 2003 | B1 |
| 6567419 | Yarlagadda | May 2003 | B1 |
| 6571222 | Matsumoto et al. | May 2003 | B1 |
| 6577769 | Kenyon et al. | Jun 2003 | B1 |
| 6583800 | Ridgley et al. | Jun 2003 | B1 |
| 6584464 | Warthen | Jun 2003 | B1 |
| 6584569 | Reshef et al. | Jun 2003 | B2 |
| 6594662 | Sieffert et al. | Jul 2003 | B1 |
| 6597381 | Eskridge et al. | Jul 2003 | B1 |
| 6597775 | Lawyer et al. | Jul 2003 | B2 |
| 6598043 | Baclawski | Jul 2003 | B1 |
| 6606613 | Altschuler et al. | Aug 2003 | B1 |
| 6625657 | Bullard | Sep 2003 | B1 |
| 6629138 | Lambert et al. | Sep 2003 | B1 |
| 6636850 | Lepien | Oct 2003 | B2 |
| 6636901 | Sudhakaran et al. | Oct 2003 | B2 |
| 6643638 | Xu | Nov 2003 | B1 |
| 6643652 | Helgeson et al. | Nov 2003 | B2 |
| 6661889 | Flockhart et al. | Dec 2003 | B1 |
| 6661908 | Suchard et al. | Dec 2003 | B1 |
| 6678679 | Bradford | Jan 2004 | B1 |
| 6678773 | Marietta et al. | Jan 2004 | B2 |
| 6678882 | Hurley et al. | Jan 2004 | B1 |
| 6684261 | Orton et al. | Jan 2004 | B1 |
| 6690788 | Bauer et al. | Feb 2004 | B1 |
| 6691067 | Ding et al. | Feb 2004 | B1 |
| 6691230 | Bardon | Feb 2004 | B1 |
| 6701314 | Conover et al. | Mar 2004 | B1 |
| 6711565 | Subramaniam et al. | Mar 2004 | B1 |
| 6721747 | Lipkin | Apr 2004 | B2 |
| 6728702 | Subramaniam et al. | Apr 2004 | B1 |
| 6728852 | Stoutamire | Apr 2004 | B1 |
| 6732095 | Warshavsky et al. | May 2004 | B1 |
| 6732111 | Brodersen et al. | May 2004 | B2 |
| 6748422 | Morin et al. | Jun 2004 | B2 |
| 6750858 | Rosenstein | Jun 2004 | B1 |
| 6751663 | Farrell et al. | Jun 2004 | B1 |
| 6754475 | Harrison et al. | Jun 2004 | B1 |
| 6756994 | Tlaskal | Jun 2004 | B1 |
| 6763351 | Subramaniam et al. | Jul 2004 | B1 |
| 6771706 | Ling et al. | Aug 2004 | B2 |
| 6772148 | Baclawski | Aug 2004 | B2 |
| 6772350 | Belani et al. | Aug 2004 | B1 |
| 6778971 | Altschuler et al. | Aug 2004 | B1 |
| 6782091 | Dunning, III | Aug 2004 | B1 |
| 6785341 | Walton et al. | Aug 2004 | B2 |
| 6788114 | Krenzke et al. | Sep 2004 | B1 |
| 6792420 | Stephen Chen et al. | Sep 2004 | B2 |
| RE38633 | Srinivasan | Oct 2004 | E |
| 6804330 | Jones et al. | Oct 2004 | B1 |
| 6807632 | Carpentier et al. | Oct 2004 | B1 |
| 6810429 | Walsh et al. | Oct 2004 | B1 |
| 6820082 | Cook et al. | Nov 2004 | B1 |
| 6829655 | Huang et al. | Dec 2004 | B1 |
| 6831668 | Cras et al. | Dec 2004 | B2 |
| 6836275 | Arquie et al. | Dec 2004 | B1 |
| 6839682 | Blume et al. | Jan 2005 | B1 |
| 6847982 | Parker et al. | Jan 2005 | B2 |
| 6851089 | Erickson et al. | Feb 2005 | B1 |
| 6856575 | Jones | Feb 2005 | B2 |
| 6856992 | Britton et al. | Feb 2005 | B2 |
| 6859787 | Fisher et al. | Feb 2005 | B2 |
| 6865546 | Song | Mar 2005 | B1 |
| 6865566 | Serrano-Morales et al. | Mar 2005 | B2 |
| 6865575 | Smith et al. | Mar 2005 | B1 |
| 6867789 | Allen et al. | Mar 2005 | B1 |
| 6918222 | Lat et al. | Jul 2005 | B2 |
| 6920615 | Campbell et al. | Jul 2005 | B1 |
| 6925457 | Britton et al. | Aug 2005 | B2 |
| 6925609 | Lucke | Aug 2005 | B1 |
| 6927728 | Vook et al. | Aug 2005 | B2 |
| 6934702 | Faybishenko et al. | Aug 2005 | B2 |
| 6940917 | Menon et al. | Sep 2005 | B2 |
| 6944644 | Gideon | Sep 2005 | B2 |
| 6954737 | Kalantar et al. | Oct 2005 | B2 |
| 6956845 | Baker et al. | Oct 2005 | B2 |
| 6959432 | Crocker | Oct 2005 | B2 |
| 6961725 | Yuan et al. | Nov 2005 | B2 |
| 6965889 | Serrano-Morales et al. | Nov 2005 | B2 |
| 6966033 | Gasser et al. | Nov 2005 | B1 |
| 6976144 | Trefler et al. | Dec 2005 | B1 |
| 6978719 | Sebata et al. | Dec 2005 | B2 |
| 6985912 | Mullins et al. | Jan 2006 | B2 |
| 6991153 | Silverbrook | Jan 2006 | B2 |
| 7020869 | Abrari et al. | Mar 2006 | B2 |
| 7020882 | Lewallen | Mar 2006 | B1 |
| 7028225 | Maso et al. | Apr 2006 | B2 |
| 7031901 | Abu El Ata | Apr 2006 | B2 |
| 7035808 | Ford | Apr 2006 | B1 |
| 7058367 | Luo et al. | Jun 2006 | B1 |
| 7058637 | Britton et al. | Jun 2006 | B2 |
| 7064766 | Beda et al. | Jun 2006 | B2 |
| 7073177 | Foote et al. | Jul 2006 | B2 |
| 7076558 | Dunn | Jul 2006 | B1 |
| 7089193 | Newbold | Aug 2006 | B2 |
| 7103173 | Rodenbusch et al. | Sep 2006 | B2 |
| 7124145 | Surasinghe | Oct 2006 | B2 |
| 7139999 | Bowman-Amuah | Nov 2006 | B2 |
| 7143116 | Okitsu et al. | Nov 2006 | B2 |
| 7171145 | Takeuchi et al. | Jan 2007 | B2 |
| 7171415 | Kan et al. | Jan 2007 | B2 |
| 7174514 | Subramaniam et al. | Feb 2007 | B2 |
| 7178109 | Hewson et al. | Feb 2007 | B2 |
| 7194380 | Barrow et al. | Mar 2007 | B2 |
| 7194690 | Guillermo | Mar 2007 | B2 |
| 7289793 | Norwood et al. | Oct 2007 | B2 |
| RE39918 | Slemmer | Nov 2007 | E |
| 7302417 | Iyer | Nov 2007 | B2 |
| 7318020 | Kim | Jan 2008 | B1 |
| 7318066 | Kaufman et al. | Jan 2008 | B2 |
| 7334039 | Majkut et al. | Feb 2008 | B1 |
| 7343295 | Pomerance | Mar 2008 | B2 |
| 7353229 | Vilcauskas, Jr. et al. | Apr 2008 | B2 |
| 7353254 | Kusuda | Apr 2008 | B2 |
| 7398391 | Carpentier et al. | Jul 2008 | B2 |
| 7406475 | Dome et al. | Jul 2008 | B2 |
| 7412388 | Dalal et al. | Aug 2008 | B2 |
| 7415731 | Carpentier et al. | Aug 2008 | B2 |
| 7505827 | Boddy et al. | Mar 2009 | B1 |
| 7526481 | Cusson et al. | Apr 2009 | B1 |
| 7536294 | Stanz et al. | May 2009 | B1 |
| 7555645 | Vissapragada | Jun 2009 | B2 |
| 7574494 | Mayernick et al. | Aug 2009 | B1 |
| 7596504 | Hughes et al. | Sep 2009 | B2 |
| 7603625 | Guillermo | Oct 2009 | B2 |
| 7640222 | Trefler | Dec 2009 | B2 |
| 7647417 | Taneja | Jan 2010 | B1 |
| 7665063 | Hofmann et al. | Feb 2010 | B1 |
| 7685013 | Gendler | Mar 2010 | B2 |
| 7689447 | Aboujaoude et al. | Mar 2010 | B1 |
| 7711919 | Trefler et al. | May 2010 | B2 |
| 7779395 | Chotin et al. | Aug 2010 | B1 |
| 7783596 | Smolen et al. | Aug 2010 | B2 |
| 7787609 | Flockhart et al. | Aug 2010 | B1 |
| 7791559 | Piasecki | Sep 2010 | B2 |
| 7818506 | Shepstone et al. | Oct 2010 | B1 |
| 7844594 | Holt et al. | Nov 2010 | B1 |
| 7870244 | Chong et al. | Jan 2011 | B2 |
| 7889896 | Roehrig et al. | Feb 2011 | B2 |
| 7937690 | Casey | May 2011 | B2 |
| 7971180 | Kreamer et al. | Jun 2011 | B2 |
| 7974714 | Hoffberg | Jul 2011 | B2 |
| 7983895 | McEntee et al. | Jul 2011 | B2 |
| 8001519 | Conallen et al. | Aug 2011 | B2 |
| 8037329 | Leech et al. | Oct 2011 | B2 |
| 8073802 | Trefler | Dec 2011 | B2 |
| 8250525 | Khatutsky | Aug 2012 | B2 |
| 8335704 | Trefler et al. | Dec 2012 | B2 |
| 8386960 | Eismann et al. | Feb 2013 | B1 |
| 8468492 | Frenkel | Jun 2013 | B1 |
| 8479157 | Trefler et al. | Jul 2013 | B2 |
| 8516193 | Clinton et al. | Aug 2013 | B1 |
| 8739044 | Varadarajan | May 2014 | B1 |
| 8744999 | Clarke | Jun 2014 | B2 |
| 8843435 | Trefler et al. | Sep 2014 | B1 |
| 8863008 | Chan | Oct 2014 | B2 |
| 8880487 | Clinton et al. | Nov 2014 | B1 |
| 8903933 | Bellini, III | Dec 2014 | B1 |
| 8924335 | Trefler et al. | Dec 2014 | B1 |
| 8959480 | Trefler et al. | Feb 2015 | B2 |
| 9026733 | Clinton et al. | May 2015 | B1 |
| 9189361 | Khatutsky | Nov 2015 | B2 |
| 9195936 | Chase | Nov 2015 | B1 |
| 9253129 | Bassemir | Feb 2016 | B2 |
| 9270743 | Frenkel | Feb 2016 | B2 |
| 9495340 | Powell | Nov 2016 | B2 |
| 9678719 | Frenkel | Jun 2017 | B1 |
| 20010013799 | Wang | Aug 2001 | A1 |
| 20010035777 | Wang et al. | Nov 2001 | A1 |
| 20010047355 | Anwar | Nov 2001 | A1 |
| 20010049682 | Vincent et al. | Dec 2001 | A1 |
| 20010052108 | Bowman-Amuah | Dec 2001 | A1 |
| 20010054064 | Kannan | Dec 2001 | A1 |
| 20020010855 | Reshef et al. | Jan 2002 | A1 |
| 20020013804 | Gideon | Jan 2002 | A1 |
| 20020029161 | Brodersen et al. | Mar 2002 | A1 |
| 20020042831 | Capone et al. | Apr 2002 | A1 |
| 20020049603 | Mehra et al. | Apr 2002 | A1 |
| 20020049715 | Serrano-Morales et al. | Apr 2002 | A1 |
| 20020049788 | Lipkin et al. | Apr 2002 | A1 |
| 20020054152 | Palaniappan et al. | May 2002 | A1 |
| 20020059566 | Delcambre et al. | May 2002 | A1 |
| 20020065912 | Catchpole | May 2002 | A1 |
| 20020070972 | Windl et al. | Jun 2002 | A1 |
| 20020073337 | Ioele et al. | Jun 2002 | A1 |
| 20020083063 | Egolf | Jun 2002 | A1 |
| 20020091677 | Sridhar | Jul 2002 | A1 |
| 20020091678 | Miller et al. | Jul 2002 | A1 |
| 20020091710 | Dunham et al. | Jul 2002 | A1 |
| 20020091835 | Lentini et al. | Jul 2002 | A1 |
| 20020093537 | Bocioned et al. | Jul 2002 | A1 |
| 20020107684 | Gao | Aug 2002 | A1 |
| 20020118688 | Jagannathan | Aug 2002 | A1 |
| 20020120598 | Shadmon et al. | Aug 2002 | A1 |
| 20020120627 | Mankoff | Aug 2002 | A1 |
| 20020120762 | Cheng et al. | Aug 2002 | A1 |
| 20020133502 | Rosenthal et al. | Sep 2002 | A1 |
| 20020177232 | Melker et al. | Nov 2002 | A1 |
| 20020178232 | Ferguson | Nov 2002 | A1 |
| 20020181692 | Flockhart et al. | Dec 2002 | A1 |
| 20020184610 | Chong et al. | Dec 2002 | A1 |
| 20020186826 | Hsu et al. | Dec 2002 | A1 |
| 20020198935 | Crandall, Sr. | Dec 2002 | A1 |
| 20030001894 | Boykin et al. | Jan 2003 | A1 |
| 20030004934 | Qian | Jan 2003 | A1 |
| 20030004951 | Chokshi | Jan 2003 | A1 |
| 20030009239 | Lombardo et al. | Jan 2003 | A1 |
| 20030014399 | Hansen et al. | Jan 2003 | A1 |
| 20030037145 | Fagan | Feb 2003 | A1 |
| 20030050834 | Caplan | Mar 2003 | A1 |
| 20030050927 | Hussam | Mar 2003 | A1 |
| 20030050929 | Bookman et al. | Mar 2003 | A1 |
| 20030061209 | Raboczi et al. | Mar 2003 | A1 |
| 20030065544 | Elzinga et al. | Apr 2003 | A1 |
| 20030066031 | Laane | Apr 2003 | A1 |
| 20030074352 | Raboczi et al. | Apr 2003 | A1 |
| 20030074369 | Scheutze et al. | Apr 2003 | A1 |
| 20030084401 | Abel et al. | May 2003 | A1 |
| 20030093279 | Malah et al. | May 2003 | A1 |
| 20030098991 | Laverty et al. | May 2003 | A1 |
| 20030109951 | Hsiung et al. | Jun 2003 | A1 |
| 20030115281 | McHenry et al. | Jun 2003 | A1 |
| 20030135358 | Lissauer et al. | Jul 2003 | A1 |
| 20030152212 | Burok et al. | Aug 2003 | A1 |
| 20030154380 | Richmond et al. | Aug 2003 | A1 |
| 20030191626 | Al-Onaizan et al. | Oct 2003 | A1 |
| 20030198337 | Lenard | Oct 2003 | A1 |
| 20030200254 | Wei | Oct 2003 | A1 |
| 20030200371 | Abujbara | Oct 2003 | A1 |
| 20030202617 | Casper | Oct 2003 | A1 |
| 20030222680 | Jaussi | Dec 2003 | A1 |
| 20030229529 | Mui et al. | Dec 2003 | A1 |
| 20030229544 | Veres et al. | Dec 2003 | A1 |
| 20040003043 | Rajamony | Jan 2004 | A1 |
| 20040021686 | Barberis | Feb 2004 | A1 |
| 20040024603 | Mahoney et al. | Feb 2004 | A1 |
| 20040034651 | Gupta et al. | Feb 2004 | A1 |
| 20040049479 | Dorne et al. | Mar 2004 | A1 |
| 20040049509 | Keller et al. | Mar 2004 | A1 |
| 20040049580 | Boyd et al. | Mar 2004 | A1 |
| 20040054610 | Amstutz et al. | Mar 2004 | A1 |
| 20040064552 | Chong et al. | Apr 2004 | A1 |
| 20040068517 | Scott | Apr 2004 | A1 |
| 20040088199 | Childress et al. | May 2004 | A1 |
| 20040103014 | Teegan et al. | May 2004 | A1 |
| 20040117759 | Rippert et al. | Jun 2004 | A1 |
| 20040122652 | Andrews et al. | Jun 2004 | A1 |
| 20040133416 | Fukuoka et al. | Jul 2004 | A1 |
| 20040133876 | Sproule | Jul 2004 | A1 |
| 20040139021 | Reed et al. | Jul 2004 | A1 |
| 20040145607 | Alderson | Jul 2004 | A1 |
| 20040147138 | Vaartstra | Jul 2004 | A1 |
| 20040148152 | Horikawa | Jul 2004 | A1 |
| 20040148586 | Gilboa | Jul 2004 | A1 |
| 20040162812 | Lane et al. | Aug 2004 | A1 |
| 20040162822 | Papanyan et al. | Aug 2004 | A1 |
| 20040167765 | Abu El Ata | Aug 2004 | A1 |
| 20040205672 | Bates et al. | Oct 2004 | A1 |
| 20040220792 | Gallanis et al. | Nov 2004 | A1 |
| 20040236566 | Simske | Nov 2004 | A1 |
| 20040243587 | Nuyens et al. | Dec 2004 | A1 |
| 20040268221 | Wang | Dec 2004 | A1 |
| 20040268299 | Lei et al. | Dec 2004 | A1 |
| 20050027563 | Fackler et al. | Feb 2005 | A1 |
| 20050027871 | Bradley et al. | Feb 2005 | A1 |
| 20050039191 | Hewson et al. | Feb 2005 | A1 |
| 20050044198 | Okitsu et al. | Feb 2005 | A1 |
| 20050050000 | Kwok et al. | Mar 2005 | A1 |
| 20050055330 | Britton et al. | Mar 2005 | A1 |
| 20050059566 | Brown et al. | Mar 2005 | A1 |
| 20050060372 | DeBettencourt et al. | Mar 2005 | A1 |
| 20050071211 | Flockhart et al. | Mar 2005 | A1 |
| 20050096959 | Kumar et al. | May 2005 | A1 |
| 20050104628 | Tanzawa et al. | May 2005 | A1 |
| 20050125683 | Matsuyama et al. | Jun 2005 | A1 |
| 20050132048 | Kogan et al. | Jun 2005 | A1 |
| 20050138162 | Byrnes | Jun 2005 | A1 |
| 20050144023 | Aboujaoude et al. | Jun 2005 | A1 |
| 20050165823 | Ondrusek et al. | Jul 2005 | A1 |
| 20050198021 | Wilcox et al. | Sep 2005 | A1 |
| 20050216235 | Butt et al. | Sep 2005 | A1 |
| 20050222889 | Lai et al. | Oct 2005 | A1 |
| 20050228875 | Monitzer et al. | Oct 2005 | A1 |
| 20050234882 | Bennett et al. | Oct 2005 | A1 |
| 20050267770 | Banavar et al. | Dec 2005 | A1 |
| 20050288920 | Green et al. | Dec 2005 | A1 |
| 20060004845 | Kristiansen et al. | Jan 2006 | A1 |
| 20060015388 | Flockhart et al. | Jan 2006 | A1 |
| 20060020783 | Fisher | Jan 2006 | A1 |
| 20060041861 | Trefler et al. | Feb 2006 | A1 |
| 20060053125 | Scott | Mar 2006 | A1 |
| 20060063138 | Loff et al. | Mar 2006 | A1 |
| 20060064486 | Baron et al. | Mar 2006 | A1 |
| 20060064667 | Freitas | Mar 2006 | A1 |
| 20060075360 | Bixler | Apr 2006 | A1 |
| 20060080082 | Ravindra et al. | Apr 2006 | A1 |
| 20060080401 | Gill et al. | Apr 2006 | A1 |
| 20060092467 | Dumitrescu et al. | May 2006 | A1 |
| 20060100847 | McEntee et al. | May 2006 | A1 |
| 20060101386 | Gerken et al. | May 2006 | A1 |
| 20060101393 | Gerken et al. | May 2006 | A1 |
| 20060106846 | Schulz et al. | May 2006 | A1 |
| 20060139312 | Sinclair et al. | Jun 2006 | A1 |
| 20060149751 | Jade et al. | Jul 2006 | A1 |
| 20060167655 | Barrow et al. | Jul 2006 | A1 |
| 20060173724 | Trefler et al. | Aug 2006 | A1 |
| 20060173871 | Taniguchi et al. | Aug 2006 | A1 |
| 20060206303 | Kohlmeier et al. | Sep 2006 | A1 |
| 20060206305 | Kimura et al. | Sep 2006 | A1 |
| 20060209085 | Wong et al. | Sep 2006 | A1 |
| 20060218166 | Myers et al. | Sep 2006 | A1 |
| 20060271559 | Stavrakos et al. | Nov 2006 | A1 |
| 20060271920 | Abouelsaadat | Nov 2006 | A1 |
| 20060288348 | Kawamoto et al. | Dec 2006 | A1 |
| 20070005623 | Self et al. | Jan 2007 | A1 |
| 20070010991 | Lei et al. | Jan 2007 | A1 |
| 20070028225 | Whittaker et al. | Feb 2007 | A1 |
| 20070038765 | Dunn | Feb 2007 | A1 |
| 20070055938 | Herring et al. | Mar 2007 | A1 |
| 20070061789 | Kaneko et al. | Mar 2007 | A1 |
| 20070094199 | Deshpande et al. | Apr 2007 | A1 |
| 20070100782 | Reed et al. | May 2007 | A1 |
| 20070118497 | Katoh | May 2007 | A1 |
| 20070130130 | Chan et al. | Jun 2007 | A1 |
| 20070136068 | Horvitz | Jun 2007 | A1 |
| 20070143163 | Weiss et al. | Jun 2007 | A1 |
| 20070143851 | Nicodemus et al. | Jun 2007 | A1 |
| 20070203756 | Sears et al. | Aug 2007 | A1 |
| 20070208553 | Hastings et al. | Sep 2007 | A1 |
| 20070226031 | Manson et al. | Sep 2007 | A1 |
| 20070233902 | Trefler et al. | Oct 2007 | A1 |
| 20070239646 | Trefler | Oct 2007 | A1 |
| 20070245300 | Chan et al. | Oct 2007 | A1 |
| 20070260584 | Marti et al. | Nov 2007 | A1 |
| 20070294644 | Yost | Dec 2007 | A1 |
| 20080002823 | Fama et al. | Jan 2008 | A1 |
| 20080046462 | Kaufman et al. | Feb 2008 | A1 |
| 20080077384 | Agapi et al. | Mar 2008 | A1 |
| 20080085502 | Allen et al. | Apr 2008 | A1 |
| 20080109467 | Brookins et al. | May 2008 | A1 |
| 20080120593 | Keren et al. | May 2008 | A1 |
| 20080163253 | Massmann et al. | Jul 2008 | A1 |
| 20080184230 | Leech et al. | Jul 2008 | A1 |
| 20080189679 | Rodriguez et al. | Aug 2008 | A1 |
| 20080195377 | Kato et al. | Aug 2008 | A1 |
| 20080196003 | Gerken et al. | Aug 2008 | A1 |
| 20080208785 | Trefler et al. | Aug 2008 | A1 |
| 20080216055 | Khatutsky | Sep 2008 | A1 |
| 20080216060 | Vargas | Sep 2008 | A1 |
| 20080263510 | Nerome et al. | Oct 2008 | A1 |
| 20090007084 | Conallen et al. | Jan 2009 | A1 |
| 20090018998 | Patten, Jr. et al. | Jan 2009 | A1 |
| 20090075634 | Sinclair et al. | Mar 2009 | A1 |
| 20090083697 | Zhang et al. | Mar 2009 | A1 |
| 20090132232 | Trefler | May 2009 | A1 |
| 20090132996 | Eldridge et al. | May 2009 | A1 |
| 20090138844 | Halberstadt et al. | May 2009 | A1 |
| 20090150541 | Georgis | Jun 2009 | A1 |
| 20090158407 | Nicodemus et al. | Jun 2009 | A1 |
| 20090164494 | Dodin | Jun 2009 | A1 |
| 20090171938 | Levin et al. | Jul 2009 | A1 |
| 20090199123 | Albertson et al. | Aug 2009 | A1 |
| 20090228786 | Danton et al. | Sep 2009 | A1 |
| 20090271708 | Peters | Oct 2009 | A1 |
| 20090276206 | Fitzpatrick et al. | Nov 2009 | A1 |
| 20090282384 | Keppler | Nov 2009 | A1 |
| 20090319948 | Stannard et al. | Dec 2009 | A1 |
| 20100011338 | Lewis | Jan 2010 | A1 |
| 20100083135 | Zawacki | Apr 2010 | A1 |
| 20100088266 | Trefler | Apr 2010 | A1 |
| 20100107137 | Trefler et al. | Apr 2010 | A1 |
| 20100217737 | Shama | Aug 2010 | A1 |
| 20110004888 | Srinivasan | Jan 2011 | A1 |
| 20110066486 | Bassin et al. | Mar 2011 | A1 |
| 20110239113 | Hung | Sep 2011 | A1 |
| 20110252305 | Tschani | Oct 2011 | A1 |
| 20110264251 | Copello et al. | Oct 2011 | A1 |
| 20120041921 | Canaday et al. | Feb 2012 | A1 |
| 20120102420 | Fukahori | Apr 2012 | A1 |
| 20120293558 | Dilts | Nov 2012 | A1 |
| 20130007267 | Khatutsky | Jan 2013 | A1 |
| 20130031455 | Griffiths et al. | Jan 2013 | A1 |
| 20130047165 | Goetz et al. | Feb 2013 | A1 |
| 20130159904 | Kelappan et al. | Jun 2013 | A1 |
| 20130167245 | Birtwhistle | Jun 2013 | A1 |
| 20130231970 | Trefler et al. | Sep 2013 | A1 |
| 20130254833 | Nicodemus et al. | Sep 2013 | A1 |
| 20130290249 | Merriman et al. | Oct 2013 | A1 |
| 20140019400 | Trefler et al. | Jan 2014 | A1 |
| 20140089819 | Andler et al. | Mar 2014 | A1 |
| 20140125577 | Hoang et al. | May 2014 | A1 |
| 20140137019 | Paulsen et al. | May 2014 | A1 |
| 20140277164 | Ramsay et al. | Sep 2014 | A1 |
| 20150058772 | Bator et al. | Feb 2015 | A1 |
| 20150089406 | Trefler et al. | Mar 2015 | A1 |
| 20150127736 | Clinton et al. | May 2015 | A1 |
| 20150149557 | Mendez | May 2015 | A1 |
| 20160041961 | Romney | Feb 2016 | A1 |
| 20160062963 | Umapathy | Mar 2016 | A1 |
| 20160070560 | Chase | Mar 2016 | A1 |
| 20160085809 | de Castro Alves et al. | Mar 2016 | A1 |
| 20160098298 | Trefler et al. | Apr 2016 | A1 |
| 20160105370 | Mellor et al. | Apr 2016 | A1 |
| 20170013073 | Mendez | Jan 2017 | A1 |
| 20170255341 | Trefler et al. | Sep 2017 | A1 |
| 20170351425 | D'angelo et al. | Dec 2017 | A1 |
| 20170357703 | Theimer et al. | Dec 2017 | A1 |
| 20180011678 | Shipper et al. | Jan 2018 | A1 |
| 20180024901 | Tankersley | Jan 2018 | A1 |
| Number | Date | Country |
|---|---|---|
| 19911098 | Dec 1999 | DE |
| 0 549 208 | Jun 1993 | EP |
| 0 669 717 | Aug 1995 | EP |
| 0 996 916 | May 2000 | EP |
| 1 015 997 | Jul 2000 | EP |
| 1 019 807 | Jul 2000 | EP |
| 1 073 955 | Feb 2001 | EP |
| 1 073 992 | Feb 2001 | EP |
| 1 135 723 | Sep 2001 | EP |
| 1 163 604 | Dec 2001 | EP |
| 1 183 636 | Mar 2002 | EP |
| 1 196 882 | Apr 2002 | EP |
| 1 203 310 | May 2002 | EP |
| 1 208 482 | May 2002 | EP |
| 1 212 668 | Jun 2002 | EP |
| 1 240 592 | Sep 2002 | EP |
| 1 277 102 | Jan 2003 | EP |
| 1 277 119 | Jan 2003 | EP |
| 1 277 120 | Jan 2003 | EP |
| 1 277 153 | Jan 2003 | EP |
| 1 277 155 | Jan 2003 | EP |
| 1 277 329 | Jan 2003 | EP |
| 1 374 083 | Jan 2004 | EP |
| 1 382 030 | Jan 2004 | EP |
| 1 386 241 | Feb 2004 | EP |
| 1 393 172 | Mar 2004 | EP |
| 1 393 188 | Mar 2004 | EP |
| 1 402 336 | Mar 2004 | EP |
| 1 407 384 | Apr 2004 | EP |
| 1 430 396 | Jun 2004 | EP |
| 1 438 649 | Jul 2004 | EP |
| 1 438 654 | Jul 2004 | EP |
| 1 438 672 | Jul 2004 | EP |
| 1 483 685 | Dec 2004 | EP |
| 1 490 747 | Dec 2004 | EP |
| 1 490 809 | Dec 2004 | EP |
| 1 492 232 | Dec 2004 | EP |
| 1 782 183 | May 2007 | EP |
| 1 830 312 | Sep 2007 | EP |
| 1 840 803 | Oct 2007 | EP |
| 2 115 581 | Nov 2009 | EP |
| 9838564 | Sep 1998 | WO |
| 9840807 | Sep 1998 | WO |
| 9905632 | Feb 1999 | WO |
| 9945465 | Sep 1999 | WO |
| 9950784 | Oct 1999 | WO |
| 0033187 | Jun 2000 | WO |
| 0033217 | Jun 2000 | WO |
| 0033226 | Jun 2000 | WO |
| 0033235 | Jun 2000 | WO |
| 0033238 | Jun 2000 | WO |
| 0052553 | Sep 2000 | WO |
| 0052603 | Sep 2000 | WO |
| 0067194 | Nov 2000 | WO |
| 0140958 | Jun 2001 | WO |
| 0175610 | Oct 2001 | WO |
| 0175614 | Oct 2001 | WO |
| 0175747 | Oct 2001 | WO |
| 0175748 | Oct 2001 | WO |
| 0176206 | Oct 2001 | WO |
| 0177787 | Oct 2001 | WO |
| 0179994 | Oct 2001 | WO |
| 0221254 | Mar 2002 | WO |
| WO2002019131 | Mar 2002 | WO |
| 0244947 | Jun 2002 | WO |
| 02056249 | Jul 2002 | WO |
| 02080006 | Oct 2002 | WO |
| 02080015 | Oct 2002 | WO |
| 02082300 | Oct 2002 | WO |
| 02084925 | Oct 2002 | WO |
| 02088869 | Nov 2002 | WO |
| 02091346 | Nov 2002 | WO |
| 02101517 | Dec 2002 | WO |
| 02103576 | Dec 2002 | WO |
| 03021393 | Mar 2003 | WO |
| 03029923 | Apr 2003 | WO |
| 03029955 | Apr 2003 | WO |
| 03030005 | Apr 2003 | WO |
| 03030013 | Apr 2003 | WO |
| 03030014 | Apr 2003 | WO |
| 03058504 | Jul 2003 | WO |
| 03069500 | Aug 2003 | WO |
| 03071380 | Aug 2003 | WO |
| 03071388 | Aug 2003 | WO |
| 03073319 | Sep 2003 | WO |
| 03077139 | Sep 2003 | WO |
| 03085503 | Oct 2003 | WO |
| 03085580 | Oct 2003 | WO |
| 2004001613 | Dec 2003 | WO |
| 2004003684 | Jan 2004 | WO |
| 2004003766 | Jan 2004 | WO |
| 2004003885 | Jan 2004 | WO |
| 2004046882 | Jun 2004 | WO |
| 2004061815 | Jul 2004 | WO |
| 2004086197 | Oct 2004 | WO |
| 2004086198 | Oct 2004 | WO |
| 2004095207 | Nov 2004 | WO |
| 2004095208 | Nov 2004 | WO |
| 2004114147 | Dec 2004 | WO |
| 2005001627 | Jan 2005 | WO |
| 2005003888 | Jan 2005 | WO |
| 2005010645 | Feb 2005 | WO |
| 2005117549 | Dec 2005 | WO |
| 2006081536 | Aug 2006 | WO |
| 2007033922 | Mar 2007 | WO |
| 2008109441 | Sep 2008 | WO |
| 2009097384 | Aug 2009 | WO |
| Entry |
|---|
| XPath Tutorial, Mar. 18, 2005, 7 pages (Year: 2005). |
| International Preliminary Report on Patentability for Application No. PCT/US2004/020783, dated Feb. 13, 2006 (6 pages). |
| International Search Report for PCT/US05/018599, dated May 15, 2007 (1 page). |
| International Preliminary Report on Patentability for PCT/US2005/018599, dated Jun. 5, 2007 (10 pages). |
| International Search Report & Written Opinion for PCT/US06/03160, dated Jul. 21, 2008 (16 pages). |
| International Preliminary Report on Patentability for PCT/US06/03160, dated Apr. 9, 2009 (14 pages). |
| International Search Report for PCT/US08/55503, dated Jul. 28, 2008 (1 page). |
| International Preliminary Report on Patentability for PCT/US2008/055503, dated Sep. 17, 2009 (4 pages). |
| International Search Report & Written Opinion for PCT/US09/32341, dated Mar. 11, 2009 (14 pages). |
| International Preliminary Report on Patentability for PCT/US2009/032341, dated Aug. 12, 2010 (8 pages). |
| Johnson et al., Sharing and resuing rules—a feature comparison of five expert system shells. IEEE Expert, IEEE Services Center, New York, NY, vol. 9, No. 3, Jun. 1, 1994, pp. 3-17. |
| Jones et al., A user-centered approach to functions in excel. International Conference on Functional Programming, Uppsala, Jun. 30, 2003, pp. 1-12. |
| Kappel, G., et al., TriGSflow active object-oriented workflow management. Proceedings of the 28th Annual Hawaii International Conference on System Sciences. 1995, pp. 727-736. |
| Kim, W., Object-Oriented Databases: Definition and Research Directions, IEEE Trans. on Knowledge and Data Engineering, vol. 2(3) pp. 327-341, Sep. 1990. |
| Kuhn, H.W., The Hungarian Method for the Assignment Problem, Naval Research Logistics Quarterly, 2 (1955), pp. 83-97. |
| Kuno, H.A., and E.A. Rundensteiner, Augmented Inherited Multi-Index Structure for Maintenance of Materialized Path Query Views, Proc. Sixth Int'l. Workshop on Research Issues in Data Engineering, pp. 128-137, Feb. 1996. |
| LaRue, J., Leveraging Integration and Workflow. Integrated Solutions, Accounting Today, SourceMedia, Aug. 2006, pp. 18-19. |
| Lippert, Eric, Fabulous Adventures in Coding: Metaprogramming, Toast and the Future of Development Tools, Microsoft.com Blog, MSDN Home, published Mar. 4, 2004, 6 pgs. |
| Mandal, et al., Integrating existing scientific workflow systems: The kepler/pegasus example. USC Information Sciences Institute, 2007, 8 pages. |
| Manghi, Paolo, et. al., Hybrid Applications Over XML: Integrating the Procedural and Declarative Approaches, 2002 ACM, pp. 1-6. Retrieved Mar. 22, 2007. |
| Manolescu, D.A., et al., Dynamic object model and adaptive workflow. Proceedings of Metadata and Active Object-Model Pattern Mining Workshop co-located with OOPSLA, 1999, vol. 99, 19 pages. |
| Markiewicz, M.E., et al., Object oriented framework development. ACM, 2001, 13 pages, <http://dl.acm.org/citation.cfm?id=372771>. |
| Markowitz, V.M., and A. Shoshani, Object Queries over Relational Databases: Language, Implementation, and Applications, IEEE Xplore, pp. 71-80, Apr. 1993. |
| Marmel, Elaine, Microsoft Office Project 2007 Bible, ISBN 0470009926, Wiley Publishing, Inc., 2007, 961 pages. |
| Maryanski, F., et al., The Data Model Compiler: A Tool for Generating Object-Oriented Database Systems, 1986 Int'l. Workshop on Object-Oriented Database Systems, IEEE, 73-84 (1986). |
| McConnell, Steven C., Brooks' Law Repealed, IEEE Software, pp. 6-9, Nov./Dec. 1999. |
| Mecca, G., et al., Cut and Paste, ACM, pp. 1-25 and Appendix I-IV (Jun. 1999). Retrieved Mar. 22, 2007. |
| Mitchell, T.M., Machine Learning, Chapter 3, 1997, McGraw-Hill, pp. 52-80. |
| Mitchell, T.M., Machine Learning, Chapter 6, 1997, McGraw-Hill, pp. 154-200. |
| Morizet-Mahoudeaux, P., A Hierarchy of Network-Based Knowledge Systems, IEEE Trans. on Systems, Man, and Cybernetics, vol. 21(5), pp. 1184-1191, Sep./Oct. 1991. |
| Pientka, B., et al., Programming with proofs and explicit contexts. International Symposium on Principles and Practice of Declarative Programming, ACM, 2008, pp. 163-173, <http://delivery.acm.org/10.1145/1390000/1389469/p163-pientka.pdf?>. |
| Reinersten, Don, Is It Always a Bad Idea to Add Resources to a Late Project?, Oct. 30, 2000. Electronic Design. vol. 48, Issue 22, p. 70. |
| Riccuiti, M., Oracle 8.0 on the way with objects: upgrade will also build in multidimensional engine. InfoWorld. Sep. 25, 1995;17(39):16. |
| Richner, T., et al., Recovering high-level views of object-oriented applications from static and dynamic information. IEEE, 1999, 10 pages, <http://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=792487>. |
| Saiz, Francisco, et al. Rule-Based Web Page Generation, Proceedings of the 2nd Workshop on Adaptive Hypertext and Hypermedia, Hypertext98, Jun. 20-24, 1998, 9 pages. |
| Salvini, S., and M.H. Williams, Knowledge Management for Expert Systems, IEEE Colloquium on ‘Knowledge Engineering’, 3 pages, May 1990. |
| Schiefelbein, Mark, A Backbase Ajax Front-end for J2EE Applications, Internet Article, dev2dev <http://dev2dev.bea.com/1pt/a/433>, Aug. 29, 2005, 16 pages. |
| Schulze, W., Filling the workflow management facility into the object management architecture. Business Object Design and Implementation II. Springer London, 1998, pp. 109-117. |
| Sellis, T., et al., Coupling Production Systems and Database Systems: A Homogeneous Approach, IEEE Trans. on Knowledge and Data Engineering, vol. 5(2), pp. 240-256, Apr. 1993. |
| Shyy Y.M., and S.Y.W. Su, Refinement Preservation for Rule Selection in Active Object-Oriented Database Systems, Proc. Fourth Int'l. Workshop on Research Issues in Data Engineering, pp. 115-123, Feb. 1994. |
| Simpson, Alan, et al., Access 97 for Windows 95/NT; 1997 SYBEX; 16 pages; USPTO STIC-EIC 2100/2400. |
| Singh, G., et al., Workflow task clustering for best effort systems with pegasus, Pegasus, 2008, 8 pages. |
| Smedley, T.J. et al., “Expanding the Utility of Spreadsheets Through the Integration of Visual Programming and User Interface Objects,” School of Computer Science, Technical University of Nova Scotia, ACM, 1996; pp. 148-155. |
| Srinivasan, V., et al., Object persistence in object-oriented applications. IBM Systems Journal, 1997, vol. 36, issue 1, pp. 66-87, <http://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber-5387186>. |
| Stonebraker, M., The Integration of Rule Systems and Database Systems, IEEE Trans. on Knowledge and Data Engineering, vol. 4(5), pp. 415-423, Oct. 1992. |
| Sun, et al., “Supporting Inheritance in Relational Database Systems,” IEEE, pp. 511-518, Jun. 1992. |
| Surjanto, B., XML content management based on object-relational database technology. Proceedings of the First International Conference on Web Information Systems Engineering, IEEE, 2000, Jun. 19-21, 2000, vol. 1, pp. 70-79. |
| Thuraisingham, “From Rules to Frames and Frames to Rules,” AI Expert, pp. 31-39, Oct. 1989. |
| Vranes, S., et al., Integrating Multiple Paradigms within the Blackboard Framework, IEEE Transactions on Software Engineering, vol. 21, No. 3, Mar. 1995, pp. 244-262. |
| Yang, Bibo; Geunes, Joseph; O'Brien, William J.; Resource-Constrained Project Scheduling: Past Work and New Directions, Apr. 2001, 28 pages, Research Report 2001-6, Department of Industrial and Systems Engineering, University of Florida. |
| [No Author Listed] About the Integrated Work Manager (IWM). Pegasystems, Inc., Apr. 30, 2009, 3 pages, <http://pdn-dev/DevNet/PRPCv5/KB/TMP9ad01zurnf.asp>. |
| [No Author Listed] FreeBSD Project. “EDQUOTA(8)” in Free BSD System Manager's Manual. FreeBSD 8.2 Jun. 6, 1993. pp. 1-2. Retrieved from freebsd.org on Oct. 27, 2011. |
| [No Author Listed] How SmartForms for Blaze Advisor works, Fair Issac White Paper, http://www.FAIRISAAC.COM/, Oct. 31, 2005, 8 pages (website no longer active). |
| [No Author Listed] How to Configure and Customize the Universal Worklist. SAP Netweaver '04 and SAP Enterprise Portal 6.0. SAP AG. Version 1, May 2004, 65 pages. <http://www.erpgenie.com/sap/netweaver/ep/Configuring%20the%20UWL.pdf>. |
| [No Author Listed] How to configure the IWM/IAC gateway. Pegasystems, Inc., Apr. 30, 2009, 4 pages, <http://pdn-dev/DevNet/PRPCv5/KB/TMP9cf8fzurq4.asp>. |
| [No Author Listed] How to install the Integrated Work Manager (IWM). Pegasystems, Inc., Apr. 30, 2009, 6 pages, <http://pdn-dev/DevNet/PRPCv5/KB/TMP9br1ezurp8.asp>. |
| [No Author Listed] HP Integrated Lights-Out 2, User Guide, Part No. 394326-004, HP, Aug. 2006, 189 pages. |
| [No Author Listed] Integrating with External Systems, PegaRULES Process Commander 5.2. Process Commander 5.2 reference. Pegasystems Inc, Cambridge, MA, 2006, 103 pages <http://pdn.pega.com/ProductSupport/Products/PegaRULESProcessCommander/documents/PRPC/V5/502/iwes/PRPC52_Integrating_with_External_Systems.pdf>. |
| [No Author Listed] IP Prior Art Database, Options when returning work items in workflow management systems. IBM, IPCOM000027980D, 2004, 3 pages. |
| [No Author Listed] IP Prior Art Database, Staff Queries and Assignments in Workflow Systems. IBM, IPCOM000142382D, 2006, 4 pages. |
| [No Author Listed] IP Prior Art Database, Using work items to manage user interactions with adaptive business services. IBM TDB, IPCOM000015953D, 2003, 4 pages. |
| [No Author Listed] Localizing an Application, PegaRULES Process Commander. Process Commander 4.2 reference. Pegasystems Inc., Cambdrige, MA, 2006, 92 pages <http://pdn.pega.com/DevNet/PRPCv4/TechnologyPapers/documents/Localization0402.pdf>. |
| [No Author Listed] Oracle Universal Work Queue: Implementation Guide. Release 11i for Windows NT. Oracle Corporation. Jul. 2001, 136 pages. <http://docs.oracle.com/cd/A85964_01/acrobat/ieu115ug.pdf>. |
| [No Author Listed] Solaris 9 resource manager software. A technical white paper. Sun Microsystems, Inc., Palo Alto CA, 2002, 37 pages. XP-002291080. Retrieved Aug. 3, 2004 from <http://wwws.sun.com/software/whitepapers/solaris9/srm.pdf>. |
| Bertino, E., and P. Foscoli, Index Organizations for Object-Oriented Database Systems, IEEE Trans. on Knowledge and Data Engineering, 7(2):193-209 (Apr. 1995). |
| Bierbaum, A., et al., VR juggler: A virtual platform for virtual reality application development. Proceedings of the Virtual Reality 2001 Conference, IEEE, 2001, 8 pages, <http://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber-913774>. |
| Breiman, L., Bagging predictors, Machine Learning, vol. 24, No. 2, Aug. 31, 1996, pp. 123-140, Kluwer Academic Publishers, Netherlands. |
| Brusilovsky, P., and De Bra, P., Editors, “Second Workshop on Adaptive Hypertext and Hypermedia Proceedings,” Jun. 20-24, 1998. Ninth ACM Conference on Hypertext and Hypermedia, Hypertext'98. pp. 1-2. |
| Burleson, D., Adding behaviors to relational databases, DBMS, 8(10): 68(5) (Sep. 1995). |
| Busse, Ralph et al., Declarative and Procedural Object Oriented Views, IEEE, 1998, pp. 570-578, retrieved Mar. 22, 2007. |
| Buyya et al., Economic Models for Resource Management and Scheduling in Grid Computing, Concurrency and Computation: Practice and Experience, 2002, vol. 14, pp. 1507-1542. |
| Ceri, S., et al., WIDE—A distributed architecture for workflow management. Proceedings. Seventh International Workshop on Research Issues in Data Engineering, IEEE, 1997, pp. 76-79, 1997. |
| Chan, T.W., and W. Hwang, Towards Integrating Logic, Object, Frame, and Production, Proc. Fourth Int'l. Conf. on Software Engineering and Knowledge Engineering, IEEE, pp. 463-469, Jun. 1992. |
| Cheng, Cheng-Chung; Smith, Stephen F.; A Constraint Satisfaction Approach to Makespan Scheduling, AIPS 1996 Proceedings, pp. 45-52 (1996). |
| Cheng, C.C. and Smith, Applying Constraint Satisfaction Techniques to Job Shop Scheduling, Annals of Operations Research, 70: 327-357 (1997). |
| Cochrane, Roberta et al., Integrating Triggers and Declarative Constraints in SQL Database Systems, pp. 567-578, Proceedings of the 22nd VLDB Conference Mumbai (Bombay), India, 1996, retrieved Mar. 22, 2007. |
| Damerau, F.J., Problems and some solutions in customization of natural language database front ends. ACM Transactions on Office Information Systems, vol. 3, No. 2, Apr. 1, 1985, pp. 165-184. |
| Danforth, S., Integrating Object and Relational Technologies, Proc. Sixteenth Annual Int'l. Computer Software and Applications Conf., IEEE Comput. Soc. Press, pp. 225-226, Sep. 1992 (Abstract). |
| Deelman, E., et al., Pegasus: A framework for mapping complex scientific workflows onto distributed systems, submitted to Scientific Programming, Jan. 2005. Pre-journal publication article, 22 pages. |
| Deelman, E., et al., Pegasus: a framework for mapping complex scientific workflows onto distributed systems. Scientific Programming, 13, pp. 219-237, 2005. |
| Deelman, E., et al., Workflows and e-science: An overview of workflow system features and capabilities. Future Generation Computer Systems, May 2009, vol. 25, issue 5, pp. 528-540. |
| DeMichiel, L.G., et al., Polyglot: Extensions to Relational Databases for Sharable Types and Functions in a Multi-Language Environment, Proc. Ninth Int'l. Conf. on Data Engineering, IEEE, pp. 651-660, Apr. 1993. |
| Devarakonda et al., Predictability of process resource usage: A measurement-based study on UNIX. IEEE Transactions on Software Engineering. 1989;15(12):1579-1586. |
| Eisenstein, et al., Adaptation in Automated User-Interface Design. IUI, 2000, pp. 74-81. |
| Communication for European Patent Application No. 05755530.2, dated Sep. 6, 2007 (2 pages). |
| European Search Report for Application No. 05755530.2, dated Mar. 26, 2012 (3 Pages). |
| European Office Action dated Aug. 31, 2012 for Application No. 05755530.2 (4 Pages). |
| Communication for European Patent Application No. 07250844.3 enclosing European Search Report, dated Jul. 11, 2007 (6 pages). |
| Communication for European Patent Application No. 07250844.3, dated Mar. 28, 2008 (1 page). |
| European Office Action dated Jul. 9, 2012 for Application No. 07250844.3 (8 Pages). |
| Communication for European Patent Application No. 07250848.4, dated Aug. 13, 2007 (EESR enclosed) (6 pages). |
| Communication for European Patent Application No. 07250848.4, dated May 29, 2008 (1 page). |
| Communication for European Patent Application No. 08731127.0, dated Oct. 13, 2009 (2 pages). |
| Extended European Search Report dated Oct. 29, 2012 for Application No. 08731127.0 (8 Pages). |
| Extended European Search Report for Application No. 15189385.6, dated Dec. 17, 2015 (9 pages). |
| Fayad, M.E., et al., Object-oriented application frameworks. Communications of the ACM, Oct. 1997, vol. 40, issue 10, pp. 32-38, <http://dl.acm.org/citation.cfm?id=262798>. |
| Gajos et al. SUPPLE: Automatically Generating User Interfaces. IUI 2004, 8 pages. |
| Hague, Darren, Universal Worklist with SAP Netweaver Portal. Galileo Press, 2008, pp. 11-31. <http://www.sap-hefte.de/download/dateien/1461/146_leseprobe.pdf>. |
| International Search Report and Written Opinion for Application No. PCT/GB2004/000677, dated Aug. 2, 2004 (15 pages). |
| International Search Report for Application No. PCT/US2004/020783, dated Nov. 8, 2005 (2 pages). |
| U.S. Appl. No. 15/613,439, filed Jun. 5, 2017, Connecting Graphical Shapes Using Gestures. |
| Summons to Attend Oral Proceedings pursuant to rule 115(1) EPC, dated May 2, 2018 for Application No. 08731127.0 (8 pages). |
| U.S. Appl. No. 08/666,165, filed Jun. 19, 1996, Rules Bases and Methods of Access Thereof. |
| U.S. Appl. No. 10/430,693, filed May 6, 2003, Methods and Apparatus for Digital Data Processing With Mutable Inheritance. |
| U.S. Appl. No. 10/547,014, filed Aug. 25, 2005, Classification Using Probability Estimate Re-sampling. |
| U.S. Appl. No. 10/639,735, filed Aug. 12, 2003, Process/Viewer Interface. |
| U.S. Appl. No. 10/854,017, filed May 26, 2004, Integration of Declarative Rule-Based Processing With Procedural Programming. |
| U.S. Appl. No. 11/046,211, filed Jan. 28, 2005, Methods and Apparatus for Work Management and Routing. |
| U.S. Appl. No. 11/203,513, filed Aug. 12, 2005, Methods and Apparatus for Digital Data Processing With Mutable Inheritance. |
| U.S. Appl. No. 11/368,360, filed Mar. 3, 2006, Rules Base Systems and Methods With Circumstance Translation. |
| U.S. Appl. No. 11/396,415, filed Mar. 30, 2006, User Interface Methods and Apparatus for Rules Processing. |
| U.S. Appl. No. 11/681,269, filed Mar. 2, 2007, Proactive Performance Management for Multi-user Enterprise Software Systems. |
| U.S. Appl. No. 12/035,682, filed Feb. 22, 2008, User Interface Methods and Apparatus for Rules Processing. |
| U.S. Appl. No. 12/174,624, filed Jul. 16, 2008, Methods and Apparatus for Implementing Multilingual Software Applications. |
| U.S. Appl. No. 12/381,523, filed Mar. 12, 2009, Techniques for Dynamic Data Processing. |
| U.S. Appl. No. 12/386,959, filed Apr. 24, 2009, Method and Apparatus for Integrated Work Management. |
| U.S. Appl. No. 12/590,454, filed Nov. 6, 2009, Techniques for Content-Based Caching in a Computer System. |
| U.S. Appl. No. 12/619,215, filed Nov. 16, 2009, Rules Base Systems and Methods With Circumstance Translation. |
| U.S. Appl. No. 12/649,095, filed Dec. 29, 2009, Methods and Apparatus for Integration of Declarative Rule-Based Processing With Procedural Programming in a Digital Data-Processing Evironment. |
| U.S. Appl. No. 12/798,161, filed Mar. 30, 2010, System and Method for Creation and Modification of Software Applications. |
| U.S. Appl. No. 13/031,097, filed Feb. 18, 2011, Systems and Methods for Distributed Rules Processing. |
| U.S. Appl. No. 13/031,109, filed Feb. 18, 2011, Rule-Based User Interface Conformance Methods. |
| U.S. Appl. No. 13/341,411, filed Dec. 30, 2011, System and Method for Updating or Modifying an Application Without Manual Coding. |
| U.S. Appl. No. 13/536,079, filed Jun. 28, 2012, Proactive Performance Management for Multi-user Enterprise Software Systems. |
| U.S. Appl. No. 13/718,255, filed Dec. 18, 2012, Methods and Apparatus for Work Management and Routing. |
| U.S. Appl. No. 13/892,956, filed May 13, 2013, Content-Based Caching Using a Content Identifier at a Point in Time. |
| U.S. Appl. No. 13/897,763, filed May 20, 2013, System and Software for Creation and Modification of Software. |
| U.S. Appl. No. 13/907,287, filed May 31, 2013, Methods and Apparatus for Integration of Declarative Rule-Based Processing With Procedural Programming in a Digital Data-Processing Environment. |
| U.S. Appl. No. 14/469,208, filed Aug. 26, 2014, Techniques for Dynamic Data Processing. |
| U.S. Appl. No. 14/527,348, filed Oct. 29, 2014, Systems and Methods for Distributed Rules Processing. |
| U.S. Appl. No. 14/558,084, filed Dec. 2, 2014, Methods and Apparatus for User Interface Optimization. |
| U.S. Appl. No. 14/597,207, filed Jan. 14, 2015, Methods and Apparatus for Integrated Work Management. |
| U.S. Appl. No. 14/879,679, filed Oct. 9, 2015, Event Processing With Enhanced Throughput. |
| U.S. Appl. No. 14/928,085, filed Oct. 30, 2015, System and Method for Updating or Modifying an Application Without Manual Coding. |
| Number | Date | Country | |
|---|---|---|---|
| 20180011678 A1 | Jan 2018 | US |
