Method for providing a connection of a client to an unmanaged service in a client-server remote access system

Information

  • Patent Grant
  • 10728168
  • Patent Number
    10,728,168
  • Date Filed
    Monday, May 21, 2018
    6 years ago
  • Date Issued
    Tuesday, July 28, 2020
    4 years ago
Abstract
Systems and methods for providing a connection of a client to an unmanaged service in a client-server remote access system. An unmanaged service may register at a remote access server and open a communication connection there between remote access server may be configured for providing remote access to the unmanaged service by a client. The remote access server receives keep-alive messages from the unmanaged service over the communication connection, which may serve to indicate that the unmanaged service is operational. The remote access server may a request for a client connection to the unmanaged service, after which, a terminate keep-alive message is communicated to the unmanaged service to terminate the sending of keep-alive messages from the unmanaged service in response to the request for the client connection to the unmanaged service.
Description
BACKGROUND

Ubiquitous remote access to services has become commonplace as a result of the growth and availability of broadband and wireless network access. As such, users are accessing services using an ever-growing variety of client devices (e.g., mobile devices, tablet computing devices, laptop/notebook/desktop computers, etc.). A remote server may communicate messages that contain data or other information between services and client devices over a variety of networks including, 3G and 4G mobile data networks, wireless networks such as WiFi and WiMax, wired networks, etc.


The services may be deployed on the same system node or computing device as an integrated remote access and application server, which also hosts a server remote access program to which client devices communicate. In other instances, services may be deployed on servers provided at different system nodes from the remote access server executing the server remote access program. While such environments provide deployment of large numbers of services, as well as a lighter weight installation and configuration process, there are problems associated with maintaining an operational statuses of such services at the remote access server.


SUMMARY

Disclosed herein are systems and methods for providing unmanaged services with a keep-alive mechanism to determine if the unmanaged service is operational. In accordance with an aspect of the disclosure, there is provided a method for providing connection of a client to an unmanaged service in a client-server remote access system. The method may include registering the unmanaged service at a remote access server and creating a communication connection there between, the remote access server being configured for providing remote access to the unmanaged service by a client; receiving keep-alive messages at the remote access server from the unmanaged service over the communication connection; receiving a request at the remote access server for a client connection to the unmanaged service; and communicating a terminate keep-alive message from the remote access server to the unmanaged service to terminate the sending of keep-alive messages from the unmanaged service in response to the request for the client connection to the unmanaged service.


In accordance with other aspects of the disclosure, another method for providing a connection of a client to an unmanaged service in a client-server remote access system is disclosed. The method may include executing the unmanaged service at a first application server; opening a communication connection between the unmanaged service and a remote access server; providing information to a remote access server to register the unmanaged service at the remote access server, the remote access server being configured for providing remote access to the unmanaged service by a client; communicating keep-alive messages from the unmanaged service to the remote access server over the communication connection; and terminating the keep-alive messages from the unmanaged service in response to receiving an instruction.


In accordance with yet other aspects of the disclosure, an apparatus for providing a connection of a client to an unmanaged service in a client-server remote access system is disclosed. The apparatus may include a remote access server having a server layer that is a communications proxy for messages sent between the client and the unmanaged service, and an application server executing a service layer associated with the unmanaged service. The remote access server receives keep-alive messages from the unmanaged service over a communication connection, wherein the remote access server receives a request for a client connection to the unmanaged service. The remote access server may also communicate a terminate keep-alive message to the unmanaged service to terminate the sending of keep-alive messages from the unmanaged service in response to the request for the client connection to the unmanaged service.


In accordance with other aspects, there is provided a method for providing a connection of a client to an unmanaged service in a client-server remote access system. The method may include executing the unmanaged service at a first application server; opening a communication connection between the unmanaged service and a remote access server; providing initial headers information to a remote access server to register the unmanaged service at the remote access server, the remote access server being configured for providing remote access to the first unmanaged service by a client; communicating keep-alive messages from the unmanaged service to the remote access server over the communication connection; and terminating the keep-alive messages from the unmanaged service in response to a receiving an instruction request for a client connection at the remote access server.


Other systems, methods, features and/or advantages will be or may become apparent to one with skill in the art upon examination of the following drawings and detailed description. It is intended that all such additional systems, methods, features and/or advantages be included within this description and be protected by the accompanying claims.





BRIEF DESCRIPTION OF THE DRAWINGS

The components in the drawings are not necessarily to scale relative to each other. Like reference numerals designate corresponding parts throughout the several views.



FIGS. 1A and 1B, illustrate example server-service models for client remote access to services in a layered architecture;



FIG. 2 illustrates a call flow diagram illustrating a sequence of messages that are sent between threads running in the unmanaged service and the remote access server to implement the keep-alive messaging of the present disclosure;



FIG. 3 illustrates operational flow diagrams of processes performed by an unmanaged service to implement the keep-alive messaging shown in FIG. 2;



FIG. 4 illustrates an operational flow diagram of processes performed by a remote access server to implement the keep-alive messaging shown in FIG. 2; and



FIG. 5 illustrates an exemplary computing device.





DETAILED DESCRIPTION

Unless defined otherwise, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art. Methods and materials similar or equivalent to those described herein can be used in the practice or testing of the present disclosure. While implementations will be described for remotely accessing services, it will become evident to those skilled in the art that the implementations are not limited thereto, but are applicable for remotely accessing any type of data or service via a remote device.


With the above overview as an introduction, reference is now made to FIGS. 1A and 1B, which illustrate examples of managed and unmanaged server-service models for client remote access to services in a layered architecture. As shown in FIG. 1A (managed service model), a client 102 having a client layer 112 may communicate to a remote access and application server 103 that includes a server layer 114 and a service layer 116. As such, the server layer 114 and service layer 116 execute on the same system node. The client layer 112 may include a client application, e.g., a web browser, dedicated application, etc., used to provide a user interface at the client 102 that displays information from a connected service or services. The client application may connect to a service using an application ID or application name. The client 102 may be wireless handheld devices such as, for example, an IPHONE, an ANDROID-based device, a tablet device or a desktop/notebook personal computer that are connected by a communication network 125 to the remote access and application server 103.


The remote access and application server 103 may include a server remote access program that executes in the server layer 114. The server remote access program is used to connect the client 102 to a managed service 115 (e.g., an application) executing in the service layer 116. By “managed service,” it is meant that remote access and application server 103 controls the application/process life cycle by starting and stopping the managed service 115 as clients connect and disconnect. For example, the managed service 115 may be a medical imaging application. Within the remote access and application server 103, the server remote access program in the server layer 114 may be connected to the service in the service layer 116 using a TCP socket connection and by, e.g., a system bus of the remote access and application server 103. Thus, bandwidth between the server remote access program and the service is extremely high. To provide additional services or application in the environment of FIG. 1A, additional service layers 116 are deployed on the remote access and application server 103. Alternatively, additional remote access and application servers 103 having additional server layers 114 and service layers 116 may be added. An example of the client 102 and the remote access and application server 103 is shown in FIG. 5.


Referring now to FIG. 1B (unmanaged service model), there is illustrated an example of a service-server model in which a remote access server 104 includes the server layer 114 in which the server remote access program executes. An application server 106 includes the service layer 116 in which the service or application executes. In the environment of FIG. 1B, the service (shown as unmanaged service 117) is provided on a system node or computing device that is a different system node or a computing device on which the server remote access program executes. The unmanaged service 117 communicates over a communication connection 126 to the remote access server 104. Thus, the service is on a node separate from the server. As used herein, an “unmanaged service” is an application that may reside on a same or different node (e.g., server) than the remote access server 104, but whose application/process life cycle is not managed by the remote access server 104. Rather, an external entity (the end user, or another process or application) launches the service outside of the remote access server.


The communication connection 126 may be a TCP/IP communications network, a VPN connection, a dedicated connection, etc. Such environments provide for deployment of large numbers of services, as service deployment is not limited by the capabilities of the remote access and application server 103 of FIG. 1A. As such, services can be created and destroyed in accordance with needs, therefore providing scalability. An example of the remote access server 104 and the application server 106 is shown in FIG. 5.


In FIG. 1B, the client 102 connects to the remote access server 104 over communication connection 125. The application server 106 may connect to the remote access server 104 at a predetermined Internet Protocol (IP) address and/or socket, or using a Uniform Resource Locator (URL) associated with the remote access server 104 to register the service or application with the server remote access program executing on the remote access server 104. The service, on startup, connects to the server using a server-service socket connection (described in more detail below) and establishes the session as a queued and unmanaged application to which a client may connect.


In the environment of FIG. 1B, the unmanaged service 117 may register with the remote access server 104 prior to a client 102 connected to the unmanaged service 117. Initially, a remotely accessible application (i.e., the unmanaged service 117) is launched at the application server 106. Herein, “remotely accessible” may be defined as an application that has been designed to run with a remote access toolkit provided as part of a Software Development Kit (SDK) implemented in the service layer 116. The unmanaged service 117 then connects to the remote access server 104 and registers therewith to create a communication there between. The remotely accessible application is now a “queued service,” as it is ready to be connected to by one or more clients 102. The queued service is known by a unique application name (for a single type of remotely accessible application) and/or a unique application instanceId that is unique to the queued service connection.


The client 102 may connect to the unmanaged service 117 by connecting to the remote access server 104, as described above. In connecting to the remote access server 104, the client 102 may either connect to a specific instance of the queued service by using the application instanceId or connect to the first available queued service of a particular type using the application name. The remote access server 104 then facilitates the mechanics of connecting the client 102 to the queued service. Once the client is connected, the queued service is upgraded it to an “active service.” Additional clients may connect to the active services by using the unique application instanceId whereby the connected clients may collaborate together with the active service. Additional services may be provided by adding additional application servers 106 that each communicate to the remote access server 104 over respective communication connections 126. For example, a second (or more) application server 106 may be added to host a second (or more) unmanaged service 117.


In both FIGS. 1A and 1B, the server remote access program may provide for connection marshalling and application process management. An example of the server remote access program is PUREWEB, available from Calgary Scientific, Inc. of Calgary, Alberta, Canada.


In accordance with aspects of the present disclosure, when an unmanaged service deployment is implemented as shown in FIG. 1B, there may be a need for the remote access server 104 to know if the unmanaged service 117 is disconnected or hung-up during a client connection process. Accordingly, a keep-alive mechanism may be provided whereby the unmanaged service 117 sends keep-alive messages to the remote access server 104 during the time when the unmanaged service 117 is first queued and before a client 102 connects.


With reference to FIG. 2, there is illustrated a call flow diagram illustrating a sequence of messages that are sent between threads running in the unmanaged service 117 and the remote access server 104 to implement the keep-alive mechanism of the present disclosure. The remote access server 104 starts a monitor thread 206 to monitor the keep-alive messages from the unmanaged service 117 to detect if the unmanaged service 117 has gone away by determining that a keep-alive message has not been received within a configurable time interval or if the server-service socket connection between the remote access server 104 and the unmanaged service 117 has unexpectedly closed. If the server-service socket connection is lost, the client 102 disconnects its server session, which in turn, causes the remote access server 104 to close the server-service socket and purge the unmanaged service 117 from the system.


However, the keep-alive messaging may cause problems if the client 102 connects to the unmanaged service 117 while the keep-alive messaging is being performed, as there will be two threads writing simultaneously to the server-service socket. In particular, once the client 102 is connected, the remote access server 104 starts a thread to read service responses from the server-service socket to send back to the client 102. Before this thread is started, the remote access server 104 needs to ensure the monitor thread 206 is shutdown so there is only one thread reading from the server-service socket at a time. Otherwise the monitor thread runs the risk of consuming a response intended for the client 120 which may break the client-service request/response protocol. The remote access server 104 also needs to ensure that the unmanaged service 117 has stopped sending keep-alive messages, which might otherwise be communicated to the client 112. Here, the client 102 would not know what to do with the keep-alive message.


Thus, in accordance with the present disclosure, the keep-alive messaging is shut down just before the client 102 connects to the unmanaged service 117. A handshake process may be implemented that takes place between the remote access server 104 and the unmanaged service 117 to shutdown the keep-alive messages in an orderly fashion when the client 102 is connecting, such that normal processing can proceed, i.e., the service input/output threads transition from sending keep-alive messages to receiving client input and sending service responses. In this manner, there is a handoff of one thread to another in the socket.



FIG. 2 illustrates a call flow diagram illustrating a sequence of messages that are sent between threads running in the unmanaged service and the remote access server to implement the keep-alive messaging of the present disclosure. FIG. 3 illustrates an operational flow diagram 300 of processes performed by the remote access server 104 to implement the keep-alive messaging shown in FIG. 2. FIG. 4 illustrates operational flow diagrams 400 and 420 of processes performed by the unmanaged service 117 to implement the keep-alive messaging shown in FIG. 2. The operational flows 300, 400 and 420 may be executed simultaneously by the remote access server 104 and unmanaged service 117 to implement keep-alive messaging as introduced above.


As shown in FIG. 2 and FIG. 4, when the unmanaged service 117 connects to the remote access server 104, an input thread 202 and an output thread 204 are started, which execute the operational flows 400 and 420, respectively. At 422, an application ID, process name and process ID (i.e., information associated with the unmanaged service 117) is sent as initial headers to the remote access server 104 (at 424). As shown in FIG. 3, this information (from 422) is received by the remote access server 104 at 304. At 306, the remote access server 104 registers the unmanaged service 117. Next, the monitor thread 206 is started and begins its operational flow, as shown in 300.


The output thread 204 begins a loop at 426 where keep-alive messages are sent, the output thread 204 waits a configurable amount of time (e.g., 500 ms at 428) and determines if a stop sending keep-alives has been received (at 430, from the remote access server 104, described below). If the stop sending keep-alives has not been received, the loop returns to 426. If a stop sending keep-alives has been received, then the sending of keep-alive messages is stopped by the output thread 204 at 432. It is noted that the wait time at 428 is configurable and may be a time period other than 500 ms.


Concurrently with the above, the monitor thread 206 operates in a loop at 312 to start a timer at 314, read the keep-alive message from the output thread 204 (at 318) and cancel the timer at 320. This loop is performed during the period of time when the unmanaged service 117 is connected to the remote access server 104, but before a client connection is received. If the timer started at 314 expires before a keep-alive message is received, then at 316, the socket associated with the unmanaged service 117 is closed and the service is unregistered, as it is assumed the unmanaged service 117 has gone away.


Concurrent with the operation of the loop at 312, at 308, it may be determined by the remote access server 104 that a client is connecting to the remote access server 104 to remotely access the unmanaged service 117 (e.g., a connection from the client 102 at the URL of the remote access server 104). The determination at 308 may be determined at any time after the unmanaged service 117 connects to the remote access server 104 as shown in FIG. 2. At 310, the remote access server 104 sends a message to the input thread 202 to stop sending keep-alive messages. This message is received by the input thread at 402, which sets a stopSendingKeepAlives value to “true” at 404. At 406, the input thread 202 notifies the output thread 204 that it should stop sending keep-alive messages.


The output thread 204, at 430, determines if a notification from the input thread 202 indicates to stop sending keep-alive messages. The output thread 204, upon receipt of the notification to stop sending keep-alive messages, stops at 432 and sends a “keep-alive=false” to the monitor thread 206. The output thread waits and then loops to process client requests (at 434) until the client disconnects. The remote access server 104 stops the monitor thread and sends an acknowledgement to the input thread 202 at 322, which is received at 408. The remote access server 104 completes the connection to the client 102 at 324. The input thread 202 loops to process client request (at 410) until the client disconnects.


Thus, the above is an example mechanism by which keep-alive messages may be communicated to a socket to determine that the unmanaged service 117 is responsive that also enables a client to connect to the same socket without creating confusion between the keep-alive messaging and the client connection process.



FIG. 5 shows an exemplary computing environment in which example embodiments and aspects may be implemented. The computing system environment is only one example of a suitable computing environment and is not intended to suggest any limitation as to the scope of use or functionality.


Numerous other general purpose or special purpose computing system environments or configurations may be used. Examples of well-known computing systems, environments, and/or configurations that may be suitable for use include, but are not limited to, personal computers, servers, handheld or laptop devices, multiprocessor systems, microprocessor-based systems, network personal computers (PCs), minicomputers, mainframe computers, embedded systems, distributed computing environments that include any of the above systems or devices, and the like.


Computer-executable instructions, such as program modules, being executed by a computer may be used. Generally, program modules include routines, programs, objects, components, data structures, etc. that perform particular tasks or implement particular abstract data types. Distributed computing environments may be used where tasks are performed by remote processing devices that are linked through a communications network or other data transmission medium. In a distributed computing environment, program modules and other data may be located in both local and remote computer storage media including memory storage devices.


With reference to FIG. 5, an exemplary system for implementing aspects described herein includes a computing device, such as computing device 500. In its most basic configuration, computing device 500 typically includes at least one processing unit 502 and memory 504. Depending on the exact configuration and type of computing device, memory 504 may be volatile (such as random access memory (RAM)), non-volatile (such as read-only memory (ROM), flash memory, etc.), or some combination of the two. This most basic configuration is illustrated in FIG. 5 by dashed line 506.


Computing device 500 may have additional features/functionality. For example, computing device 500 may include additional storage (removable and/or non-removable) including, but not limited to, magnetic or optical disks or tape. Such additional storage is illustrated in FIG. 5 by removable storage 508 and non-removable storage 510.


Computing device 500 typically includes a variety of tangible computer readable media. Computer readable media can be any available tangible media that can be accessed by device 500 and includes both volatile and non-volatile media, removable and non-removable media.


Tangible computer storage media include volatile and non-volatile, and removable and non-removable media implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules or other data. Memory 504, removable storage 508, and non-removable storage 510 are all examples of computer storage media. Tangible computer storage media include, but are not limited to, RAM, ROM, electrically erasable program read-only memory (EEPROM), flash memory or other memory technology, CD-ROM, digital versatile disks (DVD) or other optical storage, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices, or any other medium which can be used to store the desired information and which can be accessed by computing device 500. Any such computer storage media may be part of computing device 500.


Computing device 500 may contain communications connection(s) 512 that allow the device to communicate with other devices. Computing device 500 may also have input device(s) 514 such as a keyboard, mouse, pen, voice input device, touch input device, etc. Output device(s) 516 such as a display, speakers, printer, etc. may also be included. All these devices are well known in the art and need not be discussed at length here.


It should be understood that the various techniques described herein may be implemented in connection with hardware or software or, where appropriate, with a combination of both. Thus, the methods and apparatus of the presently disclosed subject matter, or certain aspects or portions thereof, may take the form of program code (i.e., instructions) embodied in tangible media, such as floppy diskettes, CD-ROMs, hard drives, or any other machine-readable storage medium wherein, when the program code is loaded into and executed by a machine, such as a computer, the machine becomes an apparatus for practicing the presently disclosed subject matter. In the case of program code execution on programmable computers, the computing device generally includes a processor, a storage medium readable by the processor (including volatile and non-volatile memory and/or storage elements), at least one input device, and at least one output device. One or more programs may implement or utilize the processes described in connection with the presently disclosed subject matter, e.g., through the use of an application programming interface (API), reusable controls, or the like. Such programs may be implemented in a high level procedural or object-oriented programming language to communicate with a computer system. However, the program(s) can be implemented in assembly or machine language, if desired. In any case, the language may be a compiled or interpreted language and it may be combined with hardware implementations.


Although the subject matter has been described in language specific to structural features and/or methodological acts, it is to be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or acts described above. Rather, the specific features and acts described above are disclosed as example forms of implementing the claims.

Claims
  • 1. A server for providing remote access to an unmanaged service to client connected to the server over a network connection, comprising: a memory that stores instructions;a processor that executes the instructions causing the processor to execute a plurality of threads that register the unmanaged service and communicate keep-alive messages between the plurality of threads to maintain a socket connection between the unmanaged service and the server prior to the client requesting a remote connection thereto,wherein upon receiving a request from the client to create the remote connection to the unmanaged service, the keep-alive messages are terminated, andwherein subsequent client requests are received at the socket by one of the plurality of threads until the client terminates the remote connection with the unmanaged service.
  • 2. The server of claim 1, wherein the unmanaged service is assigned a unique identifier.
  • 3. The sever of claim 2, wherein the unique identifier is at least one of an application ID, process name or process ID, and wherein the unmanaged service communicates the unique identifier to the server to register the unmanaged service.
  • 4. The server of claim 1, wherein one of the plurality of threads establishes a plurality of respective connections between each of a plurality of clients and the unmanaged service using the unique identifier.
  • 5. The server of claim 1, wherein terminating the keep-alive messages shuts down the monitor thread before establishing a connection between the client and the unmanaged service.
  • 6. The server of claim 1, wherein each keep-alive message is communicated after a configurable wait time has elapsed since a previous keep-alive message was communicated.
  • 7. An apparatus for providing a connection of a client to an unmanaged service in a client-server remote access system, comprising: a remote access server executing a server layer that executes (1) an output thread that registers the unmanaged service and creates a connection to communicate keep-alive messages, (2) a monitor thread that receives the keep-alive messages from the output thread to start a timer that is used to maintain the unmanaged service in a responsive state prior to the client requesting a remote connection thereto, and (3) an input thread that receives a request from the client to create the remote connection to the unmanaged service; andan application server executing a service layer that executes the unmanaged service,wherein, upon receiving the request, the input thread notifies the output thread to terminate the keep-alive messages to the monitor thread, andwherein the output thread receives subsequent client requests until the client terminates the remote connection with the unmanaged service.
  • 8. The apparatus of claim 7, wherein the remote access server establishes a connection between the client and the unmanaged service.
  • 9. The apparatus of claim 7, wherein the remote access server assigns the unmanaged service a unique identifier.
  • 10. The apparatus of claim 9, wherein the unique identifier is at least one of an application ID, process name or process ID, and wherein the unmanaged service communicates the unique identifier to the server to register the unmanaged service.
  • 11. The apparatus of claim 7, wherein the remote access server establishes a plurality of respective connections between each of a plurality of clients and the unmanaged service using the unique identifier.
  • 12. The apparatus of claim 7, wherein each keep-alive message is communicated after a configurable wait time has elapsed since a previous keep-alive message was communicated.
  • 13. A method for providing connection of a client to an unmanaged service in a client-server remote access system, comprising: executing the unmanaged service at an application server;opening a communication connection between the application server and a remote access server;executing a first thread that registers the unmanaged service and communicates keep-alive messages to maintain a socket associated with the unmanaged service at the service in a responsive state;executing a second thread that receives a request from the client to create the remote connection to the unmanaged service;terminating the keep-alive messages upon receiving the request, andreceiving subsequent client requests at the socket by the first thread the until the client terminates the remote connection with the unmanaged service.
  • 14. The method of claim 13, further comprising establishing, by the remote access server, a connection between a connection between the client and the unmanaged service.
  • 15. The method of claim 13, further comprising assigning, by the remote access server, a unique identifier to the unmanaged service.
  • 16. The method of claim 15, further comprising communicating, by the unmanaged service, at least one of an application ID, process name or process ID to the server to register the unmanaged service.
  • 17. The method of claim 13, further comprising establishing, by the remote access server, a plurality of respective connections between each of a plurality of clients and the unmanaged service using the unique identifier.
  • 18. The method of claim 13, further comprising communicating each keep-alive message after a configurable wait time has elapsed since a previous keep-alive message was communicated.
CROSS-REFERENCE TO RELATED APPLICATIONS

This application is a continuation of U.S. patent application Ser. No. 15/437,025, filed Feb. 20, 2017, entitled “METHOD FOR PROVIDING A CONNECTION OF A CLIENT TO AN UNMANAGED SERVICE IN A CLIENT-SERVER REMOTE ACCESS SYSTEM,” which is a continuation of U.S. patent application Ser. No. 14/534,274, filed Nov. 6, 2014, now U.S. Pat. No. 9,686,205, entitled “METHOD FOR PROVIDING A CONNECTION OF A CLIENT TO AN UNMANAGED SERVICE IN A CLIENT-SERVER REMOTE ACCESS SYSTEM,” which claims priority to U.S. Provisional Patent Application No. 61/910,189, filed Nov. 29, 2013, entitled “METHOD FOR SERVER-SERVICE SEPARATION WITH END-TO-END FLOW CONTROL IN A CLIENT-SERVER REMOTE ACCESS ENVIRONMENT,” and U.S. Provisional Patent Application No. 61/944,720, filed Feb. 26, 2014, entitled “METHOD FOR PROVIDING A CONNECTION OF A CLIENT TO AN UNMANAGED SERVICE IN A CLIENT-SERVER REMOTE ACCESS SYSTEM.” The disclosures of the above are incorporated herein by reference in their entireties.

US Referenced Citations (231)
Number Name Date Kind
4975690 Torres Dec 1990 A
5345550 Bloomfield Sep 1994 A
5491800 Goldsmith et al. Feb 1996 A
5555003 Montgomery et al. Sep 1996 A
5742778 Hao et al. Apr 1998 A
5844553 Hao et al. Dec 1998 A
5870759 Bauer et al. Feb 1999 A
5903725 Colyer May 1999 A
5909545 Frese, II et al. Jun 1999 A
5920311 Anthias Jul 1999 A
5978842 Noble et al. Nov 1999 A
6045048 Wilz et al. Apr 2000 A
6061689 Chang et al. May 2000 A
6075531 DeStefano Jun 2000 A
6141698 Krishnan et al. Oct 2000 A
6145098 Nouri et al. Nov 2000 A
6175869 Ahuja et al. Jan 2001 B1
6253228 Ferris et al. Jun 2001 B1
6343313 Salesky et al. Jan 2002 B1
6453334 Vinson et al. Sep 2002 B1
6453356 Sheard et al. Sep 2002 B1
6570563 Honda May 2003 B1
6601233 Underwood Jul 2003 B1
6792607 Burd et al. Sep 2004 B1
6909545 Takano et al. Jun 2005 B2
6918113 Patel et al. Jul 2005 B2
6938096 Greschler et al. Aug 2005 B1
6976077 Lehew et al. Dec 2005 B1
7028051 McMullan Apr 2006 B1
7065568 Bracewell et al. Jun 2006 B2
7069227 Lintel, III et al. Jun 2006 B1
7073059 Worely et al. Jul 2006 B2
7149761 Cooke et al. Dec 2006 B2
7167893 Malone et al. Jan 2007 B1
7174504 Tsao Feb 2007 B2
7181686 Bahrs Feb 2007 B1
7240162 de Vries Jul 2007 B2
7246063 James et al. Jul 2007 B2
7320131 O'Toole, Jr. Jan 2008 B1
7343310 Stender Mar 2008 B1
7350151 Nakajima Mar 2008 B1
7418711 Lee et al. Aug 2008 B1
7451196 de Vries et al. Nov 2008 B1
7577751 Vinson et al. Aug 2009 B2
7620901 Carpenter et al. Nov 2009 B2
7647370 Liu et al. Jan 2010 B1
7650444 Dirstine et al. Jan 2010 B2
7656799 Samuels et al. Feb 2010 B2
7703024 Kautzleben et al. Apr 2010 B2
7706399 Janczak Apr 2010 B2
7725331 Schurenberg et al. May 2010 B2
7802183 Essin Sep 2010 B1
7831919 Viljoen et al. Nov 2010 B1
7886175 Venable, Sr. Feb 2011 B1
7921078 McCuller Apr 2011 B2
7941488 Goodman et al. May 2011 B2
7966572 Matthews et al. Jun 2011 B2
8024523 de Vries et al. Sep 2011 B2
8261345 Hitomi et al. Sep 2012 B2
8356252 Raman et al. Jan 2013 B2
8359591 de Vries et al. Jan 2013 B2
8509230 Vinson et al. Aug 2013 B2
8527706 de Vries et al. Sep 2013 B2
8533103 Certain et al. Sep 2013 B1
8572178 Frazzini et al. Oct 2013 B1
8606952 Pasetto et al. Dec 2013 B2
8607158 Molander et al. Dec 2013 B2
8627081 Grimen et al. Jan 2014 B2
8910112 Li et al. Feb 2014 B2
8667054 Tahan Mar 2014 B2
8832260 Raja et al. Sep 2014 B2
8924512 Stoyanov Dec 2014 B2
9239812 Berlin Jan 2016 B1
9686205 Leitch Jun 2017 B2
9979670 Leitch May 2018 B2
20010033299 Callaway et al. Oct 2001 A1
20010047393 Arner et al. Nov 2001 A1
20020032751 Bharadwaj Mar 2002 A1
20020032783 Tuatini Mar 2002 A1
20020032804 Hunt Mar 2002 A1
20020092029 Smith Jul 2002 A1
20030014735 Achlioptas et al. Jan 2003 A1
20030023670 Walrath Jan 2003 A1
20030065738 Yang et al. Apr 2003 A1
20030120324 Osborn et al. Jun 2003 A1
20030120762 Yepishin et al. Jun 2003 A1
20030149941 Tsao Aug 2003 A1
20030163514 Waldschmidt Aug 2003 A1
20030184584 Vachuska et al. Oct 2003 A1
20030208472 Pham Nov 2003 A1
20040015842 Nanivadekar et al. Jan 2004 A1
20040029638 Hytcheson et al. Feb 2004 A1
20040039742 Barsness et al. Feb 2004 A1
20040068516 Lee et al. Apr 2004 A1
20040106916 Quaid et al. Jun 2004 A1
20040117804 Scahill et al. Jun 2004 A1
20040162876 Kohavi Aug 2004 A1
20040183827 Putterman et al. Sep 2004 A1
20040236633 Knauerhase et al. Nov 2004 A1
20040243919 Muresan et al. Dec 2004 A1
20040249885 Petropoulakis et al. Dec 2004 A1
20050005024 Samuels et al. Jan 2005 A1
20050010871 Ruthfield et al. Jan 2005 A1
20050021687 Anastassopoulos et al. Jan 2005 A1
20050050229 Comeau et al. Mar 2005 A1
20050138631 Bellotti et al. Jun 2005 A1
20050188046 Hickman et al. Aug 2005 A1
20050188313 Matthews et al. Aug 2005 A1
20050190203 Gery et al. Sep 2005 A1
20050216421 Barry et al. Sep 2005 A1
20050240906 Kinderknecht et al. Oct 2005 A1
20060004874 Hutcheson et al. Jan 2006 A1
20060026006 Hindle Feb 2006 A1
20060031377 Ng et al. Feb 2006 A1
20060031481 Patrick et al. Feb 2006 A1
20060036770 Hosn et al. Feb 2006 A1
20060039359 Pang Feb 2006 A1
20060101397 Mercer et al. May 2006 A1
20060130069 Srinivasan et al. Jun 2006 A1
20060182141 Duggirala Aug 2006 A1
20060231175 Vondracek et al. Oct 2006 A1
20060236328 DeWitt Oct 2006 A1
20060258462 Cheng et al. Nov 2006 A1
20060265689 Kuznetsov et al. Nov 2006 A1
20060271563 Angelo et al. Nov 2006 A1
20060288171 Tsien Dec 2006 A1
20060294418 Fuchs Dec 2006 A1
20070024645 Purcell et al. Feb 2007 A1
20070047535 Varma Mar 2007 A1
20070067754 Chen et al. Mar 2007 A1
20070079244 Brugiolo Apr 2007 A1
20070112880 Yang et al. May 2007 A1
20070120763 De Paepe et al. May 2007 A1
20070130292 Tzruya et al. Jun 2007 A1
20070136677 Agarwal Jun 2007 A1
20070203944 Batra et al. Aug 2007 A1
20070203999 Townsley Aug 2007 A1
20070208718 Javid et al. Sep 2007 A1
20070226636 Carpenter et al. Sep 2007 A1
20070233706 Farber et al. Oct 2007 A1
20070244990 Wells Oct 2007 A1
20070256073 Truong et al. Nov 2007 A1
20070282951 Selimis et al. Dec 2007 A1
20080134211 Cui Jun 2008 A1
20080146194 Yang et al. Jun 2008 A1
20080159175 Flack Jul 2008 A1
20080183190 Adcox et al. Jul 2008 A1
20080313282 Warila et al. Dec 2008 A1
20090044171 Avadhanula Feb 2009 A1
20090080523 McDowell Mar 2009 A1
20090089742 Nagulu et al. Apr 2009 A1
20090119644 de Vries et al. May 2009 A1
20090198787 Broda Aug 2009 A1
20090209239 Montesdeoca Aug 2009 A1
20090217177 DeGrazia Aug 2009 A1
20090328032 Crow et al. Dec 2009 A1
20100061238 Godbole et al. Mar 2010 A1
20100077058 Messer Mar 2010 A1
20100131591 Thomas et al. May 2010 A1
20100150031 Allen et al. Jun 2010 A1
20100174773 Penner et al. Jul 2010 A1
20100205147 Lee Aug 2010 A1
20100223566 Holmes et al. Sep 2010 A1
20100223661 Yang Sep 2010 A1
20100268762 Pahlavan et al. Oct 2010 A1
20100268813 Pahlavan et al. Oct 2010 A1
20100281169 Charles Nov 2010 A1
20100281258 Andress Nov 2010 A1
20110138283 Marston Jun 2011 A1
20110145863 Alsina et al. Jun 2011 A1
20110154464 Agarwal et al. Jun 2011 A1
20110157196 Nave et al. Jun 2011 A1
20110162062 Kumar et al. Jun 2011 A1
20110184993 Chawla et al. Jul 2011 A1
20110213830 Lopez et al. Sep 2011 A1
20110219229 Cholas Sep 2011 A1
20110222442 Cole et al. Sep 2011 A1
20110223882 Hellgren Sep 2011 A1
20110246891 Schubert et al. Oct 2011 A1
20110252152 Sherry et al. Oct 2011 A1
20110264530 Santangelo Oct 2011 A1
20110314093 Sheu et al. Dec 2011 A1
20120008786 Cronk Jan 2012 A1
20120011567 Cronk Jan 2012 A1
20120030275 Boller et al. Feb 2012 A1
20120084713 Desai et al. Apr 2012 A1
20120090004 Jeong Apr 2012 A1
20120133675 McDowell May 2012 A1
20120151373 Kominac et al. Jun 2012 A1
20120154633 Rodriguez Jun 2012 A1
20120221792 de Vries et al. Aug 2012 A1
20120226742 Momchilov et al. Sep 2012 A1
20120245918 Overton et al. Sep 2012 A1
20120246225 Lemire et al. Sep 2012 A1
20120296959 Momchilov et al. Nov 2012 A1
20120324032 Chan Dec 2012 A1
20130007227 Hitomi et al. Jan 2013 A1
20130013671 Relan et al. Jan 2013 A1
20130031618 Momchilov Jan 2013 A1
20130046815 Thomas et al. Feb 2013 A1
20130046816 Thomas et al. Feb 2013 A1
20130054679 Jooste Feb 2013 A1
20130070740 Yovin Mar 2013 A1
20130086156 McFadzean et al. Apr 2013 A1
20130086652 Kavantzas et al. Apr 2013 A1
20130113833 Larsson May 2013 A1
20130117474 Ajanovic et al. May 2013 A1
20130132485 Thomas et al. May 2013 A1
20130138791 Thomas et al. May 2013 A1
20130147845 Xie et al. Jun 2013 A1
20130159062 Stiehl Jun 2013 A1
20130179962 Arai et al. Jul 2013 A1
20130212483 Brakensiek et al. Aug 2013 A1
20130262566 Stephure et al. Oct 2013 A1
20130290408 Stephure et al. Oct 2013 A1
20130290856 Beveridge et al. Oct 2013 A1
20130346482 Holmes Dec 2013 A1
20140136667 Gonsalves et al. May 2014 A1
20140214925 Thomas et al. Jul 2014 A1
20140240524 Julia et al. Aug 2014 A1
20140298420 Barton et al. Oct 2014 A1
20150026338 Lehmann et al. Jan 2015 A1
20150067035 Sullad et al. Mar 2015 A1
20150067769 Barton et al. Mar 2015 A1
20150081764 Zhao et al. Mar 2015 A1
20150163292 Lemire et al. Jun 2015 A1
20150319252 Momchilov et al. Nov 2015 A1
20160054897 Holmes et al. Feb 2016 A1
20160226871 Stephure et al. Aug 2016 A1
20160226979 Lancaster et al. Aug 2016 A1
20160277495 Thomas et al. Sep 2016 A1
Foreign Referenced Citations (35)
Number Date Country
101539932 Sep 2009 CN
101883097 Nov 2010 CN
102129632 Jul 2011 CN
102821413 Dec 2012 CN
0349463 Jan 1990 EP
1422901 May 2004 EP
2007084744 Mar 1995 JP
2002055870 Feb 2002 JP
2004287758 Oct 2004 JP
2005031807 Feb 2005 JP
2005521946 Jul 2005 JP
2008099055 Apr 2008 JP
2008263280 Oct 2008 JP
4405812 Jan 2010 JP
2010238126 Oct 2010 JP
2010256972 Nov 2010 JP
2295752 Mar 2007 RU
2298287 Apr 2007 RU
2305860 Sep 2007 RU
1998058478 Dec 1998 WO
2001016724 Mar 2001 WO
2002009106 Jan 2002 WO
2003032569 Apr 2003 WO
2003083684 Oct 2003 WO
2010060206 Jun 2010 WO
2010088768 Aug 2010 WO
2010127327 Nov 2010 WO
2011087545 Jul 2011 WO
2012127308 Sep 2012 WO
2013024342 Feb 2013 WO
2013024343 Feb 2013 WO
2013109984 Jul 2013 WO
2013128284 Sep 2013 WO
2013153439 Oct 2013 WO
2016120730 Aug 2016 WO
Non-Patent Literature Citations (13)
Entry
Search Report, dated Nov. 5, 2018, received in connection with CN Patent Application No. 2014800642124 (English translation).
International Preliminary Report on Patentability and Written Opinion, dated May 31, 2016, received in connection International Patent Application No. PCT/US2014/064243.
International Search Report and Written Opinion, dated Mar. 19, 2015, received in connection with International Patent Application No. PCT/US2014/064243.
Coffman, Daniel, et al., “A Client-Server Architecture for State-Dependent Dynamic Visualizations on the Web,” IBM T.J. Watson Research Center, 2010, 10 pages.
Fraser, N., “Differential Synchronization,” Google, Mountain View, CA, Jan. 2009, 8 pages.
“GTK 3, Broadway and an HTML5 websocket gui, for free,” retrieved on Sep. 26, 2017 at http://compsci.ca/v3/viewtopic.php?t=36823, Apr. 12, 2014, pp. 1-3.
Jourdain, Sebastien, et al., “ParaViewWeb: A Web Framework for 3D Visualization and Data Processing,” International Journal of Computer Information Systems and Industrial Management Applications, vol. 3, 2011, pp. 870-877.
Microsoft Computer Dictionary, Microsoft Press, 5th Edition, Mar. 15, 2002, p. 624.
Mitchell, J. Ross, et al., A Smartphone Client-Server Teleradiology System for Primary Diagnosis of Acute Stroke, Journal of Medical Internet Research, vol. 13, Issue 2, 2011, 12 pages.
ParaViewWeb, KitwarePublic, retrieved on Jan. 27, 2014 from http://www.paraview.org/Wiki/ParaViewWeb, 1 page.
Remote Desktop Protocol (RDP), retrieved on May 4, 2014 from http://en.wikipedia.org/wiki/Remote_Desktop_Protocol, 7 pages.
Remote Desktop Services (RDS), Remote App, retrieved on May 4, 2014 from http://en.wikipedia.org/wiki/Remote_Desktop_Services, 9 pages.
Remote Desktop Services (RDS), Windows Desktop Sharing, retrieved on May 4, 2014 from http://en.wikipedia.org/wiki/Remote_Desktop_Services, 9 pages.
Related Publications (1)
Number Date Country
20180375785 A1 Dec 2018 US
Provisional Applications (2)
Number Date Country
61944720 Feb 2014 US
61910189 Nov 2013 US
Continuations (2)
Number Date Country
Parent 15437025 Feb 2017 US
Child 15984497 US
Parent 14534274 Nov 2014 US
Child 15437025 US