The present invention generally relates to monitoring and displaying performance data related to transmission of information in data communication networks. In particular, the present invention relates to methods for providing performance improvement recommendations.
Measuring the true end-user interaction experience with applications operating within a distributed computing environment is a complicated task. As used herein, the interaction experience refers to the time between a display change on a host machine and updating a display to an end-user reflecting that change. There are several factors that contribute to the interaction experience: client performance, client load, network characteristics, network performance, server performance, and server load. Each of these factors may impact the interaction experience by varying amounts, and recommendations for optimizing the performance of each may vary. A method for providing users and developers with both information regarding performance data for the varying components in a client-host connection and with recommendations needed to improve the interaction experience would be desirable.
Furthermore, generating an interface for providing meaningful feedback to an end user creates additional complications. Conventional systems may provide rudimentary graphical displays, for example, two-dimensional graphs plotting usage as a function of time. Typical systems may display to a user a graphical history of computer usage or page file usage over a period of time, and may provide statistics such as a number of threads or processes executing in a period of time or a percentage of network utilization over a period of time. However, these systems typically lack the ability to provide interactive information to users seeking to improve or optimize usage. Nor do these systems typically provide an analysis for the user of the delay introduced into a connection by particular components of a connection between the user and another network node. Methods and systems providing a user with interactive, dynamic displays and recommendations for connection optimization would be desirable.
In one aspect, a method of providing a performance improvement recommendation for a connection between a first network node in communication with a second network node includes the step of transmitting information from the first node to the second node to provide communication between the nodes, via a plurality of transmission components. An elapsed time of transmission of the information between a subset of the plurality of transmission components is measured, the aggregation of the measurements representing time elapsed for end-to-end transmission of the information that includes preparing, by the first node, the information for transmission and processing, by the second node, the information upon receipt. A determination is made that one of the plurality of measured transmission components has a performance that crosses a predetermined threshold. A recommendation is identified to improve the performance of the identified component.
In one embodiment, the transmitted information comprises voice data. In another embodiment, the transmitted information comprises screen sharing data. In still another embodiment, the transmitted information comprises video data.
In one embodiment, the aggregation of the measurements for a subset of the plurality of transmission components occurs at a predetermined interval. In another embodiment, the measurement of elapsed time is taken for at least one of the transmission components selected from the group consisting of: graphic card performance at one of the first network node and second network node, network transmission time between the first network node and the second network node, processing data at one of the first network node and second network node, and network transmission time between the second network node and the first network node. In still another embodiment, the measurement includes measuring performance of a CPU of at least one of the first node and the second node. In yet another embodiment, the measurement includes measuring performance of a graphics card of at least one of the first node and the second node. In still another embodiment, the measurement includes measuring performance of transmitting information into the network at the first node. In a further embodiment, the measurement includes measuring performance of receiving information from a network at the second node. In yet another embodiment, the measurements are displayed graphically.
In one embodiment, a presentation is made to an end-user of a recommendation actionable by the end-user. In another embodiment, a presentation is made to an end-user of a recommendation in response to a query for a recommendation. In still another embodiment, historical data is accessed for a subset of the plurality of measured components and a recommendation is provided in response to the historical data. In yet another embodiment, the historical data is displayed graphical. In a further embodiment, the measurements for transmission components are transmitted to a server for storage.
The foregoing and other objects, aspects, features, and advantages of the invention will become more apparent and better understood by referring to the following description taken in conjunction with the accompanying drawings, in which:
Referring now to
As shown in
The network connections 160, 170, 180 between the second nodes 150, 150′, 150″ and the first node 100 can be local area networks (LAN), metropolitan area networks (MAN), or a wide area network (WAN) such as the Internet. The network connections 160, 170, 180 may be any type and/or form of network and may include any of the following: a point to point network, a broadcast network, a wide area network, a local area network, a telecommunications network, a data communication network, a computer network, an ATM (Asynchronous Transfer Mode) network, a SONET (Synchronous Optical Network) network, a SDH (Synchronous Digital Hierarchy) network, a wireless network and a wireline network. In some embodiments, the network connections 160, 170, 180 may comprise a wireless link, such as an infrared channel or satellite band. The topology of the network may be a bus, star, or ring network topology. The network topology may be of any such network or network topology as known to those ordinarily skilled in the art capable of supporting the operations described herein. The network connections 160, 170, 180 may comprise mobile telephone networks utilizing any protocol or protocols used to communicate among mobile devices, including AMPS, TDMA, CDMA, GSM, GPRS or UMTS. In some embodiments, different types of data may be transmitted via different protocols.
The first node 100 and the second nodes 150, 150′, 150″ may connect to the networks 160, 170, 180 through a variety of connections including standard telephone lines, LAN or WAN links (e.g., T1, T3, 56 kb, X.25), broadband connections (ISDN, Frame Relay, ATM), and wireless connections. Connections between the first node 100 and the second nodes 150, 150′, 150″ may use a variety of data-link layer communication protocols (e.g., TCP/IP, IPX, SPX, NetBIOS, NetBEUI, SMB, Ethernet, ARCNET, Fiber Distributed Data Interface (FDDI), RS232, WEE 802.11, IEEE 802.11a, IEEE 802.11b, IEEE 802.11g and direct asynchronous connections). Although shown in
The first node 100 and the second nodes 150, 150′, 150″ can communicate directly with each other or through an intermediary computing or communication device. For example, in some embodiments, a communication server may facilitate communications between the first and second nodes. The communications server can provide a secure channel using any number of encryption schemes to provide communications between the first node 100 and the second nodes 150, 150′, 150″. One remote access product that currently uses such a communication scheme is GOTOMYPC offered by Citrix Online, LLC of Santa Barbara Calif. Other such services can include, but are not limited too, CITRIX METAFRAME, provided by Citrix Systems, Inc. of Ft. Lauderdale Fla., WEBEX PCNOW offered by WebEx Communications, Inc. of Santa Clara Calif., LOGMEIN offered by 3 am Labs, Inc. of Woburn, Mass., REMOTELY ANYWHERE also offered by 3 am Labs, and PROVISION MANAGEMENT FRAMEWORK offered by Provision Networks.
The bandwidth and the latency of the networks 160, 170, 180 are factors that may affect the interaction experience of the end-user of the network environment. Other factors include the number of applications executing on the first node 100, the amount of data being executed (or load) of the applications of the first node 100, and the amount of processing (or load) being done by the second node 150. During operation, each of these factors fluctuates. As data is transmitted through the network, the amount of available bandwidth of the network is reduced. The number of requests to the first node 100 increases and decreases over time, thereby varying the load of the first node 100.
In some embodiments, the first node 100 and the second nodes 150, 150′, 150″ are provided as personal computers or computer servers, of the sort manufactured by the Hewlett-Packard Corporation of Palo Alto, Calif. or the Dell Corporation of Round Rock, Tex.
The central processing unit 202 is any logic circuitry that responds to and processes instructions fetched from the main memory unit 204. In many embodiments, the central processing unit is provided by a microprocessor unit, such as: those manufactured by Intel Corporation of Mountain View, Calif.; those manufactured by Motorola Corporation of Schaumburg, Ill.; those manufactured by Transmeta Corporation of Santa Clara, Calif.; the RS/6000 processor, those manufactured by International Business Machines of White Plains, N.Y.; or those manufactured by Advanced Micro Devices of Sunnyvale, Calif. The computer 200 may be based on any of these processors, or any other processor capable of operating as described herein.
Main memory unit 204 may be one or more memory chips capable of storing data and allowing any storage location to be directly accessed by the microprocessor 202, such as Static random access memory (SRAM), Burst SRAM or SynchBurst SRAM (BSRAM), Dynamic random access memory (DRAM), Fast Page Mode DRAM (FPM DRAM), Enhanced DRAM (EDRAM), Extended Data Output RAM (EDO RAM), Extended Data Output DRAM (EDO DRAM), Burst Extended Data Output DRAM (BEDO DRAM), Enhanced DRAM (EDRAM), synchronous DRAM (SDRAM), JEDEC SRAM, PC100 SDRAM, Double Data Rate SDRAM (DDR SDRAM), Enhanced SDRAM (ESDRAM), SyncLink DRAM (SLDRAM), Direct Rambus DRAM (DRDRAM), or Ferroelectric RAM (FRAM).
In the embodiment shown in
In the embodiment shown in
The computer 200 may support an installation device, such as a floppy disk drive for receiving floppy disks such as 3.5-inch, 5.25-inch disks or ZIP disks, a CD-ROM drive, a CD-R/RW drive, a DVD-ROM drive, tape drives of various formats, USB device, hard-drive or any other device suitable for installing software and programs such as a client agent, or portion thereof. The computer 200 may further comprise a storage device, such as one or more hard disk drives or redundant arrays of independent disks, for storing an operating system and other related software, and for storing application software programs such as any program related to a client agent. Optionally, any of the installation devices could also be used as the storage device. Additionally, the operating system and the software can be run from a bootable medium, for example, a bootable CD, such as KNOPPIX®, a bootable CD for GNU/Linux that is available as a GNU/Linux distribution from knoppix.net.
A wide variety of I/O devices 230 may be present in the computer system 200. Input devices include keyboards, mice, trackpads, trackballs, microphones, and drawing tablets. Output devices include video displays, speakers, inkjet printers, laser printers, and dye-sublimation printers. An I/O device may also provide mass storage for the computer system 200 such as a hard disk drive, a floppy disk drive for receiving floppy disks such as 3.5-inch, 5.25-inch disks or ZIP disks, a CD-ROM drive, a CD-WPM drive, a DVD-ROM drive, tape drives of various formats, and USB storage devices such as the USB Flash Drive line of devices manufactured by Twintech Industry, Inc. of Los Alamitos, Calif.
In some embodiments, the computer 200 may comprise or be connected to audio devices. In other embodiments, the computer 200 may be connected to video devices. In still other embodiments, the computer 200 may comprise or be connected to multiple display devices, which each may be of the same or different type and/or form. As such, any of the I/O devices 230a-230n may comprise any type and/or form of suitable hardware, software, or combination of hardware and software to support, enable or provide for the connection and use of multiple display devices by the computer 200. For example, the computer 200 may include any type and/or form of video adapter, video card, driver, and/or library to interface, communicate, connect or otherwise use the display devices. In one embodiment, a video adapter may comprise multiple connectors to interface to multiple display devices. In other embodiments, the computer 200 may include multiple video adapters, with each video adapter connected to one or more of the display devices. In still other embodiments, any portion of the operating system of the computer 200 may be configured for using multiple displays. In yet other embodiments, one or more of the display devices may be provided by one or more other computing devices, such as second nodes 150′, 150″ connected to the second node 150, for example, via a network. These embodiments may include any type of software designed and constructed to use another computer's display device as a second display device for the computer 200.
further embodiments, an I/O device 230 may be a bridge between the system bus 220 and an external communication bus, such as a USB bus, an Apple Desktop Bus, an RS-232 serial connection, a SCSI bus, a FireWire bus, a FireWire 800 bus, an Ethernet bus, an AppleTalk bus, a Gigabit Ethernet bus, an Asynchronous Transfer Mode bus, a HIPPI bus, a Super wpm bus a SerialPlus bus, a SCI/LAMP bus, a FibreChannel bus, or a Serial Attached small computer system interface bus.
General-purpose desktop computers of the sort depicted in
In some embodiments, the computer 200 may have different processors, operating systems, and input devices consistent with the device. For example, in one embodiment the computer 200 is a Treo 180, 270, 1060, 600, 650, 700w, or 700p smart phone manufactured by Palm, Inc. In this embodiment, the Treo smart phone is operated under the control of the PalmOS operating system and includes a stylus input device as well as a five-way navigator device. In other embodiments the computer 200 is a mobile device, such as a JAVA-enabled cellular telephone or personal digital assistant (PDA), such as the Motorola Q, i55sr, i58sr, i85s, i88s, i90c, i95ci, or the im11000, all of which are manufactured by Motorola Corp, of Schaumburg, Ill., the 6035 or the 7135, manufactured by Kyocera of Kyoto, Japan, or the i300 or i330, manufactured by Samsung Electronics Co., Ltd., of Seoul, Korea. In still other embodiments, the computer 200 is a Blackberry handheld or smart phone, such as the devices manufactured by Research In Motion Limited, including the Blackberry 7100 series, 8700 series, 7700 series, 7200 series, the Blackberry 7520, and the Blackberry Pearl 8100. In yet other embodiments, the computer 200 is a smart phone, Pocket PC, Pocket PC Phone, or other handheld mobile device supporting Microsoft Windows Mobile Software. Moreover, the computer 200 can be any workstation, desktop computer, laptop or notebook computer, server, handheld computer, mobile telephone, any other computer, or other form of computing or telecommunications device that is capable of communication and that has sufficient processor power and memory capacity to perform the operations described herein.
In some embodiments, the second nodes 150, 150′, 150″ connect to the first node 100 using any one of a number of well-known protocols from the GSM or CDMA families, such as W-CDMA. These protocols support commercial wireless communication services and W-CDMA, in particular, the underlying protocol supporting i-Mode and Mode services, offered by NIT DoCoMo.
Referring now to
Referring to
In one embodiment, the connection between the first computing device and the second computing device includes a physical portion between the first computing device and a network to which the first computing device connects. In another embodiment, the connection between the first computing device and the second computing device includes a physical portion between the second computing device and a network to which the second computing device connects. In still another embodiment, each section in the plurality of sections 320 represents a physical portion of the connection for a past session.
In one embodiment, a section 320 represents a host computing device. In another embodiment, a section 320′ represents a network to which the host computing device connects. In still another embodiment, a section 320″ represents a client computing device. In yet another embodiment, a section 320″′ represents a network to which the client computing device connects. In some embodiments, a section 320″′ represents an intermediate computing device forwarding communications between the host computing device and the client computing device. In one of these embodiments, a section 320″″ represents a network to which the intermediate computing device connects.
In some embodiments, a section 320 represents a graphics component of the host computing device. In one of these embodiments, the section 320 represents a graphics card. In another of these embodiments, the section 320 represents a graphics device. In still another of these embodiments, the section 320 represents a graphics processor. In other embodiments, the section 320 represents a video component of the host computing device. In one of these embodiments, the section 320 represents a video card in another of these embodiments, the section 320 represents a video device. In still another of these embodiments, the section 320 represents a video processor. In still other embodiments, the section 320 represents an audio component of the host computing device. In one of these embodiments, the section 320 represents an audio card. In another of these embodiments, the section 320 represents an audio device. In still another of these embodiments, the section 320 represents an audio processor.
In some embodiments, the section 320 represents a host computing device encoding data. In one of these embodiments, the section 320 represents the host computing device encoding video. In another of these embodiments, the section 320 represents the host computing device encoding audio. In still another of these embodiments, the section 320 represents the host computing device encoding graphics. In other embodiments, the section 320 represents a host computing device compressing data. In one of these embodiments, the section 320 represents the host computing device compressing video. In another of these embodiments, the section 320 represents the host computing device compressing audio. In still another of these embodiments, the section 320 represents the host computing device compressing graphics.
In some embodiments, the section 320 represents the client computing device decoding data. In one of these embodiments, the section 320 represents the client computing device decoding video. In another of these embodiments, the section 320 represents the client computing device decoding audio. In still another of these embodiments, the section 320 represents the client computing device decoding graphics. In other embodiments, the section 320 represents the client computing device decompressing data. In one of these embodiments, the section 320 represents the client computing device decompressing video. In another of these embodiments, the section 320 represents the client computing device decompressing audio. In still another of these embodiments, the section 320 represents the client computing device decompressing graphics. In still other embodiments, the section 320 represents a computing device encoding, compressing, encrypting, decoding, decompressing, or decrypting data.
In one embodiment, each of the plurality of sections 320 has a color. In another embodiment, each of the plurality of sections 320 has a distinct color. In still another embodiment, a color is dynamically assigned to a section in the plurality of sections 320. In yet another embodiment, the color assigned to section 320 provides an indication of a quality of a performance rating associated with the section 320. For example, if the section 320 represents a physical portion of a connection having a poor performance rating, the graphical user interface 300 may display the section 320 in red.
In some embodiments, the second graphical element 330 dynamically displays the past performance of a respective physical portion of the connection in the same color as the same respective physical portion of the first graphical element 310 when a pointer is placed on the same respective physical portion of the first graphical element 310. In one of these embodiments, the graphical user interface 300 displays a section 320′ in a color distinct from a color in which other sections 320″, 320″′ in the plurality of sections 320 are displayed. In another of these embodiments, the second graphical element 330 displays past performance of the section 320′ in the same color as the color used to display the section 320′ in the first graphical element 310.
In some embodiments, a graphical etc ent is displayed with a section in the plurality of sections 320 to convey information about an amount of latency introduced by the corresponding physical section of the connection. In one of these embodiments, a symbol, such as an exclamation point, is placed on the graphical element representing the section 320. In another of these embodiments, if the communication from the host's network introduces greater than 250 ms of delay to the overall latency, a flag, exclamation point, or other symbol indicating a warning, is placed on the graphical element representing the corresponding section 320. In still another of these embodiments, if the communication from the client's network introduces greater than 250 ms of delay to the overall latency, a flag, exclamation point, or other symbol indicating a warning, is placed on the graphical element representing the corresponding section 320.
Referring now to
Referring ahead to
Referring back to
In some embodiments, and as described in further detail below in connection with
Referring now to
In one embodiment, the graphical user interface 300 is displayed to the second computing node. In another embodiment, the graphical user interface 300 is displayed to the first computing node. In still another embodiment, the graphical user interface 300 is displayed to an intermediate erode. Ire yet another embodiment, the graphical user interface 300 is displayed to a computer unrelated to the performance data or the session. For example, an administrator on a fourth computing device could request and review recommendations for a particular session via the graphical user interface 300.
In one embodiment, the graphical element displays a recommendation retrieved from a database. In another embodiment, the graphical element displays a recommendation provided by an administrator of the system. In still another embodiment, the graphical element displays a recommendation identified by a file downloaded from a server. In yet another embodiment, the graphical element displays a recommendation retrieved from a host node.
In one embodiment, the displayed recommendation comprises an action the viewer of the recommendation can take to improve the performance of a transmission component associated with the recommendation. For example, the graphical element displaying an actionable recommendation to a user may depict a suggestion to upgrade a type of graphics card or network connection type, or may display a suggestion to modify a personal preference.
In some embodiments, the intermediate computing device provides the graphical elements and retrieves the recommendations for display in the graphical element. In other embodiments, a rule is applied to the aggregated measurements to identify a recommendation. In still other embodiments, the graphical element displays the recommendation from the first computing device. In yet other embodiments the graphical element displays the recommendation from the second computing device.
In some embodiments, the recommendation relates to general client-side optimizations. In one of these embodiments, a graphical element recommends closing, minimizing, or pausing animations or videos playing on the client unrelated to the client-host connection. In another of these embodiments, a graphical element recommends exiting from any applications executing on the client and unrelated to the client-host connection. In still another of these embodiments, a graphical element recommends changing a color quality in a preferences menu. In yet another of these embodiments, a graphical element recommends changing a setting of a display resolution on the client.
In other embodiments, the recommendation relates to the client's usage of the internet. In one of these embodiments, a graphical element recommends exiting from any peer-to-peer or file-sharing applications to allocate additional network bandwidth to the client-host connection. In another of these embodiments, a graphical element recommends avoiding downloading or uploading files from the client to the internet while the client-host connection is active. In still another of these embodiments, a graphical element recommends avoiding the use of streaming media, such as streaming radio, music, video, or Voice over IP applications for the duration of the client-host connection. In yet another of these embodiments, a graphical element recommends determining whether the user has sufficient network bandwidth to maintain the client-host connection, or whether activities of other users on the client network impact the amount of network bandwidth available to the user. In one embodiment, a graphical element recommends changing a type of connection from the wireless connection to a wired connection. In a further embodiment, a graphical element recommends upgrading a type of interact connection to a type of internet connection providing a higher speed, for example, upgrading from a dial-up connection to a cable modem connection.
In still other embodiments the recommendation relates to the host computer. In one of these embodiments, a graphical element recommends ensuring that a specific version of a driver for a video card is used. In another of these embodiments, a graphical element recommends lowering a color setting on a host. In still another of these embodiments, a graphical element recommends upgrading a video card. In yet another of these embodiments, a graphical element recommends exiting an application unrelated to the client-host connection, for example, an application using a high percentage of processor resources on the host. In a further embodiment, a graphical element recommends upgrading a host processor to a faster processor.
In yet other embodiments, the recommendation relates to the client computer. In one of these embodiments, a graphical element recommends modifying a window scale preference. In another of these embodiments, a graphical element recommends exiting an application unrelated to the client-host connection, for example, an application using a high percentage of processor resources on the client. In still another of these embodiments, a graphical element recommends upgrading a client processor to a faster processor.
Referring now to
In
Referring now to
Referring now to
In one embodiment, each of the plurality of sections of the first graphical element has a color. In another embodiment, the graphical element 430 dynamically displays the past performance rating of a respective physical portion of the connection in the same color as the same respective physical portion of the graphical element 310 when a pointer is placed of the same respective physical portion of the graphical element 310.
In some embodiments, the graphical user interface 300 is displayed to a user of a second node, such as a client or viewing node. In one of these embodiments, the user requests the display of the graphical user interface 300. In another of these embodiments, the user requests the display via a menu. In still another of these embodiments, the user is required to provide authentication credentials, such as a username and password. In yet another of these embodiments, the user is able to provide feedback regarding the display.
Referring now to
Referring now to
Referring now to
Referring now to
Referring now to
In one embodiment, the plurality of sections comprises sections 320 as described above. In another embodiment, a graphical element is generated for each section in the plurality of sections. In still another embodiment, the graphical element is interactive and a user may request and receive data by selecting a graphical element in the graphical user interface. In yet another embodiment, each of the plurality of sections of the first graphical element is displayed in color.
A second graphical element is retrieved, which displays performance data for a predetermined number of previous remote access sessions (step 504). In one embodiment, the first computing device generates the second graphical element and displays the second graphical element to a user of the second computing device. In another embodiment, the first computing device generates the second graphical element and transmits the second graphical element to an intermediate computing device for display to a user of the second computing device. In another embodiment, the second computing device generates the second graphical element. In still another embodiment, an intermediate computing device generates the second graphical element and displays the second graphical element to a user of the second computing device.
In one embodiment, the first computing device retrieves the second graphical element from a database. In another embodiment, the first computing device retrieves the second graphical element from a file stored on a server 100″. In still another embodiment, the first computing device receives the second graphical element from an administrator.
In one embodiment, an intermediate computing device retrieves the second graphical element from a database. In another embodiment, the intermediate computing device retrieves the second graphical element from a file stored on a server 100″′. The server 100″′ may be a web server. In still another embodiment, the intermediate computing device receives the second graphical element from an administrator.
In some embodiments, the second computing device requests performance data associated with the first computing device. In one of these embodiments, the intermediate computing device retrieves the second graphical element displaying the performance data associated with the first computing device, responsive to the request from the second computing device. In another of these embodiments, the intermediate computing device generates a graphical user interface, including the first graphical element and the second graphical element, and displays the graphical user interface to the second computing device responsive to the request from the second computing device for the performance data associated with the first computing device.
In one embodiment, the second graphical element dynamically displays the past performance of a respective physical portion of the connection when a pointer is placed over the same respective physical portion of the first graphical element. In another embodiment, the second graphical element displays the past performance of a respective physical portion of the connection in the same color as the same respective physical portion of the first graphical element when a pointer is placed of the same respective physical portion of the first graphical element. In still another embodiment, the second graphical element is associated with a dynamic label.
In one embodiment, a menu is configured to allow selection of one of the previous session for display in the first graphical element. In another embodiment, highlighting the selected previous session in the second graphical element triggers selection of the previous session for display in the first graphical element.
In some embodiments, a third graphical element displays a rating of the performance data of the current communication session relative to a predetermined number of communication sessions.
In one embodiment, a graphical element indicates that performance of one of the physical sections is below a predetermined threshold. In another embodiment, a graphical element displays a recommendation for improving the performance of the physical section that is below the predetermined threshold. In some embodiments, an administrator defines the predetermined threshold. In one of these embodiments, the graphical element receives an identification of the predetermined threshold. In other embodiments, the predetermined threshold may be dynamically adjusted, responsive to performance data. In one of these embodiments, the performance data comprises statistical data associated with performance data recorded for previous sessions. In another of these embodiments, the performance data comprises statistical data associated with performance data recorded for sessions provided to other computing devices.
In some embodiments, a computer readable medium having executable instructions thereon causes a graphical user interface to display performance data related to a current remote access session between a viewer computing device and a host computing device. The computer readable medium includes instructions to generate a first graphical element having a plurality of section that represent a respective physical portion of the remote access session. The computer readable medium further includes instructions to generate a second graphical element displaying performance data for a predetermined number of previous remote access sessions.
Referring now to
Referring now to
In one embodiment, the first node transmits audio data, such as music files, to the second node. In another embodiment, the first node transmits data to the second node, the data including files transmitted via file transfer protocols. In still another embodiment, the first node transmits mouse and keyboard input data to the second node. In yet another embodiment, the first node transmits information comprising combinations of different types of data, including screen-sharing data, video data, audio data, file transfer data, and mouse and keyboard input data.
In some embodiments, the first node transmits information to the second node via an intermediate node. In one of these embodiments, the intermediate node is referred to as a communication server. In other embodiments, the first node transmits data requesting a measurement of elapsed time from the second node. In one of these embodiments, the first node requests transmission, from the second node to the first node, of measurements taken by the second node regarding elapsed time.
An elapsed time of transmission of the information between a subset of the plurality of transmission components is measured, the aggregation of the measurements representing time elapsed for end-to-end transmission of the information that includes preparing, by the first node, the information for transmission and processing, by the second node, the information upon receipt (step 604). In one embodiment, the plurality of transmission components includes a component for each section of a physical connection between the first node and the second node. In another embodiment, the plurality of transmission components includes one of: a first node, a network accessed by the first node, a second node, and a network accessed by the second node. In still another embodiment, the transmission component includes an intermediate, communications server forwarding information from the first node to the second node. In yet another embodiment, a measurement is taken of the elapsed time of transmission of the information between a subset of the plurality of transmission components, the measurement taken as a percentage of capacity for transmission.
In some embodiments, a timer starts on the first node before the first node delivers a screen change to a queue for transmission to the second node. In one of these embodiments, after complete transmission of the screen change, the second node provides a unique number in an acknowledgement message and transmits the acknowledgement message to the first node. In another of these embodiments, the first node reviews incoming acknowledgement messages and stops the communication timer upon receipt of the acknowledgement message with the modified unique number from the second node.
In some embodiments, the first node takes the measurement of elapsed time of information transmission. In other embodiments, the second node takes the measurement of elapsed time of information transmission. In still other embodiments, an intermediate node takes the measurement of elapsed time of information transmission. In yet other embodiments, a node taking a measurement of elapsed time transmits the measurements to a different node, which displays the measurements to a user via a graphical user interface element.
In one embodiment, a measurement is taken of an elapsed time of information transmission between transmission components selected from the group consisting of: a graphic card performance at one of the first network node and second network node, a network transmission time between the first network node and the second network node, processing data at one of the first network node and second network node, and network transmission time between the second network node and the first network node. In other embodiment, the transmission components are selected from a group consisting of: a graphics card performance at the first node, a time of communication between the host and a network on which the first resides, a time of communication from a network on which the second node resides to the second node, and a processing time at the second node. In still another embodiment, in which an intermediate, communications server receives transmitted information from the first network node and forwards the transmitted information to the second network node, the transmission components are selected from a group consisting of: a graphics card performance at the first node, a time of communication between the host and a network on which the first resides, a time of communication from a network on which the second node resides to the second node, and a processing time at the second node.
In some embodiments, a measurement is taken of a performance of a video component of at least one of the first node and the second node. In one of these embodiments, a measurement is taken of a performance of a video capture component. In another of these embodiments, a measurement is taken of a performance of a video compression component. In still another of these embodiments, a measurement is taken of a performance of a component for receiving video. In yet another of these embodiments, a measurement is taken of a performance of a component for decompressing video. In a further of these embodiments, a measurement is taken of a component for receiving video. In still another of these embodiments, a measurement is taken of a component for transmitting video. In even still another of these embodiments, a measurement is taken of a component for resampling video.
In other embodiments, a measurement is taken of a performance of an audio component of at least one of the first node and the second node. In one of these components, a measurement is taken of an audio capture component. In another of these components, a measurement is taken of an audio compression component. In still another of these embodiments, a measurement is taken of an audio decompression component. In yet another of these embodiments, a measurement is taken of a component for receiving audio. In a further of these embodiments, a measurement taken of a component for transmitting audio. In even still another of these embodiments, a measurement is taken of a component for resampling audio.
In some embodiments, a measurement is taken of a performance of a graphics card of at least one of the first node and the second node. In one of these embodiments, a measurement is taken of a latency introduced when a graphics card on the first node reads a screen change on the first node. In another of these embodiments, a measurement is taken of a time to estimate and perfect a screen change by the graphics card. In still another of these embodiments, the measurement of the graphics card equals the time elapsed between the time before the estimator is called and the time after the perfector returns. In still another of these embodiments, the measurement of the graphics card equals a time elapsed during the preparation of the data for transmission. Preparation of the data may include, without limitation, transforming, sanitizing, resampling, formatting, encoding, compressing, and encrypting data. In yet another of these embodiments, the measurement of the graphics card equals a time elapsed during the processing of the data receiving by the client computing device. Processing of the received data may include, without limitation, transforming, sanitizing, resampling, formatting, encoding, compressing, and encrypting data.
In other embodiments, a measurement is taken of a performance of a CPU of at least one of the first node and the second node. In one of these embodiments, a measurement is taken of a latency introduced by the first node in processing image data. In another of these embodiments, the first node introduces latency when compressing or encrypting image data, such as screen updates, for transmission to the second node.
In one embodiment, a measurement is taken of a performance of transmission of information to a network by the first node. In another embodiment, a measurement is taken of a performance of receiving information from a network at the second node. In still another embodiment, a roundtrip time for a link in the physical connection between the first node and the second node is used to make the measurement. For example, and in some embodiments, if a roundtrip time for information transmitted between a first node and an intermediate node is twice as high as a roundtrip time for information transmitted between the intermediate node and a second node, ⅔ of the latency may be introduced by the link between the first node and the intermediate node and ⅓ of the latency may have been in introduced by the link between the intermediate node and the second node. In other embodiments, additional bandwidth tests are implemented to improve the accuracy of the latency measurements.
In one embodiment, a measure is taken of a latency introduced when the second node processes screen changes. In another embodiment, a measurement is taken when the second node decrypts and decompresses a received screen change. In still another embodiment, a measurement is made of an elapsed time between receipt of a screen update and display of a received screen update.
In some embodiments, the measurements, referred to as performance values, are averaged over periods of time. In other embodiments, the measurements, referred to as performance values, are aggregated over predetermined intervals. In one of these embodiments, the measurements are aggregated over one-minute intervals. In another of these embodiments, the measurements are aggregated over five-minute intervals. In still another of these embodiments, the measurements are aggregated over ten-minute intervals. In yet another of these embodiments, the measurements are aggregated over fifteen-minute intervals. In a further of these embodiments, the measurements are aggregated over thirty-minute intervals.
In one of these embodiments, the measurements are aggregated over one-hour intervals. In another of these embodiments, the measurements are aggregated over six-hour intervals. In still another of these embodiments, the measurements are aggregated over eighteen-hour intervals. In yet another of these embodiments, the measurements are aggregated over twenty-four intervals. In some of these embodiments, the performance values are transmitted to the first node every interval.
In some embodiments, supplemental measurements are taken. In one of these embodiments, a measurement is taken of a number of bytes and updates processed over time, which may be referred to as throughput. In another of these embodiments, a supplemental measurement is taken to measure an amount of bandwidth available in a connection between the first node and the second node.
In one embodiment, a supplemental measurement is taken to identify latency in transmitting information from the first node to an intermediate node, such as a communications server. In another embodiment, supplemental measurements are taken to identify latency in the roundtrip time required to transmit information between the intermediate server and the second node. In still another embodiment, supplemental measurements are taken to identify latency in the roundtrip time required to transmit information between the first node and the second node. In some embodiments, the first node initiates the supplemental measurements.
In one embodiment, a measurement of jitter in a roundtrip time latency measurement may provide an indication of packet toss in a particular connection. In another embodiment, supplemental measurements are taken to identify an amount of latency jitter for the communications between the first node and the intermediate server. In still another embodiment, supplemental measurements are taken to identify an amount of latency jitter for the communications between the intermediate server and the second node. In yet another embodiment, supplemental measurements are taken to identify an amount of latency jitter for the communications between the first node and the second node.
In one embodiment, graphics card performance, audio performance, video performance, and host performance measurements are computed and stored on the first node. In another embodiment, end-to-end communication time for screen updates is measured and computed on an application-level. In still another embodiment, a communications agent on an intermediate server provides an interface for querying communications statistics for use in determining inter-process communication measurements. In yet another embodiment, the communications agent resides on the first node. In a further embodiment the inter-process communication refers to a plurality of processes that transmit data from the first node to the second node, including, but not limited to, processes that capture screen data and processes that transmit captured screen data to the second node over a network.
In one embodiment, aggregate performance data received from the second node are stored on the first node. In another embodiment, the first node computes a running average of averages of the performance of the second node for a session. In some embodiments, the first node transmits stored measurements and statistics to a third node for storage. In one of these embodiments, the third node generates a graphical user interface displayed to the user. In another of these embodiments, the third node generates the graphical user interface 300 described above in connection with
In some embodiments, supplemental measurements are taken regarding audio device measurements. In one of these embodiments, supplemental measurements are taken of an audio capture component. In another of these embodiments, supplemental measurements are taken of audio performance. In still another of these embodiments, supplemental measurements are taken of performance of an audio compression component. In still another of these embodiments, supplemental measurements are taken of performance of an audio decompression component. In yet another of these embodiments, supplemental measurements are taken of audio resolution rates, such as bits per sample. In a further of these embodiments, supplemental measurements are taken of audio sampling rates. In one embodiment, supplemental measurements are taken regarding audio encoding and compression formats, available formats, and available compression ratios.
In other embodiments, supplemental measurements are taken regarding video device measurements. In one of these embodiments, supplemental measurements are taken of a video capture component. In another of these embodiments, supplemental measurements are taken of video performance. In still another of these embodiments, supplemental measurements are taken of performance of a video compression component. In still another of these embodiments, supplemental measurements are taken of performance of a video decompression component. In yet another of these embodiments, supplemental measurements are taken of video resolution rates. In a further of these embodiments, supplemental measurements are taken of video frame rates. In one embodiment, supplemental measurements are taken regarding video compression rates and compression formats.
In some embodiments, supplemental measurements are taken regarding screen information. In one of these embodiments, a supplemental measurement is taken to identify a resolution of a screen accessed by the first node. In another of these embodiments, a supplemental measurement is taken to identify a resolution of a screen accessed by the second node. In still another of these embodiments, a supplemental measurement is taken to identify a compression format of a screen accessed by the first node. In yet another of these embodiments, a supplemental measurement is taken to identify a compression mode of a screen accessed by the second node. In others of these embodiments, a supplemental measurement is taken to identify a color depth of a screen accessed by the first node. In still others of these embodiments, a supplemental measurement is taken to identify a color depth of a screen accessed by the second node. In yet others of these embodiments, a supplemental measurement is taken to identify information associated with a display adapter on one of the first node and the second node, the information including, but not limited to a name of the adapter, a driver of the adapter, and a version of the adapter.
In one embodiment, supplemental measurements are added to a measurement identifying latency between two of the transmission components in the plurality of transmission components. In another embodiment, supplemental measurements are added to a measurement identifying an aggregate update latency representing an amount of latency in the elapsed time for end-to-end transmission of information from a first node to a second node.
In some embodiments, the measurements are aggregated at predetermined intervals. In one of these embodiments, the predetermined interval is a session, such as a screen-sharing session between a host node and a client node. In another of these embodiments, the predetermined interval is one minute. In still another of these embodiments, the predetermined interval is configurable by a user.
In one of these embodiments, the measurements are aggregated over five-minute intervals. In another of these embodiments, the measurements are aggregated over ten-minute intervals. In stilt another of these embodiments, the measurements are aggregated over fifteen-minute intervals. In yet another of these embodiments, the measurements are aggregated over thirty-minute intervals.
In one of these embodiments, the measurements are aggregated over one-hour intervals. In another of these embodiments, the measurements are aggregated over six-hour intervals. In still another of these embodiments, the measurements are aggregated over eighteen-hour intervals. In yet another of these embodiments, the measurements are aggregated over twenty-four intervals. In some of these embodiments, the performance values are transmitted to the first node every interval.
In one embodiment, the aggregated measurements represent elapsed time between detection of a screen change on a host node and display of the screen change on the client node. In another embodiment, the aggregated measurement is referred to as update latency. In still another embodiment, the aggregated measurement comprises a main factor in a level of user-perceived quality of an interactive experience. In yet another embodiment, the aggregated measurement comprises a metric for the quality of a session.
In some embodiments, the measurements are aggregated to determine average or median update latency. In other embodiments, a standard deviation is computed for all measurements. In one of these embodiments, the standard deviation is used to identify packet loss from a measurement of roundtrip link latency.
In some embodiments, the measurements are aggregated over large intervals, such as sessions. In other embodiments, the measurements are aggregated over short intervals of time. In still other embodiments, the aggregated measurement comprises a metric for the overall session quality or the quality of the session at a point in time, depending on the time scale used when making the component measurements.
A determination is made when one of the plurality of measured transmission components has a performance that crosses a predetermined threshold (step 606). In one embodiment, an aggregate measurement comprises an indication of a performance of a transmission component for a particular session. In another embodiment, an aggregate measurement identifies an elapsed time below a predetermined threshold. In some embodiments, the predetermined threshold identifies a maximum amount of latency acceptable for a connection between the first and second nodes. In one of these embodiments, an aggregate measurement below the predetermined threshold indicates a positive performance for the transmission component introducing the latency into the connection, a performance without excessive amounts of latency, as defined by the predetermined threshold. In another of these embodiments, an aggregate measurement above the predetermined threshold indicates a negative performance.
In one embodiment, a transmission component having a performance in excess of a predetermined threshold has require an elapsed time for transmission of information crossing a threshold of acceptable elapsed time. In another embodiment, a transmission component having a performance crossing a predetermined threshold has introduced an amount of latency into an overall amount of latency in excess of a predetermined threshold of acceptable latency. In still another embodiment, the predetermined threshold identifies an amount of time acceptable for transmission of information from a first node, such as a host node, to a second node, such as a client node. In yet another embodiment, the predetermined threshold identifies an amount of latency acceptable in an amount of time required to provide an update of a screen change on a first node, such as a host node, to a second node, such as a client node. In some embodiments, transmission components requiring periods of time crossing the predetermined threshold to transmit information require remediation. In other embodiments, users require information regarding remediation or optimization upon identification of transmission components requiring periods of time crossing the predetermined threshold to transmit information.
In one embodiment, a rating is provided for the level of performance indicated by the aggregate measurements. In another embodiment, if an average update latency of a particular transmission component is greater than an average of update latency for all sessions in a predetermined period of time plus twice a standard deviation for all sessions, the rating is poor. A poor rating may be denoted by a zero in a numerical rating, or a graphical element displayed in red within a graphical user interface, such as the graphical user interface 300 described above.
In another embodiment, if an average update latency of a particular transmission component is less than an average of update latency for all sessions in a predetermined period of time minus a standard deviation for all sessions, the rating is excellent. An excellent rating may be donated by a ten in a numerical rating, or a graphical element displayed in green within a graphical user interface, such as the graphical user interface 300 described above.
In still another embodiment, a rating is given a numerical value equal to ten times the quantity of one minus the quantity of the quantity of an average update latency of a particular transmission component minus an average update latency for all sessions in a predetermined period of time plus one standard deviation, divided by the quantity of three times the standard deviation. In some embodiments, a range of colors is assigned to a range of numerical ratings, such as yellow for graphical elements representing transmission components having numerical ratings between 2.1 and 4, or varying shades of green for graphical elements representing transmission components having numerical ranges between 4.1 and 6, between 6.1 and 8 and between 8.1 and 10.
A recommendation is identified to improve the performance of the determined component (step 608). In one embodiment, historical data is accessed for a subset of the plurality of measured components and the recommendation is provided in response to the historical data. In another embodiment, the identified recommendation is provided to a user via a graphical user interface, such as the graphical user interface 300 described above in connection with
In one embodiment, the measurement of the elapsed time of transmission of information between the plurality of transmission components is transmitted to a server for storage. In another embodiment, a stored measurement of elapsed time provides the basis for historical data regarding performance of a particular component in the plurality of transmission components.
In one embodiment, the measurement of elapsed time of transmission of information is displayed graphically. In another embodiment, a graphical user interface, such as the graphical user interface 300 described above, displays the measurement of elapsed time. In still another embodiment, historical data is accessed for a subset of the plurality of transmission components and the historical data is displayed graphically.
In some embodiments, the recommendation relates to general client-side optimizations. In other embodiments, the recommendation relates to the client's usage of the internet. In still other embodiments, the recommendation relates to the host computer. In yet other embodiments, the recommendation relates to the client computer. The recommendations may be of the type described above in connection with
In some embodiments, a computer readable medium having executable instructions thereon to cause the providing of a performance improvement recommendation for a connection between a first network node in communication with a second network node is provided. The computer readable medium comprises instructions to transmit information from the first node to the second node to provide communication between the nodes, via a plurality of transmission components. The computer readable medium also comprises instructions to measure an elapsed time of transmission of the information between each of the plurality of transmission components, the aggregation of the measurements representing time elapsed for end-to-end transmission of the information that includes preparing, by the first node, the information for transmission and processing, by the second node, the information upon receipt. The computer readable medium further comprises instructions to determine when one of the plurality of measured transmission components has a performance that crosses a predetermined threshold. The computer readable medium additionally comprises instructions to identify a recommendation to improve the performance of the component determined by the instructions to determine when a performance crosses a predetermine threshold.
The systems and methods described above may be provided as one or more computer-readable programs embodied on or in one or more articles of manufacture. The article of manufacture may be a floppy disk, a hard disk, a CD-ROM, a flash memory card, a PROM, a RAM, a ROM, or a magnetic tape. In general, the computer-readable programs may be implemented in any programming language, LISP, PERL, C, C++, PROLOG, or any byte code language such as JAVA. The software programs may be stored on or in one or more articles of manufacture as object code.
Having described certain embodiments of methods for providing performance improvement recommendations, it will now become apparent to one of skill in the art that other embodiments incorporating the concepts of the invention may be used. Therefore, the invention should not be limited to certain embodiments, but rather should be limited only by the spirit and scope of the following claims.
The present application is a continuation of U.S. application Ser. No. 11/532,416, filed Sep. 15, 2006, the disclosure of which is incorporated by reference herein.
Number | Name | Date | Kind |
---|---|---|---|
5553083 | Miller | Sep 1996 | A |
5727002 | Miller | Mar 1998 | A |
5764235 | Hunt et al. | Jun 1998 | A |
5826025 | Gramlich | Oct 1998 | A |
5845265 | Woolston | Dec 1998 | A |
5956027 | Krishnamurthy | Sep 1999 | A |
6081829 | Sidana | Jun 2000 | A |
6167432 | Jiang | Dec 2000 | A |
6246758 | Low | Jun 2001 | B1 |
6249291 | Popp et al. | Jun 2001 | B1 |
6272539 | Cuomo et al. | Aug 2001 | B1 |
7013327 | Hickman et al. | Mar 2006 | B1 |
7161905 | Hahn et al. | Jan 2007 | B1 |
7430179 | Towns-von Stauber et al. | Sep 2008 | B2 |
7929453 | Parolkar et al. | Apr 2011 | B2 |
20030112796 | Kwan | Jun 2003 | A1 |
20030140159 | Campbell | Jul 2003 | A1 |
20050080850 | Salesky et al. | Apr 2005 | A1 |
20050265253 | Swift et al. | Dec 2005 | A1 |
20070064913 | Shaffer et al. | Mar 2007 | A1 |
Entry |
---|
US 5,715,404, 02/1998, Katseff et al. (withdrawn). |
“CU-SeeMe Software Product,” Brought to you by the Cu-SeeMe Development Team of the Advanced Technologies and Planning group of the Network Resources Division of Cornell Information Technologies, pp. 1-8 (1995). |
“ORCA Video Conferencing System”, Manual Written by the National Oceanic and Atmospheric Administration's Office of Ocean Resources Conservation and Assessment for Operation of the CU-SeeMe System, 26 pages (1995). |
Abdel-Waha et al., “XTV: A Framework for Sharing X Window Clients in Remote Synchronous Collaboration,” IEEE Conference, pp. 1-15 (1991). |
Chen et al., “Real Time Video and Audio in the World Wide Web”, 1995. |
Bolot et al., “Scalable Feedback Control for Multicast Video Distribution in the Internet,” SIGCOMM 94, London England, pp. 58-67 (1994). |
Cox, “Global Schoolhouse Project,” http://www.virtualschool.edu/mon/academia (2010). |
Crowley et al., “MMConf: An Infrastructure for Building Shared Multimedia Applications,” Proceedings of the 1990 ACM Conference on Computer-Supported Cooperative Work, pp. 329-342 (1990). |
Delgrossi et al., “Media Scaling for Audiovisual Communication with the Heidelberg Transport System,” Conference Proceedings of the first ACM International Conference on Multimedia, pp. 99-104 (1993). |
Dorcey, “ CU-SeeMe Desktop Videoconferencing Software,” Connexions the Interoperability Report, 9: 42-45 (1995). |
Ensor et al., “Control Issues in Multimedia Conferencing,” IEEE Conference, pp. 133-143 (1991). |
Ensor et al., “The Rapport Multimedia Conferencing System—A Software Overview,” Proceedings of the 2nd IEEE Conference, pp. 52-58 (1988). |
Maly et al., “Mosaic + XTV=CoReview,” Computer Networks and ISDN Systems, pp. 1-19 1995. |
McCanne et al., “Receiver-Driven Layered Multicast,” ACM SIGCOMM, pp. 1-14 (1996). |
Sattler, “Internet TV with CU-SeeMe”, Book, 323 pages (1995). |
Savetz et al., “MBONE: Multicasting Tomorrow's Internet,” IDG Books Worldwide, Inc., (1996). |
Number | Date | Country | |
---|---|---|---|
20120179811 A1 | Jul 2012 | US |
Number | Date | Country | |
---|---|---|---|
Parent | 11532416 | Sep 2006 | US |
Child | 13180220 | US |