Method and system for identifying lossy links in a computer network

Abstract

A computer network has links for carrying data among computers, including one or more client computers. Packet loss rates are determined for the client computers and, a system of equations is set up expressing the relationship between the loss rates at the client computers and the loss rates at the links. The system of equations is then solved using one or more linear programming techniques, and optimized by making an effort to find the most parsimonious solution.

Description

TECHNICAL FIELD

[0002] The invention relates generally to network communications and, more particularly, to methods and systems for identifying links in a computer network that are experiencing excessive data loss.

BACKGROUND

[0003] Computer networks, both public and private, have grown rapidly in recent years. A good example of a rapidly growing public network is the Internet. The Internet is made of a huge variety of hosts, links and networks. The diversity of large networks like the Internet presents challenges to servers operating in such networks. For example, a web server whose goal is to provide the best possible service to clients must contend with performance problems that vary in their nature and that vary over time. For example performance problems include, but are not limited to, high network delays, poor throughput and high incidents of packet losses. These problems are measurable at either the client or the server, but it is difficult to pinpoint the portion of a large network that is responsible for the problems based on the observations at either the client or the server.

[0004] Many techniques currently exist for measuring network performance. Some of the techniques are active, in that they involve injecting data traffic into the network in the form of pings, traceroutes, and TCP connections. Other techniques are passive in that they involve analyzing existing traffic by using server logs, packet sniffers and the like. Most of these techniques measure end-to-end performance. That is, they measure the aggregate performance of the network from a server to a client, including all of the intermediate, individual network links, and make no effort to distinguish among the performance of individual links. The few techniques that attempt to infer the performance of portions of the network (e.g., links between nodes) typically employ “active” probing (i.e., inject additional traffic into the network), which places an additional burden on the network.

SUMMARY

[0005] In accordance with the foregoing, a method and system for identifying lossy links in a computer network is provided. According to various embodiments of the invention, the computer network has links for carrying data among computers, including one or more client computers. Packet loss rates are determined for the client computers and a system of equations express the relationship between the loss rates at the client computers and the loss rates at the links. An objective function is defined by the system of equations and one or more linear programming techniques are applied to the function in order to find a solution to the equations in which as few links as possible have high loss rates. From the solution, lossy links are identified as those links whose loss rates, as inferred from the solution, exceed a predetermined threshold.

[0006] Additional aspects of the invention will be made apparent from the following detailed description of illustrative embodiments that proceeds with reference to the accompanying figures.

BRIEF DESCRIPTION OF THE DRAWINGS

[0007] While the appended claims set forth the features of the present invention with particularity, the invention may be best understood from the following detailed description taken in conjunction with the accompanying drawings of which:

[0008] FIG. 1 illustrates an example of a computer network in which the invention may be practiced;

[0009] FIG. 2 illustrates an example of a computer on which at least some parts of the invention may be implemented;

[0010] FIG. 3 illustrates a computer network in which an embodiment of the invention is used; and

[0011] FIG. 4 illustrates programs executed by a server in an embodiment of the invention.

DETAILED DESCRIPTION

[0012] Prior to proceeding with a description of the various embodiments of the invention, a description of the computer and networking environment in which the various embodiments of the invention may be practiced will now be, provided. Although it is not required, the present invention may be embodied by programs executed in a computer. Generally, programs include routines, objects, components, data structures and the like that perform particular tasks or implement particular abstract data types. The term “program” as used herein may connote a single program module or multiple program modules acting in concert. The term “computer” as used herein includes any device that electronically executes one or more programs, such as personal computers (PCs), hand-held devices, multi-processor systems, microprocessor-based programmable consumer electronics, network PCs, minicomputers, mainframe computers, consumer appliances having a microprocessor or microcontroller, routers, gateways, hubs and the like. The invention may also be employed in distributed computing environments, where tasks are performed by remote processing devices that are linked through a communications network. In a distributed computing environment, programs may be located in both local and remote memory storage devices.

[0013] An example of a networked environment in which the invention may be used will now be described with reference to FIG. 1. The example network includes several computers 10 communicating with one another over a network 11, represented by a cloud. Network 11 may include many well-known components, such as routers, gateways, hubs, etc. and allows the computers 10 to communicate via wired and/or wireless media. When interacting with one another over the network 11, one or more of the computers may act as clients, servers or peers with respect to other computers. Accordingly, the various embodiments of the invention may be practiced on clients, servers, peers or combinations thereof, even though specific examples contained herein don't refer to all of these types of computers.

[0014] Referring to FIG. 2, an example of a basic configuration for a computer on which all or parts of the invention described herein may be implemented is shown. In its most basic configuration, the computer 10 typically includes at least one processing unit 14 and memory 16. The processing unit 14 executes instructions to carry out tasks in accordance with various embodiments of the invention. In carrying out such tasks, the processing unit 14 transmits electronic signals to other parts of the computer 10 and to devices outside of the computer 10 to cause some result. Depending on the exact configuration and type of the computer 10, the memory 16 is volatile (such as RAM), non-volatile (such as ROM or flash memory) or some combination of the two. This most basic configuration is illustrated in FIG. 2 by dashed line 18. Additionally, the computer may also have additional features/functionality. For example, computer 10 may also include additional storage (removable and/or non-removable) including, but not limited to, magnetic or optical disks or tape. In general, the storage media of the computer 10 includes volatile and non-volatile, removable and non-removable media implemented in any method or technology for storing information, including computer-executable instructions, data structures, program modules, or other data. Computer storage media includes, but is not limited to, RAM, ROM, EEPROM, flash memory, CD-ROM, digital versatile disk (DVD) or other optical storage, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices, or any other medium which can be used to stored the desired information and which can be accessed by the computer 10. Any such computer storage media may be part of computer 10.

[0015] Computer 10 may also contain communications connections that allow the device to communicate with other devices. A communication connection is an example of a communication medium. Communication media typically embodies computer readable instructions, data structures, program modules or other data in a modulated data signal such as a carrier wave or other transport mechanism and includes any information delivery media. By way of example, and not limitation, communication media includes wired media such as a wired network or direct-wired connection, and wireless media such as acoustic, RF, infrared and other wireless media. The term “computer-readable medium” as used herein includes both computer storage media and communication media.

[0016] Computer 10 may also have input devices such as a keyboard, mouse, pen, voice input device, touch input device, etc. Output devices such as a display 20, speakers, a printer, etc. may also be included. All these devices are well known in the art and need not be discussed at length here.

[0017] The invention is generally directed to identifying lossy links on a computer network. Identifying lossy links is challenging for a variety of reasons. First, characteristics of a computer network may change over time. Second, even when the loss rate of each link is constant, it may not be possible to definitively identify the loss rate of each link due to the large number of constraints. For example, given M clients and N links, there are M constraints (corresponding to each server—end node path) defined over N variables (corresponding to the loss rate of the individual links). For each client Cj, there is a constraint of the form 1−Πi∈Tj(1−li)=pj, where Tj is the set of links on the path from the server to the client Cj, li is the loss rate of link i, and pj is the end-to-end loss rate between the server and the client Cj. If M<N, as is often the case, there is not a unique solution to this set of constraints.

[0018] The system and method described herein is intended for use on computer networks, and may be employed on a variety of topologies. The various embodiments of the invention and example scenarios contained herein are described in the context of a tree topology. However, the invention does not depend on the network topology being a tree.

[0019] Referring to FIG. 3, a computer network 30, having a tree topology, is shown. The computer network 30 includes a server 32 and client computers 34, 36, 38, 40, 42, 44, 46 and 48. The client computers include a first client computer 34, a second client computer 36 and a third client computer 38. The client computers of the network 30 also include a first end node C1, a second end node C2, and third end node C3, a fourth end node C4 and a fifth end node C5. Each end node has a loss rate associated with it. The loss rate represents the rate at which data packets are lost when traveling end-to-end between the server 32 and the end node. This loss rate is measured by a well-known method, such as by observing transport control protocol (TCP) packets at the server and counting their corresponding ACKs.

[0020] The network 30 also includes network links 33, 35, 37, 39, 41, 43, 45 and 47. Each network link has a packet loss rate associated with it. The packet loss rate of a link is the fraction of packets arriving at the link that don't make it across the link.

TABLE 1
Table 1 shows the meaning of the variables used in FIG. 3.
Variable Meaning
l1       loss rate of the link 33 between the server 32 and
         the first client computer 34
l2       loss rate of the link 35 between the first client
         computer 34 and the second client computer 36
l3       loss rate of the link 37 between the first client
         computer 34 and the third client computer 38
l4       loss rate of the link 39 between the second client
         computer 36 and the first end node 40
l5       loss rate of the link 41 between the second client
         computer 36 and the second end node 42
l6       loss rate of the link 43 between the second client
         computer 36 and the third end node 44
l7       loss rate of the link 45 between the third client
         computer 38 and the fifth end node 48
P1       end-to-end loss rate between the server 32 and
         the first end node 40
P2       end-to-end loss rate between the server 32 and
         the second end node 42
P3       end-to-end loss rate between the server 32 and
         the third end node 44
P4       end-to-end loss rate between the server 32 and
         the fourth end node 46
P5       end-to-end loss rate between the server 32 and
         the fifth end node 48

[0021] For any given path between the server 32 and an end node, the rate at which packets reach the end node is equal to the product of the rates at which packets pass through the individual links along the path. Thus, the loss rates in the network 30 can be expressed with the equations shown in Table 2.

TABLE 2
(1 − l1)*(1 − l2)*(1 − l4) = (1 − p1)
(1 − l1)*(1 − l2)*(1 − l5) = (1 − p2)
(1 − l1)*(1 − l2)*(1 − l6) = (1 − p3)
(1 − l1)*(1 − l3)*(1 − l7) = (1 − p4)
(1 − l1)*(1 − l3)*(1 − l8) = (1 − p5)

[0022] Solving the equations shown in Table 2 presents several challenges. One challenge is that there are many more unknown values than there are equations.

[0023] Referring to FIG. 4, a block diagram shows the programs that execute on the server 32 (from FIG. 3) according to an embodiment of the invention. The server 32 is shown executing a communication program 50 that sends and receives data packets to and from other computers in the network 30 (FIG. 3). The communication program 50 serves a variety of application programs (not shown) that also execute on the server 32. An analysis program 52 also executes on the server 32. The analysis program 52 receives data from the communication program 50. The analysis program 52 may carry out some or all of the steps of the invention, depending on the particular embodiment being used.

[0024] The communication program 50 keeps track of how many data packets it sends to the each of the end nodes 40, 42, 44, 46 and 48 (FIG. 3). It also determines how many of those packets were lost en route based on the feedback it receives from the end nodes. The feedback may take a variety of forms, including Transport Control Protocol (TCP) ACKs and Real-Time Control Protocol (RTCP) receiver reports. The communication program 50 is also capable of determining the paths that packets take through the network 30 by using a tool such as traceroute. Although the traceroute tool does involve active measurement, it need not be run very frequently or in real time. Besides traceroute, there are other ways to determine the paths that packets take, such as invoking the record route option (Ipv4) or extension header (Ipv6) on a small subset of packets. Thus, the communication program 50 gathers its data in a largely passive fashion.

[0025] The analysis program 52 identifies which link of the network 30 is excessively lossy by performing a statistical analysis on the data it receives from the communication program 50. In performing the statistical analysis, the goal of the analysis program 52 is not necessarily to infer a specific loss rate for each individual link of the network 30, but to identify those links that are likely to be excessively lossy. To accomplish this goal, the analysis program takes one or more steps to simplify the analysis. According to one step, for those links of a network path that have no branches, the analysis program 52 collapses the links into a single “virtual link.” Thus, for example, the link 33 between the server 32 and the first client computer 34 (FIG. 3), may be a virtual link that actually comprises several different physical links, but without any additional branches that carry data packets down to any of the end nodes 40, 42, 44, 46 and 48.

[0026] Another step taken by the analysis program 52 to simplify its analysis is to assume that the loss rate of each link in the network 30 is constant. Although this is not necessarily a realistic assumption, it has been shown that, in many networks, some links consistently have high loss rates while others consistently have low loss rates. Since the goal of the analysis program 52 is to determine which links are likely to be excessively lossy, and not to determine exact loss rates, this assumption is reasonable.

[0027] As previously discussed, for each client Cj of the network of FIG. 3, there is a constraint of the form 1−Πi∈Tj(1−li)=pj. This constraint can be converted to a linear constraint of the form as follows:

Πi∈Tj(1−li)=1−pj

log(Πi∈Tj(1−li))=log(1−pj)

Σi∈Tllog(1−li)=log(1−pj)

−Σi∈Tllog(1−li)=−log(1−pj)

Σi∈Tllog(1/(1−li))=log(1/(1−pj))

[0028] Therefore we have Σi∈TjLi=Pj, where Li=log (1/(1−li)) and Pj=log(1/(1−pj)). Additionally, a constraint on Li is that Li≧0. The transformed variables Li and Pj are monotonic functions of li and pj, respectively. According to an embodiment of the invention, the analysis program 52, introduces a slack variable, referred to herein as Sj, in the constraint for the client Cj, yielding a modified overall constraint of Σi∈TjLi+Sj=Pj. The slack variable Sj permits the analysis program 52 to violate, to a limited extent, the constraint Σi∈TjLi=Pj. The analysis program 52 uses the slack variable Sj to account for the possibility of errors in the computation of p1-p5. Such errors may result from anomalous measurements of packet loss rates made by the communication program 50, or temporal fluctuation in link loss rates and the like.

[0029] To determine the loss rates of the individual links l1-l8 (FIG. 3), the analysis program 52 attempts to minimize the following function:

wΣiLi+Σj|Sj|

[0030] Minimizing the tern ΣiLi represents an attempt to obtain a parsimonious solution for the system of equations shown in Table 2. In other words, it represents an attempt to find a solution in which as few links as possible have high loss rates. Minimizing the tern Σi|Sj| represents an attempt to minimize the extent to which the constraint Σi∈TjLi=Pj is violated. The constant w is a weight factor that the analysis program 52 uses to control the relative importance of finding a parsimonious solution versus the importance of minimizing the extent to which the constraint Σi∈TjLi=Pj is violated. By default, the analysis program 52 sets w equal to one.

[0031] To simplify the actual computations required to minimize the objective function wΣiLi+Σj|Sj|, the term |Sj| is converted to S′j, in which S′j≧Sj and S′j≧−Sj. Thus, the function to be minimized becomes wΣiLi+ΣjS′j, which is a linear objective function. Thus, the analysis program 52 solves the system of equations of Table 2 while minimizing the function wΣiLi+ΣjS′j. This can be accomplished in a variety of ways. For example, the analysis program 52 may use any of a number of linear programming techniques. An example of a suitable linear programming technique is that used by the “linprog” function of the MATLAB® software package.

[0032] For the example shown in FIG. 3, we have the following linear program, where p1=0.12, p2=0.15, p3=0.1, p4=0.02, p5=0.05. For w equals one (1), the problem is expressed as follows:

[0033] minimize (L1+L2+L3+L4+L5+L6+L7+L8+S1′+S2′+S3′+S4′+S5′), subject to (L1+L2+L4+S1=

L1 + L2 + L5 + S2 = P2
L1 + L2 + L6 + S3 = P3
L1 + L3 + L7 + S4 = P4
L1 + L3 + L8 + S5 = P5
S1′ + S1 <=	−S2′ + S2 <=	−S3′ + S3 <=	−S4′ + S4 <=	−S5′ + S5 <=
0	0	0	0	0
−S1′ −S1 <=	−S2′ − S2 <=	−S3′ − S3 <=	−S4′ − S4 <=	−S5′ − S5 <=
0	0	0	0	0
L1 >=	L2 >= 0	L3 >= 0	L4 >= 0	L5 >= 0	L6 >= 0	L7 >= 0	L8 >= 0
0

[0034] The above linear program can be solved using Matlab (or another linear programming solver), which gave the following output:

L1 = 0.0233

L2 = 0.0866

L3 = 0

L4 = 0.0075

L5 = 0.0215

L6 = 0

L7 = 0

L8 = 0.0121

[0035] Based on Li=log(1/(1−li)), the link loss rate is inferred to be as follows:

L1 = 0.023

L2 = 0.083

L3 = 0

L4 = 0.0075

L5 = 0.0213

L6 = 0

L7 = 0

L8 = 0.0121

[0036] Based on the inferred link loss rate, a link is lossy if its loss rate exceeds a threshold. The level at which the threshold is set depends on a variety of factors, such as how high of a loss rate is serious enough to adversely impact the application that a network user wishes to run. In this example, if the threshold is set to be a five percent loss rate, then link L2 is lossy with an inferred loss rate of 8.3 percent.

[0037] In view of the many possible embodiments to which the principles of this invention may be applied, the embodiments described herein with respect to the drawing figure are meant to be illustrative only and are not intended as limiting the scope of invention. For example, those of skill in the art will recognize that the elements of the illustrated embodiments shown in software may be implemented in hardware and vice versa or that the illustrated embodiments can be modified in arrangement and detail without departing from the spirit of the invention. Therefore, the invention as described herein contemplates all such embodiments as may come within the scope of the following claims and equivalents thereof.

Claims

1. A method for determining which of a plurality of links of a computer network are lossy, the network comprising a plurality of clients that communicate with a server over one or more of the plurality of links, the method comprising: establishing a system of equations that describes the relationship between the packet loss rates at the links and the packet loss rates at the clients; setting up constraints on the possible solutions to the system of equations; linearizing the constraints; deriving an objective function that represents both an aggregation of the packet loss rates for the plurality of links and an aggregate slack in the constraints; and calculating loss rates that solve the system of equations and give a minimum possible value for the function.

2. A computer-readable medium having stored thereon computer-executable instructions for performing the method of claim 1.

3. The method of claim 1 wherein each of the equations in the system expresses a product of success rates of links that form a path between the server and a particular client, wherein the product is the success rate of the particular client.

4. The method of claim 1 wherein one of the constraints is expressible as 1−Πi∈Tj(1−li)=pj, and wherein Tj is the set of links on a path from the server to the client Cj, li is the loss rate of link i, and pj is the end-to-end loss rate between the server and the client Cj.

5. The method of claim 4 wherein linearizing the constraints includes applying a log-transformation on each of the constraints so it becomes expressible as Σi∈TjLi=Pj, where Lilog(1/(1−li)) and Pj=log(1/(1−pj)).

6. The method of claim 1 wherein each of the plurality of clients communicates with the server over a subset of the plurality of links.

7. The method of claim 1 wherein the objective function further comprises a slack variable representing the extent to which each of the constraints may be violated in calculating the minimum possible value of the function.

8. The method of claim 1 wherein the objective function comprises the term ΣiLi, wherein Li=log(1/(1−li)) and li is the loss rate of link i of the plurality of links.

9. The method of claim 1 wherein the objective function comprises ΣiLi+Σi|Sj|, wherein Li=log(1/(1−li)) and li is the loss rate of link i of the plurality of links and wherein Sj is a slack variable representing the extent to which the constraint can be violated.

10. The method of claim 1, wherein the objective function comprises wΣiLi+Σj|Sj|, wherein Li=log(1(1−li)) and li is the loss rate of link i of the plurality of links and wherein Sj is a slack variable representing the extent to which one of the constraints can be violated, and wherein w represents a relative importance of a parsimonious solution.

11. In a computer network comprising a plurality of links and a plurality of end nodes, a method for determining which one or more links of the plurality of links are lossy, wherein each link has a loss rate representing a rate at which data packets are lost on the link, and a success rate representing a rate at which packets are successfully transmitted over the link, the method comprising: establishing constraints relating the loss rates of the links and packet loss rates at the end nodes; introducing slack variables allowing the constraints to be violated to an extent; optimizing a function by minimizing (1) an aggregation of the loss rates of the links and (2) an aggregation of the slack variables; and identifying from the optimization any links that violate a threshold value for loss rates or success rates.

12. The method of claim 11 wherein the function comprises a sum of a logarithm of an inverse of the success rates of the plurality of links.

13. The method of claim 12, wherein the function also comprises an aggregate slack in the set of constraints.

14. A computer-readable medium having stored thereon computer-executable instructions for performing the method of claim 11.

15. The method of claim 11 wherein at least one of the constraints is expressed as 1−Πi∈Tj(1−li)=pj, and wherein Tj is the set of links on the path between nodes, li is the loss rate of link i, and pj is the end-to-end loss rate between the nodes.

16. The method of claim 15, further comprising converting the constraint into a linear constraint that is expressible as Σi∈TjLi=Pj, where Li=log(1/(1−li)) and Pj=log(1/(1−pj)).

17. The method of claim 16, wherein the function is expressible in terms comprising ΣiLi, wherein Li=log(1/(1−li)) and li is the loss rate of link i of the plurality of links.

18. The method of claim 16, wherein the function is expressible in terms comprising ΣiLi+Σi|Sj|, wherein Li=log(1/(1−li)) and li is the loss rate of link i of the plurality of links and wherein Sj is a slack variable representing the extent to which the constraint can be violated.

19. The method of claim 16, wherein the function is expressible in terms comprising wΣiLi+Σj|Sj|, where Li=log(1/(1−li)) and li is the loss rate of link i of the plurality of links and Sj is a slack variable representing the extent to which the constraints can be violated, and wherein w represents a relative importance of a parsimonious solution.

20. On a computer network comprising a plurality of links, each of the plurality of links having associated therewith a rate of loss for data attempting to pass through the link, a method for identifying a lossy link, the method comprising: modeling the network connections among nodes on the network so as to define loss rates for each connection and infer loss rates for each of the links comprising the connection; and identifying which links in the connections have inferred loss rates that exceed a predetermined rate.

21. The method of claim 20 wherein the modeling of the network connections includes choosing the loss rate for each of the plurality of links so as to minimize a function comprising a summation over all of the links of an logarithm of the inverse of success rates for the plurality of links.

22. The method of claim 21 wherein the function also comprises an aggregate slack in a set of constraints.

23. A computer-readable medium having stored thereon computer executable instructions for performing the method of claim 20.

24. The method of claim 21 wherein the function is expressible in terms comprising ΣiLi, wherein Li=log(1/(1−li)) and li is the loss rate of link i of the plurality of links.

25. The method of claim 22, wherein the function is expressible in terms comprising ΣiLi+Σi|Sj|, wherein Li=log(1/(1−li)) and li is the loss rate of link of the plurality of links and wherein Sj is a slack variable representing the extent to which the constraint can be violated.

26. The method of claim 22 wherein the function is expressible in terms comprising wΣiLi+Σj|Sj|, wherein Li=log(1/(1−li)) and li is the loss rate of link i of the plurality of links and wherein Sj is a slack variable representing the extent to which the constraint can be violated, and wherein w the relative importance of finding a parsimonious solution.

27. In a computer network having a plurality of links connecting a server to client computers and carrying data traffic between the server and client computers, a system for determining which of the plurality of links are lossy, the system comprising: a model comprising (1) constraints relating packet loss rates at the links and packet loss rates at the clients, (2) slack variables relaxing the constraints, and, (3) a function representing both an aggregation of the packet loss rates for the plurality of links and an aggregation of the slack variables; means for solving the model by finding a minimum value for the function, which thereby yields loss rates for the links in the network; and means responsive to the yielded loss rates for identifying lossy links.

28. The system of claim 27 wherein the model resides at the server.

29. The system of claim 28 wherein the means for solving and identifying is the server computer executing an analysis program.