The subject matter described herein relates to testing network equipment. More particularly, the subject matter described herein relates to methods, systems, and computer readable media for providing user interfaces for specification of system under test (SUT) and network tap topology and for presenting topology specific test results.
In network lab testing environments, network equipment test devices are connected to single or multiple devices under test (DUTs). A network that includes multiple DUTs is often referred to as a system under test (SUT). In some tests, the network equipment test devices send packets to the DUTs, receive packet from the DUTs, and generate statistics based on the received packets.
Currently, network equipment test devices allow topology information to be specified about the network equipment test devices themselves. However, the SUT is treated as a black box by current network equipment test devices. That is, current network equipment test devices do not allow the specification of topology information associated with the SUT. Accordingly, the test administrator is required to manually interpret received packets statistics to identify configuration errors associated with the SUT. In light of the voluminous nature of network test data, such manual interpretation is undesirable.
In addition to specifying the topology of the SUT, it is desirable for the user to be able to define tap points which may be the DUTs themselves or links between the DUTs. Network taps are devices that either passively copy or generate measurements based on packets transmitted through a network while allowing the original packets to proceed to their destinations. In order to properly configure a test, taps must be configured to measure or copy only traffic that is of interest to the user for a specific test. Performing such configuration manually can be cumbersome, especially when the number of taps is large. In addition, if a large number of taps are used in a particular test, a large number of packets will be measured or copied and analysis of measurements from multiple different sources may be difficult. Accordingly, there exists a need for methods, systems, and computer readable media for providing user interfaces for specification of SUT and network tap topology and for presenting topology specific test results.
A network equipment test device provides a user interface for user specification of a test traffic source, a test traffic destination, SUT and waypoint topology and one or more test cases. In response to receiving the specified input from the user via the interface, the test traffic source is automatically configured to send the test traffic to the destination via the SUT. The waypoint is automatically configured to measure the test traffic. When the test is initiated, test traffic is sent from the test traffic source to the test traffic destination via the SUT and the at least one waypoint. Test traffic is measured at the waypoint, and traffic measurement results are displayed on a visual map of SUT topology.
The subject matter described herein can be implemented in software in combination with hardware and/or firmware. For example, the subject matter described herein can be implemented in software executed by a processor. In one exemplary implementation, the subject matter described herein can be implemented using a non-transitory computer readable medium having stored thereon computer executable instructions that when executed by the processor of a computer control the computer to perform steps. Exemplary computer readable media suitable for implementing the subject matter described herein include non-transitory computer-readable media, such as disk memory devices, chip memory devices, programmable logic devices, and application specific integrated circuits. In addition, a computer readable medium that implements the subject matter described herein may be located on a single device or computing platform or may be distributed across multiple devices or computing platforms.
The subject matter described herein will now be explained with reference to the accompanying drawings of which:
The subject matter described herein relates to methods, systems, and computer readable media for providing user interfaces for specification of SUT and network tap topology and for presenting topology specific test results.
Once SUT topology information has been specified, either through user input or autodiscovery and the user starts a test, a test packet generator 103 generates and sends test packets to SUT 101 based on test cases 104. Because SUT topology information has been specified, when packets or corresponding traffic measurements are received by traffic measurements processor 108, the topology information can be used to generate SUT-topology-specific test results. Examples of SUT topology-specific test results include DUT coverage by a test, link coverage by a test, and packet statistics on a per link and/or per DUT basis. The SUT-topology-specific test results may also be used to generate new test cases and/or reconfigure existing test cases. For example, if a test indicates that a particular DUT in the SUT topology fails to forward packets, additional test cases may be created for this DUT.
As described above, once DUT topology information is specified, the DUT topology information can be used to visualize and/or analyze test results. For example, test packet generator 103 may transmit test packets to a device under test. Traffic measurements processor 108 may receive packets or corresponding traffic measurements from the system under test and/or waypoints defined in the system under test and determine, using the stored topology information, which links between the devices under test were covered by the test. Traffic measurements processor 108 may generate a diagram, similar to that illustrated in
In another example, as illustrated in
It should be noted that network equipment test device 100 and its components and functionality described herein constitute a special purpose test device that improves the technological field of testing network devices by providing for user specification of SUT and tap topology, automatic configuration of taps to detect traffic of interest, and display of SUT-topology-specific test results.
As stated above, traffic measurements processor 108 may utilize the SUT topology information to generate SUT-topology-specific test results.
Returning to
In another example of SUT-topology-specific test results, traffic measurements processor 108 may generate latency graphs as a function of location in the SUT topology. For example, a latency graph may be generated showing the average latency on each link 214, 216, 218, 220, 224, and 226 illustrated in
As stated above, the SUT-topology-specific test results may be used to generate new test cases or update existing test cases. Such generation may be performed dynamically by traffic measurements processor 108 during a test or statically by a test administrator using the interface provided by SUT topology specifier 102 after viewing SUT-topology-specific test results. In the automated case, traffic measurements processor 108 may determine that a particular test is not covering all of the DUTs in the topology and may modify the test during execution of the test to send packets to the DUT that was initially not covered by the test. Such a modification may also be performed manually by the test administrator after viewing test results. In another example, if the test results indicate that a particular device under test is causing packet loss for packets over a certain size, traffic measurements processor 108 may reduce the packet size of packets sent to the DUT until the packets pass the DUT.
In another example, if the SUT-topology-specific test results indicate that all packets are being transmitted over one link but no packets are being transmitted over another link through which packets are expected to be transmitted, it may be desirable to review the cabling between the network equipment test devices and the devices under test to determine whether a cable misconfiguration has occurred before running subsequent tests.
In step 504, packets are received from the system under test. The packets may be packets that were transmitted by or through the devices under test. In step 506, the method includes generating SUT-topology-specific information from the test results. An example of such information is illustrated in
Although in the examples above, packets are described as being received from the DUTs, it is understood that packets transmitted from or through the DUTs could be collected by network taps, such as the network taps illustrated in
Traffic definition portion 602 further includes an interface where the user can specify a traffic source and a traffic destination, as well as intermediate points between the traffic source and the destination. In the illustrated example, A is referred to as the traffic source, and B is the traffic destination. Intermediate points are not shown in
Control plane definition and display portion 604 displays network endpoints 610 and 612 and system under test 614. In the illustrated example, the network endpoints include 100 laptops running IPv4 over Ethernet and 10 Facebook servers running IPv4 over Ethernet. The topology of system under test 614 is not specified in
Once the user has specified the topology network using control plane definition and display portion 604, the user can define which nodes are traffic sources, which nodes are traffic destinations, as well as the locations of the waypoints. In
In step 904, in response to the user input, the test traffic source is automatically configured to generate the test traffic and send the test traffic to the traffic destination via the system under test and the waypoints are automatically configured to measure the test traffic. Automatically configuring the test traffic source to transmit the traffic may include configuring a packet generator with the type and volume of traffic to be sent. Automatically configuring the waypoints to measure the traffic may include programming the waypoints to look for the specific traffic type that is of interest to the user by specifying information, such as packet group identifiers (PGIDs) that are of interest. In step 906, the test traffic is generated and sent from the traffic source to the traffic destination via the at least one waypoint and the SUT, the traffic is measured at the at least one waypoint, and measurements of the traffic mapped to different regions of a displayed topology map of the system under test is output. Measuring and outputting the results may include capturing the traffic that is of interest at the waypoints and presenting results that are mapped to the SUT topology, such as packet loss or latency mapped to links or DUTs, as illustrated in
It will be understood that various details of the presently disclosed subject matter may be changed without departing from the scope of the presently disclosed subject matter. Furthermore, the foregoing description is for the purpose of illustration only, and not for the purpose of limitation.
This application is a continuation-in-part of U.S. patent application Ser. No. 14/051,424 filed Oct. 10, 2013; the disclosure of which is incorporated herein by reference in its entirety.
Number | Name | Date | Kind |
---|---|---|---|
5263029 | Wicklund, Jr. | Nov 1993 | A |
5276789 | Besaw | Jan 1994 | A |
5757820 | Angelotti | May 1998 | A |
6122753 | Masuo | Sep 2000 | A |
6321356 | Snodgrass | Nov 2001 | B1 |
6513138 | Ohsawa | Jan 2003 | B1 |
7154860 | Nanba | Dec 2006 | B1 |
7221912 | Nelson | May 2007 | B2 |
7272765 | Ichiyoshi | Sep 2007 | B2 |
7370236 | Szucs et al. | May 2008 | B2 |
7500158 | Smith | Mar 2009 | B1 |
7590903 | Volkerink | Sep 2009 | B2 |
8031623 | Beeson | Oct 2011 | B2 |
8086660 | Smith | Dec 2011 | B2 |
8255749 | Swoboda | Aug 2012 | B2 |
8826088 | Swoboda | Sep 2014 | B2 |
9003292 | Smith | Apr 2015 | B2 |
9246772 | Smith | Jan 2016 | B2 |
9356855 | Gintis | May 2016 | B2 |
20020093961 | Sharma | Jul 2002 | A1 |
20030043745 | Kano | Mar 2003 | A1 |
20030097438 | Bearden | May 2003 | A1 |
20030140279 | Szucs | Jul 2003 | A1 |
20060159033 | Suzuki | Jul 2006 | A1 |
20060268944 | Xu | Nov 2006 | A1 |
20070081549 | Cicchetti | Apr 2007 | A1 |
20070081553 | Cicchetti | Apr 2007 | A1 |
20070291650 | Ormazabal | Dec 2007 | A1 |
20080162994 | Szucs et al. | Jul 2008 | A1 |
20080198768 | Nanjundaswamy | Aug 2008 | A1 |
20080201733 | Ertugrul | Aug 2008 | A1 |
20090077163 | Ertugrul | Mar 2009 | A1 |
20090222694 | Adir | Sep 2009 | A1 |
20090303880 | Maltz | Dec 2009 | A1 |
20090327903 | Smith | Dec 2009 | A1 |
20100058457 | Ormazabal | Mar 2010 | A1 |
20100074141 | Nguyen | Mar 2010 | A1 |
20100110883 | Russell | May 2010 | A1 |
20100204948 | Kirrmann | Aug 2010 | A1 |
20110211473 | Matityahu | Sep 2011 | A1 |
20110305168 | Koide | Dec 2011 | A1 |
20120051234 | Gintis | Mar 2012 | A1 |
20120151596 | McClure et al. | Jun 2012 | A1 |
20130159865 | Smith et al. | Jun 2013 | A1 |
20130173940 | Sargent | Jul 2013 | A1 |
20130305091 | Stan et al. | Nov 2013 | A1 |
20130311646 | Nikaido | Nov 2013 | A1 |
20130329572 | Gintis | Dec 2013 | A1 |
20140098824 | Edmiston | Apr 2014 | A1 |
20140115421 | Cai | Apr 2014 | A1 |
20140269386 | Chu | Sep 2014 | A1 |
20140269390 | Ciodaru | Sep 2014 | A1 |
20140321285 | Chew | Oct 2014 | A1 |
20140341052 | Devarasetty et al. | Nov 2014 | A1 |
20150003259 | Gao | Jan 2015 | A1 |
20150106669 | Gintis | Apr 2015 | A1 |
20150106670 | Gintis | Apr 2015 | A1 |
Entry |
---|
Agilent Technologies, Agilent Triple Play NGN Seminar 2006 Ensuring your Network is Triple-Play Ready, Mar. 22, 2006,Agilent Technologies, pp. 1-159. |
David Jörg, Ants-Based Routing in Mobile Ad-Hoc Networks, 2004, Diplomarbeit der Philosophisch-naturwissenschaftlichen Fakultät der Universität Bern, pp. 1-89. |
Haris, Abdullah, A DTN Study: Analysis of Implementations and Tools, 2010, Technical University of Denmark, pp. 1-86. |
Non-Final Office Action for U.S. Appl. No. 14/051,424 (Mar. 25, 2015). |
Han et al., “Star Topology Test Architecture for Multi-site Testing,” IEEE, pp. 1-5 (Jun. 27, 2012). |
Poretsky et al., “Benchmarking Methodology for Link-State IGP Data Plane Route Convergence,” draft-ietf-bmwg-igp-dataplane-conv-meth-21, Network Working Group, pp. 1-28 (May 10, 2010). |
Commonly-assigned, co-pending U.S. Appl. No. 14/051,424 for “Methods, Systems, and Computer Readable Media for Providing for Specification or Autodiscovery of Device Under Test (DUT) Topology Information,” (Unpublished, filed Oct. 10, 2013). |
Notice of Allowance and Fee(s) Due for U.S. Appl. No. 14/051,424 (Feb. 1, 2016). |
Advisory Action Before the Filing of an Appeal Brief for U.S. Appl. No. 14/051,424 (Dec. 1, 2015). |
Notification of Transmittal of the International Search Report and the Wiitten Opinion of the International Searching Authority, or the Declaration for International Application No. PCT/US2015/041633 (Nov. 4, 2015). |
Final Office Action for U.S. Appl. No. 14/051,424 (Aug. 20, 2015). |
Number | Date | Country | |
---|---|---|---|
20150106670 A1 | Apr 2015 | US |
Number | Date | Country | |
---|---|---|---|
Parent | 14051424 | Oct 2013 | US |
Child | 14452205 | US |