The disclosure generally relates to computer networks, and more particularly, to an apparatus, system, and method for packet switching.
Networks, such as the Internet, have numerous networking and computing machines that are involved in transmitting data between machines in the network. One such networking machine is the router. A router is highly complex piece of networking equipment that directs data packets through a network from one machine to another. Generally speaking, a router receives packets of data, determines the destination for those data packets, and then transmits the data packets to the correct port that is connected with the destination or the next stop on a path to the destination. There are numerous decisions and computations involved with determining the next hop on the path to the destination and the router makes those decisions for enormous amounts of data every second. A switch is a similar type networking device that directs packets of data through a network, albeit some switches may make fewer and less sophisticated decisions as to the next hop for a data packet. Regardless, both routers and switches are highly sophisticated and complex pieces of networking equipment.
Conventional routers and switches are typically sold as a vertically integrated device, with a full computer hardware solution integrated with a full software suite. While providing excellent functionality, such vertically integrated devices are very expensive. Moreover, such vertically integrated devices do not provide network providers with the capability to customize the router or switch, to deploy a lighter weight device (one with less software, for example), or to otherwise customize the device or provide unique services or rates within the network.
It is with these inadequacies and concerns in mind, among others, that various aspects of the present disclosure were conceived and developed.
An apparatus is provided for control of a plurality of forwarding switches using a network controller. The network controller executes a routing configuration application that analyzes interconnections between the forwarding switches to identify a topology of the network, determine label switched paths (LSPs) between the forwarding switches, and transmits the next hop routes to the forwarding switches. The forwarding switches use the next hop routes to route packets through the network according to a multiprotocol label switching (MPLS) protocol. Each LSP includes one or more next hop routes defining a forwarding address associated with one forwarding switch to an adjacent forwarding switch.
According to another aspect, a network controlling method includes analyzing, by a network controller, a plurality of interconnections between a plurality of forwarding switches of a communication network to identify a network topology of the communication network, determining at least one label switched path (LSP) between the forwarding switches, and transmitting the next hop routes to the forwarding switches. The forwarding switches use the next hop routes to route packets through the network according to a multiprotocol label switching (MPLS) protocol. Each LSP includes one or more next hop routes defining a forwarding address associated with one forwarding switch to an adjacent forwarding switch.
According to yet another aspect, a communication network system includes multiple forwarding switches interconnected with one another, and controlled by a network controller. The network controller executes a routing configuration application that analyzes interconnections between the forwarding switches to identify a topology of the network, determine label switched paths (LSPs) between the forwarding switches, and transmits the next hop routes to the forwarding switches. The forwarding switches use the next hop routes to route packets through the network according to a multiprotocol label switching (MPLS) protocol. Each LSP includes one or more next hop routes defining a forwarding address associated with one forwarding switch to an adjacent forwarding switch.
The foregoing and other objects, features and advantages of the disclosure will be apparent from the following description of particular embodiments of the disclosure, as illustrated in the accompanying drawings in which like reference characters refer to the same parts throughout the different views. The drawings are not necessarily to scale, emphasis instead being placed upon illustrating the principles of the disclosure.
Aspects of the present disclosure involve a networking architecture and related apparatus and methods for packet switching using one or more software defined networking (SDN) controllers deployed in a network and in communication with any number of non-vertically integrated forwarding switches. Unlike a conventional vertically integrated router or switch that operates distributing routing protocols, such as open shortest path first (OSPF), border gateway protocol (BGP), or intermediate system to intermediate system (IS-IS), and independently calculates routing tables, the forwarding switches in the present architecture do not necessarily independently calculate routing tables. Instead, the forwarding switch may be a generic hardware device with forwarding plane hardware, such as one or more line cards that provide the ports for connecting to other forwarding switches, needed to forward packets. The forwarding switch may also include a light weight operating system and customized applications, and a SDN controller (or controllers) that runs routing protocols for the network and provides the forwarding paths to the forwarding switches.
Generally speaking, various devices within the customer network 104, such as local area network devices, are connected to the CE router 106. The CE router 106 is in communication with the provider edge device 114, which may be connected using any type of connection, such as a gigabit Ethernet (GigE) connection. In this example network implementation, the PE device 114 is a conventional vertically integrated device such as a router. The PE device 114 is in communication with a gateway 116 of the backbone network 102. The PE device 114 is configured to interoperate with legacy customer devices, such as the CE router 106, that the backbone network may not control or operate. Thus, the network, by using a conventional PE device 114, may maintain interoperability with conventional devices and protocols without involving any change at the CE router 106 or customer network 104.
Within the backbone network 102, however, one or more conventional routers or switches may be replaced with forwarding switches (P1-P5) whose routes are determined and controlled by one or more SDN controllers 120. The forwarding switches (P1-P5) are relatively non-complex devices in that they are not required to implement routing functionality or conform to other networking standards associated with other networking devices. For example, each forwarding switch may include generic hardware, such as one or more line cards that provide forwarding plane hardware and ports for connecting to other forwarding switches needed to forward packets. Rather than each forwarding switch calculating its own routing information, such as routing table information, the SDN controller 120 determines routing information to be used by each forwarding switch and transmits this routing information to be used by the forwarding switches for routing packets through the communication network 102.
Although the particular embodiment shown only includes one SDN controller 120, other embodiments may include two or more SDN controllers 120 that function together to determine and control routes through the network 102. The scale and configuration of the network 102 will play a role in determining how many SDN controllers 120 are used in the network 102. For example, in a small geographically localized network, it may be sufficient to have one SDN controller 120. In a global network however, multiple SDN controllers 120 may be deployed at each data center where forwarding switches and other networking components are located. As another example, a large, international network may include multiple SDN controller 120 distributed at varying locations for distributing the processing load of each SDN controller 120 and providing fault tolerance.
The forwarding switches (P1-P5) communicate with the SDN controller 120 to receive routing information to be used for routing packets through the backbone network 102. In a first embodiment, the SDN controller 120 may compute routes and forward those routes to the forwarding switches (P1-P5). That is, high speed memory within the line cards are prepopulated with routes computed by the SDN controller 120 prior to routing packets through the backbone network 102. In another embodiment, the SDN controller 120 may respond to queries from each forwarding switch concerning packet forwarding and provide routes to the forwarding switch after it has received the packets. In other embodiments, the two embodiments described above may also be practiced in combination.
Routing in the described architecture may be performed based on multiprotocol label switching (MPLS), or more specifically MPLS labels, as opposed to using layer 2 or layer 3 headers. Thus, for example, as opposed to analyzing each IPv4 or IPv6 address in a data packet, the present architecture may make forwarding decisions at a higher layer of abstraction where forwarding decisions are made without analyzing the specific IP address or other layer 2 or layer 3 header information, but rather an MPLS label that represents a plurality of IP addresses or other Layer-3 or Layer-2 header information. Such an implementation is particularly useful in a backbone network setting where hardware resources, such as table lookup capacities, are limited. Additionally, MPLS labels are generally shorter and easier to decipher than layer 2 or layer 3 information in each packet, thus allowing the use of high speed, hardwired routing mechanisms, such as application specific integrated circuits (ASICS) that are relatively inexpensive to implement and maintain.
In one embodiment, multiple forwarding switches (P1-P2) may be configured as a multi-chassis link aggregation group (MC-LAG) for one or more edge devices (e.g., provider edge device 114 and/or provider edge router 112). Such a configuration may provide certain benefits, such as reduction of a configuration for static LSP label mappings on the edge devices. Specifically, only one or a few static LSP mappings for each edge device may be required, and not one for each forwarding switch provisioned in the network.
In one embodiment, the SDN controller 120 discovers the forwarding switches (P1-P5), such as through the link layer discovery protocol (LLDP) and the connections between. In other embodiments, any suitable type of protocol may be used to discover the topology of the communication network 102. Additionally, the SDN controller 120 learns the topology of the backbone network 120 using multiple characteristics of each interconnection commonly referred to as an “IGP metric.” These characteristics may be used by the SDN controller 120 to determine one or more optimal paths for packets through the network 120.
Once the network topology is understood, the SDN controller 120 may apply any number of possible routing algorithms, as well as customized routing algorithms, to the network topology to define MPLS paths through the network in operation 210. For example, a least cost routing algorithm, a dijkstra routing algorithm, a geographic routing algorithm, hierarchal routing algorithm, and/or a multipath routing algorithm may be used. In another example, the SDN controller may include a customized route for specific routing information. In yet another example, multiple routing algorithms may be used in combination.
According to one aspect, the SDN controller 120 implements a multiprotocol label switching (MPLS) mechanism for forwarding packets through the network 102 in which each route is referred to as a label switched path (LSP). To accomplish this, the SDN controller 120 executes a label distribution protocol (LDP) that generates label mapping information for the communication network and transmits the label mapping information to each forwarding switch in the backbone network 102. That is, the SDN controller 120 designates unique labels for each forwarding switch in the backbone network 102 that are used for routing packets through the backbone network 102.
The SDN controller 120 determines the routes according to an MPLS protocol. The MPLS protocol is a mechanism used in data networks in which packets are routed through nodes (e.g. edge devices and forwarding switches) of the network using labels appended to each packet, rather than by inspection of each layer 2 or layer 3 address of each packet. So for example, regardless of the least cost routing route, the SDN controller 120 may determine a LSP and identify that path with a label (e.g., XYZ) such that any packet with that routing label may be directed to traverse the network according to next hop routes determined by the SDN controller 120, and downloaded to each forwarding switch (P1-P5).
In such an architecture and in contrast to an architecture in which the SDN controller determines the LSPs (e.g., routes) through the network, the forwarding switches do not require MPLS signaling or label distribution protocols (e.g.: LDP, RSVP, and/or BGP) to exchange MPLS labels. That is, the forwarding switches (P1-P5) may be void of any routing functionality thus reducing their costs while enhancing the reliability by reducing the complexity of hardware and software used in the forwarding switches.
Each LSP extends from one edge device to another edge device (e.g., provider edge device 114 and provider edge router 112) and includes one or more next hop routes to be performed by any forwarding switch (P1-P5) along that route. For example, as shown in
To generate LSPs, the SDN controller 120 includes a route reflector (RR) function that interfaces with a border gateway protocol (BGP) instance executed on each of the provider edge device 114 and provider edge router 112 to learn destinations of all packet traffic through the backbone network 102. The RR function uses the BGP instance to resolve next hop routes for each adjacent node (e.g., provider edge device 114, provider edge router 112, and forwarding switches (P1-P5)) in the backbone network 120. The SDN controller 120 also stores loopback interface information for each edge device (i.e., provider edge device 120, and provider edge router 112) since that is what is used by the BGP to resolve its next hop route to other nodes. Additionally, the SDN controller 120 uses the stored loopback interface information about each edge device to resolve the source and destinations of the LSPs.
Now referring to an example packet from the first customer network destined for the second customer network the packet from (CE) router to a conventional ingress provider edge router will conduct a conventional border gateway protocol (BGP) routing look-up using an IP destination address of the packet, where the look-up occurs in a BGP routing table. This result of the lookup in the BGP routing table is the next-hop IP address of the loopback interface of an egress PE, and an associated MPLS tunnel label with that loopback interface of the egress PE, at the far-end of the network where there is a customer (destination) network attached to that egress PE router. The ingress PE router then adds that MPLS label to the packet and forwards the MPLS encapsulated packet to the Backbone label switch router (P1 or P2). Thus, packets arriving at the backbone label switch router (forwarding switches P1 and P2) will cause the MPLS label switch router to perform a lookup based on the incoming MPLS label to determine the appropriate LSP that is used to forward the MPLS packet to the next forwarding switch and, ultimately, to the destination PE at the remote end of the network. The key point is that forwarding entries (LSP entries) in each label forwarding switch are provided solely by the SDN controller.
In one embodiment, the SDN controller 120 uses stored loopback interface information of all PE devices to generate label forwarding information base (LFIB) entries that are subsequently transmitted to each edge device (e.g., provider edge router 112 and provider edge device 114) in the backbone network 102. The LFIB is transmitted to each edge device using any suitable protocol, such as a netconf protocol, a command line interface (CLI) protocol, or an openflow protocol. Once the LFIB is received by each edge device, the LFIB is processed by the edge device to identify next hop routes (i.e., routing actions) corresponding with each LSP across the Backbone to a remote PE. The forwarding switches, (P1-P5), receive routing information for each next hop route, (egress PE Loopback interface), to LSP mapping from LFIB information generated by the SDN controller 120. Certain embodiments including such functionality may reduce the complexity of the forwarding switches by placing route resolution functionality in the SDN controller 120 and edge devices rather than in the forwarding switches. In some embodiments, the edge devices may also generate additional LFIB actions to enable label-swapping and/or label pushing by the forwarding switches, when these devices interface with nodes of other networks, such as a broader inter-city backbone network.
In one embodiment, one or more bypass LSPs (e.g., routes) may be determined for each LSP thus providing for increased reliability in the event that the primary LSP fails or begins to operate below a specified level of performance.
In operation 220, the next hop routes (e.g., one-hop of a LSP), are then transmitted to several individual forwarding switches to construct an edge-to-edge LSP (i.e., tunnel) across the Backbone network 102. These MPLS LSP's may be loaded into line card memory of the forwarding switches.
Although
In operation 260, each forwarding switch (P1-P5) reacts autonomously to a local link-failure and immediately switches traffic onto a Bypass LSP. A bypass LSP generally refers to another LSP that is redundant to the main path, but routed through differing forwarding switches such that, in the event that a forwarding switch through which the main LSP travels should fail, packets may be transferred over to the bypass LSP. The forwarding switch may react to any failure indication, such as a Loss-of-Signal (LOS) or Loss-of-Light (LOL) to initiate switchover. Additionally, each forwarding switch may also use a local, onboard implementation of Link Aggregation Control Protocol (LACP) and/or a Bidirectional Forwarding Detection (BFD) to detect failures, which may not be adequately noticed by the LOS or LOL indications. In effect, the forwarding switch would autonomously perform an action similar to that of the Fast Re-Route Point-of-Local-Repair (PLR) where it automatically appends a new MPLS label to packets to temporarily detour traffic around the failure. In addition, the forwarding switch would notify the SDN Controller 120 of the failure such that the SDN controller 120 could re-calculate and re-optimize primary LSP's through the network, as appropriate. This may include programming new primary LSPs through the network and performing Make-Before-Break (MBB) actions, as required.
In operation 270, each forwarding switch (P1-P5) manages time-to-live (TTL) exceeded packets. In one embodiment, each forwarding switch determines any TTL exceeded packets, generates an Internet control message protocol (ICMP) Destination Unreachable response, encapsulates that with the original MPLS (outermost) label set and forwarding the encapsulated packet to the egress edge device associated with the LSP. In another embodiment, the forwarding switch transmits information associated with the TTL exceeded packet to the SDN controller 120 such that the SDN controller 120 generates a MPLS label stack that may be used for transmitting the TTL exceeded packet back to the ingress edge device. In yet another embodiment, the SDN controller 120 may wrap the ICMP TTL exceeded message in a uniform datagram protocol (UDP) (e.g., GRE or IP) tunnel that directs the TTL exceeded packet back to the ingress edge device associated with the LSP.
Although
The described systems, methods and apparatus, provide several advantages over conventional systems. For example, the system may provide customizable network services and allow for much more rapid introduction of new services. The system may be more robust as compared to vertically integrated system (particularly at software) which have tended to have more bugs simply resulting from the sheer complexity of conventional vertically integrated systems that are required to include many functions for conforming standards for interoperating autonomously with other devices. A substantial portion of the software complexity of the forwarding switches are provided in the SDN controller 120 allowing for far less expensive and complicated hardware switches relative to conventional routers and switches. Finally, the overall system (combination of SDN controller and hardware switches) can also be customizable to provide unique or customized routes not otherwise decided by conventional routing protocols.
The computing system 300 includes at least one processor 310, at least one communication port 315, a main memory 320, a removable storage media 325, a read-only memory 330, a mass storage device 335, and an I/O port 340. Processor(s) 310 can be any known processor, such as, but not limited to, an Intel® Itanium® or Itanium 2® processor(s), AMD® Opteron® or Athlon MP® processor(s), or Motorola® lines of processors. The communication port 315 can be any type, such as an RS-232 port for use with a modem based dial-up connection, a 10/100 Ethernet port, a Gigabit port using copper or fiber, or a USB port. Communication port(s) 315 may be chosen depending on a network such as a Local Area Network (LAN), a Wide Area Network (WAN), or any network to which the computer system 300 connects. The computing system 300 may be in communication with peripheral devices (e.g., display screen 350 and a user input device 516) via Input/Output (I/O) port 340.
Main memory 320 can be Random Access Memory (RAM) or any other dynamic storage device(s) commonly known in the art. Read-only memory 330 can be any static storage device(s) such as Programmable Read-Only Memory (PROM) chips for storing static information such as instructions for processor 310. Mass storage device 335 can be used to store information and instructions. For example, hard disks such as the Adaptec® family of Small Computer Serial Interface (SCSI) drives, an optical disc, an array of disks such as Redundant Array of Independent Disks (RAID), such as the Adaptec® family of RAID drives, or any other mass storage devices, may be used.
The bus 305 communicatively couples processor(s) 310 with the other memory, storage and communications blocks. The bus 305 can be a PCI/PCI-X, SCSI, or Universal Serial Bus (USB) based system bus (or other) depending on the storage devices used. Removable storage media 325 can be any kind of external hard drives, floppy drives, OMEGA® Zip Drives, Compact Disc-Read Only Memory (CD-ROM), Compact Disc-Re-Writable (CD-RW), Digital Video Disk-Read Only Memory (DVD-ROM), etc.
The computer system 300 includes one or more processors 310. The processor 310 may include one or more internal levels of cache (not shown) and a bus controller or bus interface unit to direct interaction with the processor bus 305. The main memory 320 may include one or more memory cards and a control circuit (not shown), or other forms of removable memory, and may store a routing configuration application 365 including computer executable instructions, that when run on the processor, implement the methods and system set out herein, such as the method discussed with reference to
The computer system 300 may further include a communication port 315 connected to a transport and/or transit network 355 by way of which the computer system 300 may receive network data useful in executing the methods and system set out herein as well as transmitting information and network configuration changes and MPLS routes or other routes determined thereby. The computer system 300 may include an I/O device 340, or other device, by which information is displayed, such as at display screen 350, or information is input, such as input device 345. The input device 345 may be alphanumeric input device, including alphanumeric and other keys for communicating information and/or command selections to the processor. The input device 345 may be another type of user input device including cursor control, such as a mouse, a trackball, or cursor direction keys for communicating direction information and command selections to the processors 310 and for controlling cursor movement on the display device 350. In the case of a tablet device, the input may be through a touch screen, voice commands, and/or Bluetooth connected keyboard, among other input mechanisms. The system set forth in
In the present disclosure, the methods disclosed may be implemented as sets of instructions or software readable by a device. Further, it is understood that the specific order or hierarchy of steps in the methods disclosed are instances of example approaches. Based upon design preferences, it is understood that the specific order or hierarchy of steps in the method can be rearranged while remaining within the disclosed subject matter. The accompanying method claims present elements of the various steps in a sample order, and are not necessarily meant to be limited to the specific order or hierarchy presented.
The described disclosure may be provided as a computer program product, or software, that may include a machine-readable medium having stored thereon instructions, which may be used to program a computer system (or other electronic devices) to perform a process according to the present disclosure. A machine-readable medium includes any mechanism for storing information in a form (e.g., software, processing application) readable by a machine (e.g., a computer). The machine-readable medium may include, but is not limited to, magnetic storage medium (e.g., floppy diskette), optical storage medium (e.g., CD-ROM); magneto-optical storage medium, read only memory (ROM); random access memory (RAM); erasable programmable memory (e.g., EPROM and EEPROM); flash memory; or other types of medium suitable for storing electronic instructions.
The description above includes example systems, methods, techniques, instruction sequences, and/or computer program products that embody techniques of the present disclosure. However, it is understood that the described disclosure may be practiced without these specific details.
It is believed that the present disclosure and many of its attendant advantages will be understood by the foregoing description, and it will be apparent that various changes may be made in the form, construction and arrangement of the components without departing from the disclosed subject matter or without sacrificing all of its material advantages. The form described is merely explanatory, and it is the intention of the following claims to encompass and include such changes.
While the present disclosure has been described with reference to various embodiments, it will be understood that these embodiments are illustrative and that the scope of the disclosure is not limited to them. Many variations, modifications, additions, and improvements are possible. More generally, embodiments in accordance with the present disclosure have been described in the context of particular implementations. Functionality may be separated or combined in blocks differently in various embodiments of the disclosure or described with different terminology. These and other variations, modifications, additions, and improvements may fall within the scope of the disclosure as defined in the claims that follow.
This application is a continuation of and claims the benefit of priority to U.S. non-provisional application Ser. No. 14/089,547, entitled “APPARATUS, SYSTEM, AND METHOD FOR PACKET SWITCHING,” filed on Nov. 25, 2013, the entire contents of which are fully incorporated by reference herein for all purposes. Application Ser. No. 14/089,547 claims priority under 35 U.S.C. § 119 from U.S. provisional application No. 61/729,862, entitled “APPARATUS, SYSTEM, AND METHOD FOR PACKET SWITCHING,” filed on Nov. 26, 2012, the entire contents of which are fully incorporated by reference herein for all purposes.
Number | Date | Country | |
---|---|---|---|
61729862 | Nov 2012 | US |
Number | Date | Country | |
---|---|---|---|
Parent | 14089547 | Nov 2013 | US |
Child | 15786818 | US |