Patent Application
20130287039
This invention relates to Ethernet switches and to a method of operating such a switch.
For many years now, telecommunications carriers have been deploying packet-switched networks in place of, or overlaid upon, circuit-switched networks for reasons of efficiency and economy. Packet-switched networks such as Internet Protocol (IP) or Ethernet networks are intrinsically connectionless in nature and, as a result, suffer from Quality of Service (QoS) problems. Customers value services which are guaranteed in terms of bandwidth and QoS.
It is desired to use Ethernet switches in carriers' networks. Use of Ethernet switches in carriers' networks would have the advantages of interoperability, since mappings between Ethernet and other frame/packet/cell data structures such as IP, Frame Relay are well known, and economy, since Ethernet switches are relatively inexpensive compared to IP routers, for example. It would also provide a distinct advantage of being the principal technology used by enterprises that require a wide area network service from a carrier and therefore able to work in a native mode.
A conventional high-capacity Ethernet switch has a set of input ports and a set of output ports which are connected via a switch fabric. On start-up, or on re-start, a conventional switched Ethernet network behaves like a ‘classic’ Ethernet Local Area Network (LAN) in that every Ethernet frame is broadcast across the entire network. Every switch, upon receiving an Ethernet frame on one port, broadcasts the frame out on every other port. The process repeats as the frame is received by other switches, thus broadcasting the frame across the entire network. In switched Ethernet networks Medium Access Control (MAC) address auto-learning functionality is provided to improve configuration efficiency. Ethernet frames have source and destination MAC addresses corresponding to their source and destination Ethernet ports. When an Ethernet frame sent out by a source switch is received by an intermediate or destination Ethernet switch the receiving switch observes the port on which the frame was received and the source address of the frame. The switch then builds a forwarding table for use in future frame switching. Once a MAC address has been seen on a port, that information is made available to all ports to be used if any encounters that address. A central processor builds a single Forwarding Database (FDB) on the basis of MAC addresses seen on all ports. Over time, the network builds up forwarding state enabling efficient switching of Ethernet frames, without relying on broadcast any further. On modern high-performance switches the FDB is typically replicated into a memory located at each input port, and the copy of the FDB associated with each port is the same. This allows each port to route a received frame without waiting to access a shared Forwarding Database. The overall memory requirement becomes significant in situations where the switch has a large number of input and output ports and a large FDB.
Conventional Ethernet networks are connectionless, i.e. no path through the network is pre-established for a frame, or group of frames, corresponding to a traffic flow. Patent Application PCT/GB2005/001332, filed 6 Apr. 2005, describes a way of providing connection-oriented behaviour in Ethernet networks. Connections are provided across an Ethernet network by configuring, via a control plane or management interface, Ethernet switches to map received data frames to particular output ports.
An Ethernet switch for use in an Ethernet network comprises a set of ingress ports for receiving data frames and a set of egress ports. A memory is associated with each ingress port and stores forwarding information indicating one or more of the egress ports to which data frames received by that ingress port should be forwarded. A control or management interface receives information about a network connection established, or to be established, through the switch. A switch controller causes forwarding information to be stored in a memory associated with a first ingress port which the network connection will use, on the basis of the received information about a network connection. Forwarding information is not stored in a memory associated with a second of the set of ingress ports which the network connection will not use. Preferably, the switch controller causes forwarding information to be stored only in a memory associated with the one or more ingress ports which the network connection will use and not to be stored in a memory associated with any of the other ingress ports. When traffic diverges (splits) at the Ethernet switch, forwarding information will cause a data frame arriving at an ingress port to be forwarded to multiple egress ports. When traffic routes converge at the Ethernet switch, forwarding information will be stored at each of the multiple ingress ports where data frames of those routes will arrive, and the forwarding information will cause the data frames to be forwarded to a common egress port.
A consequence of using Ethernet switches in a connection-oriented mode of operation is that frames associated with a particular routing across the network will leave a switch by a known port and can only arrive at the switch through a known port (or set of ports). The Forwarding Database (FDB) associated with each ingress port may therefore be individually populated, and contain only those entries which the Network Management System knows could be validly received on that port. This allows a considerable reduction in FDB memory compared to replicating the FDB table to all ports in the manner of a conventional Ethernet switch, which allows a considerable cost saving. Alternatively, the network can be scaled for a given memory size. Investigation of typical carrier deployment scenarios shows that the reduction in memory size can easily be a factor of four.
Although the ingress and egress ports have been separately referred to it will be understood that typically an Ethernet switch comprises a set of bi-directional interface ports, each bi-directional interface port comprising an ingress port and an egress port. The switch fabric selectively interconnects the ingress port of one bi-directional interface port with the egress port of another bi-directional interface port. Normally the ingress port and egress port of a bi-directional interface port will share a common MAC address.
A further aspect of the invention provides a port card comprising an ingress port for receiving data frames and a memory for storing forwarding information indicating one or more egress ports of the switch to which data frames received by the ingress port should be forwarded. The forwarding information stored in the memory relates only to network connections which use that ingress port. The port card typically supports a bi-directional port having an ingress port function and an egress port function. The port card may house a single ingress port (or bi-directional port) or multiple ports (or bi-directional ports). The plurality of ingress ports may share the same memory.
A further aspect of the invention provides a port controller comprising control logic which is operable to receive forwarding information from the switch controller for a network connection which is established, or will be established, via the ingress port and update the forwarding information in the memory for that ingress port. The forwarding information is received on the basis of whether the network connection will use that ingress port.
A still further aspect of the invention provides a switch controller comprising control logic which is operable to receive information about a network connection established, or to be established, through the switch; and cause forwarding information to be stored in a memory associated with a first ingress port which the network connection will use, on the basis of the received information about a network connection, and not to be stored in a memory associated with a second ingress port which the network connection will not use.
This functionality can be implemented in software, hardware or a combination of these. The invention can be implemented by means of hardware comprising several distinct elements, and by means of a suitably programmed computer. Accordingly, another aspect of the invention provides software for providing the functions of the switch controller and/or port controller. The software may be stored on an electronic memory device, hard disk, optical disk or other machine-readable storage medium. The software may be delivered as a computer program product on a machine-readable carrier or it may be downloaded directly to the switch via a network connection.
Embodiments of the invention will be described, by way of example only, with reference to the accompanying drawings in which:
The carrier Ethernet network 20 provides connectivity between customer sites. Three customers having respective pairs of geographically distant Ethernet switches (40a and 40b, 42a and 42b, 44a and 44b) are shown connected to carrier network 20 via edge Ethernet switches 22a and 22b respectively. The communications links between edge switches 22a and 22b and customer switches 40a, 40b, 42a, 42b, 44a, and 44b may be dedicated links such as T1, E1 leased lines or access links such as digital Subscriber Lines (DSLs). Carrier edge switches 22a, 22b, 26 may be logically separated into a single Provider Edge- (PE-) Core and one or more PE-Edge functions. The PE-Edge is the ingress/egress point at which customer traffic enters or leaves the carrier network 20. The PE-Core preferentially encapsulates incoming Ethernet traffic from the customer using Media Access Control (MAC) in MAC encapsulation (or, if desired, Pseudo-Wire over MAC encapsulation) and forwards the encapsulated traffic across the carrier network 20. This embodiment is preferred as a mechanism to limit the number of table entries required because only the MAC address space of the carrier network need be recognised, and not the whole of the customer's MAC address space, which could be changed independently. Similarly, the PE-Core decapsulates (strips) outgoing Ethernet traffic and forwards the stripped traffic on to the customer via the appropriate PE-Edge. VLAN tags are often used to provide customer separation at the logical PE-Core with each different customer site connected to each edge switch having a unique VLAN tag. Stacked VLAN (i.e. VLAN-in-VLAN encapsulation or Q-in-Q) may be used to protect any VLAN tags used by the customer traffic. For example, customer switch 42a may send Ethernet traffic over communications link 46a to the logical PE-Edge of edge switch 22a. Logical PE-Core of edge switch 22a encapsulates each Ethernet frame in a further Ethernet frame using the MAC address of the ingress port on edge switch 22a as the source address and the MAC address of the appropriate egress point—in this case a port on edge switch 22b—as the destination address. The encapsulated traffic is forwarded across a connection established over communications links 48 of carrier network 20 to edge switch 22b. Connections may be typically trunked in the sense that traffic from multiple customers will be routed through the same connection. Alternatively, those skilled in the art will appreciate that separate connections 48 could be used for each customer. At the PE-Core of edge switch 22b, the original frames are stripped of their encapsulation and sent over communications link 46b via PE-Edge of edge switch 22b to customer switch 42b.
The logical PE-Edge may also be physically separated from the logical PE-Core and may reside at customer premises whereas the PE-Core would preferentially reside at a central office or Point of Presence (PoP) of the carrier. The reader will also appreciate that other edge switches may also have connections to customer sites and that customers may have to be provided with connectivity between two or more geographically distant sites over carrier network 20.
It will now be described how carrier network 20 is arranged to establish connections through which to forward encapsulated Ethernet traffic. A connection may be defined as an entity configured in a network which provides transport of data from a source node to one or more sink nodes. As described above, carrier network 20 may be at least partially-meshed—i.e. there will usually be more than one possible path between at least some, and preferably all, nodes of the network. Thus, as will be explained below, broadcast and Ethernet MAC address auto learning functionality should be at least partially deactivated to permit loops to be formed safely in the network. On start-up (or on re-start), conventional switched Ethernet networks behave like a “classic” Ethernet Local Area Networks (LANs) in that every Ethernet frame is broadcast across the entire network. Thus, every switch, receiving an Ethernet frame on one port, broadcasts the frame out on every other port. The process repeats as the frame is received by other switches thus broadcasting the frame across the entire network.
MAC address auto-learning functionality is provided to improve configuration efficiency in switched Ethernet networks. Ethernet frames have source and destination MAC addresses corresponding to their source and destination Ethernet ports. (An Ethernet port here is signifying an end system which is therefore configured with at least one MAC address.) When an Ethernet frame sent out by a source switch is received by an intermediate or destination Ethernet switch, the receiving switch observes the port on which the frame was received and the source address of the frame. It then builds up a forwarding table for use in future frame switching. The forwarding table maps destination address to output port and is built up using the source address of a received frame and the input port on which it was received. Over time, the network builds up forwarding state enabling efficient switching of Ethernet frames, without relying on broadcast any further. It can thus be seen that conventional switched Ethernet networks using auto-learning must be simply-connected—i.e. there must be one and only one path between each and every node of the network. If there were multiple paths between any two nodes, the input port on which a frame is received from a source node would not be a reliable indicator of the correct output port to forward future traffic destined for that node. Inconsistencies in forwarding tables on Ethernet switches could result in looping of frames. Moreover, if there exists any loop in a part of the network then any broadcast packet will be continuously duplicated in that loop and the duplicates forwarded all over the whole network, limited only by the link capacities concerned. This inevitably results in catastrophic failure of the network.
In a connection-oriented Ethernet network Ethernet switches do not use auto learning to independently configure their forwarding tables but, instead, forwarding tables are directly configured using an Ethernet control plane. In one possible embodiment this control plane may actually be a centralized Network Management system, with complete knowledge of the state of the entire network. In another embodiment, the control plane may be a distributed function. The configuration of such an Ethernet network will now be described with reference to the latter.
While CCs 32a, 32b, 34a and 34b are logically separate from Ethernet switches 22a, 22b, 24a and 24b the reader will understand that they may be implemented in the same physical nodes in a distributed control plane model. Additionally, one CC may control one or more Ethernet switches which is moving towards a more centralised control plane model. Furthermore, NNI signaling may take place over the same communications links used for transporting user traffic.
It will be appreciated that the mechanism for establishing connections across carrier network 20 described above is merely exemplary and other well-known mechanisms may be used. For example, all the admission control may be performed in a centralised CC controlling several if not all the Ethernet switches in the extreme. In another example arrangement, the supervisory management function may be used to compute routes for connections and simultaneously perform the necessary admission control; this in turn would simplify the role performed by the CC. Yet another example is where the supervisory management function or CC consults a specialised and either centralised or distributed Bandwidth Manager or Policy Decision Function to perform the admission control.
Typically, there will be many thousands or tens of thousands of connections established across a carrier network at any time. These connections will share the physical resources of the carrier network—i.e. the switches and communications links. Thus, each switch will typically have a large number of connections established through it at any point in time. However, each switch must be able to forward data traffic according to the explicit route requirements of the specific connection through which that traffic is being sent. A likely scenario is that the carrier network will need to establish multiple connections from the same source nodes, multiple connections to the same destination nodes and multiple connections both from the same source nodes and to the same destination nodes. However, for traffic engineering purposes, the latter connections may need to be established through physically distinct routes across the network. Furthermore, these routes may need to converge and diverge again within the carrier network. To support such route flexibility in connections, what is required is that each switch be able to differentiate between data traffic travelling in different connections and forward accordingly. A conventional switched Ethernet is incapable of differentiating between flows in this way since conventional Ethernet switches forward traffic based solely on a forwarding table (established through auto learning) mapping destination address to output port. As a result, a conventional Ethernet switch will not be able to differentiate between data traffic having the same destination address, although it may be associated with multiple different connections.
There are various ways in which an Ethernet switch can be configured to recognise traffic belonging to certain intended paths across the network. A preferred way, described in unpublished Patent Application PCT/GB2005/001332, filed 6 Apr. 2005, the contents of which are incorporated herein, is to use a combination of the destination address and VLAN tag carried within a frame. VLAN tags are defined in IEEE 802.1Q and are usually intended to identify a LAN to which the traffic belongs. Here, VLAN tags are used in a different manner, and traffic which is intended to follow a particular path across the Ethernet network 20 is allocated a unique combination of VLAN tag and destination address. Each Ethernet switch stores separate forwarding tables for each VLAN tag configured, the VLAN tag acting as a mapping (or indexing) to forwarding tables, and each forwarding table mapping destination address to output port. The group of forwarding tables at each switch provide a mapping from a combination of destination address and VLAN tag to output port.
According to the preferred embodiment, VLAN tags have meaning only within the context of a destination address. As such, the allocation of VLAN tags is logically localised to the node owning the destination address, herein called the destination node. Thus, at the point where a new connection is requested, its destination node will allocate to that connection a VLAN tag to use in combination with a destination address corresponding to that node. This VLAN tag will be allocated such that no existing connection to the destination address whose route crosses with & subsequently diverges from the new connection shall share a VLAN tag. This is such that where differential forwarding is required (at the divergence point), the destination address/VLAN tag pair of the diverging connections are distinct. Additional constraints can be placed on the allocation as described elsewhere to improve pathological behaviour in case of inadvertent partial route removal in a network where broadcast-on-unknown is not fully disabled on all VLAN tags used for connections.
Each port is associated with a port controller 121 which is responsible for maintaining the forwarding table 123 at that port. Port controller 121 communicates with a switch controller 102. Port controller 121 is essentially a ‘housekeeping’ processor which performs tasks locally at the port, in response to instructions received from switch controller 102. Switch controller 102 maintains a master forwarding table 104 in storage 103 local to the controller 102 and communicates via a signaling interface 105 to a connection controller. As connections across network 20 are set-up, changed (e.g. due to traffic management operations) or torn down, switch controller 102 receives instructions to add or remove entries in the forwarding table 104 from a network connection controller. The information received at switch controller 102 from a Network Management System will typically refer to a physical address and will set up a bi-directional path (i.e. forward and return paths) at the same time {i.e. forward frames with destination MAC_address1 and VLAN1 arriving at port X to port Y; forward return-path frames with destination MAC_address2 and VLAN2 arriving at port Y to port X}. Alternatively, the switch controller 102 may receive information in the form of a more symbolic address which is resolved to a physical address at switch 100 (e.g. to determine the exact ports involved in the connection). For each change to table 104, switch controller 102 determines which port is affected by the change and then instructs the port controller responsible for that port of the change. Port controller 121 then updates the forwarding table 123 held locally at the port. It can be seen that because each port only maintains a forwarding table of connections involving that port, the size of the local table is much smaller than would otherwise be needed. This allows the port to have a smaller memory, which reduces cost of each port. The association between a port controller 121/memory 122 and a port can be 1:1 (i.e. one port controller 121 and memory 122 for each bi-directional port, which allows high-speed access to forwarding table 123 held within memory 122) or it can be 1:N where N is the set of ports on a port card or a sub-set of the ports.
As an example of the type of forwarding table held at each port, the following represents part of the forwarding table 123 held at port 110:
where the ‘Destination Address’ field would include the Ethernet address corresponding to Node 22b or Node 22c. In this example, a frame arriving at port 110 with a destination address field set to ‘Node 22b’ and a VLAN tag=1 would be routed to destination port 117 of the switch, as shown by path 141 of
In the embodiment described above each port has a port controller 121. However, it is not essential that a port controller is provided for each port. Where a switch provides multiple physical ports per peripheral card, each card can have a port/card controller—essentially a ‘housekeeping’ processor—which talks to the hardware and communicates with the switch controller. The switch controller can specify exactly which port is to be updated by the port/card controller.
For completeness,
The invention is not limited to the embodiments described herein, which may be modified or varied without departing from the scope of the invention.
| Number | Date | Country | |
|---|---|---|---|
| Parent | 11223246 | Aug 2005 | US |
| Child | 13925196 | US |
