Link aggregation with internal load balancing

Information

  • Patent Grant
  • 7990853
  • Patent Number
    7,990,853
  • Date Filed
    Tuesday, December 12, 2006
    18 years ago
  • Date Issued
    Tuesday, August 2, 2011
    13 years ago
Abstract
A system and method provides Link Aggregation that internalizes the link aggregation to improve internal traffic capacity, in addition to sharing traffic across external links to connecting packet systems. A system for handling data traffic comprises a plurality of network switches, each network switch having an interface to a packet network, the interface arranged so as to provide at least one link aggregation group, an interface to at least one other network switch, and an interface to each of a plurality of optical network service units, a plurality of optical network service units, each optical network service units having an interface to each of the plurality of network switches and an interface to at least one optical network, wherein each network switch is operable to receive data over a link aggregation group from the packet network and transmit the data to at least one optical network service unit either directly or via another network switch based on an optical network to which the data is destined (or other criteria) Also, each optical network service unit can send upstream data to any port of either network switch- via selected internal paths.
Description
BACKGROUND OF THE INVENTION

1. Field of the Invention


The present invention relates to a system and method providing for link aggregation features of protection and extra bandwidth, while reducing traffic congestion within the system, in a way not visible to an external packet network.


2. Background of the Prior Art


A Passive Optical Network (PON) is a point-to-multipoint, fiber to the premises network architecture in which unpowered optical splitters are used to enable a single optical fiber to serve multiple premises, typically 32. A PON consists of an Optical Line Termination (OLT) typically at the service provider's central office and a number of Optical Network Units (ONUs) near end users. A PON configuration reduces the amount of fiber and central office equipment required compared with point to point architectures. Downstream signals are broadcast to each premises sharing a fiber. Encryption is used to prevent eavesdropping. Upstream signals are combined using a multiple access protocol, typically time division multiple access (TDMA). The OLTs “range” the ONUs in order to provide time slot assignments for upstream communication and to equalize roundtrip transmission delay between the ONU's on a PON and the OLT.


There are a number of standard types of PON that have been implemented. APON (ATM Passive Optical Network) was the first Passive optical network standard. It was used primarily for business applications, and was based on ATM. BPON (Broadband PON) is a standard based on APON. It adds support for WDM, dynamic and higher upstream bandwidth allocation, and survivability. GPON (Gigabit PON) is an evolution of BPON. It supports higher rates, enhanced security, and choice of Layer 2 protocol (ATM, GEM, Ethernet). GPON represents a significant boost in both the total bandwidth and bandwidth efficiency through the use of larger, variable-length packets. A GPON network delivers up to 2,488 megabits per second (Mbit/s) of downstream bandwidth, and 2,488 Mbit/s of upstream bandwidth. GPON Encapsulation Method (GEM) allows very efficient packaging of user traffic, with frame segmentation to allow for higher Quality of Service (QoS) for delay-sensitive traffic such as voice and video communications.


Among the features of GPON is Link Aggregation. Link Aggregation involves aggregating a plurality of links to form a group of links that may be treated as a single link for most purposes. Current implementations of Link Aggregation provide this function only at the external facing ports of a system to a connecting system. In this invention, the link aggregation function not only provides this capability, but internalizes the functionality to provide improved traffic handling throughout the internals of the system.


SUMMARY OF THE INVENTION

The present invention provides a system and method for providing Link Aggregation that internalizes the benefits of link aggregation to provide improved traffic handling throughout the internals of the system, in addition to the usual functionality on external facing ports.


A system for handling data traffic comprises a plurality of network switches, each network switch having an interface to a packet network, the interface arranged so as to provide at least one link aggregation group, an interface to at least one other network switch, and an interface to each of a plurality of optical network service units, a plurality of optical network service units, each optical network service units having an interface to each of the plurality of network switches and an interface to at least one optical network, wherein, downstream, each network switch is operable to receive data over a link aggregation group from the packet network and transmit the data to at least one optical network service unit either directly or via another network switch based on an optical network to which the data is destined.


Upstream, each network switch may be further operable to receive data from at least one optical network service unit and transmit the data to the packet network over the link aggregation group. Each network switch may be further operable to distribute the data across the network switches and the interface to the packet network based on data traffic demand and congestion.


A system for handling data traffic comprises a first network switch having an interface to a packet network, the interface arranged so as to provide at least a portion of at least one link aggregation group, an interface to a second network switch, and an interface to each of a plurality of optical network service units, the second network switch having an interface to the packet network, the interface arranged so as to provide at least a portion of at least one link aggregation group, an interface to the first network switch, and an interface to each of a plurality of optical network service units, and a plurality of optical network service units, each optical network service units having an interface to each of the network switches and an interface to at least one optical network, wherein data in the link aggregation group that is destined for a first optical network is received by both the first network switch and the second network switch, the data that is received by the first network switch is transmitted to an optical network service unit from the first network switch, and the data that is received by the second network switch is transmitted to the optical network service unit via the first network switch. Per FIG. 1, either network switch can send data to any network service unit directly, or thru the other network switch, where the switching path will be selected to best balance internal traffic.


Data in the link aggregation group that is destined for a second optical network may be received by both the first network switch and the second network switch, the data that is received by the second network switch is transmitted to the optical network service units from the second network switch, and the data that is received by the first network switch is transmitted to the optical network service unit via the second network switch. Each network switch may be further operable to receive data from at least one optical network service unit and transmit the data to the packet network over the link aggregation group. Each network switch may be further operable to distribute the data across the network switches and the interface to the packet network based on data traffic demand and congestion.





BRIEF DESCRIPTION OF THE DRAWINGS


FIG. 1 is an exemplary block diagram of an Optical Line Terminal (OLT) t, in which the present invention may be implemented.



FIG. 2 is an exemplary block diagram of link aggregation groups to packet network interfaces which may be implemented using the present invention.



FIG. 3 is an exemplary block diagram of link aggregation groups to packet network interfaces which may be implemented using the present invention.



FIG. 4 is a data flow diagram of a system, in which the present invention may be implemented, showing typical downstream direction data flows.



FIG. 5 is a data flow diagram of a system, in which the present invention may be implemented, showing typical upstream direction data flows.



FIG. 6 is a data flow diagram of a system, in which the present invention may be implemented, showing typical protocol layer (management plane) data flows.





DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

The present invention provides a system and method for providing Link Aggregation that does internalizes the link aggregation to obtain improved traffic handling within the system, in addition to the usual benefit if traffic sharing at the external facing ports.


An example of an optical line terminal (OLT) 100, in which the present invention may be implemented, is shown in FIG. 1. Network 100 includes a plurality of switches, such as Ethernet switches 102A-N, a plurality of SONET line units 104A-M, a plurality of service units 106A-L, and shelf controller 108. The OLT 100 provides the interface between the network side data, video, and telephony networks and the GPON networks. The primary function of the OLT 100 is to receive traffic in an IP/Ethernet format and convert it to the GPON format and to receive traffic from the GPON and convert it to IP/Ethernet format. Alternatively, the OLT can convert some traffic from SONET/SDH format to GPON format. At or near the end user, the ONU's convert GPON format to the end user format (Ethernet, IP Multicast, POTS, T1, etc).


A network switch, such as an Ethernet switch 102A-N is a networking device that performs transparent bridging (connection of multiple network segments with forwarding based on MAC addresses) at full wire speed in hardware. The use of specially designed hardware also makes it possible to have large numbers of ports.


SONET line units 104A-M (LUs), provide communication interface with the SONET network, while service units 106A-L (SUs), provide communication with the GPON networks. Each LU 104A-M typically provides timing control, SONET frame pulse reference, and may contain optical interfaces to transmit part or all of the SONET data to the GPON network via the OLT, to supplement data fed directly to the GPON network via the OLT from the packet network.


Exemplary block diagrams of possible link aggregation groups to packet network interfaces are shown in FIGS. 2 and 3. In the example shown in FIG. 2, a single link aggregation group 202 contains all 1 Gigabit Ethernet (GE) or all 10 GE links of both Ethernet Switch Units 204 and 206. In the example shown in FIG. 3, there are multiple link aggregation groups 302A-C, each using a subset of links from each Ethernet Switch Unit 304 and 306. In both cases, each link aggregation group contains an equal number of links from each Ethernet Switch. This allows protection to be provided in case of failure of a link, an Ethernet Switch Unit, or a Packet Network Interface. Also, link aggregation provides additional bandwidth under normal operation, which can provide improved data performance, especially for best effort traffic. All links that are members of the same link aggregation group must have identical link speeds.


A data flow diagram of a system 400, in which the present invention may be implemented, showing typical downstream direction data flows is shown in FIG. 4. The system includes Ethernet Switch Units 402 and 404 and a plurality of service units 406A-N. The Ethernet Switch Units 402 and 404 interface to an external packet network(not shown) via network packet interfaces, while the service units interface to a plurality of GPONs 410 and 412. The external packet network can distribute packets across multiple links as it chooses. System 400 accepts packets on any interface of a link aggregation group and switches them to an appropriate GPON SU 406A-N interface based on the destination Media Access Control (MAC), Virtual Local Area Network (VLAN), or Internet Protocol (IP) address. Each GPON SU 406A-N has two physical interfaces, one to each Ethernet Switch 402 and 404. For example, service unit 406A has physical interfaces 414 and 416, while service unit 406N has physical interfaces 418 and 420. By distributing traffic among the Ethernet switches 402 and 404 depending on the GPON number (odd or even) (or other criteria) congestion on each backplane link may be reduced under normal operation (when all elements of the link aggregation group are working). For example, logical traffic flow 422, which is destined for service unit 406A, GPONs 1 and 3, is directed by Ethernet switch 402 to service unit 406A, while logical traffic flow 424 which is destined for service unit 406A, GPONs 2 and 4, is directed by Ethernet switch 402 via Ethernet switch 404 to service unit 406A. Likewise, logical traffic flow 426 which is destined for service unit 406A, GPONs 1 and 3, is directed by Ethernet switch 404 via Ethernet switch 402 to service unit 406A, while logical traffic flow 428 which is destined for service unit 406A, GPONs 2 and 4, is directed by Ethernet switch 404 to service unit 406A. When a failure occurs, traffic is redistributed on remaining links or switches, so no services are dropped, but best effort traffic is reduced.


A data flow diagram of system 400, in which the present invention may be implemented, showing typical upstream direction data flows is shown in FIG. 5. Under normal operation system 400 switches packets to the appropriate Ethernet Switch and links to the packet network to best distribute traffic across switches and links based on traffic demand, to minimize congestion. For example, logical traffic flow 502 is directed by service unit 406A to Ethernet switch 402, while logical traffic flow 504 is directed by service unit 406A to Ethernet switch 404. The external packet network only sees its interfaces with the two Ethernet switches 402 and 404.


A data flow diagram of system 400, in which the present invention may be implemented, showing typical protocol layer (management plane) data flows is shown in FIG. 6. There are two components to the link aggregation management plane:


1. The Ethernet Switches inter-work with the packet network interfaces for external flows.


2. The Ethernet Switches inter-work with the GPON SU's for intra-system traffic flows.


The Ethernet switches 402 and 404 interwork with each other and with the external packet network to create one or more standards-based link aggregation groups. The external packet network is unaware of the GPON SU's 406A-N and the internal architecture of system 400. The Ethernet switches 402 and 404 send control information to the GPON SU's 406A-N on where they statically switch packets based on predicted congestion in the switches and links, so as to best distribute the traffic. In link aggregation, each end of a multi-link trunk can distribute packets across multiple links in any manner it chooses, the far end must accept packets on any link of the aggregation group. Packet distribution is typically static under normal operation, but re-distribution is implemented upon failures (or failure recovery) to best restore service. (Attorney: in general, the arrows in FIG. 6 from switch to service units should be 2 way.)


Although specific embodiments of the present invention have been described, it will be understood by those of skill in the art that there are other embodiments that are equivalent to the described embodiments. Accordingly, it is to be understood that the invention is not to be limited by the specific illustrated embodiments, but only by the scope of the appended claims.

Claims
  • 1. A system for handling data traffic comprising: a plurality of network switches, each network switch having an interface to a packet network, each interface arranged so as to provide at least one link aggregation group, an interface to at least one other network switch, and an interface to each of a plurality of optical network service units; anda plurality of optical network service units, each of the optical network service units having an interface to each of the plurality of network switches and an interface to each of a plurality of optical networks;wherein each network switch is arranged so as to transmit and receive data over a link aggregation group from the packet network and transmit and receive the data with at least one optical network service unit by selecting to transmit and receive the data either directly or via another network switch, wherein the selection is based on whether a number of an interface to each of the plurality of optical networks of each of the plurality of optical network service units is odd or even, so as to reduce data traffic congestion.
  • 2. A system for handling data traffic comprising: a first network switch having an interface to a packet network, the interface arranged so as to provide at least a portion of at least one link aggregation group, an interface to a second network switch, and an interface to each of a plurality of optical network service units;the second network switch having an interface to the packet network, the interface arranged so as to provide at least a portion of at least one link aggregation group, an interface to the first network switch, and an interface to each of a plurality of optical network service units; anda plurality of optical network service units, each of the optical network service units having an interface to each of the network switches and an interface to each of a plurality of optical networks;wherein data in the link aggregation group that is communicated to or from a first optical network is communicated with both the first network switch and the second network switch, and either the first network switch or the second network switch is selected to communicate the data to an optical network service unit based on whether a number of an interface to each of the plurality of optical networks of the optical network service unit is odd or even, so as to reduce data traffic congestion.
  • 3. The system of claim 2, wherein data in the link aggregation group that is destined for a second optical network is received by both the first network switch and the second network switch, the data that is received by the second network switch is transmitted to the optical network service units from the second network switch, and the data that is received by the first network switch is transmitted to the optical network service unit via the second network switch.
CROSS-REFERENCE TO RELATED APPLICATIONS

This application claims the benefit of provisional application 60/749,577, filed Dec. 13, 2005, the entirety of which is incorporated herein by reference.

US Referenced Citations (78)
Number Name Date Kind
4046193 Dougherty Sep 1977 A
4557225 Sagues Dec 1985 A
4720850 Oberlander Jan 1988 A
4858069 Hughes Aug 1989 A
5105336 Jacoby Apr 1992 A
5280191 Chang Jan 1994 A
5636215 Kubo Jun 1997 A
5748445 North May 1998 A
5812373 Hwang Sep 1998 A
5812528 VanDervort Sep 1998 A
5825621 Giannatto Oct 1998 A
5829514 Smith Nov 1998 A
5831830 Mahler Nov 1998 A
5867494 Krishnaswamy Feb 1999 A
5867495 Elliott Feb 1999 A
5953207 Aakalu Sep 1999 A
6002585 Leeb Dec 1999 A
6038129 Falaki Mar 2000 A
6047002 Hartmann Apr 2000 A
6101090 Gates Aug 2000 A
6434000 Pandolfi Aug 2002 B1
6532088 Dantu Mar 2003 B1
6614758 Wong et al. Sep 2003 B2
6621818 Szczepanek Sep 2003 B1
6671818 Mikurak Dec 2003 B1
6711013 Wobig Mar 2004 B2
6789191 Lapstun Sep 2004 B1
6972959 Asai Dec 2005 B2
6985467 Lomp et al. Jan 2006 B2
7020111 Ozluturk et al. Mar 2006 B2
7046679 Sampath May 2006 B2
7085281 Thomas et al. Aug 2006 B2
7095611 Kunz Aug 2006 B2
7103807 Bosa Sep 2006 B2
7124101 Mikurak Oct 2006 B1
7133415 Zelig Nov 2006 B2
7154755 Araujo Dec 2006 B2
7158380 Green Jan 2007 B2
7245628 Shi et al. Jul 2007 B2
7277443 Goode Oct 2007 B2
7283519 Girard Oct 2007 B2
7322850 Neer Jan 2008 B2
7376136 Song May 2008 B2
7403477 Takeuchi et al. Jul 2008 B2
7428211 Yu Sep 2008 B2
7492719 Lim Feb 2009 B2
7512147 Sato Mar 2009 B2
7599620 Graves Oct 2009 B2
20020059637 Rakib May 2002 A1
20020085548 Ku Jul 2002 A1
20020141159 Bloemen Oct 2002 A1
20020196792 McNeil Dec 2002 A1
20020196811 Park Dec 2002 A1
20030026074 Clements Feb 2003 A1
20030050002 Pfister Mar 2003 A1
20030091267 Alvarez May 2003 A1
20040007348 Stoller Jan 2004 A1
20040064351 Mikurak Apr 2004 A1
20040107169 Lowe Jun 2004 A1
20040177161 Hoang Sep 2004 A1
20040190548 Harel Sep 2004 A1
20040202470 Lim Oct 2004 A1
20050008013 Jamieson Jan 2005 A1
20050013314 Lim Jan 2005 A1
20050099949 Mohan May 2005 A1
20050100015 Eubanks May 2005 A1
20050180749 Koley Aug 2005 A1
20050198247 Perry Sep 2005 A1
20060098578 Mallya May 2006 A1
20060120389 Sampath Jun 2006 A1
20060209825 Carroll et al. Sep 2006 A1
20060285536 Pauwels et al. Dec 2006 A1
20070025370 Ghasem et al. Feb 2007 A1
20070070997 Weitz et al. Mar 2007 A1
20070109974 Cutillo et al. May 2007 A1
20070136743 Hasek Jun 2007 A1
20070136777 Hasek Jun 2007 A1
20080068807 Horng Mar 2008 A1
Foreign Referenced Citations (1)
Number Date Country
2004063453 Jul 2004 KR
Related Publications (1)
Number Date Country
20070133618 A1 Jun 2007 US
Provisional Applications (1)
Number Date Country
60749577 Dec 2005 US