The present invention relates generally to data communications, and specifically to methods and systems for transferring packet communication traffic between TDM and packet networks.
In the context of the present patent application and in the claims, the terms listed below shall be interpreted as follows:
The Synchronous Optical Network (SONET) is a set of standards that define a hierarchical set of transmission rates and transmission formats for carrying high-speed, time-domain-multiplexed (TDM) digital signals. SONET lines commonly serve as trunks for carrying traffic between circuits of the plesiochronous digital hierarchy (PDH) used in circuit-switched communication networks. SONET standards of relevance to the present patent application are described, for example, in Synchronous Optical Network (SONET) Transport Systems: Common Generic Criteria (Telcordia Technologies, Piscataway, N.J., publication GR-253-CORE, September, 2000), which is incorporated herein by reference. While the SONET standards have been adopted in North America, a parallel set of standards, known as Synchronous Digital Hierarchy (SDH), has been promulgated by the International Telecommunications Union (ITU), and is widely used in Europe. From the point of view of the present invention, however, these alternative standards are functionally interchangeable.
The lowest-rate link in the SONET hierarchy is the OC-1 level, which is capable of carrying 8000 STS-1 frames per second, at a line rate of 51.840 Mb/s. Higher-speed links in the hierarchy, referred to as OC-N links, operate at rates that are multiples of the basic 51.840 Mbps OC-1 rate. For example, OC-192 supports a line rate of 9953.28 Mb/s. (The term OC-192 as used herein should be understood as covering all types of data paths that may be carried at the OC-192 line rate, including both multiplexed STS-1 paths and concatenated paths, which are sometimes referred to as OC-192c.) This line rate is similarly supported by the SDH STM-64 link.
The Generic Framing Procedure (GFP) has been developed to enable efficient encapsulation and transport of packet traffic, such as Ethernet frames, over synchronous optical networks. GFP is defined in ITU-T Recommendation G.7041/Y.1303, promulgated by the International Telecommunications Union (available at www.itu.int/itudoc/itu-t/aap/sg15aap/history/g.7041/index.html), which is incorporated herein by reference. In frame-mapped GFP (GFP-F, defined in Clause 7 of the Recommendation), each Ethernet data frame, from MAC header through frame check sequence (FCS) is encapsulated in a single, corresponding GFP frame with GFP core and payload headers. The core header is four bytes long, and the payload header may also be four bytes or longer, depending on whether an optional extension header is included. GFP drops the non-data-carrying portions of the Ethernet data stream, including the inter-frame gap (IFG), frame preamble, start frame delimiter (SFD) and end frame delimiter (EFD). The GFP frames are then concatenated in the SONET or SDH frame payload.
From the foregoing description, it can be appreciated that GFP provides efficient bandwidth utilization, since it can transport Ethernet frames with only eight bytes of header overhead per frame, while eliminating the non-data portions of the Ethernet data stream. As a result, the GFP-encapsulated stream of Ethernet frames may actually contain less overhead than the original Ethernet stream that it encapsulates.
This discrepancy can be problematic when the stream of frames is transported over the synchronous optical network at high-speed (>9.5 Gb/s) and is to be converted back to individual Ethernet frames on a corresponding high-speed Ethernet link. As will be demonstrated in greater detail hereinbelow, when an OC-192 link with GFP, for example, is coupled to deliver a stream of short Ethernet frames to a 10 GbE XGMII Ethernet interface, the Ethernet link will be unable to keep up with the GFP data rate. This result is surprising, since the nominal data rate of the Ethernet link (10 Gb/s) is higher than that of OCS-192 (9.95328 Gb/s), and stems from the high efficiency of the GFP encapsulation.
In embodiments of the present invention, a GFP/Ethernet interface MAC adapter overcomes this discrepancy by concatenating the Ethernet frames following GFP de-encapsulation to form an extended frame. The extended frame has a single start frame delimiter (SFD) and a single end frame delimiter (EFD) in compliance with Ethernet standards and thus appears on the Ethernet network to be a single, longer Ethernet frame. The extended frame is preceded by only a single IFG and preamble, so that the overhead per frame on the Ethernet link is reduced considerably relative to transmission of separate, individual Ethernet data frames. As a result, the Ethernet interface is able to keep pace with the incoming GFP stream. Typically, another compatible MAC adapter at a node downstream from the GFP/Ethernet interface breaks the extended frames into their component individual Ethernet data frames for delivery to the respective destination addresses or, alternatively, for re-encapsulation in GFP frames for transport over another synchronous optical link.
Although the embodiments described herein refer to certain specific link types and data rates, the principles of the present invention may similarly be applied in interfacing between other types of high-speed synchronous and packet network links.
There is therefore provided, in accordance with an embodiment of the present invention, a method for communication, including:
Typically, the two or more of the Ethernet data frames include respective headers and data payloads, and the extended frame includes the headers and data payloads of all of the two or more of the Ethernet data frames. In a disclosed embodiment, concatenating the two or more of the Ethernet data frames includes inserting a predetermined separator sequence between the Ethernet data frames in the extended frame. The method may also include receiving the extended frame over the Ethernet link, and separating the Ethernet data frames out of the extended frame responsively to the separator sequence.
In some embodiments, receiving the flow of encapsulated Ethernet data frames includes receiving the flow at a data rate greater than 9.5 Gb/s, and transmitting the extended frame includes transmitting the extended frame over a 10 Gb/s Ethernet (10 GbE) link. In one embodiment, the Ethernet data frames are encapsulated for transmission over the synchronous optical network link using a Generic Framing Procedure (GFP).
There is also provided, in accordance with an embodiment of the present invention, a method for communication, including:
Typically, the synchronous optical network link includes at least one of a SONET OC-192 link and a SDH STM-64 link, and transmitting the flow includes transmitting all of the Ethernet data frames over the 10 GbE link without frame loss irrespective of a size of the Ethernet data frames.
There is additionally provided, in accordance with an embodiment of the present invention, apparatus for communication, including:
In a disclosed embodiment, the adapter includes a buffer, which is coupled to receive the Ethernet data frames from the receiver, and a transmit controller, which is coupled to initiate concatenation of the Ethernet data frames to form the extended frame when a fill level of the buffer exceeds a predetermined watermark. Additionally or alternatively, the adapter includes a counter, which is coupled to count a number of bytes placed in the extended data frame, and to terminate concatenation of the Ethernet data frames when the number reaches a predetermined limit.
There is further provided, in accordance with an embodiment of the present invention, apparatus for communication, including:
There is moreover provided, in accordance with an embodiment of the present invention, a network node, including:
In a disclosed embodiment, the data include a flow of Ethernet data frames encapsulated using a Generic Framing Procedure (GFP).
The present invention will be more fully understood from the following detailed description of the embodiments thereof, taken together with the drawings in which:
Node 28 comprises “east” and “west” synchronous optical network interfaces 32 and 34, which connect to ring network 22 in accordance with the applicable synchronous optical network standard. (The terms “east” and “west” are used here solely for the sake of convenience and have no geographical meaning.) In an exemplary embodiment, network 22 is a bi-directional network, such as a Resilient Packet Ring (RPR) network, but the principles of this embodiment are applicable in connection to any sort of synchronous optical network link operating at the OC-192 rate.
Nodes 28 and 30 comprise suitable 10 GbE interfaces 36 and 38, for example, XGMII-compliant interfaces, as described in the above-mentioned IEEE 802.3ae standard. Optionally, each of interfaces 36 and 38 comprises a 10 Gigabit Attachment Unit Interface (XAUI), to extend the operational distance of the XGMII and to reduce the number of interface signals, as described in Clause 47 of IEEE 802.3ae. XGMII and XAUI interfaces may also be used for exchanging data at high speed within node 28, such as between east and west synchronous optical network interfaces 32 and 34 and/or between these interfaces and interface 36.
A MAC adapter 44 between framer 40 and PHY 42 performs encapsulation and de-encapsulation functions, as described hereinbelow. Typically, the MAC adapter communicates with framer 40 and PHY 42 using standard protocol interfaces, such as System Packet Interface Level 4, Phase 2 (SPI4.2) and XGMII interfaces, respectively. In order to meet the high processing speed requirements of interface 32, MAC adapter 44 typically comprises one or more application-specific integrated circuit (ASIC) devices and/or field programmable gate arrays (FPGA). Alternatively, at least some of the functions of the MAC adapter may be implemented in software on a suitable microprocessor.
MAC adapter 44 comprises a SONET MAC processor 46 terminates and removes the GFP headers of frames received from network 22, and adds the appropriate GFP headers to frames for transmission over network 22. These SONET MAC functions are performed in the conventional manner, as mandated by the above-mentioned G.7041 recommendation, and the implementation of processor 46 will thus be apparent to those skilled in the art. An Ethernet MAC processor 48 receives the de-encapsulated Ethernet frames from processor 46, and prepares the frames for transmission by XAUI PHY 42. Processor 48 likewise prepares Ethernet frames received from XAUI PHY 42 for GFP encapsulation. Processor 48 is responsible for maintaining rate compatibility between the OC-192 and 10 GbE sides of interface 32, as will be explained in detail hereinbelow.
Data frame 68 is encapsulated as a payload 72 of GFP frame 52. GFP adds a core header 74 (four bytes) and a payload header 76 (four bytes), and optionally an extension header 78 and a frame check sequence (FCS—not shown). Thus, when the extension header is not used, GFP adds only eight bytes of overhead to each Ethernet data frame, in contrast to the twenty-one bytes added in the Ethernet data stream. Assuming minimal-size Ethernet data frames of sixty-four bytes each, the OC-192 link operating at 9.58464 Gb/s is then capable of transmitting 16,640,000 frames/second.
By contrast, even at the nominal rate of 10 Gb/s, the Ethernet link will be capable of transmitting only about 14,705,883 frames/second, because of the higher overhead on the Ethernet link. MAC adapter 44 must be capable of dealing with the frame rate mismatch between the OC-192 and XMGII interfaces in order to avoid losing packets under high load conditions. Methods for dealing with the mismatch are described hereinbelow.
De-encapsulated Ethernet data frames 68 (
Transmitter 84 adds the appropriate IFG 54, preamble 56 and SFD 58 at the beginning of extended frame 100, and appends EFD 70 at the end. Thus, when the extended frame is transmitted over a 10 GbE link, it will appear to be a conventional Ethernet frame, meeting all the applicable requirements. In this example, the overhead per Ethernet data frame is reduced to ten bytes, so that transmitter 84 will be capable of transmitting 16,891,891 frames/second and will thus keep pace with the incoming GFP-encapsulated stream of data frames. Although extended frame 100 is shown in
Since the IPG byte sequence is used by the XAUI receiver to compensate for clock differences relative to the XAUI transmitter, the length of extended frame 100 is limited by the possible clock mismatch between the transmitter and the receiver. (The receiver compensates for the mismatch by skipping four bytes in the IPG sequence, as is known in the art. It can be shown that for clock variability of ±100 ppm, the extended frame should therefore be no longer than 20 kbytes.) Furthermore, the length of the extended frame may be limited by the maximum frame size permitted in the 10 GbE network over which the extended frames are to be transmitted.
Therefore (returning to
The incoming data stream from PHY 42 is placed in a FIFO buffer 112. An Ethernet data frame transmitter 114 removes the non-data portion of the stream and passes data frames 68 (
When large Ethernet data frames are transmitted over the 10 GbE link to PHY 42 at the nominal 10 Gb/s speed, the data rate may exceed the capability of the SONET OC-192 interface, which is limited to 9.58464 Gb/s. In order to avoid buffer overflow due to this eventuality, a receive controller 120 senses when the fill level of buffer 112 exceeds a preset watermark 118. The receive controller then sends a back-pressure signal to the transmitting MAC processor, which will cause the transmitter to reduce its transmission rate in accordance with Ethernet convention.
Receiver 110 may alternatively be part of an Ethernet bridge or other switch, at node 30 (
Furthermore, although system 20 and the methods described above in the context of this system relate specifically to OC-192 and 10 GbE, the principles of the present invention will similarly be applicable in interfacing between other types of high-speed synchronous and packet network links as network speeds continue to grow in excess of 10 Gb/s. It will thus be appreciated that the embodiments described above are cited by way of example, and that the present invention is not limited to what has been particularly shown and described hereinabove. Rather, the scope of the present invention includes both combinations and subcombinations of the various features described hereinabove, as well as variations and modifications thereof which would occur to persons skilled in the art upon reading the foregoing description and which are not disclosed in the prior art.