(Not applicable)
1. Field of the Invention
The invention relates to Clos switch architecture used for example in telecommunications systems, and more particularly, to a variant of the Clos switch, known as the Time-Space-Time Clos.
2. Description of the Related Art
A key feature of telecommunications systems based on the SONET/SDH standards is the ability to switch traffic arriving on one port of a system, so that it can be output on any other port of the system. In equipment operating at the edge of the network, this switching needs to be performed with fine granularity (1.5 or 2 Mbits/s). Devices that can operate at this level are referred to as VT or VC-12 switches.
Typical systems (SONET/SDH multiplexors) are required to interconnect many hundreds or thousands of these connections. For example, a MSPP (Multi-Service Provisioning Platform) product could require a 8064 port VT switch. The MSPP switch is a relatively small part. Commercial devices exist that can switch between over 21,000 ports (40 Gbit/s).
Two techniques are normally adopted for building very large VT switches. These are “square” and Clos designs. The same is also true of the higher capacity STS switches used in telecommunications systems, to which the present invention may be applicable.
Square switches operate by writing incoming data into a memory, from which it is read whenever it is needed to be written to an output port. Because the memory can only be accessed by one output port at a time, it is necessary to provide a separate copy of the memory for each physical output port. Thus doubling the size of a switch results in a four-times increase in the size of the switch memory. For the 40 Gbit/s switch described above, this equates to 6.8 Mbits of RAM, and for an 80 Gbit/s switch it requires 27.1 Mbits. Large memory requirements limit the size of switch that can be implemented in either FPGA or ASIC technology.
The second technique is the Clos switch, which utilizes an array of smaller switches, normally arranged in either 3 or 5 columns. The Clos switch requires much less memory, but is more complex to configure. Normally a computer algorithm is used to convert the switch map into a form that can be applied to a Clos switch.
Square switches are easy to configure, and have the ability to connect any input port to any output port, without restriction. A disadvantage of square switches is that their memory requirement grows according to a square law, making the construction of large square switches very expensive.
Clos switches have much smaller memory requirements, but they are complex to configure, and are subject to a problem called blocking. This occurs when a desired connection between input and output ports cannot be implemented, because other existing connections in the switch matrix ‘block’ the new connection.
One variant of the Clos switch is known as a “Time-Space-Time Clos.” In a conventional Time-Space-Time Clos switch, an algorithm is required to find time-slots during which a centre stage element is available to transfer data from one input port to one or more output ports. As the number of connections in a switch increases, it becomes more difficult to find suitable center stage timeslots. Eventually it may become necessary to rearrange other connections within the switch to make a new connection.
In order to address the above-mentioned limitations associated with the prior art, a Self-Steering Clos switch is disclosed which adds a queuing function between the input and output memories. Each time an input memory is read, the result is placed in a queue dedicated to that memory. Each of the output RAMs has an associated arbitrator that monitors all of the queues coming from the input RAMs. The arbitrator reads data from the input RAM queues using a suitable scheduling scheme, such as fair round-robin, transferring the data to the output RAMs.
Thus if a center stage timeslot is not available at the exact time the data is read from the input RAM, the data will be held in a center stage queue until the required output RAM becomes available. An external algorithm is no longer required to configure the Clos, as the traffic is steered through it using the internal logic.
The inventive system has similarities to packet switching, but still maintains the very low latency, and deterministic timing required by Sonet/SDH switches.
The invention in one aspect provides a technique for efficiently building switches, avoiding the very large amounts of memory that are normally associated with large switches, while allowing the switch to be programmed by software as if it were a conventional design.
The invention in this aspect is related to the Clos switch architecture, but allows the switch to be configured in the same way as a conventional square switch. Specifically, it is derived from a variant of the Clos switch, known as the Time-Space-Time Clos.
In a conventional Clos switch, the configuration of the switch determines when a byte of data is moved (scheduled) from one stage of the switch to the next. A switch in accordance with the invention is arranged similarly to a Clos switch, but in which data moving from one stage to the next is queued until the relevant resource in the next stage becomes available. The result is a “self-scheduling” or “self-steering” Clos.
By having a Clos structure, the memory requirements are greatly reduced. An 80 Gbit/s square switch would require 27.1 Mbits of traffic RAM. The equivalent 80 Gbit/s switch built using this architecture requires 1.5 Mbits of traffic RAM.
As the data moving through the switch is self-steered, only the input and output port identifiers need to be provided. The path which the data follows through the switch is determined by the switch logic itself. This means that the switch does not need the complex configuration normally associated with a Clos. Configuration of the inventive self-steering Clos can be made to appear identical to that of a conventional square switch.
One feature of the inventive self-steering Clos is a RAM requirement that grows linearly, as with a Time-Space-Time Clos, rather than according to a square law. Another feature is a switch which is configured in a similar manner as a conventional square switch. A single value representing the required input port is programmed into a location denoting the output port. In order to minimize the risk of blocked connections affecting normal traffic, the bandwidth provided between the input and output RAMs of the self-steering Clos is more than doubled. The delay through the switch can be set to be just over ⅓ of a Sonet/SDH row, which is the typical delay of a square switch, rather than the ⅔ of a row which would be typical of a conventional Time-Space-Time Clos.
Many advantages of the present invention will be apparent to those skilled in the art with a reading of this specification in conjunction with the attached drawings, wherein like reference numerals are applied to like elements, and wherein:
The information stream arriving at ports 45a, 45b is written into the two memories, 42a, 42b, respectively, in basically linear ascending order. At the start of every switching period (typically 125 microseconds or some fraction thereof), application zero (first application) begins in memory. Each sample at a port 45 is written in a memory 42, until all the samples have been written. Then, at the beginning of the next period, writing begins again at the first location (memory 42), and the cycle is repeated.
The diagonal line in each of memory blocks 42a, 42b indicates that the memory block actually consists of two memories, a write memory accessed through a write address (WrAd) and a read memory accessed through a read address (RdAd). Information from each of the two ports 45a, 45b is written into both memories 42a, 42b, as enabled by combining nodes 46a and 46b, in effect widening the size of the required memory, which is typically a RAM (Random Access Memory) or the like. Writing data into both memories 42a and 42b makes the data accessible to both output port 43a connected to memory 42a, and output port 43b connected to memory 42b. Control and timing of the read and write operations is performed by controller 44. Memories 41a and 41b contain the switch configuration, and provide the read addresses (RdAd) for memories 41a and 42b. These memories are programmed by the user to define the switching operation to be performed.
Square switch 10, having two input ports 45a, 45b and two output ports 43a, 43b, requires a total of four memories—two write memories and two read memories. In general, the size of the traffic memory required grows with the square of the number of input/output ports of the switch, as
One approach to reducing the memory requirements of large switches is to construct what is generally known as a Clos type switch. This approach effectively breaks up the large switch into a multiplicity of smaller switches arranged in separate stages. The drawback of this approach is that it introduces significant complexity. The individual switches and stages have to be properly configured and connected to one another, and each individually set up. Moreover, a Clos type switch maybe be subject to blocking, whereby not all output ports can have access to information from all input ports. A rearrangeably non-blocking Clos switch avoids this, but at the expense of increasing the size of the center stage. A general example of a Clos type switch is depicted in
The three smaller memories 151 shown in input memory circuit 15 receive incoming traffic from input ports 21. Each of these smaller memories is accessed independently, and consists of a write memory and a read memory, separated by the representative horizontal line in the center of each block in the drawing figure. Incoming data from input ports 21 is written into the write memory and read from the read memory. In this implementation, incoming data is written in 32 bit blocks (4 bytes). The memory 15 contains data for 2 channels (2 bytes per cycle), so one 32 bit word is written on every alternate clock cycle. Each of the smaller memories 151 is therefore written on every 6th clock cycle. Each memory 151 has two ports. One is always available for reading, the other is used to write the incoming data, but may be used as a read port when not required for writes. The configuration and operation of the input memory 15 will be described in greater detail below.
Reading of the read memory portion is conducted under control of read requests from blocks 14. A center stage, output arbitrator 17, conducts switching of the data as it is read from the memory 15. To keep output arbitrator 17 from being overwhelmed by traffic at any particular moment in time, a set of storage memories 16 is provided in the read flow path. These storage memories 16 can be FIFO (first-in-first-out) registers or buffers or the like. Thus data stored in memory 15, and particularly in memory blocks 151, exits same and enters FIFO registers 16. If output arbitrator 17 can handle switching the data at that time, the data is switched to an appropriate output memory 19 as further detailed below. If not, the data is queued in the register 16 until output arbitrator 17 is ready to switch it to the necessary output port. Register 16, in addition to containing the incoming data being switched, includes steering information indicative of which output port 22 it should be switched to.
The switched data is written into an appropriate output memory 19, which, like memory 15, supports multiple ports, in this case two write ports and one read port, as demarcated by a horizontal line in the drawing figure. Additional FIFO registers 18 or the like are provided upstream of output memory 19, for buffering if necessary until output memories 19 become available. Registers 18 may not be necessary in all implementations and may therefore be omitted.
Comparing the behavior of the input memories 15 with that of the output memories 19, it will be appreciated that incoming data from input ports 21 is written into input memories 15 sequentially, but is read out in a non-sequential order determined by the switching decisions of output arbitrator 17. On the other hand, for output memories 19, the data is written in non-sequential order as determined by the switching decisions of output arbitrator 17, but is read out in sequential order on output ports 22.
Configuration memories 11 are provided, serving the role of mapping the operation of switch 20. For every output port 22, configuration memories 11 contain information as to which input port 21 corresponds thereto and from which such input port data should be obtained. Configuration memories 11 thus provide an input/output port definition, whereby each location in a memory 11 corresponds to a particular output port 22, while the content of that location defines a corresponding input port 21. Further, since the switch 20 is a TDM (time division multiplexed) switch, each input/output port definition, or request, obtained from configuration memory 11 also contains information identifying the time slot within the indicated port, for both the input 21 and output 22 ports. Accordingly, the requests from memories 11 are each associated with four pieces of information: input port number, corresponding input port time slot, output port number, and corresponding output port time slot.
Block 13, which designates a circuit effectively operating as an input arbitrator similarly to output arbitrator 17, receives the connection requests from memories 11, possibly by way of FIFO registers or buffers 12 which operate in a similar manner as registers 16, 18, and 14—that is, to hold and queue information or data, in this case the requests, until a downstream stage (input arbitrator 13) can accept it. Since there is a one-to-one mapping of locations in memories 11 to output ports 22, input arbitrator 13 is left with the task of identifying from which input ports 21 and corresponding input memories 15 data should be retrieved for routing to a particular output port 22, and the corresponding input port and output port time slots. Input arbitrator 13 receives routing requests issuing from the memories 11, identifies the relevant input port 21/memory 15, and steers the request to an appropriate FIFO register 14 associated with the identified input port 21/memory 15 so that the request from an appropriate output 13a of input arbitrator 13 will land at the corresponding memory 151 and associated input port 21. For each input memory 151 circuit, the input arbitrator 13 identifies all configuration queues (in FIFO registers 12) that wish to read data therefrom. The input arbitrator 13 then selects one of these, and writes it into the input memory 151 read queue (registers 14). Selection is performed on a normal basis as detailed below. The required traffic byte is read from the input memory 15. When the read port of an input memory circuit 151 is available, connection requests are read from the input memory 151 read read queue (registers 14). The location (input port) of the connection request is used to address the input memory 151 circuit. The byte which is read from the location is appended to the connection request, and written into the input memory 151 output queue (in FIFO registers 16).
It should be noted that there is a one-to-one correspondence of, on the one hand, outputs 13a of input arbitrator 13, and possibly FIFO registers 14, and on the other hand, input ports 21 and memories 151 in input memory 15. Further, the request informs the particular location in memory 15 of the time slot from which data should be obtained. Since at this point the request has arrived at the memory location 15 associated with the correct input port 21, the bit identifying the input port can be stripped off, and after the data from the correct input time slot is obtained, the bit identifying that time slot can also be stripped off.
The data thus obtained is passed to output arbitrator 17, along with the information from the request identifying the output port 22 number and corresponding output port time slot. The data is passed along by the output arbitrator 17 to the FIFO register 18 associated with the appropriate output port 22 and output port time slot. The data is then written into the memory location 19 associated with the destination output port 22, and the remaining pointer information—the output port number and corresponding output port time slot—is then stripped off.
The bandwidth requirement of the portion of the system 20 between the input (15) and output (19) memories—that is, Stage II in
Circuits 13 and 17, which operate in a similar manner to one another, can both be referred to as arbitrators and serve to guide traffic from a particular input register to a requested output register, and to resolve any occurring contention. The input and output registers in the case of input arbitrator 13 are 12 and 14, respectfully, and in the case of circuits 17 are 16 and 18, respectively. The arbitration in circuits 13 and 17 is preferably conducted on a fair basis. One resolution mechanism can be a round-robin approach, whereby if multiple input FIFO registers are requesting access to a single output FIFO register simultaneously, a round-robin selection is made and access granted in order.
It will be appreciated that the implementation depicted in
The configuration of the memory 15 for use with the self-steering Clos switch can be more fully explained with reference to
In
A more efficient approach for achieving a differential in bandwidth between the read and write process capacities occurs by using an input memory configured as shown in
In the configuration of
In addition, when using multiple dual-port memories and alternating in time the memory that is being used for the functions of reading and writing, rather than obtaining 1.75 read ports, 2 read ports can be made available. Schematically, this approach is illustrated in
In accordance with the preferred embodiment of the invention described with reference to
The arrangement of
The above are exemplary modes of carrying out the invention and are not intended to be limiting. It will be apparent to those of ordinary skill in the art that modifications thereto can be made without departure from the spirit and scope of the invention as set forth in the following claims.