Digital cross-connect

Abstract

Two or more cross-connect ICs are interconnected. Each IC directly receives some, but not all, of the system inputs, and outputs to some, but not all, outputs. Each cross-connect IC has a switch matrix that has the same number of inputs as the system, and a lesser number of outputs that matches the number of outputs of the IC. Each cross-connect IC provides fanout of its direct inputs to a link to each other cross-connect IC. Thus, each IC receives inputs either directly, or from a fanout on another IC.

Description

BACKGROUND OF THE INVENTION

[0002] Terminology and Bandwidth Accounting

[0003] FIG. 1 is a schematic diagram of an illustrative digital cross-connect switching system that includes sixteen 10 Gbps line cards 1A, a working switch card 1D, and a protection switch card 1E connected through a high-speed backplane 1C in one shelf 1F. The line cards 1A provide the primary inputs and outputs of the digital cross-connect switching system.

[0004] Each switch card 1E, 1F contains a 160 Gbps cross connect IC. The cross-connect IC on the working switch card 1D is illustrated as object 1B. If, in this example, all line cards 1A are the same, and each supports M/16 inputs and M/16 outputs for some number M, then the cross-connect IC 1B comprises an M×M switch matrix, as shown.

[0005] The protection switch card 1E and the working switch card 1D are identical. The traffic across the backplane is 640 Gbps since the line cards send and receive 160 Gbps of data to and from each of the two switch cards.

[0006] FIG. 2 is a three-dimensional view of the 160 Gbps switching system in FIG. 1. Not all line cards must be identical in the system. For example, there could be seven 20 Gbps line cards and eight 2.5 Gbps line cards in the system to utilize the full 160 Gbps switching capacity while taking fifteen out of sixteen line card slots 2A.

[0007] Suppose that the backplane 2C is designed to accommodate 1,280 Gbps of traffic. Each switch card in the expanded system can then cross-connect at most 320 Gbps of traffic. Several options are available to achieve this bandwidth.

[0008] 1) FIG. 3A illustrates a monolithic cross-connect switch 300 having N inputs and N outputs, where N=KM for some value K. For example, the monolithic 160 Gbps cross-connect IC in each switch card 2D, 2E of FIG. 2 could be replaced with a monolithic 320 Gbps cross-connect IC, where K=2.

[0009] However, since the number of crosspoints increases quadratically as a function of bandwidth, such an IC is costly to manufacture. The industry is typically not willing to pay four times the price to get twice the bandwidth. The manufacturing cost of such a monolithic IC is particularly high if advances in IC fabrication technology lag bandwidth growth.

[0010] 2) Parallel processing techniques, such as bit- or byte-slicing to scale the bandwidth, could be employed. For example, two nibble-sliced 160 Gbps cross-connect ICs can switch 320 Gbps data in parallel. See, for example, McKeown, N., et al., “The Tiny Tera: A Packet Switch Core”, Hot Interconnects V, Stanford University, August 1996, incorporated herein by reference.

[0011] FIG. 3B is a schematic diagram illustrating this technique. One cross-connect IC 55 processes the upper nibble of each byte while the other cross-connect IC 57 processes the lower nibble. This method additionally requires a slicer 51 to slice, and a reassembler 53 to reassemble, data between the line cards and the switch cards. If line cards perform slicing and reassembly, then only these line cards can communicate with the sliced cross-connects.

[0012] Legacy line cards that do not slice and reassemble data would have to be modified or replaced, an option that does not offer backward compatibility. A cross-connect bandwidth upgrade should involve upgrading the switch cards while preserving the line cards to be cost-effective.

[0013] If the switch card performs slicing and reassembly, then additional ICs are necessary to slice and reassemble the data there. Since all data links are high-speed links (typically at 2.5 Gbps line rate in 2002), this option doubles the number of these high-speed links on the switch card and triples the number of high-speed ports since the number of high-speed ports in the slicer and the reassembler is twice as many as that of the cross-connect ICs. As a result, this approach doubles the amount of high-speed link routing on the switch card and triples the power consumed by the high-speed ports.

[0014] 3) A 320 Gbps cross-connect with multiple smaller cross-connect ICs could be implemented to form a Clos network but the resulting system is blocking for arbitrary multicast traffic and requires scheduling. See Clos, C., “A Study of Non-Blocking Switching Networks,” Bell System Technical Journal, vol. 32, 406-424, 1953, incorporated herein by reference.

SUMMARY OF THE INVENTION

[0015] The present invention addresses three concerns for digital cross-connect system bandwidth upgrade with integrated circuits (ICs): 1) scalability with minimal additional cross-connect IC cost; 2) backward compatibility with existing line cards; and 3) non-blocking switching for arbitrary multicast.

[0016] The present invention requires only K identical cross-connect ICs for each switch card to scale K times the bandwidth of the original digital cross-connect system, and maintains non-blocking switching for arbitrary multicast traffic without requiring line card changes or additional ICs on the switch card to preprocess the data. Depending on the IC technology, K such cross-connect ICs are more economical to manufacture than a monolithic cross-connect IC with K times the bandwidth.

[0017] A switching system or method, according to an embodiment of the present invention, includes two or more cross-connect ICs. Each IC directly receives some, but not all, of the system inputs, and outputs to some, but not all, outputs. Each cross-connect IC has a switch matrix that has the same number of inputs as the system, and a lesser number of outputs that matches the number of outputs of the IC. Each cross-connect IC provides fanout of its direct inputs to a link to each other cross-connect IC. Thus, each IC receives inputs either directly, or from a fanout on another IC.

[0018] Each cross-connect IC may further include deskewers that deskew or synchronize, after fanout, data streams which are input to the cross-connect's switch matrix, such that all data streams entering the switch matrix are synchronized. The deskewers may be, for example, but are not limited to, first-in-first-out (FIFO) buffers.

[0019] Plural input streams may be merged into a merged stream prior to being forwarded to other cross-connect ICs. The merged stream preferably has a higher bandwidth than the individual input streams contained therein, and may be formed by bit-interleaving the input streams.

[0020] Unique identifiers may be embedded into unused portions, e.g., overhead bytes, of one or more of the input streams. A cross-connect IC receiving a merged stream can then demultiplex and reconstruct the input streams based on identifiers embedded in the input streams.

[0021] Data streams may be, but are not limited to SONET or SDH data streams.

[0022] Different inputs/outputs may have different bandwidth capabilities.

[0023] Another embodiment of the invention is a cross-connect integrated circuit (IC), which includes input ports for directly receiving less than all of the inputs to the switching system, as well as output ports for outputting to less than all outputs of the switching system. One or more link receivers for receive, over one or more links connected to additional (second) cross-connect ICs, inputs which are directly received by those cross-connect ICs. A switch matrix on the IC has an input for each system input, and a lesser number of outputs matching the outputs of the IC, i.e., the direct outputs. A fanout circuit provides fanout of the directly received inputs, for transmission over the link(s) to the second cross-connect ICs.

BRIEF DESCRIPTION OF THE DRAWINGS

[0024] The foregoing and other objects, features and advantages of the invention will be apparent from the following more particular description of preferred embodiments of the invention, as illustrated in the accompanying drawings in which like reference characters refer to the same parts throughout the different views. The drawings are not necessarily to scale, emphasis instead being placed upon illustrating the principles of the invention.

[0025] FIG. 1 is a schematic diagram of a typical digital cross-connect switching system.

[0026] FIG. 2 is a three-dimensional view of the 160 Gbps switching system in FIG. 1.

[0027] FIG. 3A is a schematic diagram illustrating a simple but expensive solution to increased bandwidth, by quadratically growing the square switch matrix to N×N, where N=K×M.

[0028] FIG. 3B is a schematic diagram illustrating a parallel processing technique.

[0029] FIG. 4A is a schematic diagram illustrating an embodiment of the present invention, where bandwidth has been doubled relative to the system shown in FIG. 1, i.e., K=2.

[0030] FIG. 4B is a schematic diagram illustrating an embodiment of the present invention similar to that shown in FIG. 4A, but where the fanout circuitry is co-located with a switch matrix in a cross-connect integrated circuit.

[0031] FIGS. 4C and 4D are block diagrams that demonstrate the advantages of the internal fanout of the present invention.

[0032] FIG. 4E is a schematic diagram illustrating the system of FIG. 1 upgraded to 320 Gbps using an embodiment of the present invention.

[0033] FIG. 5 is a schematic diagram that, generally, illustrates K cross-connect ICs in an embodiment of the present invention.

[0034] FIG. 6 is a schematic diagram illustrating an embodiment of the present invention with K=3.

[0035] FIG. 7 is a schematic diagram illustrating one of the ICs of FIG. 5.

[0036] FIG. 8 is a schematic diagram illustrating circular dependency latency that may occur when two SONET cross-connect ICs are connected via links.

[0037] FIG. 9 is a schematic diagram illustrating how circular latency dependency can be avoided by an embodiment of the present invention.

[0038] FIGS. 10A and 10B are schematic diagrams illustrating the fanout circuitry of FIG. 9, and the merging of two data structures into a single merged stream in an embodiment of the present invention.

[0039] FIG. 11 is a schematic diagram illustrating a bit-interleaving receiver implementation as employed in the embodiment of FIGS. 10A and 10B.

[0040] FIGS. 12A and 12B are schematic diagrams illustrating how two rectangular cross-connect ICs may be connected together, in an embodiment of the present invention, to groom 320 Gbps STS-1 data in a non-blocking fashion.

DETAILED DESCRIPTION OF THE INVENTION

[0041] A description of preferred embodiments of the invention follows.

[0042] System Overview

[0043] An embodiment of the present invention requires K cross-connect ICs to scale the switching system bandwidth K times.

[0044] FIG. 4A is a schematic diagram illustrating an embodiment of the present invention, where bandwidth has been doubled, i.e., K=2, so that there are now N inputs and N outputs, where N=2×M. Each half (N/2) of the inputs 28 is routed directly to a corresponding rectangular N×N/2 (or equivalently, 2M×M) switch matrices 105. In addition, fanout circuitry 113, described below, distributes the direct inputs over links 107 to each other switch matrix 105. Thus, each switch matrix 105 receives all N inputs (N/2 directly and N/2 from the other switch matrix's fanout), while only connecting half (N/2) of the inputs to the N/2 directly connected outputs 29.

[0045] FIG. 4B is a schematic diagram illustrating an embodiment of the present invention similar to that shown in FIG. 4A, but where the fanout circuitry 113 is co-located with a switch matrix 105 in a cross-connect integrated circuit (IC) 100. By locating the fanouts 113 on the respective cross-connect ICs 100, the amount of extra circuitry needed on the switch card (FIG. 1, 1D) is greatly reduced, and implementation simplified. As described below, implementation may be further simplified (i.e., IC pin count and printed circuit board trace count) by multiplexing plural input streams and serializing the multiplexed data for transmission over the links 107.

[0046] Thus, without the internal fanout of the cross-connect, a system would have to have an external fanout device, since any fanout signal must go through deserialization. (Differential high-speed signals cannot be fanned out, because they are all point-to-point connections). The number of high-speed transmitters and receivers of such an “external fanout” system would thus be higher than that required by the present invention. The present invention is therefore more power-, cost- and space-efficient than a system with external fanout.

[0047] FIGS. 4C and 4D demonstrate the advantages of the internal fanout more clearly.

[0048] FIG. 4C is a block diagram illustrating a system with external fanouts. Three high-speed receivers 403, 413A, 413B and two high-speed transmitters 408A, 408B are necessary to distribute the same signal 28 from the line card to two cross-connects 411A, 411B that have no internal fanout. In addition, three differential pairs of high-speed board traces are required on the board: one 28 from the line card to the high-speed receiver 403, one 409A from the high-speed transmitter 408A to the high-speed receiver 413A, and one 409B from the high-speed transmitter 408B to the high-speed receiver 413B.

[0049] FIG. 4D, on the other hand, is a block diagram illustrating an embodiment of the present invention having internal fanout. Here, only two high-speed receivers 10A, 11A and one high-speed transmitter 10H are required to distribute the high-speed differential signal 28 from the line card to both cross-connect ICs 100. Furthermore, only two differential pairs are needed to route the above differential signal: one 28 from the line card to the high-speed receiver 10A and the other 107 from the high-speed transmitter 10H to the high-speed receiver 11A. The internal fanout system of FIG. 4D thus requires fewer high-speed board traces than the external fanout system of FIG. 4C.

[0050] FIG. 4E is a schematic diagram illustrating the system of FIG. 1 upgraded to 320 Gbps using an embodiment of the present invention. Line cards 4A1, 4A2 are the primary inputs and outputs of the system. In this example, the aggregate bandwidth of the line cards is 320 Gbps for the inputs and the outputs. For clarity, not all line cards are shown. Line cards 4A1 represent 160 Gbps of the system aggregate bandwidth, while line cards 4A2 represent the other 160 Gbps. The backplane 4B carries 1.28 Tbps of traffic: 320 Gbps to and 320 Gbps from the working switch card 4E and 320 Gbps to and 320 Gbps from the protection switch card 4F.

[0051] The protection switch card 4F is identical to the working switch card 4E. The two cross-connect ICs 4C, 4D shown on the working switch card 4E are identical and together switch 320 Gbps of traffic to and from the line cards 4A. Bidirectional inter-IC links 4G, 160 Gbps in each direction, accomplish non-blocking switching for arbitrary multicast. As a result, each cross-connect IC 4C/4D has 320 Gbps of inputs and 320 Gbps of outputs, half of which are connected to half of the line cards while the other half are connected to the other cross-connect IC.

[0052] FIG. 5 is a schematic diagram that, generally, illustrates K cross-connect ICs 51. Each IC 51 has 1/K of the KM inputs and outputs connected directly to the line cards and 1/K of the KM inputs and outputs connected to each one of the other identical K−1 ICs 51. The cross-connect ICs can thus scale the system bandwidth K times.

[0053] FIG. 6 is a schematic diagram illustrating an embodiment of the present invention with K=3. The cross-connect ICs 6A-6C are identical. Without loss of generality, the following description focuses on cross-connect IC 6A, which has 160 Gbps of inputs and 160 Gbps of outputs connected to line cards 64 and 160 Gbps of inputs and 160 Gbps of outputs connected to each one of the other two cross-connect ICs 6B, 6C. The cross-connect 6A thus has 480 Gbps and 480 Gbps of inputs and outputs.

[0054] Port Partitioning

[0055] FIG. 7 is a schematic diagram illustrating one of the ICs 51 of FIG. 5. Instead of using an N×N switch matrix in one square cross-connect IC, where N=KM (see FIG. 5), an embodiment of the present invention uses K rectangular cross-connect ICs, each having an 1$N\times \frac{N}{K}$

[0056] switch matrix 7A. These rectangular cross-connect ICs, in combination, perform the same function as a monolithic N×N cross-connect IC.

[0057] Each rectangular cross-connect IC has (K−1) sets of 2$\frac{N}{K}$

[0058] pass-through ports 7C. Each set of pass-through ports is connected to a particular one of the other K−1 rectangular cross-connect ICs. In particular, each set of the 3$\frac{N}{K}$

[0059] pass-through output ports 7C gets its inputs from a unique set of 4$\frac{N}{K}$

[0060] input ports 7E that are directly connected to a set of line cards, without the data going through the switch matrix 7A. The other K−1 sets of input ports 7B are received from other ICs via pass-through input ports. Only one set of 5$\frac{N}{K}$

[0061] output ports 7D is directly connected to the switch matrix 7A.

[0062] Those skilled in the art should see, depending on N, that K being 2, for instance, the present invention can reduce the die size from that required for an N×N square cross-connect IC so that two such rectangular cross-connect ICs are less costly to manufacture than a monolithic N×N square cross-connect IC.

PASS-THROUGH PATH CONSTRUCTION

[0063] This section discusses how the pass-through paths may be constructed to eliminate external devices to compensate for cross-connect latency. A SONET/SDH cross-connect is assumed, but the description applies to any cross-connect with a synchronous switch matrix. Each input port in a SONET/SDH cross-connect contains a deskew FIFO to absorb clock transients and arrival time mismatch due to differences in path lengths. The pass-through output ports get their data from before the deskew FIFO input; otherwise, additional deskew devices, for instance, SONET/SDH pointer adjusters, would be necessary in the switching system.

[0064] Deskew FIFO Overview

[0065] A SONET/SDH cross-connect deskew FIFO typically has its write clock in the recovered clock domain for its particular input port. The read clocks of all such FIFOs are derived from the same source so that the data streams going into the switch matrix are synchronous and properly aligned. In particular, the switch matrix accepts the first byte of each frame (start-of-frame) from each input at the same time. Typically, a cross-connect IC has a reference frame pulse and a programmable counter so that reading of the start-of-frame begins some time after the active edge of the reference frame pulse, as specified by the programmable counter. Adjusting the programmable counter changes the latency of the cross-connect IC.

[0066] Cross-Connect Circular Latency Dependency

[0067] FIG. 8 is a schematic diagram illustrating two SONET cross-connect ICs 8A, 8B connected via links 8F and 8H. Consider the path through input port 8C, cross-connect 8A, and link 8F. Without loss of generality, suppose that the start-of-frame arrival time at input port 8C of cross-connect 8A is 0. Suppose also that the reference frame pulse programmable counter in switch 8A is set such that the at time DF1, the start-of-frame appears at the output of the deskew FIFO 8E. Let the latency from the output of any FIFO to any pass-through output be DC and the delay through the link 8F be DS1. Then the start-of-frame arrival time at the input connected to link 8F in cross-connect 8B is DF1+DC+DS1.

[0068] Now consider the path through input port 8D, cross-connect 8B, and link 8H. Again, without loss of generality, suppose that the start-of-frame arrival time at 8D is 0 and that the programmable counter in 8B is set such that the start-of-frame appears at the output of the deskew FIFO 8G at time DF2. Let the delay through the link 8H be DS2. Then the start-of-frame arrival time at the input port of 8A connected to the link 8H is DF2+DC+DS2.

[0069] Note that because the FIFOs cannot overflow if they are to deskew the data properly, DF1+DC+DS1 must be less than DF2, and DF2+DC+DS2 must be less than DF1. Obviously, these conditions cannot both be true.

[0070] FIG. 9 is a schematic diagram illustrating how the circular latency dependency shown in FIG. 8 is avoided by an embodiment of the present invention. In this two-IC illustrative example, inter-cross-connect links 107 from each IC 100 are connected to input ports of the other IC without first being deskewed by deskewing FIFOs 101. Instead, deskewing FIFOs 103 on each IC deskew the inputs passed by the other IC. Thus, all inputs to a switch matrix 105 are deskewed on the same IC as the switch matrix 105.

[0071] Reducing Pin Count for Pass-Through Ports

[0072] The primary inputs and outputs preferably run at line rates compatible with the line cards. The pass-through ports, on the other hand, can run at a higher rate to reduce pin count, board traces, and, in the case of multi-shelf applications, connectors and cables.

[0073] Multiplexing Pass-Through Data

[0074] Without loss of generality, consider the merging of two 2.5 Gbps input streams into one 5 Gbps stream, transmitted through a pass-through output port. Since the two input streams are taken from before the deskew FIFO, the 5 Gbps output stream needs to be retimed. The deskewing/synchronizing FIFOs can be such that the write clock of each FIFO originates in each of the recovered clock domains. The read clock can be in one of the recovered clock domains or can be driven by an external mesochronous reference clock.

[0075] FIG. 10A is a schematic diagram illustrating the fanout circuitry 113 of FIG. 9 and the merging of two input streams into a single merged stream. The first 2.5 Gbps stream is processed by receiver 10A, clock-data recovery (CDR) unit 10C, and deserializer 10L, finally feeding the input of the synchronizing FIFO 10E whose write clock is the recovered clock 10I of this stream. Similarly the second 2.5 Gbps stream is processed by receiver 10B, CDR 10D, and deserializer 10M, feeding the input of the synchronizing FIFO 10F whose write clock is the recovered clock 10J of this stream.

[0076] The read clock 10K of both FIFOs 10E, 10F must be the same. This clock can be one of the recovered clocks, 10I, 10J, or an external mesochronous reference clock. Preferably, the read and write pointers of each FIFO are kept apart enough so that the FIFO does not overflow or underflow, and that there are enough entries in the FIFO to absorb clock transients in the 2.5 Gbps streams. The two streams from the FIFOs are then bit-interleaved and serialized in 10G before reaching the pass-through output port through the 5 Gbps transmitter 10H.

[0077] FIG. 10B is a schematic diagram providing further details to FIG. 10A. The multiplexing circuitry comprises stream-ID insert units 32 (discussed below), the synchronizing FIFO buffers 10E, 10OF and the bit-interleaving multiplexor and serializer 10G. Note that each incoming stream 28 is actually a point-to-point differential signal which cannot be readily fanned out on a circuit board. Fan-out to the pass-through port 10H occurs after byte aligners 30 and before the stream-ID insert units 32.

[0078] After fan-out, the signals may be further processed by blocks 34 and deskewed by deskew FIFOs 101 before being presented to the switch matrix resident on the particular cross-connect IC.

[0079] Demultiplexing Pass-Through Data

[0080] Once the 5 Gbps stream reaches the input port of the next cross-connect IC, that input port must have a means to retrieve the original two 2.5 Gbps streams. For SONET/SDH streams, stamping an overhead byte, such as the forty-seventh A2 byte in an STS-48/STM-16 frame, with a uniquely identifiable 2.5 Gbps stream ID can enable the downstream receiver to distinguish between the two bit-interleaved 2.5 Gbps streams. Since the A2 byte is not scrambled in SONET/SDH, the codeword chosen for the stream ID should not disturb DC balance. The forty-seventh A2 byte is used as an example here because it is typically not used for framing. This stamping may be done by the stream-ID insert units 32 (FIG. 10B).

[0081] FIG. 11 is a schematic diagram illustrating a bit-interleaving receiver implementation. The 5 Gbps receiver 11A sends its data to the CDR 11B, which feeds the deserializer 11C. The deserializer 11C arbitrarily sends every other bit to the framer 11D and the other half of the data to framer 11E. These two framers look for the A1/A2 SONET/SDH framing boundary in parallel. Once any one of the framers has determined the proper framing boundary, it can locate the stamped overhead byte with the stream ID. The framer then sends the ID to the 2×2 switch controller 11F.

[0082] Suppose that the two stream IDs are 0 and 1. Let “N/A” denote an ID not yet available to the 2×2 switch controller 11F. Then there are 9 possible states of the two inputs into 11F. Table 1 illustrates the 9 possible states. In the “Action” column, “straight through” means that the 2×2 switch 11G has input 11H connected to output 11J and input 11I connected to output 11K. “Swap” indicates that the 2×2 switch 11G has input 11H connected to output 11K and input 11I connected to output 11J.

TABLE 1
Switch Controller State Table
Input from Framer 11D	Input from Framer 11E	Action
0	0	Report error
0	1	Straight through
0	N/A	Straight through
1	0	Swap
1	1	Report error
1	N/A	Swap
N/A	0	Swap
N/A	1	Straight through
N/A	N/A	Straight through

[0083] For instance, whenever the stream IDs from the two framers are different and the ID from framer 11D is 0 or the ID from framer 11E is 1, then output 11J receives data from 11H and 11K from 11I. Likewise, whenever the IDs are different and the ID from framer 11D is 1 or the ID from framer 1E is 0, then the output 11J is connected to 11I and 11K to 11H. When both IDs are either 0 or 1, then the controller reports an error. When both IDs are “N/A”, the framers are still looking for the A1/A2 boundary and the switch is in pass-through mode. Note that this implementation requires only one of the streams to be stamped and ensures that the output port 1J receives the stream stamped with ID “0” and the output port 11K receives the stream stamped with ID “1”.

[0084] Connection Set-up

[0085] FIGS. 12A and 12B are schematic diagrams illustrating how two rectangular cross-connect ICs may be connected together to groom 320 Gbps STS-1 data in a non-blocking fashion. Bold lines represent data flow for four combinations of cross-connecting inputs and outputs. Each cross-connect IC accepts 160 Gbps data from the line cards and sends the data to two destinations: 1) its 320 Gbps×160 Gbps switch core after the deskew FIFO and 2) the other cross-connect IC before the deskew FIFO.

[0086] For instance, to connect a north primary input to a south primary output as in 123, a connection map in the lower cross-connect IC 100S for the output port is programmed to accept input from the south-bound input port which receives data from the north primary port via a south-bound pass-through port. Those skilled in the art would readily see how to set up a connection in general for the network in FIG. 5.

[0087] Reference numbers 121, 125 and 127 similarly illustrate, respectively, north primary input to north primary output, south primary input to north primary output, and south primary input to south primary output configurations.

[0088] While this invention has been particularly shown and described with references to preferred embodiments thereof, it will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the scope of the invention encompassed by the appended claims.

Claims

1. A switching system, comprising: plural cross-connect ICs, each IC directly receiving less than all inputs and outputting to less than all outputs; each cross-connect IC having a switch matrix having a number of inputs that matches system inputs and a lesser number of outputs that matches outputs of the IC; each cross-connect IC providing fanout of direct inputs to a link to each other cross-connect IC.

2. The switching system of claim 1, each cross-connect IC comprising: deskewers which deskew, post-fanout, data streams which are input to the cross-connect's switch matrix, wherein all such data streams are synchronized prior to switching.

3. The switching system of claim 2, the deskewers being buffers.

4. The switching system of claim 3, the buffers being FIFO buffers.

5. The switching system of claim 1, plural input streams being merged into a merged stream prior to being forwarded to the other cross-connect ICs.

6. The switching system of claim 5, the merged stream being at a higher bandwidth than the individual streams contained therein.

7. The switching system of claim 5, wherein the input streams are bit-interleaved.

8. The switching system of claim 5, a unique identifier being embedded in an used portion of at least one of the input streams.

9. The switching system of claim 5, a cross-connect IC receiving a merged stream demultiplexing and reconstructing the input streams based on identifiers embedded in at least one of the input streams.

10. The switching system of claim 1, data streams being SONET/SDH data streams.

11. The switching system of claim 1, different inputs/outputs having different bandwidth capabilities.

12. A switching method, comprising: interconnecting plural cross-connect ICs, each IC directly receiving less than all inputs and directly outputting to less than all outputs, each cross-connect IC having a switch matrix having a number of inputs that matches system inputs and a lesser number of outputs that matches outputs of the IC; and fanning out each cross-connect IC direct input to a link to each other cross-connect IC.

13. The switching method of claim 12, further comprising, in each cross-connect IC: deskewing, post-fanout, data streams which are input to the cross-connect's switch matrix, wherein all such data streams are synchronized prior to switching.

14. The switching method of claim 13, deskewing being performed with buffers.

15. The switching method of claim 14, the buffers being FIFO buffers.

16. The switching method of claim 12, further comprising: merging plural input streams into a merged stream for forwarding to the other cross-connect ICs.

17. The switching method of claim 16, the merged stream being at a higher bandwidth than the individual streams contained therein.

18. The switching method of claim 16, further comprising: bit-interleaving the input streams prior to merging them into the merged stream.

19. The switching method of claim 16, further comprising: embedding a unique identifier in a portion of at least one of the input streams.

20. The switching method of claim 16, further comprising: receiving and demultiplexing a merged stream; and reconstructing the input streams based on identifiers embedded in at least one of the input streams.

21. The switching method of claim 12, data streams being SONET/SDH data streams.

22. The switching method of claim 12, different inputs/outputs having different bandwidth capabilities.

23. A cross-connect integrated circuit (IC), comprising: input ports for directly receiving less than all inputs to a switching system and output ports for outputting to less than all outputs of the switching system; a link receiver for receiving, over a link from a second cross-connect IC, inputs which are directly received by said second cross-connect IC; a switch matrix having a number of inputs that matches system inputs and a lesser number of outputs that matches outputs of the IC; and a fanout circuit which provides fanout of the directly received inputs, for transmission over a link to the second cross-connect IC.

24. The integrated circuit of claim 23, further comprising: deskewers which deskew, post-fanout, data streams which are input to the cross-connect's switch matrix, wherein all such data streams are synchronized prior to switching.

25. The integrated circuit of claim 24, the deskewers being buffers.

26. The integrated circuit of claim 25, the buffers being FIFO buffers.

27. The integrated circuit of claim 23, the fanout circuitry comprising multiplexing circuitry for merging plural input streams into a merged stream prior to transmission the second cross-connect IC.

28. The integrated circuit of claim 27, the merged stream being at a higher bandwidth than the individual streams contained therein.

29. The integrated circuit of claim 27, wherein the multiplexing circuitry bit-interleaves input streams.

30. The integrated circuit of claim 27, the fanout circuitry embedding a unique identifier in a portion of at least one of the input streams.

31. The integrated circuit of claim 27, further comprising: demultiplexing circuitry which demultiplexes a merged stream received from the second cross-connect IC and reconstructs input streams based on identifiers embedded in at least one of the input streams by the second cross-connect IC.

32. The integrated circuit of claim 23, data streams being SONET/SDH data streams.

33. The integrated circuit of claim 23, different inputs/outputs having different bandwidth capabilities.