Methods and devices for converting between trunked and single-link data transmission in a fibre channel network

Abstract

A device for converting between the trunked and untrunked transmission of Fibre Channel frame data is described. During conversion, the device manages the flow of frame data in both the egress (from Fibre Channel ports to a non-Fibre Channel port) and ingress (from a non-Fibre Channel port to Fibre Channel ports) directions. In the egress direction, the device operates as a FIFO to transmit all frames received from the Fibre Channel ports to the non-Fibre Channel ports. In the ingress direction, every frame received by the non-Fibre Channel port is stored in one of up to four storage segments based on the frame data's virtual circuit and path number identifiers. Frames are transmitted out of each storage segment in the order in which they are received therein. The device may be a stand-alone device. The device may also be incorporated into a Fibre Channel switch or other apparatus that connects to a Fibre Channel network or switch.

Description

BACKGROUND OF INVENTION

[0002] The invention relates generally to data transmission in a Fibre Channel network and, more particularly but not by way of limitation, to techniques for converting between the trunked transmission of data frames and the transmission of data frames over a single high-speed link.

[0003] As used herein, the phrase “Fibre Channel” refers to the Fibre Channel family of standards promulgated by the American National Standards Institute as ANSI X.3/T11. In general, Fibre Channel defines a high speed serial transport system that uses a hierarchically structured information exchange protocol consisting of frames, sequences and exchanges. A “frame” is the atomic unit of data transmission between two communicating devices. A “sequence” is a set of one or more related data frames transmitted unidirectionally from one device to another device within an exchange. An “exchange” is the basic construct for coordinating the transfer of information between communicating devices during higher layer protocol operations such as Small Computer System Interface (SCSI) and Transport Control Protocol/Internet Protocol (TCP/IP).

[0004] Referring to FIG. 1, communication between end devices such as server 100, storage unit 105, databases 110 and loop 115 (itself comprised of devices, not shown) is mediated by “fabric” 120, a term which refers to one or more operatively coupled Fibre Channel switches, e.g., 125, 130 and 135.

[0005] One technique to transmit a high-speed stream of frames between two devices is to use a single link that supports the desired bandwidth. For example, if data needs to be moved from device-1 to device-2 at 6 Gigabits per second (Gbps), the two devices could be coupled by a single 6 Gbps link (though this speed is not currently available through a Fibre Channel port).

[0006] Another technique to transmit a high-speed stream of frames between two devices is to use trunking. As described in U.S. patent application Ser. No. 09/872,412, trunking is a technique for sending a stream of frames across multiple links between two devices such that: (1) nearly all of the combined available bandwidth between the two devices can be used; and (2) frames are delivered to the receiving device in order. For example, if data needs to be moved from device-1 to device-2 at 6 Gigabits per second (Gbps), the two devices could be coupled by 3 trunked 2 Gbps links or 6 trunked 1 Gbps links. Trunking allows the creation of logical high-speed links from a plurality of slower-speed links without violating the in-order delivery requirement of most Fibre Channel devices.

[0007] To take full advantage of individual high-speed links from within a network also having slower-speed links, as well as to facilitate communicating with devices coupled to a fabric via links having higher bandwidth than intra-fabric links, a means of converting between trunked transmission and single link transmission is needed.

SUMMARY OF INVENTION

[0008] In one embodiment the invention provides a device for converting a single stream of data frames to a trunked transmission of data frames. The device includes an interface circuit adapted to receive frame data associated with a first virtual circuit and a second virtual circuit, a first storage adapted to receive (from the interface circuit) frame data associated with the first virtual circuit, a second storage adapted to receive (from the interface circuit) frame data associated with the second virtual circuit, a plurality of Fibre Channel ports communicatively coupled to the first and second storage, and a control means for routing frame data from the first storage to at least two of the Fibre Channel ports and for routing frame data from the second storage to at least one of the Fibre Channel ports, wherein the Fibre Channel ports receiving frame data from the first storage are different from the at least one Fibre Channel port receiving frame data from the second storage.

[0009] In another embodiment, the invention provides a device for converting a trunked stream of data frames to a single stream of data frames. The device includes a plurality of Fibre Channel ports adapted to receive frame data, storage adapted to receive frame data, an interface circuit adapted to transmit frame data, and a control means for routing frame data from each of the plurality of Fibre Channel ports to the storage and for routing frame data from the storage to the interface circuit, wherein frame data is routed from the storage to the interface circuit in the same order it was received at the storage from the plurality of Fibre Channel ports.

[0010] In yet another embodiment, the invention provides a method to process data frames received through a high-speed link employing multiple buffers and a prioritization scheme. In still other embodiments, the invention provides switches and Fibre Channel networks capable of converting between trunked and un-trunked communications.

BRIEF DESCRIPTION OF THE DRAWINGS

[0011] FIG. 1 shows, in block diagram form, an illustrative prior art Fibre Channel network.

[0012] FIG. 2 shows, in block diagram form, a device in accordance with one embodiment of the invention.

[0013] FIG. 3 shows an illustrative internal frame format for a device in accordance with one embodiment of the invention.

[0014] FIG. 4 shows, in block diagram form, the device of FIG. 2 in one operational configuration.

[0015] FIG. 5 shows a flow chart of a data frame egress operation for a device in accordance with FIG. 4.

[0016] FIG. 6 shows, in block diagram form, the device of FIG. 2 in another operational configuration.

[0017] FIG. 7 shows, in block diagram form, a device in accordance with yet another embodiment of the invention.

[0018] FIG. 8 shows, in block diagram form, a Fibre Channel network in accordance with one embodiment of the invention.

[0019] FIG. 9 shows, in block diagram form, a Fibre Channel network in accordance with another embodiment of the invention.

DETAILED DESCRIPTION

[0020] The invention relates generally to data transmission and, more particularly but not by way of limitation, to devices for converting between the trunked transmission of data frames and the transmission of data frames over a single link. The following embodiments of the invention, described in terms of a Fibre Channel network, are illustrative only and are not to be considered limiting in any respect.

[0021] FIG. 2 shows a high-level block diagram for a device in accordance with one embodiment of the invention. As shown, device 200 may be communicatively coupled to a fabric (not shown) by up to four Fibre Channel gigabit port circuits 205 through 220 (identified as ports GP0 through GP3 or, collectively GP ports) and to one high-speed port circuit 225 (identified as port P10G). For example, GP ports 205 through 220 may each operate independently at 1, 2 or 3 gigabits per second (Gbps) and port P10G 225 may implement a four-lane 10 Gbps attachment unit interface (XAUI) circuit. During conversion operations in accordance with the invention, device 200 may manage the flow of frames in two directions: egress (from GP ports to port P10G) and ingress (from port P10G to GP ports).

[0022] In the egress direction, device 200 operates as a FIFO transmitting all frames received from GP ports 205-220 through transmit buffer TX_BUFFER 230 and transmit circuit TX_CKT 235 to port P10G 225 in exactly the same order as they are received at the GP ports. In this mode of operation, device 200 does not prioritize frame traffic based on virtual circuit identifier (VC_ID) or path number (PN). In particular, the PN of an egress frame is assigned by TX_BUFFER 230 based on the source GP and passed through TX_CKT 235 to port P10G 225. As used herein, a PN identifies a bidirectional data path through device 200 and VC identifies a specific virtual (i.e., logical) circuit within a stream of frames associated with a single PN.

[0023] In the ingress direction, RX_BUFFER 245 stores every frame received by port P10G 225 (through RX_CKT circuit 240) in one of up to four segments, mapping each segment to one or more destination GP ports. Specifically, frames can be mapped to the one or more segments within RX_BUFFER 245 based on VC and PN identifiers. Thus, because frames are routed to RX_BUFFER 245 segments based on VC and PN and further because frames are transmitted out of each segment in the order in which they are received therein (that is, each segment may be organized as a FIFO), frame ordering within VC and PN can be maintained.

[0024] In one embodiment, port P10G 225 and each GP port (205-220) may be independently configured to operate as an E_Port (a label used to identify a switch-to-switch, or intra-fabric, port) or F_Port (a label used to identify a fabric port coupled to a single device such as a server, workstation, database or storage unit). Each port circuit, therefore, may independently utilize Fibre Channel ARB primitives before transmitting a data frame to identify the relevant virtual channel; as described in Ser. No. 09/929,627 entitled “Quality of Service Using Virtual Channel Translation” by David C. Banks and Alex Wang, filed Aug. 13, 2001, which is hereby incorporated by reference; and VC_RDY primitives for flow control to indicate if the particular virtual channel can receive or transmit data packets. In one particular embodiment, F_Ports operate with a single VC identifier (e.g., VC_ID=0) while E_Ports support up to 12 virtual circuits (VC_ID=0 to 11). In addition, port P10G 225's ARB and VC_RDY messages may have an associated Path Number (PN) and Virtual Channel (VC), while each GP port 205-220 may have associated only a VC.

[0025] In the embodiment of FIG. 2:

[0026] 1. Port circuit 225 implements the functionality of a bi-directional four-lane XAUI port as defined by the developing ANSI T11 10GFC standard, which references the IEEE P802.3ae standard and provides enhancements and modifications for Fibre Channel operation. Port circuit 225 may further comprise SERializing/DESerializing (SERDES) circuitry to receive serial input and to provide serial output.

[0027] 2. Receive circuit RX_CKT 240 provides an interface between port circuit 225 and receive buffer RX_BUFFER 245. Inter alia, RX—CKT 240 (1) converts ingress data frames into device specific format (see discussion below and FIG. 3), (2) contains an elasticity FIFO to synchronize data received from port circuit 225 at the port circuit's clock rate, to the clock rate of the buffer RX_BUFFER 245, (3) performs CRC check on received frames and, in the case of an error, invalidates the frame, (4) performs frame size under-run and over-run checks and, in the case of an error, tags the frame with an error code of “abort frame,” and (5) captures received ARB/VC ordered sets preceding a frame to determine the associated virtual channel number that is passed to receive buffer RX_BUFFER 245.

[0028] 3. Receive buffer RX_BUFFER 245 provides segmented buffer space for frames received from port circuit 225. Inter alia, RX_BUFFER 245 (1) buffers data received from port circuit 225, (2) transmits buffered frames to a designated GP port based on path number, and (3) checks aging of buffered frames and invalidates those frames that are timed out. In one particular embodiment, RX_BUFFER 245's segmented buffer comprises 1.3 million bytes of data storage and has a bandwidth of 20.4 Gbps when operated at a clock speed of 159.375 MHz (see discussion below and Table 6).

[0029] 4. Fibre channel gigabit ports 205-220 provide conventional Fibre Channel port functionality. Each port may be separately configured to operate as an independent port or as one port in a trunked group of ports. In addition, each port may incorporate SERDES circuitry.

[0030] 5. Transmit buffer TX_BUFFER 230 provides speed matching buffering for frames received by any of GP ports 205-220 (at a GP port clock rate) on their way to port circuit 225 (operated at the TX_CKT 235 and port circuit 225's clock rate). TX_BUFFER 230 receives and transmits all data frames using device 200's internal frame format (see discussion below and FIG. 3).

[0031] 6. Transmit circuit TX_CKT 235 provides an interface between transmit buffer 230 and port circuit 225. Inter alia, TX_CKT 235 (1) converts egress data frames from internal device format to standard Fibre Channel format (see discussion below and FIG. 3), (2) performs CRC check on out-going frames and, in the case of an error, invalidates the frame, and (3) when enabled, transmits ARB/VC ordered sets preceding a frame to identify the associated virtual channel.

[0032] The RX_BUFFER 245 and TX_BUFFER 230 are configured to enable in-order delivery of frames. Generally the RX_BUFFER 245 is organized physically as a single FIFO or circular buffer so that frames are stored in-order. Egress logic then monitors the GP ports 205-220 for virtual channel credit availability and properly reads the frames from the RX_BUFFER 245 in-order for each GP port 205-220. The TX_BUFFER 230 is preferably organized as four buffers, one per GP port, each buffer being a circular buffer. A separate ordering FIFO is used to record order entry of frames into the four buffers. Egress from the TX_BUFFER 230 is based on entries from the ordering FIFO.

[0033] Frames passing though device 200 may be formatted in accordance with FIG. 3 and routed using Fibre Channel ARB and VC_RDY primitives. In one embodiment, device 200's internal frame format 300 is the same as the standard Fibre Channel frame format except for its start of frame (ISOF field 305) and end of frame (IEOF field 310) fields. Table 1 defines ISOF field 305 and Table 2 defines IEOF field 310. Tables 3 through 5 illustrate the Fibre Channel ARB and VC_RDY primitives as used in the preferred embodiment in E_Port mode. The ARB and VC_RDY primitives are not defined by the ANSI standards for E_Port mode use, but are used in the preferred embodiment in that mode for the operations described herein.

TABLE 1
Illustrative ISOF Field Definition
Bits  Function
31:28 The one's complement of bits 27:24. This value is
      checked before a frame is transmitted out of device 200
      and the frame is invalidated if there is a
      mismatch.
27:24 Encodes the Fibre Channel start of frame (SOF) type.
23:10 Reserved.

[0034]

TABLE 2
Illustrative IEOF Field Definition
Bits  Function
31:30 Frame error code: NO_ERR if no error is detected; INV_FRM to signify an
      invalid frame because, for example, of a frame CRC error, EOF type
      mismatch, RX_BUFFER 245 timeout; and ABRT_FRM to signify an abort
      frame error because, for example, the frame size is less than 36 bytes or
      greater than 2148 bytes or because of a device 200 internal data path parity error.
29:27 The one's complement of bits 26:24. This value is checked before a frame is
      transmitted out of device 200 and the frame is invalidated if there is a
      mismatch.
26:24 Encodes the Fibre Channel end of frame (EOF) type.
23:22 Reserved.
21:20 Path Number (PN) which generally equates to Source Fibre Channel port
      (GP0-GP3) identifier. When a frame is received by one of GP ports 205-220,
      this field identifies the port. When a frame is received by port P10G 225
      in the trunked mode, this field is forced to ‘00b.’ When a frame is received
      by port P10G 225 in the non-trunked mode, this field identifies which port in
      the externally transmitting device sent the frame.
19:16 Virtual channel identifier.
15:0  Encodes the sequence number associated with the frame. The sequence
      number is used by RX_BUFFER 245 to ensure that frames associated with a
      given source port and virtual channel are transmitted in the same order as
      they are received. For each source port and virtual channel, this field can be
      incremented by one for each frame received by RX_BUFFER 245. Other
      functional blocks within device 200 may ignore this field.

[0035]

TABLE 3
ARB and VC_RDY primitives Transmitted/Received
by Ports GP0-GP3 in E_Port Mode
	Primitive	Format
	ARB	K28.5	D20.4	VC_ID	VC_ID
	VC_RDY	K28.5	D21.7	VC_ID	VC_ID

[0036]

TABLE 4
ARB and VC_RDY primitives Transmitted/Received
by Port P10G in E_Port Mode
	Primitive	Format
	ARB	K28.2	D20.4	PN_VC	PN_VC
	VC_RDY	K28.2	D21.7	PN_VC	PN_VC

[0037] Where the PN_VC format can be an 8-bit field defined as shown in Table 5.

TABLE 5
PN_VC Field Format
Bits Function
7:6  Path number.
5:4  Reserved.
3:0  Virtual channel identifier.

[0038] For the particular embodiment of FIG. 2, Table 6 shows typical clock speeds and throughput rates for each GP port 205-220 and port P10G 225. (Each of GP0-GP3 may have its clock speed set independent of the other ports.)

TABLE 6
Supported Data Rates for the Embodiment of FIG. 2
	Fibre	Fibre	Data	Combined
	Channel	Channel Port	Rate Per GP	GP Port Data
	Port Type	Clock (MHz)	Port (Gbps)	Rate (Gbps)
	1 Gigabit	53.126	0.85	3.4
	2 Gigabit	106.25	1.7	6.8
	3 Gigabit	159.375	2.55	10.2

[0039] Referring to FIG. 4, in one embodiment device 200 may be configured such that all four GP ports 205-220 are trunked and port P10G 225 is coupled to a 10 Gbps XAUI compatible device. Accordingly, all ports (GP0-GP3 and P10G) are configured as E_Ports and the memory associated with RX_BUFFER 400, which may be implemented as one physical memory space, may be partitioned into two segments:

[0040] 1. A relatively large segment 405 (configured as a FIFO) for ingress frames belonging to a specified virtual circuit. Frame data is throttled into segment 405 in accordance with Fibre Channel “credit” flow control mechanisms. Preferably the large segment 405 is the remainder of the RX_BUFFER 400 after providing space for a small segment 410 described next. Receive buffers for the specified virtual circuit are allocated in segment 405 and advertised to the external transmitting device. (Additional receive buffers residing in a device(s) coupled to one or more of GP ports 205-220 may also be advertised to the external transmitting device.)

[0041] 2. A relatively small segment 410 (configured as a FIFO) that has only a small number of any allocated receive buffers but does not advertise or indicate any credits associated with those buffers. Segment 410 may be used for ingress frames belonging to all other virtual circuits. The amount of the RX_BUFFER 400 reserved for the small segment 410 is based on the number of credits for the GP ports 205-220, the frame rates of the GP Ports 205-220 and the P10G port 225, the number of frames temporarily buffered, the number of RDYs sent and other relevant factors. In most cases the size is less than 100 k bytes.

[0042] Segment 410 can act as a temporary FIFO: receive buffers for the associated virtual circuits are allocated in the appropriate devices coupled to GP ports 205-220, and flow control between the externally transmitting device and these GP coupled devices ensures that the external device sends a frame to this segment only if the GP coupled device has a receive buffer for it. (This mechanism implements the Fibre Channel proscribed “credit” system of flow control.) A frame in segment 410 is forwarded to the appropriate GP port coupled device as soon as possible so that it does not block other frames behind it in the segment. Accordingly, segment 410 should have a higher priority for transmitting data through Fibre Channel port circuits 205-220 than segment 405. In addition, if the combined GP port data rate (see Table 6) is less than the 10 Gigabit rate of the P10G port 225, segment 410 should be large enough to provide temporary buffering to accommodate for the speed difference. For example, if each GP port is running at 2 Gbps, the combined GP port data rate is approximately 6.8 Gbps versus 10.2 for the P10G port-a ratio of about 2:3 (see Table 6). If 4 virtual circuits are mapped to segment 410 and the devices coupled to GP ports 205-225 advertise 16 buffers per virtual circuit, then the externally transmitting device can send up to 64 maximum sized buffers into segment 410 at a rate of 10.2 Gbps. However, frames can only be sent from segment 410 at a rate of 6.8 Gbps. Thus, the minimum size for segment 410 to prevent an overrun is (64×1/3), or 21.3 maximum frame sizes (plus some margin to accommodate for a minimum inter-frame gap size at port P10G 225 and a maximum frame gap size at GP ports 205-220).

[0043] The RX_BUFFER 400 is organized in the same manner as RX_BUFFER 245, except that the additional segmentation of the RX_BUFFER 245 is not required to be tracked.

[0044] One method to process ingress data frames in accordance with the embodiment of FIG. 4 is shown in FIG. 5. As a frame is received through port circuit 225 (block 500), a determination is made as to which virtual circuit the frame is associated with. If the frame is not associated with the specified virtual circuit (the “no” prong of diamond 505), it is buffered in segment 410 (block 515). If the frame is associated with the specified virtual circuit (the “yes” prong of diamond 505), it is buffered in segment 405 (block 515). If segment 410 does not contain a full frame (the “no” prong of diamond 520), a frame from segment 405 is routed to the appropriate Fibre Channel port (block 525). If segment 410 does contain a full frame (the “yes” prong of diamond 520), a frame from segment 410 is routed to the appropriate Fibre Channel port (block 530). While the illustrated process indicates the operations on a single frame, it is understood that this process is repeated as necessary until all received frames have been routed to the appropriate Fibre Channel port.

[0045] Additionally, it is understood that frames can be provided from segment 410 before segment 405 even if a full frame has not been received because the frame rate from port P10G 225 is higher than the combined frame rates for GP ports 205-220 when the GP ports 205-220 are at 1 and 2 Gbps rates. In those cases the test of diamond 520 could be changed to “Frame being written to segment 410?” Additional priority variations can also be developed.

[0046] Referring to FIG. 6, in another embodiment of device 200, port P10G 225 is configured as an E_Port and each of GP ports 205-220 are configured as non-trunked F_Ports. In this embodiment, the memory associated with RX_BUFFER 600 may be partitioned into four segments 605, 610, 615 and 620. In this configuration, each of segments 605-620 implement a FIFO structure and are dedicated to an associated Fibre Channel port. (One of ordinary skill in the art will recognize that two or more of segments 605-620 may be physically embodied in a single memory device.) An egress frame received by device 200 in this configuration is transmitted through port P10G 225 with its PN value using the Fibre Channel ARB primitive. An ingress frame received by device 200 in this configuration is passed through with its PN value and transmitted by the associated Fibre Channel port.

[0047] While FIGS. 4 and 6 illustrate two embodiments of device 200, one of ordinary skill in the art will recognize not all functions needed to implement a viable device have been shown. For example, it will be recognized that multiple clocking signals may be needed to implement device 200 but that the existence and variety of such clocking signals (forming different clock domains) would be known to those of ordinary skill. In addition, various other embodiments of device 200 may include additional circuits. Referring to FIG. 7, for example, device 700 designed to implement the functions described herein may also include one or more circuits such as:

[0048] 1. Flow control management circuit FLOW_CKT 705 for managing buffer-to-buffer credits (the Fibre Channel flow mechanism) for both the egress and ingress directions.

[0049] 2. Statistics acquisition and monitoring circuit STAT_CKT 710 for recording frame traffic statistics such as, for example, the number of frames passing though a specified Fibre Channel port, the number of CRC errors occurring on frames passing through a specified port, etc.

[0050] 3. Low-level port circuit LLI_P10G 715 for control of the management data (MDIO) interface in accordance with the IEEE 802.3ae standard and the sideband signals of the 10G PHY layer components.

[0051] 4. Low-level Fibre Channel port interface LLI_GP 720 for communication with internal status and control registers within each Fibre Channel port circuit 205-220.

[0052] It will be recognized by one of ordinary skill in the art that a device in accordance with the invention may include more or fewer than four Fibre Channel port circuits and, perhaps, more than one high-speed circuit such as port circuit 225. It will also be recognized by those of ordinary skill in the art that while port circuit 225 has been described in terms of an IEEE compliant XAUI interface, it may be virtually any interface such as XGMII. Similarly, it will be recognized that any device such as device 200 may utilize special registers (e.g., “global registers”) to identify certain operational characteristics of the components therein. For example, there may be registers to indicate the path number for each GP port acting as a data frame source (egress operations) and additional registers to identify the path number for each GP port acting as a data frame destination (ingress operations).

[0053] It will further be recognized that a device in accordance with the invention may be one component in a larger system. For example, FIG. 8 illustrates Fibre Channel network 800 having conversion unit 805 for coupling fabric 810 (itself comprising Fibre Channel switches, not shown) to high-speed device 815 (e.g., a XAUI compliant device). As shown, conversion unit 805 itself comprises circuit 820 in accordance with one of FIGS. 2, 4, 6 and 7, CPU module 825, memory 830 and interface circuit 835 for communicating with control processor 840 via bus 845. CPU module 825 is typically used, along with local memory 830, to configure and initialize conversion unit 805 via bus 822, which may be a PCI bus. CPU module 825 and memory 830 may also be used during operations to query the state of conversion unit 805, obtain real-time operating data, for hardware and software debugging purposes and to provide other control functions for the circuit 820. Interface circuit 835 is connected to the bus 822 and provides an interface between an external control computer 840 and the conversion unit 805. Interface circuit 835 may provide one or more desired electrical interfaces such as, for example, RS-232, RS-422 or Ethernet connectivity to the bus 822. Accordingly, bus 845 may be any bus compatible with interface circuit 835. Control computer 840 provides administrator level control of the conversion unit 805.

[0054] Alternatively, the circuit 820 could be installed inside a Fibre Channel switch and connected internally to lower speed Fibre Channel ports contained inside the switch. For example, a card installed in the switch might have 16 ports in an all lower speed embodiment, but if circuit 820 is included on the same card, four of the ports would be internally connected to the circuit 820, so that the card would then have 12 lower speed ports and one high speed port interface.

[0055] FIG. 9 shows Fibre Channel network 900 in accordance with another embodiment of the invention. In this embodiment, conversion circuit 905 is incorporated within one or more Fibre Channel switches (e.g., 910, 915, and 920) forming fabric 925. Conversion circuit 905 may embody a device in accordance with one of FIGS. 2, 4, 6 and 7 or conversion circuit 805. Accordingly, switch 910 (via conversion circuit 905) may couple device 930 (e.g., a XAUI compliant device) to fabric 925. Links 935 and 940 between switch 910 and switches 920 and 915, respectively, are preferably trunked Fibre Channel links, but could be single Fibre Channel links.

[0056] Various changes in the illustrated embodiments are possible without departing from the scope of the claims. For example, devices in accordance with any of FIGS. 2 through 9 may be implemented in a number of ways including, but not limited to, Application Specific Integrated Circuits (ASICs), Field Programmable Gate Arrays (FPGAs), one or more operatively coupled microcontrollers or microprocessors and discrete logic, or a combination of one or more of these technologies. In addition, buffer circuits in accordance with 230, 245, 400 and 600 may be implemented using any convenient storage technology including, but not limited to random access memories (RAMs), Flash devices, Electrically Erasable Programmable Read Only Memory (EEPROM) devices and Programmable Read Only Memory (PROM) devices. In addition, acts in accordance with FIG. 5 may be performed by a programmable control device executing instructions organized into a program module. A programmable control device may be a single computer processor, a plurality of computer processors coupled by a communications link, or a custom designed state machine. Custom designed state machines may be embodied in a hardware device such as a printed circuit board comprising discrete logic, integrated circuits, or specially designed application specific integrated circuits (ASICs). Storage devices suitable for tangibly embodying program instructions include all forms of non-volatile memory including, but not limited to: semiconductor memory devices such as Electrically Programmable Read Only Memory (EPROM), Electrically Erasable Programmable Read Only Memory (EEPROM), and flash devices.

[0057] Thus, while the invention has been disclosed with respect to a limited number of embodiments, numerous modifications and variations will be appreciated by those skilled in the art. It is intended, therefore, that the following claims cover all such modifications and variations that may fall within the true sprit and scope of the invention.

Claims

1. A device, comprising: a first interface circuit adapted to receive frame data; first storage adapted to receive, from the first interface circuit, frame data; a plurality of Fibre Channel ports communicatively coupled to the first storage; and a control means for routing frame data from the first storage to at least two of the Fibre Channel ports, wherein frame data is routed from the first storage to the at least two Fibre Channel ports in the same order it was received at the first storage as appropriate for each of the at least two Fibre Channel ports.

2. The device of claim 1, wherein at least two Fibre Channel ports are trunked.

3. The device of claim 2, wherein the first storage includes a first segment and a second segment.

4. The device of claim 3, wherein the frame data can be associated with a first virtual circuit or a second virtual circuit and wherein frame data associated with the first virtual circuit is routed to the first segment and frame data associated with the second virtual circuit is routed to the second segment.

5. The device of claim 3, wherein the first segment is substantially larger than the second segment.

6. The device of claim 3, wherein the control means is further adapted to route frame data from the second segment to the at least two Fibre Channel ports in preference to routing frame data from the first segment to the at least two Fibre Channel ports.

7. The device of claim 1, wherein the first storage includes a first segment and a second segment.

8. The device of claim 7, wherein the frame data can be associated with a first virtual circuit or a second virtual circuit and wherein frame data associated with the first virtual circuit is routed to the first segment and frame data associated with the second virtual circuit is routed to the second segment.

9. The device of claim 7, wherein the first segment is substantially larger than the second segment.

10. The device of claim 7, wherein the control means is further adapted to route frame data from the second segment to the at least two Fibre Channel ports in preference to routing frame data from the first segment to the at least two Fibre Channel ports.

11. The device of claim 1, wherein the at least two Fibre Channel ports are not trunked.

12. The device of claim 11, wherein the first storage includes a segment for each of the at least two Fibre Channel ports.

13. The device of claim 1, wherein the first storage includes a segment for each of the at least two Fibre Channel ports.

14. The device of claim 1, wherein said plurality of Fibre Channel ports comprise four Fibre Channel ports.

15. The device of claim 1, further comprising: third storage; a second interface circuit; and a processor circuit operatively coupled to the third storage and the second interface circuit, the processor circuit adapted to communicate with one or more devices through the second interface circuit and to initialize the plurality of Fibre Channel ports.

16. The device of claim 15, wherein the second interface circuit is adapted to transmit and receive signals over a Peripheral Component Interconnect bus.

17. The device of claim 1, further comprising a control circuit adapted to manage Fibre Channel frame data flow control.

18. The device of claim 1, wherein the first interface circuit comprises a 10 Gigabit attachment unit interface (XAUI) circuit.

19. The device of claim 1, wherein the first storage is configured as a FIFO.

20. A device, comprising: a plurality of Fibre Channel ports adapted to receive frame data; first storage adapted to receive frame data; a first interface circuit adapted to transmit frame data; and a control means for routing frame data from each of the plurality of Fibre Channel ports to the first storage and for routing frame data from the storage to the first interface circuit, wherein frame data is routed from the first storage to the first interface circuit in the same order it was received at the first storage from the plurality of Fibre Channel ports.

21. The device of claim 20, wherein the interface circuit comprises a 10 Gigabit attachment unit interface (XAUI) circuit.

22. The device of claim 20, wherein the storage is configured as a FIFO.

23. The device of claim 20, wherein the plurality of Fibre Channel ports comprise four Fibre Channel ports.

24. The device of claim 20, further comprising: second storage; a second interface circuit; and a processor circuit operatively coupled to the second storage and the second interface circuit, the processor circuit adapted to communicate with one or more devices through the second interface circuit and to initialize the plurality of Fibre Channel ports.

25. The device of claim 24, wherein the second interface circuit is adapted to transmit and receive signals over a Peripheral Component Interconnect bus.

26. The device of claim 20, further comprising a control circuit adapted to manage Fibre Channel frame data flow control.

27. A Fibre Channel switch, comprising: a plurality of Fibre Channel ports adapted to receive and transmit frame data; a first interface circuit adapted to receive and transmit frame data; first storage adapted to receive, from the first interface circuit, frame data; second storage adapted to receive, from at least one of the plurality of Fibre Channel ports, frame data; a first control circuit adapted to route frame data from the first storage to at least two of the Fibre Channel ports, and for routing frame data from the second storage to at least one of the Fibre Channel ports, wherein frame data is routed from the first storage to the at least two Fibre Channel ports in the same order it was received at the first storage as appropriate for each of the at least two Fibre Channel ports; and a second control circuit adapted to route frame data from each of the plurality of Fibre Channel ports to the second storage and for routing frame data from the second storage to the first interface circuit, wherein frame data is routed from the second storage to the first interface circuit in the same order it was received at the second storage from the plurality of Fibre Channel ports.

28. The Fibre Channel switch of claim 27, wherein the first interface circuit comprises a 10 Gigabit attachment unit interface (XAUI) circuit.

29. The Fibre Channel switch of claim 27, wherein the first and second storages are configured as FIFOs.

30 The Fibre Channel switch of claim 27, wherein at least two Fibre Channel ports are trunked.

31. The Fibre Channel switch of claim 30, wherein the first storage includes a first segment and a second segment.

32. The Fibre Channel switch of claim 31, wherein the frame data can be associated with a first virtual circuit or a second virtual circuit and wherein frame data associated with the first virtual circuit is routed to the first segment and frame data associated with the second virtual circuit is routed to the second segment.

33. The Fibre Channel switch of claim 31, wherein the first segment is substantially larger than the second segment.

34. The Fibre Channel switch of claim 31, wherein the first control circuit is further adapted to route frame data from the second segment to the at least two Fibre Channel ports in preference to routing frame data from the first segment to the at least two Fibre Channel ports.

35. The Fibre Channel switch of claim 27, wherein the first storage includes a first segment and a second segment.

36. The Fibre Channel switch of claim 35, wherein the frame data can be associated with a first virtual circuit or a second virtual circuit and wherein frame data associated with the first virtual circuit is routed to the first segment and frame data associated with the second virtual circuit is routed to the second segment.

37. The Fibre Channel switch of claim 35, wherein the first segment is substantially larger than the second segment.

38. The Fibre Channel switch of claim 35, wherein the first control circuit is further adapted to route frame data from the second segment to the at least two Fibre Channel ports in preference to routing frame data from the first segment to the at least two Fibre Channel ports.

39. The Fibre Channel switch of claim 27, wherein the at least two Fibre Channel ports are not trunked.

40. The Fibre Channel switch of claim 39, wherein the first storage includes a segment for each of the at least two Fibre Channel ports.

41. The Fibre Channel switch of claim 27, wherein the first storage includes a segment for each of the at least two Fibre Channel ports.

42. The Fibre Channel switch of claim 27, wherein the plurality of Fibre Channel ports comprise four Fibre Channel ports.

43. The Fibre Channel switch of claim 27, further comprising: third storage; a second interface circuit; and a processor circuit operatively coupled to the third storage and the second interface circuit, the processor circuit adapted to communicate with one or more devices through the second interface circuit and to initialize the plurality of Fibre Channel ports.

44. The Fibre Channel switch of claim 43, wherein the second interface circuit is adapted to transmit and receive signals over a Peripheral Component Interconnect bus.

45. The Fibre Channel switch of claim 27, further comprising a third control circuit adapted to manage Fibre Channel frame data flow control.

46. A Fibre Channel network comprising: a first switch having: a plurality of Fibre Channel ports adapted to receive and transmit frame data; a first interface circuit adapted to receive and transmit frame data; first storage adapted to receive, from the first interface circuit, frame data associated with a first virtual circuit; second storage adapted to receive, from at least one of the plurality of Fibre Channel ports, frame data; a first control circuit adapted to route frame data from the first storage to at least two of the Fibre Channel ports, and for routing frame data from the second storage to at least one of the Fibre Channel ports, wherein frame data is routed from the first storage to the at least two Fibre Channel ports in the same order it was received at the first storage as appropriate for each of the at least two Fibre Channel ports; and a second control circuit adapted to route frame data from each of the plurality of Fibre Channel ports to the second storage and for routing frame data from the second storage to the first interface circuit, wherein frame data is routed from the second storage to the first interface circuit in the same order it was received at the second storage from the plurality of Fibre Channel ports; and a high-speed serial device having a high speed serial link connected to the first interface circuit.

47. The Fibre Channel network of claim 46, wherein the first interface circuit comprises a 10 Gigabit attachment unit interface (XAUI) circuit.

48. The Fibre Channel network of claim 46, wherein the first and second storage are configured as FIFOs.

49. The Fibre Channel network of claim 46, wherein at least two Fibre Channel ports are trunked.

50. The Fibre Channel network of claim 47, wherein the first storage includes a first segment and a second segment.

51. The Fibre Channel network of claim 50, wherein the frame data can be associated with a first virtual circuit or a second virtual circuit and wherein frame data associated with the first virtual circuit is routed to the first segment and frame data associated with the second virtual circuit is routed to the second segment.

52. The Fibre Channel network of claim 50, wherein the first segment is substantially larger than the second segment.

53. The Fibre Channel network of claim 50, wherein the first control circuit is further adapted to route frame data from the second segment to the at least two Fibre Channel ports in preference to routing frame data from the first segment to the at least two Fibre Channel ports.

54. The Fibre Channel network of claim 46, wherein the first storage includes a first segment and a second segment.

55. The Fibre Channel network of claim 54, wherein the frame data can be associated with a first virtual circuit or a second virtual circuit and wherein frame data associated with the first virtual circuit is routed to the first segment and frame data associated with the second virtual circuit is routed to the second segment.

56. The Fibre Channel network of claim 55, wherein the first segment is substantially larger than the second segment.

57. The Fibre Channel network of claim 56, wherein the first control circuit is further adapted to route frame data from the second segment to the at least two Fibre Channel ports in preference to routing frame data from the first segment to the at least two Fibre Channel ports.

58. The Fibre Channel network of claim 46, wherein the at least two Fibre Channel ports are not trunked.

59. The Fibre Channel network of claim 58, wherein the first storage includes a segment for each of the at least two Fibre Channel ports.

60. The Fibre Channel network of claim 46, wherein the first switch further comprises: third storage; a second interface circuit; and a processor circuit operatively coupled to the third storage and the second interface circuit, the processor circuit adapted to communicate with one or more devices through the second interface circuit and to initialize a Fibre Channel port.

61. The Fibre Channel network of claim 60, wherein the second interface circuit is adapted to transmit and receive signals over a Peripheral Component Interconnect bus.

62. The Fibre Channel network of claim 46, wherein the first switch further comprises a third control circuit adapted to manage Fibre Channel frame data flow control.

63. A method to convert reception of data frames from a serial link to a transmission of data frames on at least two Fibre Channel links, comprising: receiving a plurality of data frames from a serial link; storing the plurality of data frames in a first storage; transmitting the plurality of data frames through at least two Fibre Channel ports, wherein each frame is transmitted in the same order they were received as appropriate for each of the at least two Fibre Channel ports.

64. The method of claim 63, wherein the act of receiving comprises receiving data frames through a 10 Gigabit attachment unit interface (XAUI) interface circuit.

65. The method of claim 63, wherein the act of storing comprises storing into a FIFO memory.

66. The method of claim 63, wherein the at least two Fibre Channel ports are trunked.

67. The method of claim 66, wherein the first storage includes a first segment and a second segment.

68. The method of claim 67, wherein the frame data can be associated with a first virtual circuit or a second virtual circuit and wherein frame data associated with the first virtual circuit is routed to the first segment and frame data associated with the second virtual circuit is routed to the second segment.

69. The method of claim 67, wherein the first segment is substantially larger than the second segment.

70. The method of claim 67, wherein frame data from the second segment to the at least two Fibre Channel ports is routed in preference to frame data from the first segment to the at least two Fibre Channel ports.

71. The method of claim 63, wherein the first storage includes a first segment and a second segment.

72. The method of claim 71, wherein the frame data can be associated with a first virtual circuit or a second virtual circuit and wherein frame data associated with the first virtual circuit is routed to the first segment and frame data associated with the second virtual circuit is routed to the second segment.

73. The method of claim 71, wherein the first segment is substantially larger than the second segment.

74. The method of claim 71, wherein frame data from the second segment to the at least two Fibre Channel ports is routed in preference to frame data from the first segment to the at least two Fibre Channel ports.

75. The method of claim 63, wherein the at least two Fibre Channel ports are not trunked.

76. The method of claim 75, wherein the first storage includes a segment for each of the at least two Fibre Channel ports.

77. The method of claim 63, wherein the first storage includes a segment for each of the at least two Fibre Channel ports.

78. The method of claim 63, further comprising transmitting and receiving signals with an external control unit over a Peripheral Component Interconnect bus.

79. A Fibre Channel switch comprising: a plurality of Fibre Channel ports; a serial link interface; a first buffer operatively coupled to the plurality of fiber channel ports and the serial link interface; a control circuit; and storage, readable by the control circuit, having instructions for causing the control circuit to: receive a plurality of data frames from the serial link interface, store the plurality of data frames in the first buffer, and transmit the plurality of data frames through at least two of the plurality of Fibre Channel ports, wherein each frame is transmitted in the same order that they were received, as appropriate for each of the at least two Fibre Channel ports.

80. The Fibre Channel switch of claim 79, wherein the plurality of Fibre Channel ports comprise 4 Fibre Channel ports.

81. The Fibre Channel switch of claim 79, wherein the serial link interface comprises a 10 Gigabit attachment unit interface (XAUI) interface.

82. The Fibre Channel switch of claim 79, wherein the first buffer comprises FIFO storage.

83. The Fibre Channel switch of claim 79, wherein at least two Fibre Channel ports are trunked.

84. The Fibre Channel switch of claim 83, wherein the first storage includes a first segment and a second segment.

85. The Fibre Channel switch of claim 84, wherein the frame data can be associated with a first virtual circuit or a second virtual circuit and wherein the storage further has instructions for causing the control circuit to route frame data associated with the first virtual circuit to the first segment and route frame data associated with the second virtual circuit to the second segment.

86. The Fibre Channel switch of claim 84, wherein the first segment is substantially larger than the second segment.

87. The Fibre Channel switch of claim 84, wherein the storage further has instructions for causing the control circuit to route frame data from the second segment to the at least two Fibre Channel ports in preference to routing frame data from the first segment to the at least two Fibre Channel ports.

88. The Fibre Channel switch of claim 79, wherein the first storage includes a first segment and a second segment.

89. The Fibre Channel switch of claim 88, wherein the frame data can be associated with a first virtual circuit or a second virtual circuit and wherein the storage further has instructions for causing the control circuit to route frame data associated with the first virtual circuit to the first segment and route frame data associated with the second virtual circuit to the second segment.

90. The Fibre Channel switch of claim 88, wherein the first segment is substantially larger than the second segment.

91. The Fibre Channel switch of claim 88, wherein the storage further has instructions for causing the control circuit to route frame data from the second segment to the at least two Fibre Channel ports in preference to routing frame data from the first segment to the at least two Fibre Channel ports.

92. The Fibre Channel switch of claim 79, wherein the at least two Fibre Channel ports are not trunked.

93. The Fibre Channel switch of claim 92, wherein the first storage includes a segment for each of the at least two Fibre Channel ports.

94. The Fibre Channel switch of claim 79, wherein the first storage includes a segment for each of the at least two Fibre Channel ports.

95. A Fibre Channel network, comprising: a first Fibre Channel switch having a first plurality of Fibre Channel ports, a serial link interface, a first buffer operatively coupled to the first plurality of Fibre Channel ports and the serial link interface, a first control circuit, and first storage readable by the first control circuit and having instructions for causing the first control circuit to: receive a plurality of data frames from the serial link interface, store the plurality of data frames in the first buffer, and transmit the plurality of data frames through at least two of the first plurality of Fibre Channel ports, wherein each frame is transmitted in the same order it was received as appropriate for each of the at least two Fibre Channel ports; and a second Fibre Channel switch having a second plurality of fiber channel ports, wherein at least one of the second plurality of Fibre Channel ports is operatively coupled to the at least one of the first plurality of Fibre Channel ports, a second control circuit, and second storage readable by the second control circuit and having instructions for causing the second control circuit to receive data frames from the second plurality of Fibre Channel ports.

96. The Fibre Channel network of claim 95, wherein the serial link interface comprises a 10 Gigabit attachment unit interface (XAUI).

97. The Fibre Channel network of claim 95, wherein the first buffer comprises FIFO storage.

98. The Fibre Channel network of claim 95, wherein each of the first and second plurality of Fibre Channel ports comprise at least four Fibre Channel ports.

99. The Fibre Channel network of claim 95, wherein at least two Fibre Channel ports are trunked.

100. The Fibre Channel network of claim 99, wherein the first storage includes a first segment and a second segment.

101. The Fibre Channel network of claim 100, wherein the frame data can be associated with a first virtual circuit or a second virtual circuit and wherein the first storage further has instructions for causing the first control circuit to route frame data associated with the first virtual circuit to the first segment and route frame data associated with the second virtual circuit to the second segment.

102. The Fibre Channel network of claim 100, wherein the first segment is substantially larger than the second segment.

103. The Fibre Channel network of claim 100, wherein the first storage further has instructions for causing the first control circuit to route frame data from the second segment to the at least two Fibre Channel ports in preference to routing frame data from the first segment to the at least two Fibre Channel ports.

104. The Fibre Channel network of claim 95, wherein the first storage includes a first segment and a second segment.

105. The Fibre Channel network of claim 104, wherein the frame data can be associated with a first virtual circuit or a second virtual circuit and wherein the first storage further has instructions for causing the first control circuit to route frame data associated with the first virtual circuit to the first segment and route frame data associated with the second virtual circuit to the second segment.

106. The Fibre Channel network of claim 104, wherein the first segment is substantially larger than the second segment.

107. The Fibre Channel network of claim 104, wherein the first storage further has instructions for causing the first control circuit to route frame data from the second segment to the at least two Fibre Channel ports in preference to routing frame data from the first segment to the at least two Fibre Channel ports.

108. The Fibre Channel network of claim 95, wherein the at least two Fibre Channel ports are not trunked.

109. The Fibre Channel network of claim 108, wherein the first storage includes a segment for each of the at least two Fibre Channel ports.

110. The Fibre Channel network of claim 95, wherein the first storage includes a segment for each of the at least two Fibre Channel ports.

111. The Fibre Channel network of claim 95, wherein at least one of the first and second Fibre Channel switches further comprise: memory; an off-switch interface circuit; and a processor circuit operatively coupled to the memory and the off-switch interface circuit, the processor circuit adapted to communicate with one or more devices through the off-switch interface circuit and to initialize a Fibre Channel port.

112. The Fibre Channel network of claim 111 wherein the off-switch interface circuit is adapted to transmit and receive signals over a Peripheral Component Interconnect bus.

113. A method to convert reception of data frames from at least two Fibre Channel links to a transmission of data frames to a serial link, the method comprising: receiving a plurality of data frames from a plurality of Fibre Channel ports; storing the data frames in first storage; and transmitting the plurality of data frames through a serial link, wherein each frame is transmitted in the same order it was received from the plurality of Fibre Channel ports.

114. The method of claim 113, wherein the act of transmitting comprises transmitting data frames through a 10 Gigabit attachment unit interface (XAUI) circuit.

115. The method of claim 113, wherein the act of storing comprises storing in a FIFO.

116. The method of claim 113, wherein at least two Fibre Channel ports are trunked.