1. Field of the Invention
The present invention relates to Fibre Channel networks, and more particularly to a Fibre Channel switch element that can operate at a high speed.
2. Background of the Invention
Fibre Channel is a set of American National Standard Institute (ANSI) standards, which provide a serial transmission protocol for storage and network protocols such as HIPPI, SCSI, IP, ATM and others. Fibre Channel provides an input/output interface to meet the requirements of both Channel and network users.
Fibre Channel supports three different topologies: point-to-point, arbitrated loop and Fibre Channel fabric. The point-to-point topology attaches two devices directly. The arbitrated loop topology attaches devices in a loop. The Fibre Channel fabric topology attaches host systems directly to a fabric, which are then connected to multiple devices. The Fibre Channel fabric topology allows several media types to be interconnected.
In Fibre Channel, a path is established between two nodes where the path's primary task is to transport data from one point to another at high speed with low latency, performing only simple error detection in hardware.
Fibre Channel fabric devices include a node port or “N_Port” that manages fabric connections. The N_port establishes a connection to a fabric element (e.g., a switch) having a fabric port or “F_port”. Fabric elements include the intelligence to handle routing, error detection, recovery, and similar management functions.
A Fibre Channel switch is a multi-port device where each port manages a simple point-to-point connection between itself and its attached system. Each port can be attached to a server, peripheral, I/O subsystem, bridge, hub, router, or even another switch. A switch receives messages from one port and automatically routes it to another port. Multiple calls or data transfers happen concurrently through the multi-port Fibre Channel switch.
Fibre Channel switches use memory buffers to hold frames received and sent across a network. Associated with these buffers are credits, which are the number of frames that a buffer can hold per fabric port.
Current Fibre Channel standards define switch port/link operations to occur at 1 gigabit per second (“G”), 2 G, 4 G and 10 G. However, as bandwidth increases a need for 20 G, 40 G or higher port/link operation will occur. Conventional standards and Fibre Channel switches do not provide Fibre Channel switches that can operate at such high speeds.
Therefore, there is a need for a Fibre Channel switch whose ports can be selected to operate at high speeds, for example, at 10 G, 20 G or 40 G.
In one aspect of the present invention, a high-speed Fibre Channel switch element is provided. The Fibre Channel switch element includes, a rate select module that allows a port in the Fibre Channel switch element to operate at a rate equal to and/or higher than 10 gigabits per second (“G”). The port may operate at 20 G, 40 G or at a rate greater than 40 G.
Also, a cut status is provided for cut-through routing between ports operating at different speed. Plural transmit and receive lines are used for port operation at a rate equal to or higher than 10 G.
In another aspect of the present invention, a Fibre Channel network is provided. The network includes a Fibre Channel switch element including a rate select module that allows a port in the Fibre Channel switch element to operate at a rate equal to and/or higher than 10 G, as described above.
This brief summary has been provided so that the nature of the invention may be understood quickly. A more complete understanding of the invention can be obtained by reference to the following detailed description of the preferred embodiments thereof concerning the attached drawings.
The foregoing features and other features of the present invention will now be described with reference to the drawings of a preferred embodiment. In the drawings, the same components have the same reference numerals. The illustrated embodiment is intended to illustrate, but not to limit the invention. The drawings include the following Figures:
Definitions
The following definitions are provided as they are typically (but not exclusively) used in the Fibre Channel environment, implementing the various adaptive aspects of the present invention.
“E_Port”: A fabric expansion port that attaches to another Interconnect port to create an Inter-Switch Link.
“F_Port”: A port to which non-loop N_Ports are attached to a fabric and does not include FL_ports.
“Fibre Channel ANSI Standard”: The standard (incorporated herein by reference in its entirety) describes the physical interface, transmission and signaling protocol of a high performance serial link for support of other high level protocols associated with IPI, SCSI, IP, ATM and others.
“Fabric”: The structure or organization of a group of switches, target and host devices (NL_Port, N_ports etc.).
“N-Port”: A direct fabric attached port, for example, a disk drive or a HBA.
“NL_Port”: A L_Port that can perform the function of a N_Port.
“Port”: A general reference to N. Sub.-Port or F.Sub.-Port.
“Switch”: A fabric element conforming to the Fibre Channel Switch standards.
To facilitate an understanding of the preferred embodiment, the general architecture and operation of a Fibre Channel switch system/element will be described. The specific architecture and operation of the preferred embodiment will then be described with reference to the general architecture.
Fibre Channel System
The devices of
Switch Element
The fabric element of the present invention is presently implemented as a single CMOS ASIC, and for this reason the term “fabric element” and ASIC are used interchangeably to refer to the preferred embodiments in this specification. Although
ASIC 20 has 20 ports numbered in
For illustration purposes only, all GL ports are drawn on the same side of ASIC 20 in
Each port GL0-GL19 has transmit and receive connections to switch crossbar 50. One connection is through receive buffer 52, which functions to receive and temporarily hold a frame during a routing operation. The other connection is through a transmit buffer 54.
Switch crossbar 50 includes a number of switch crossbars for handling specific types of data and data flow control information. For illustration purposes only, switch crossbar 50 is shown as a single crossbar. Switch crossbar is a connectionless crossbar (packet switch) of known conventional design, sized to connect 21×21 paths. This is to accommodate 20 GL ports plus a port for connection to a fabric controller, which may be external to ASIC 20.
In the preferred embodiments of switch chassis described herein, the fabric controller is a firmware-programmed microprocessor, also referred to as the input/output processor (“IOP”). IOP 66 is shown in
Control register 62 receives and holds control information from IOP 66, so that IOP 66 can change characteristics or operating configuration of ASIC 20 by placing certain control words in register 62. IOP 66 can read status of ASIC 20 by monitoring various codes that are placed in status register 64 by monitoring circuits (not shown).
Each GL_Port may have an optical-electric converter, designated as OE0-OE19 connected with its SERDES through serial lines, for providing fibre optic input/output connections, as is well known in the high performance switch design. The converters connect to switch channels C0-C19. It is noteworthy that the ports can connect through copper paths or other means instead of optical-electric converters.
Details of how switch 20 is operated is provided in U.S. patent application Ser. No. 10/894,587, filed on Jul. 20, 2004, the disclosure of which is incorporated herein by reference in its entirety.
A rate select module 202 is provided that selects a particular speed for a port based on a select speed signal 201 that is generated from the common port 62A. Firmware for switch element 20 may be used to generate signal 201. Module 202 provides the appropriate clock and configuration signals for a 10 G, 20 G, 40 G or port/link operation at any rate.
A port can negotiate with another port to operate at 10 G/20 G/40 G or any other rate. A port may operate at 10 G, 20 G, 40 G, 10 G and 20 G, 20 G and 40 G or any other combination. The negotiation process may be similar to that described in the FC-FS Fibre Channel standard. The ‘RF” primitive may be used to replace the “NOS” primitive, as discussed in FC-FS.
SERDES 204, 205, 206 and 207 converts parallel 10 bit characters into a serial stream on the transmit side (i.e. data to the network) and converts data received by switch element 20 into 10-bit characters. SERDES 204-207 recover clock information from data that is received by a port.
In one aspect of the present invention, for a 20 G operation, 4 serial streams (i.e., four transmit and four receive lanes) (as shown in
For a 40 G operation, 4 serial streams each at 12.75 G may be used. Each lane encodes/decodes a byte of data using 8 B/10 B code. The four lanes are synchronized and aligned, as described in the aforementioned patent application.
It is noteworthy that the invention is not limited to any particular number of serial streams; for example, a single stream may be used to operate a port at 20 G/40 G or any other rate. Also, the serial streams may operate at the same optical wavelength or different wavelengths; one for each serial stream.
SERDES 204-207 clock rates are manipulated to facilitate higher speed operation. Currently the XAUI interface (incorporated herein by reference in its entirety) supports 10 G operation using four transmit and four receive lanes; each lane encoding data with an 8 B/10 B code for differential serial transmission and operating at 3.1875 GigaBaud. To operate at higher speeds, a full rate will be at 12.75 GigaBaud, half rate will be at 6.375 GigaBaud. The full rate, half and quarter rates are selected by module 202, based on signal 201.
Cut-Through Routing at Higher Speeds:
“Cut” bits are a status signal sent from receive to transmit buffers to keep the transmit buffer running as quickly as possible by either guaranteeing that the transmit port either does not run out of data or by allowing the transmit port to re-arbitrate its tags to select a frame source that has the “cut” bit set. The use of cut bits at lower rates (i.e., 1 G, 2 G, 4 G and 10 G) is described in the aforementioned patent application. The Cut Bits may be expanded to include 20 G, 40 G or higher transfer rates.
To reduce latency, a frame is released from a receive buffer, after a certain threshold value is reached. However, if the receive buffer slots become almost full with other frames, then new incoming frames wait for the end of frame (“EOF”). This reduces contention time on shared resources that may occur if the receive buffer is tied up for “cut” through routing.
There are different conditions on cut status depending on what kind of port the Receive Buffer resides in (for example, 10 G/20 G/40 G or any other speed). The selection of cut status also depends on the type of port the Transmit Port resides in. Table I in
In one aspect of the present invention, a port can be configured to operate at different rates. High bandwidth operation is permitted for better performance.
Although the present invention has been described with reference to specific embodiments, these embodiments are illustrative only and not limiting. Many other applications and embodiments of the present invention will be apparent in light of this disclosure and the following claims.
This application is a continuation of application Ser. No. 10/956,501, filed on Oct. 1, 2004, now U.S. Pat. No. 8,295,299, the entire contents of which are hereby incorporated by reference.
Number | Name | Date | Kind |
---|---|---|---|
5751710 | Crowther et al. | May 1998 | A |
5920705 | Lyon et al. | Jul 1999 | A |
6144668 | Bass et al. | Nov 2000 | A |
6185203 | Berman | Feb 2001 | B1 |
6614796 | Black et al. | Sep 2003 | B1 |
20030091062 | Lay et al. | May 2003 | A1 |
20030191883 | April | Oct 2003 | A1 |
20040030766 | Witkowski | Feb 2004 | A1 |
20050099970 | Halliday | May 2005 | A1 |
20080320143 | Di Benedetto et al. | Dec 2008 | A1 |
Number | Date | Country |
---|---|---|
1302160 | Jul 2001 | CN |
1379042 | Jan 2004 | EP |
Entry |
---|
“Examination Report from Indian Patent Office dated Mar. 12, 2013 for Indian Patent Application No. 415/MUMNP/2007”. |
“Office Action from USPTO dated Jun. 24, 2013 for U.S. Appl. No. 13/177,314”. |
Ridgeway, Curt “0GFC-40GFC using 4-lane XAUI's”, LSI Logic Presentation-T11/03-069v0, (Feb. 3, 2003). |
Curtis, A. R., “Design Considerations for 10-Gbit Fibre Channel”, Curtis A. Ridgeway, Distinguished I/O Architect, Storage and Computing ASIC's Division, LSI Logic Corp., (Apr. 14, 2003). |
“Office Action from USPTO dated Mar. 16, 2009 for U.S. Appl. No. 10/956,501”. |
“Examination Report from European Patent Office dated Mar. 27, 2009 for European Application No. 05798761.2”. |
“Office Action from Chinese State Intellectual Property Office dated Jul. 10, 2009 for Chinese Application No. 200580032888.6”. |
“Final Office Action from USPTO dated Sep. 15, 2009 for U.S. Appl. No. 10/956,501”. |
“Office Action from USPTO dated Jan. 6, 2010 for U.S. Appl. No. 10/956,501”. |
“Office Action from USTPO dated Jan. 26, 2010 for U.S. Appl. No. 10/956,501”. |
“Communication Under Rule 71(3) EPC indicating allowance of application dated Apr. 9, 2010 from European Patent Office for European Application No. 05798761.2”. |
“Final Office Action from USPTO dated Aug. 16, 2010 for U.S. Appl. No. 10/956,501”. |
“Office Action from USPTO dated Apr. 12, 2011 for U.S. Appl. No. 10/956,501”. |
“Office Action from State Intellectual Property Office of China dated Jul. 1, 2011 for Chinese Application No. 200580032888.6”. |
“Office Action from USPTO dated Oct. 24, 2011 for U.S. Appl. No. 10/956,501”. |
“Office Action from USPTO dated Apr. 24, 2012 for U.S. Appl. No. 10/956,501”. |
“Office Action from State Intellectual Property Office dated Mar. 31, 2012 for Chinese Application No. 200580032888.6”. |
“Office Action from State Intellectual Property Office dated Aug. 8, 2012 for Chinese Application No. 200580032888.6”. |
“Notice of Allowance from USPTO dated Aug. 30, 2012 for U.S. Appl. No. 10/956,501”. |
“Notice of Allowance from USPTO dated Oct. 8, 2013 for U.S. Appl. No. 13/177,314”. |
Number | Date | Country | |
---|---|---|---|
20130077637 A1 | Mar 2013 | US |
Number | Date | Country | |
---|---|---|---|
Parent | 10956501 | Oct 2004 | US |
Child | 13604261 | US |