This invention pertains generally to the field of high performance switching, and in particular to improvements in Fibre Channel switching to provide the establishment of zones for permitted access to connected devices, with hardware-enforcement of the zoning.
The Fibre Channel standard has been established to provide for high performance switching solutions for computing and data handling systems. Examples of applications where the high speed and high bandwidth of Fibre Channel switches may be used to advantage include interconnecting computers and high-performance storage devices, interconnecting computers in multiple-computer operating environments, and anywhere multiple high-speed data interconnections must be established between designated nodes or groups of nodes in data handling networks.
The Fibre Channel standard, ANSI X3.T11, broadly defines classes and standards of function and performance, but does not dictate the implementation technologies to be used in providing these functions. A particular design of a switch to implement Fibre Channel functions is referred to as the ‘fabric’ of the switch. As this invention is directed to improvements in Fibre Channel switches, the description of the invention herein uses terminology and other defined terms from the field of Fibre Channel (referred to by the notation “FC” below) switches, and the FC standard may be consulted for definitions.
For data integrity and security reasons, it is necessary in some networks to make certain that certain hosts or devices have controlled access. For example, certain hosts may be allowed access to only certain storage devices, and vice versa. This requirement means that certain channels or groups of channels to which the affected hosts or devices are attached must be isolated from communication to or from other channels or groups of channels. Zoning techniques are used in prior art systems to define zones of addresses that will be considered valid for various sources or destinations connected to a switch.
Soft Zoning: The Problem
A problem with Fibre Channel zoning as it presently exists is that it is software-enforced zoning, often referred to as soft zoning. In soft zoning, devices connected to N_Ports and NL_Ports of the FC fabric login to the fabric and make queries of the Name Server to determine which of the remote devices this device can communicate with, along with their FC addresses (D_IDs). The Name Server defines and enforces the zones by listing in the login response the set of devices (by D_ID) that are in the login requester's zone or zones. In this manner, devices honor zones by using only those D_IDs given out by the Name Server.
However, this works only if all devices follow the rules, and there are no hardware failures. Soft zoning can be breached in the following ways.
The present invention solves the problems discussed which are inherent with soft zoning systems by providing hardware-enforced zoning, also referred to herein as hard zoning. Hard zoning prevents breaching of assigned zoning by the accidental or intentional soft zoning problems discussed above, thereby improving system data integrity and security.
Hard zoning solves the soft zoning problems by using a hardware check of the frame's Source ID (S_ID) both at the point the frame enters the fabric, and at the point the frame leaves the fabric.
As shown in
The frame S_ID is validated at the point the frame exits the fabric (at an F_Port or FL_Port, but not an E_Port), to insure that the frame, based on the S_ID, is part of the zone or zones that the attached N_Port or NL_Port belongs to. Frame S_IDs are compared against a list of S_IDs that are valid for that port, where the size of the list is implementation-dependent, and where each entry defines a source that is allowed to transmit frames to this destination. If the S_ID matches an entry in the list, it is routed out of the fabric to the destination. If the S_ID does not match any entry in the list, the frame is not passed to the destination, but is disposed of by the fabric according to FC rules.
This method works both for fabric clouds containing homogenous switch devices connected together by E_Ports, and clouds containing heterogeneous switch devices connected together by E_Ports, providing all switch devices use S_ID-based hard zoning in the manner described above.
The method also partially works when some heterogeneous devices are equipped with S_ID hard zoning and others are not. In this case, the devices so equipped are offered full hard zoning protection except from frames entering the fabric from devices not so equipped, whose S_ID is incorrect.
The method also works when in devices so equipped, some fabric ports are deliberately excluded from hard zoning protection, producing a deliberate half-duplex hard zoning case. This can be done to work around the limitations of the Hard Zoning S_ID Inclusion List, which has a finite range.
The hard zoning methods and switches of the present invention provide a number of advantageous features, which include the following:
The overall operation of S_ID validation is discussed above with reference to
The Native ID register (1) is resident to the fabric port logic, and is typically written by the fabric manager (15) to whatever ID has been chosen for the port, but may be hard-wired into the logic in a simpler design with greater operating restrictions. The Native ID is the Domain and Area of the F_Port or FL_Port. The Enable Hard Zoning FF (2) is also resident to the fabric port logic and written by the fabric manager (15), which enables the feature on F_Ports and FL_Ports, but disables it on E_Ports.
The incoming frame (3) is parsed and the S_ID contents (bits 23:0) of frame word 2 are presented to this circuitry. The frame S_ID Domain and Area (5), bits 23-8 of frame word 2, are compared against the Native ID Register (1) Domain and Area (6) in comparator (11). Match/mismatch is fed to gate (14).
If there is a miscompare, and Enable Hard Zoning (2) is active, then gate (10) specifies an invalid frame S_ID. In this case, the frame is not routed normally (it will never reach the intended destination), but is typically forwarded to the fabric manager for processing according to Fibre Channel rules for switches. This typically means that a Class 2 frame that fails the S_ID test spawns a response back to the sender with reason code, and that a Class 3 frame that fails the S_ID test is tossed.
If there is no miscompare in the frame S_ID, or if Enable Hard Zoning (2) is inactive, then gate (10) specifies that the frame will route normally, which means it will route to the fabric destination port specified by the frame D_ID.
This feature ensures that frames entering the fabric are not forwarded if the S_ID is illegal in any way.
Destination fabric port S_ID validation, described with reference to
Issues with Linear Tables.
Ideally, S_ID hard zoning would be performed in each host bus adapter (HBA) attached to the fabric. Each HBA would have its own unique zoning table. However, FC standards demand that zoning functions, hard and soft, be contained in the fabric.
A linear inclusion table would seem to be the most straightforward. However, to work for any address in the FC addressing range requires a very large table. For an F_Port, it would have an entry for every possible FC source address, which results in a depth of 256 Domains*256 Areas*256 Ports=16,777,216 table entries/port. If an FL_Port, the table has to also represent up to 126 loop devices, each of which may belong to different zones, which would require a unique linear inclusion table for each. The total number of inclusion table entries for an FL_Port would then be 256*256*256*126=2,113,929,216 table entries/port.
Shorter linear zone tables can be used, where a limited set of addresses, typically starting at the value Domain 1/Area 0, Port 0, and increasing sequentially up to the maximum table size implemented, can be economical. However, these tables cannot express any FC address and so greatly limits the fabrics that can be handled. For example, if the table had 512 entries, it could express all addresses in Domains 0x01 and 0x02, but none in Domain 0x03 through 0xEF.
The method described here utilizes a random table of 24-bit S_IDs, designed as CAM (Content Addressable Memory) where a frame S_ID can be compared against all CAM entries simultaneously seeking a comparison, or inclusion. Since the entries are 24-bit, the CAM can represent any FC address, but is limited to representing a subset of FC addresses far less than the FC maximum. For example, it could be expected that the CAM could economically hold 16-256 addresses, but could be less or more depending on the application and availability of resources.
The method has a single CAM per fabric port transmitter, even when the destination is an FL_Port, and so must work with as many as 126 loop destinations. For this reason, the CAM provides a source zone mask for each S_ID entry, which is compared against a destination zone mask contained in a separate lookup table.
There is a single destination zone mask table per fabric port transmitter, each entry representing a loop destination, or AL_PD, and which typically has an entry for every one of the 126 legal AL_PDs.
CAM-Based Inclusion Table.
This uses the S_ID Inclusion List (SIL), which describes which sources are allowed to send to this port, and if the destination is a loop, what zones each source belongs to.
It also uses the AL_PD Zone List (AZL), used only if the destination is a loop, which describes what zones a destination AL_PA belongs to.
The S_ID Inclusion List (SIL).
SIL (31) is a programmable list of 24-bit S_IDs deemed by the fabric manager to belong to the same zones as the port in question, where each entry also has a 2-bit Compare Mask and a Source Zone Mask. SIL is written by the fabric manager (32) based on zone information. SIL (31) can be any size, but typically would contain as many entries as is economically feasible, to allow as many sources as possible, and to cover as many topologies as possible. SIL (31) provides S_ID compare information (33) to S_ID Compare (34) and the source zone mask (41) to the Source Zone Mask Mux (42).
The Sil (31) entry format is shown in
“Source S_ID” is 24 bits, and defines a legal source S_ID, if the “Compare Mask” value is not 00. Any S_ID within the FC address range of 0x0 -FFFFFF can be expressed.
“Source Zone Mask” is a bit mask of variable size, which defines which zone or zones the source belongs to. See Zone Mask explanation below.
“Compare Mask” defines how the compare against the frame S_ID is to take place
00=Slot not valid. No compare is possible against this entry.
01=No mask. Domain/Area/Port are compared [see note 1 below]
10=Mask Port. Domain/Area are compared [see note 2 below]
11=Mask Area and Port. Domain is compared [see note 3 below]
[note 1] The entry represents exactly 1 source.
[note 2] The entry could represent 126 sources.
[note 3] The entry could represent 256*126=32,256 sources.
S_ID Compare.
S_ID Compare (34) (see
S_ID compare (34) distills the Hit/not status from every SIL entry compare as described above into a No Hit, Hit, or Multiple Hit status for the frame being processed. It also encodes the entry number of the hit into a binary value for use in the Source Zone Mask Mux.
There exists an autonomous compare circuit for every SIL entry, as shown in
Distiller
The Distiller processes the results of SIL entry compares.
A Miss occurs when neither Hit nor Multiple Hit occurs. This causes the frame to be rejected.
A Hit occurs if a single entry compares. This is the first step in causing the frame to be accepted, the second being the SIL/AZL zone mask compare.
A Multiple Hit occurs if two or more entries compare. This causes the frame to be rejected. This is the way exceptions to ranges is implemented, and it also covers programming errors.
Entry Number is used on a Hit, to be a mux select for Source Zone Mask Mux.
Source Zone Mask Mux
The Source Zone Mask Mux (42) produces the zone mask associated with the source S_ID that matched the frame S_ID. The mux select (43) is produced by S_ID Compare (34) which is the encoded value of the SIL (31) entry that matched the frame S_ID. The Source Zone Mask Mux output (44) is given to the Hard Zoning State Machine (47) which will compare it against the destination zone mask (40).
The source zone mask can contain any number of bits, depending on how many zones a loop is designed to handle. For example, a 4-bit zone mask implies that a loop can have up to 4 zones, and an 8-bit mask allows 8 zones. The size of the source zone mask in SIL (31) must be identical to the size of the destination zone mask in AZL (38).
The AL PD Zone List (AZL)
AZL (38) (
The destination zone mask can contain any number of bits, depending on how many zones a loop is designed to handle. For example, a 4-bit zone mask implies that a loop can have up to 4 zones, and an 8-bit mask allows 8 zones. The size of the destination zone mask in AZL (38) must be identical to the size of the source zone mask in SIL (31).
Hard Zoning Enable
The Hard Zoning Enable (53)(
The state of Hard Zoning Enable (52) is fed to the Hard Zoning State Machine (47) to condition the function. Hard Zoning Enable (52) is unique to the port, and is the same storage element that enables/disables S_ID validation on incoming frames.
The Hard Zoning State Machine
The Hard Zoning State Machine (47) (
The Source Zone Mask (62) is provided by the Source Zone Mask Mux (42). The Destination Zone Mask (63) is provided by AZL (38). A bit-wise compare is made between the two masks in AND gates (66), all of which are ORed together in gate (67), which is active if any bit pair is set, and inactive if no bit pairs are set.
Function (68) is active if all source zone mask bits are zero. This is the test for a known bad S_ID that has been tagged in this way to insure its immediate tossing.
S_ID Hit (60) and S_ID Multiple Hit (61) are from S_ID Compare (34). Hard Zone Enable (65) is from the storage element of the same name (52). The translation for S_ID=0xFxxxxx+Frame Source=Fabric Manager (64) is made locally.
AND gate (69) commands the unconditional toss of frames whose source zone mask=0.
AND gate (70) commands that a frame is valid because it passes the general hard zoning test.
AND gate (71) commands the general frame valid.
The diagram in
The programmable values for each fabric port is as follows.
Port 01,00 (Domain 01, Area 00): Host A
Port 01,01 (Domain 01, Area 01): Loop X
Port 01,02 (Domain 01, Area 02): Loop Y
Port 01,03 (Domain 01, Area=03): Host B
Configured as described above, the desired hard zoning for Example A,
The example in
Port 01,03 (Domain 01, Area=00): Host A
Configured as described above, the desired hard zoning for Example B,
The example in
Port 01, 03 (Domain 01, Area=00): Host A
Configured as described above, the desired hard zoning for Example C,
It will be seen from the above description that the present invention provides improved FC switch techniques, by providing roubust hardware-enforced zoning for data integrity and security. While specific embodiments and techniques have been described, it will be appreciated that the invention is not limited to those specific embodiments, and that many variations are possible within the scope of the invention.
This application is a continuation under 35 U.S.C. 111(a) of PCT/US01/18159, filed Jun. 5, 2001, which claims priority to U.S. Provisional Patent Application Ser. No. 60/209,413, filed Jun. 5, 2000, which applications are incorporated herein by reference.
Number | Name | Date | Kind |
---|---|---|---|
4162375 | Schlichte | Jul 1979 | A |
4425640 | Philip et al. | Jan 1984 | A |
4546468 | Christmas et al. | Oct 1985 | A |
4569043 | Simmons et al. | Feb 1986 | A |
4725835 | Schreiner et al. | Feb 1988 | A |
4821034 | Anderson et al. | Apr 1989 | A |
5144622 | Takiyasu et al. | Sep 1992 | A |
5367520 | Cordell | Nov 1994 | A |
5598541 | Malladi | Jan 1997 | A |
5610745 | Bennett | Mar 1997 | A |
5633867 | Ben-Nun et al. | May 1997 | A |
5687172 | Cloonan et al. | Nov 1997 | A |
5748612 | Stoevhase et al. | May 1998 | A |
5818842 | Burwell et al. | Oct 1998 | A |
5987028 | Yang et al. | Nov 1999 | A |
5999528 | Chow et al. | Dec 1999 | A |
6014383 | McCarty | Jan 2000 | A |
6021128 | Hosoya et al. | Feb 2000 | A |
6047323 | Krause | Apr 2000 | A |
6081512 | Muller et al. | Jun 2000 | A |
6118776 | Berman | Sep 2000 | A |
6128292 | Kim et al. | Oct 2000 | A |
6160813 | Banks et al. | Dec 2000 | A |
6185203 | Berman | Feb 2001 | B1 |
6289386 | Vangemert | Sep 2001 | B1 |
6308220 | Mathur | Oct 2001 | B1 |
6324181 | Wong et al. | Nov 2001 | B1 |
6330236 | Ofek et al. | Dec 2001 | B1 |
6411599 | Blanc et al. | Jun 2002 | B1 |
6424658 | Mathur | Jul 2002 | B1 |
6449274 | Holden et al. | Sep 2002 | B1 |
6470007 | Berman | Oct 2002 | B1 |
6484173 | O'Hare et al. | Nov 2002 | B1 |
6597691 | Anderson | Jul 2003 | B1 |
6647019 | McKeown et al. | Nov 2003 | B1 |
6697359 | George | Feb 2004 | B1 |
6839747 | Blumenau et al. | Jan 2005 | B1 |
6904053 | Berman | Jun 2005 | B1 |
6980525 | Banks et al. | Dec 2005 | B2 |
7165152 | Blumenau et al. | Jan 2007 | B2 |
20010038628 | Ofek et al. | Nov 2001 | A1 |
20030016683 | George et al. | Jan 2003 | A1 |
20040028038 | Anderson | Feb 2004 | A1 |
Number | Date | Country |
---|---|---|
0649098 | Sep 1994 | EP |
0856969 | Jan 1998 | EP |
WO-9836537 | Aug 1998 | WO |
Number | Date | Country | |
---|---|---|---|
20030179748 A1 | Sep 2003 | US |
Number | Date | Country | |
---|---|---|---|
60209413 | Jun 2000 | US |
Number | Date | Country | |
---|---|---|---|
Parent | PCT/US01/18159 | Jun 2001 | US |
Child | 10310653 | US |