The present disclosure relates to the merging of a stand-alone switch to a Fibre (Fiber) Channel network.
In a Fibre Channel (FC) network, FC switches are deployed to direct traffic between, for example, host server devices and storage array devices. Each FC switch can serve devices in multiple runtime domains that are identified by a domain identifier (ID). The domain ID is an 8-bit identifier with a range of 1-239. As such, each switch has one or more domain IDs associated therewith that reflect the runtime domains serviced by the switch.
Network operators are often required to increase the size and functionality of an existing FC network. This is commonly done through the addition of a single stand-alone FC switch to the existing network.
Overview
A Fibre (Fiber) Channel (FC) switch and related methods are provided for merging the FC switch with an existing FC network. During a merge process of a stand-alone switch with an FC network, a first Exchange Fabric Parameters (EFP) frame is sent from the stand-alone switch to an FC switch in the existing FC network. The first EFP frame has an empty domain identifier (ID) list. The stand-alone switch receives a second EFP frame from the FC switch. The second EFP frame contains a domain ID list of domain IDs already in use in the FC network. The stand-alone switch compares the domain ID list in the second EFP frame with a stored list of one or more domain IDs associated with the stand-alone switch in order to determine if there is a domain ID overlap or conflict. If no conflict is detected, the stand-alone switch merges with the existing network without initiating a Build Fabric phase or a Principal Switch Selection phase that could cause disruption of traffic in the network.
Example Embodiments
Referring first to
In the arrangement of
FC switches 10(1)-10(4) are part of the existing stable network. Each FC switch 10(1)-10(4) connects to other FC switches, and some edge FC switches also connect to FC devices. For example, switch 10(1) is configured to connect to switch 10(5), while switch 10(4) is configured to connect to servers 25(1)-25(N). Servers 25(1)-25(N) may be in one or more different runtime domains. Similarly, switch 10(2) connects to a plurality of FC storage arrays 20(1)-20(M) that may be in one or more different runtime domains. Thus, there are several runtime domains already in use in a given FC network, each of which are associated with a switch.
In certain networks, when a stand-alone FC switch is merged into an existing FC network, the stand-alone FC switch will have one or more predetermined or default domain IDs assigned to it. The stand-alone FC switch initiates the merge by sending an EFP frame to a switch within the FC network. The EFP frame comprises a domain ID list that includes the domain ID assigned to the stand-alone switch, as well as other information, such as information regarding a principal switch. One or more network switches receive this EFP frame and evaluate the domain ID list received from the stand-alone FC switch to determine if the domain ID(s) of the stand-alone switch is/are in conflict with (i.e., is/are the same as) any domain IDs already in use in the FC network. If there is a conflict between the domains IDs of the stand-alone switch and the domain IDs in use in the FC network, the ports used for communication of the EFP frame are isolated from other ports in the network. If there is no conflict, a Build Fabric phase is initiated, followed by a Principal Switch Selection phase and then a Domain ID Distribution phase in which the principal switch will distribute domain IDs using a protocol. The Build Fabric and Principal Switch Selection phases involve all the switches in the network, and together take at least 15 seconds to complete (i.e., approximately 5 seconds to complete the Build Fabric phase and approximately 10 seconds to complete the Principal Switch Selection phase). As such, the time required to complete the merge of the stand-alone switch with the network may disrupt traffic within the network. Additionally, when the reconfiguration is triggered on several VSANs at once, there is a risk of excessive loads on the processors that may lead to isolated ports. In the worst case scenario, excessive processor loads can lead to systems that are so unstable that a manual reboot is required for correction.
In accordance with certain aspects described herein, switch 10(5) is configured to merge with existing FC network 5 without requiring a Build Fabric phase or a Principal Switch Selection phase. As such, the merge of switch 10(5) with existing FC network 5 may be substantially instantaneous so as not to disrupt traffic within the network. This instantaneous merge that avoids the Build Fabric and Principal Switch Selection phases may take only a few milliseconds, which is substantially less than the approximately 15 seconds required to complete both phases. The instantaneous merge is facilitated by stand-alone switch 10(5) and more particularly through the execution of domain ID comparison process logic 55 in memory 45. As a result of this instantaneous merge, the stand-alone switch 10(5) also accepts the principal switch of FC network 5 as its own principal switch.
Still referring to
Stand-alone switch 10(5) includes FC switch hardware 35 that comprises digital logic and other circuitry configured to perform the FC switching operations in an FC network. The FC switch hardware 35 may be implemented by one or more application specific integrated circuits (ASICs). The network interface(s) 40 include suitable FC interfaces, such as ports, for connection to an FC network and also to any other network for control/command functions associated with switch 10(5).
As explained above, techniques are provided in which switch 10(5) may be merged with FC network 5 without requiring a Build Fabric phase or a Principal Switch Selection phase. To accomplish this instantaneous merge, switch 10(5) begins the merge by sending an EFP frame 60(1) to switch 10(1) in network 5. As schematically shown in
The FC standard calls for a comparison of the domain ID list 62 in the received EFP frame 60(1) to the domain ID list for the network in order to check for domain ID conflicts. Because the received domain ID list 62 is empty, a conflict in domain IDs will not be detected. However, in practice and as noted above, stand-alone switch 10(5) will have one or more domain IDs associated therewith because it will, at least, assign a default to itself or have a domain otherwise previously assigned.
Because domain ID list 62 in EFP frame 60(1) is empty, switch 10(5) is viewed as an un-configured switch (i.e., no domain ID yet assigned). As such, as shown in
As noted above, stand-alone switch 10(5) includes memory 45 that stores domain ID list 50. Domain ID list 50 is the list of one or more predetermined or default domain IDs assigned to switch 10(5). Stand-alone switch 10(5) uses this stored list 50, as well as the received EFP frame 60(2), to determine if the switch can merge with FC network 5 without the requirement of a Build Fabric phase or a Principal Switch Selection phase. More specifically, processor 30 executes domain ID comparison process logic 55 to compare the list of domain IDs contained in the EFP frame 60(2) with the one or more domain IDs in domain ID list 50 to determine if there is a conflict between any domain IDs. That is, processor 30 determines if any of the domain IDs in the list received from switch 10(1) are the same as at least one of the domain IDs in domain ID list 50. If no conflict is detected, switch 10(5) is permitted to instantly merge with FC network 5 (i.e., without the requirement of a Build Fabric phase or a Principal Switch Selection phase). Additionally, this merge occurs such that the principal switch of FC network 5 (in this example, switch 10(3)), does not change as a result of the merge. In other words, switch 10(5) automatically accepts switch 10(3) as its principal switch.
More specifically, if stand-alone switch 10(5) determines that there are no conflicts between domain IDs contained in the EFP frame 60(2) with the one or more domain IDs in domain ID list 50, switch 10(5) will not start a Build Fabric phase, but will instead wait to receive a DIA_REQUEST from the stable FC network side. The stable FC network 5, because it received EFP frame 60(1) containing an empty domain ID list will not detect a conflict, so a switch in the FC network 5 will send the DIA_REQUEST to the stand-alone switch 10(5).
In certain circumstances, a conflict between a domain ID of a network switch and a domain ID stored in domain ID list 50 may occur. Further details of the operations performed after detecting such a conflict are described below with reference to
At 70, during a merge process of stand-alone switch 10(5) with FC network 5, the stand-alone switch sends a first EFP frame 60(1) to switch 10(1) in the network. As noted above, the EFP frame 60(1) has an empty domain ID list.
At 75, stand-alone switch 10(5) receives a second EFP frame 60(2) from FC switch 10(1). At 80, stand-alone switch 10(5) compares the domain ID list 66 in the second EFP frame 60(2) with a list of one or more domain IDs associated with stand-alone switch 10(5). These domain IDs are stored in domain ID list 50. The comparison determines if there is a conflict between the two domain ID lists.
As previously noted, in certain networks, when a stand-alone FC switch is merged into an existing FC network, both a Build Fabric phase and a Principal Switch Selection phase are initiated. However, this may, in certain circumstances, result in a situation in which the stand-alone switch becomes the principal switch of the FC network. In other words, the newly added switch does not accept the FC network's principal switch as its own, even though the configured priority of the switches in the network has not changed. This situation can result from the relative time delays caused by the Build Fabric phase and a Principal Switch Selection phases. Also as noted above, techniques provided herein are directed to a stand-alone switch configured to merge with an existing FC network without necessarily requiring a Build Fabric phase and a Principal Switch Selection phase, thereby preventing the above situation.
If at 90, it is determined that domain ID list 66 in EFP frame 60(2) is not empty, at 100 a determination is made as to whether there is a conflict between domain IDs in list 66 and the domain IDs in list 50. As noted above, if there is no conflict, switch 10(5) instantaneously merges with FC network 5 at 105 without requiring a Build Fabric phase or a Principal Switch Selection phase. Additionally, the merge does not affect the designation of the principal switch in network 5. That is, switch 10(5) accepts the principal switch designation already selected in network 5. If, at 100, a conflict is detected, at 110 stand-alone switch 10(5) isolates the port it used to communicate with switch 10(1) from all other ports in the network.
It should be noted that when stand-alone switch 10(5) isolates the port it used to communicate with switch 10(1), both sides of the communication link will end up isolated. This symmetrical isolation results from the fact that switch 10(5) isolates its port due to the detected conflict, and, when the DIA_REQUEST frame is received on the isolated port, a DIA_REJECT frame is sent back to the FC network 5. The other side of the link is then isolated when the DIA_REJECT frame is received.
The techniques described herein are advantageous in that backward compatibility with conventional existing network devices is supported because only the added stand-alone switch needs to support the new capabilities. Additionally, these techniques increase the scalability of the overall FC network and reduce concerns that the addition of a switch will disrupt traffic because there is not necessarily a requirement to reconfigure the FC network when the switch is added.
The above description is intended by way of example only.
Number | Name | Date | Kind |
---|---|---|---|
7230929 | Betker et al. | Jun 2007 | B2 |
7606167 | DeSanti et al. | Oct 2009 | B1 |
7830880 | Sasso et al. | Nov 2010 | B2 |
7876707 | Sasso et al. | Jan 2011 | B2 |
7936769 | Chung et al. | May 2011 | B2 |
8098595 | Desanti et al. | Jan 2012 | B2 |
20040013092 | Betker et al. | Jan 2004 | A1 |
20050213561 | Yao et al. | Sep 2005 | A1 |
20070201457 | Betker et al. | Aug 2007 | A1 |
20080112311 | Hariharan et al. | May 2008 | A1 |
20090067430 | Sasso et al. | Mar 2009 | A1 |
20090327518 | DeSanti et al. | Dec 2009 | A1 |
20100214950 | Vobbilisetty | Aug 2010 | A1 |
Entry |
---|
S. Wilson et al., Fibre Channel, Switch Fabric-5 (FC-SW-5) Rev. 8.5 INCITS working draft proposed, American National Standard for Information Technology, Jun. 3, 2009 (310 pages). |
Number | Date | Country | |
---|---|---|---|
20130010638 A1 | Jan 2013 | US |