Method and system for creating and implementing zones in hardware within a fiber channel system

Information

  • Patent Grant
  • 6980525
  • Patent Number
    6,980,525
  • Date Filed
    Tuesday, January 29, 2002
    22 years ago
  • Date Issued
    Tuesday, December 27, 2005
    18 years ago
Abstract
In a system comprising a first fabric and a plurality of devices coupled to the fabric by fiber channel connections, the devices are logically grouped to form configurations and zones. A configuration includes at least one zone, and each zone includes at least one device as a member of the zone. Communications between the devices is restricted according to the configuration currently in effect. For example, one device may be permitted to communicate with another device only if they are members of a common zone.
Description
BACKGROUND OF THE INVENTION

1. Field of the Invention


This invention relates generally to a method for creating and implementing zones within a network communication system, and more particularly to a method for creating and implementing such zones for devices within a network communication system using fibre channel connections.


2. Description of the Related Art


As the result of continuous advances in technology, particularly in the area of networking such as the Internet, there is an increasing demand for communications bandwidth. For example, the transmission of data over a telephone company's trunk lines, the transmission of images or video over the Internet, the transfer of large amounts of data as might be required in transaction processing, or videoconferencing implemented over a public telephone network typically require the high speed transmission of large amounts of data. As applications such as these become more prevalent, the demand for communications bandwidth capacity will only increase.


Fibre channel is a transmission medium that is well-suited to meet this increasing demand, and the Fibre Channel family of standards (developed by the American National Standards Institute (ANSI)) is one example of a standard which defines a high speed communications interface for the transfer of large amounts of data via connections between a variety of hardware devices, including devices such as personal computers, workstations, mainframes, supercomputers, and storage devices. Use of fibre channel is proliferating in many applications, particularly client/server applications which demand high bandwidth and low latency I/O. Examples of such applications include mass storage, medical and scientific imaging, multimedia communications, transaction processing, distributed computing and distributed database processing applications.


In one aspect of the fibre channel standard, the communications between devices is based on the use of a fabric. The fabric is typically constructed from one or more fibre channel switches and each device (or group of devices, for example, in the case of loops) is coupled to the fabric. Devices coupled to the fabric are capable of communicating with every other device coupled to the fabric.


However, there are situations where the ability to freely communicate between all devices on a fabric is not desirable. For example, it may be desirable to screen off certain devices on a fabric in order to perform testing and/or maintenance activities on only those devices, without risking interfering with the other devices on the fabric. Alternately, devices may be segregated according to use. For example, the devices coupled to the fabric may be segregated in one fashion during normal operation and in another fashion to facilitate back-ups or system maintenance. As another example, different levels of security may be enforced by allowing only certain sets of devices to communicate with each other. As a final example, devices may be segregated according by operating system or other technical features.


Conventional fibre channel fabric topologies do not allow the logical segregation of devices which are coupled to the same fabric. Rather, devices can be prevented from communicating with each other typically only if they are actually physically separated (e.g., coupled to different fabrics). However, this method does not facilitate the dynamic re-configuration of connections between devices since each re-configuration requires a physical recoupling of devices.


Thus, there is a need to configure a fabric so as to restrict communications between sets of devices connected to the fabric. There is further a need to be able to dynamically re-configure the fabric and to support multiple configurations of device connections.


SUMMARY OF THE INVENTION

In accordance with the present invention, a method is for use in a system comprising a first fabric and a plurality of devices coupled to the first fabric by fibre channel connections. The method is for logically organizing the devices and includes the following steps. A definition of a first configuration is accessed. The first configuration includes at least one zone, and each zone includes at least one device as a member of the zone. Responsive to the definition of the first configuration, communications between the devices coupled to the first fabric is restricted. The first configuration may be an effective one of a plurality of configurations. The members of each zone may be identified in a number of ways, including by the port on the fabric to which the member device is coupled, by a name for the device which is independent of the device's location on the fabric, or by an arbitrated loop physical address.


In one embodiment, communications between devices are restricted as follows. When a first device queries for the address of a second device, the address is returned only if the first and second device are members of a common zone. This prevents the first device from learning the addresses of other devices connected to the fabric but not within a common zone with the first device. Alternately or additionally, communications may be restricted by blocking communications between devices if they are not members of a common zone. In another aspect of the invention, at least one zone is characterized by a type of communication, such as read-only access or a specific communications protocol, and communications within that zone are restricted to the specified type of communication.


In another aspect of the invention, zoning configuration information is stored within the fabric itself and/or the zoning functionality is implemented by the fabric. Additionally, the zoning configuration information and/or zoning functionality may be distributed among the individual fabric elements which make up the fabric.


In another aspect of the invention, a fabric element includes a plurality of ports, a storage medium, and a logic device coupled to each of the foregoing. Each port is adapted to be coupled to a device by a fibre channel connection. The storage medium is for storing a definition of the first configuration. The logic device restricts communications for devices coupled to the plurality of ports, responsive to the definition of the first configuration.


In yet another aspect of the invention, zoning is implemented by software.


Zoning is advantageous because it overcomes many of the limitations of completely open connectivity between all devices coupled to the fabric. Zoning allows for the creation of segmentation or zones within a fabric. This allows the devices coupled to the fabric to be subdivided into logical groups of devices without the need to physically re-configure the network. Zones may be used to create different user groups, test and maintenance areas, and/or security barriers between devices. Zones are dynamic and can be easily and quickly changed to suit varying network needs.





BRIEF DESCRIPTION OF THE DRAWINGS

The present invention has other advantages and features which will be more readily apparent from the following detailed description of the invention and the appended claims, when taken in conjunction with the accompanying drawings, in which:



FIG. 1 is a diagram of a fibre channel network communication system 100 utilizing zoning in accordance with the present invention;



FIG. 2 is a diagram of system 100 utilizing a second example of zoning;



FIG. 3 is a flow diagram of a method of zoning in accordance with the present invention;



FIG. 4 is a diagram of a preferred embodiment 400 of fibre channel system 100 utilizing zoning;



FIG. 5 is a flow diagram of a preferred method of zoning based on the Simple Name Server (SNS); and



FIG. 6 is a flow diagram of another preferred method of zoning.





DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS


FIG. 1 is a diagram of a fibre channel network communication system 100 utilizing zoning in accordance with the present invention. As used herein, the term “fibre channel” refers to the Fibre Channel family of standards as well as other flexible, expandable network connectivity systems capable of moving data over long distances and supporting a variety of protocols. The fibre channel network communication system 100 comprises a fabric 110 and a plurality of devices 120, 122, and 124 and/or groups of devices 130. Fabric 110 is coupled to the various devices 120, 122, 124, and 130, and acts as a switching network to allow the devices to communicate with each other.


In the examples which follow, fabric 110 is a fibre channel network made up of one or more interconnected fibre channel switches (not shown in FIG. 1), although the invention is not limited to such fabrics or to fibre channel. Devices 120, 122, 124 may be any type of device, such as a computer or a peripheral, and are coupled to the fabric 110 using a point-to-point topology. Fabric 110 is also coupled to loop 130. Loop 130 includes a hub 132 and devices 134, 136, and 138, which are coupled in a loop topology. In a preferred embodiment, the loop 130 comprises an arbitrated loop with ring connections for providing multiple nodes with the ability to arbitrate access to a shared bandwidth.


In FIG. 1, fibre channel system 100 includes two zones 140 and 142. Zone 140 contains device 120 and device 122. Zone 142 contains device 124 and loop 130. Devices within the same zone may communicate with each other. Thus, for example, devices 120 and 122 may communicate with each other because they are both members of zone 140. Likewise, device 124 and loop 130 may communicate with each other because they are both members of zone 142. However, device 124 cannot communicate with device 120 because device 124 and device 120 are not members of a common zone. Similarly, device 124 cannot communicate with device 122; and loop 130 cannot communicate with either device 120 or device 122.


Zone 140 and zone 142 may be designated to be in effect at separate times or at the same time. If zones 140 and 142 are in effect at the same time, they would constitute a zone configuration 150. When a zone configuration is in effect, all zones that are members of that configuration are in effect.



FIG. 2 is a diagram of system 100 illustrating another example configuration 210. Configuration 210 includes zones 140 and 200. Zone 140 is as defined in FIG. 1. Zone 200 includes devices 120 and 124. A device may be a member of more than one zone concurrently, as shown by device 120 which is a member of both zone 140 and zone 200. Device 120 may communicate with both device 122 and device 124. However, device 122 may not communicate directly with device 124, and vice versa. Furthermore, in configuration 210, loop 130 may not communicate with any of the devices 120, 122, or 124.


Note that zone configurations 150 and 210 may be stored and recalled at various times, thus facilitating the implementation of zones. For example, configuration 150 may be the configuration which is normally in effect because devices 120 and 122 are used by one group of people and device 124 and loop 130 are used by another group. Configuration 210 may be used when loop 130 requires servicing. Note that in configuration 210, loop 130 is isolated from the other devices, which would minimize any disruption to devices 120, 122, and 124; and devices 120 and 124 are zoned together, perhaps because device 120 serves as a temporary substitute to loop 130.



FIG. 3 is a flow diagram of a method of zoning in accordance with the present invention. In step 300, a zone configuration is defined. For example, in FIG. 1, zone configuration 150 would be defined to include zones 140 and 142, each of which is defined to include their respective devices. As noted above, any zones which are in effect at the same time make up a zone configuration. Hence, defining a zone inherently also defines a zone configuration (i.e., the configuration consisting of the defined zone); so step 300 is not intended to require the explicit definition of a configuration. For example, in FIG. 1, supposed that there was only one zone: zone 140. Defining zone 140 would also define the configuration including zone 140. In step 310, the zoning configuration is implemented. As described previously, implementation of a configuration restricts communications between devices according to the zones in the configuration.


Zoning is beneficial for a number of reasons. For example, it allows for greater flexibility in managing a network. In one application, different zones could be defined for different user groups with each zone set up to meet the needs of the corresponding user group. Zoning can also be used to set up barriers between different operating environments, to deploy logical fabric subsets by creating closed user groups, or to create test and maintenance areas that are separate from the rest of the fabric. Zoning allows the network to be subdivided for these and other purposes in a dynamic fashion and without the need to restructure the physical configuration of the network. This makes logically separating devices from each other faster, safer and easier.


Zoning may be implemented in a variety of different ways and FIGS. 4–6 illustrate two preferred embodiments for implementing zoning within a fibre channel system. FIG. 4 is a diagram of a preferred embodiment 400 of fibre channel system 100 utilizing zoning. FIG. 4 shows further details of the fabric 110, devices 120, 122 and 124, and loop 130. Fabric 110 is comprised of three fabric elements 420, 440 and 450, preferably Silkworm switches series 2100, 2400, or 2800 manufactured by Brocade. Each switch 420, 440 and 450 contains ports to which devices may be coupled. In a preferred embodiment, these ports are implemented on Application Specific Integrated Circuits (ASICs) that may be plugged into or removed from a switch, thus allowing modularity regarding what ports are supported by each switch. Different types of ports support different types of connections from devices to a switch. An FPort is a label used to identify a port of a fabric that is used to directly couple the fabric to a single device, such as a computer or peripheral. An FLPort is a label used to identify a port of a fabric that is used to couple the fabric to a loop. The FPort and the FLPorts shall be referenced jointly as FxPorts. An EPort is a label used to identify an inter-switch expansion port used to connect to an EPort of another switch in order to build a larger switch fabric.


For this example, the relevant ports on switch 420 are FPorts 422 and 432 and EPorts 424 and 434. Similarly, switch 440 contains an FPort 442 and EPorts 444 and 446. Switch 450 contains an FLPort 452 and two EPorts 454 and 456. Switch 420 is coupled to switch 450 via EPorts 434 and EPort 454. Switch 450 is coupled to switch 440 via EPort 456 and EPort 446. Switch 440 is coupled to switch 420 via EPort 444 and EPort 424.


Devices coupled to the fabric are also identified as ports. An NPort is a label used to identify a device coupled to the fabric. Device 120 is coupled to switch 420 via NPort 460 and FPort 422; device 124 is coupled to switch 420 via NPort 470 and FPort 432; and device 122 is coupled to switch 440 via NPort 480 and FPort 442. An NLPort is a label used to identify a device which is coupled to the fabric using a loop topology. Devices 134, 136, and 138 are coupled to loop 130 via NLPorts 496, 494 and 492, respectively. Loop 130, in turn, is coupled to switch 450 via FLPort 452. The NPorts and the NLPorts shall be referenced jointly as NxPorts.


Each switch 420, 440 and 450 also contains an embedded central processing unit (CPU) module 428, 448 and 458 which controls the switch. These CPU modules typically include some sort of processor as well as local memory. As part of this control, each embedded CPU module 428, 448 and 458 provides support to its associated switch for operating a Simple Name Server (SNS) module. The SNS in a fabric provides address information to devices about other devices connected to the fabric. As part of the fibre channel standard, NxPorts joining a fabric typically must register their fibre channel attributes with the SNS. They typically also query the SNS for address information and attributes of other devices (e.g., other Nx-Ports) on the fabric. In response, the SNS provides an address list of other devices on the fabric. If address information changes at a later time, for example due to zoning changes, the fabric sends a change signal to each device to instruct them to requery the SNS for updated address information.


It should be understood that the examples discussed herein are purely illustrative. For example, referring to FIG. 4, fabric 110 may be comprised of a single switch or large numbers of switches. Other EPort connection combinations could be used to couple the switches 420, 440, and 450 together to form fabric 110. Similarly, other number and types of ports may be contained within each switch. The composition of configurations 150 and 210 from FIGS. 1 and 2, and of the zones within these configurations is also merely illustrative.



FIG. 5 is a flow diagram of a preferred method of implementing zoning based on the Simple Name Server (SNS). Additional zoning software is added to the existing SNS addressing functions to implement zoning. This zoning software loads zoning configuration information in the form of a database into the CPU of each switch. The zoning configuration database is replicated and propagated to each individual fabric switch. For example, referring to the example of FIG. 4, each switch 420, 440 and 450 would have a copy of the information defining configurations 150 and 210. The SNS will use this zoning configuration information to determine which devices are allowed to communicate with each other under the zoning configuration in effect. Since each switch maintains its own copy of the zoning information, a single switch failure will not interrupt zoning enforcement to other devices on the fabric.


In step 500, a device attached to the fabric queries the SNS regarding address information for other devices attached to the fabric. This typically occurs, for example, when a device is first coupled to the fabric in order for the device to determine what other devices are attached to the fabric. If the addressing information contained in the SNS or the zoning information changes, the SNS sends a signal to all devices instructing them to requery 500 the SNS for updated address information. In FIG. 4, when device 122 first attaches to the fabric 110, device 122 may query 500 the SNS (which is implemented as software running on CPU 448) to learn what other devices are also attached to fabric 110. This information is provided as a table of addresses with which device 122 may communicate. If the zoning configuration for the fabric 110 changes, device 122 will receive a signal from the SNS instructing it to re-load the address database, in which case device 122 will repeat step 500.


In step 510, the SNS processes the request for information under standard SNS operating procedures. In the current example, in response to device 122's queries, an SNS without zoning capability would identify devices 120 and 124 and loop 130 as being attached to the fabric 110, and would return the addresses of all of these devices. Device 122 would then have the addresses of these other devices and would be able to communicate with them.


However, an fabric with the zoning software enabled performs an additional feature. If a zone configuration is enabled in the fabric 110, the SNS does not automatically send back a list of all devices connected to the fabric 110. Rather, in step 520, a zone check is performed. The zoning software uses the zoning configuration information to determine which devices share a common zone. Each device address to be provided to another device requesting an address update is checked to ensure the two devices share a common zone. The SNS replies in step 540 only with the addresses of those devices sharing a common zone with the requesting device. The addresses of devices which are not in the same zone as the requesting device are not returned as shown in step 530 and, therefore, the requesting device does not know that these other devices exist. This effectively makes devices not within the same zone invisible to each other, although they are still connected to the same fabric.


Continuing the current example, assume that configuration 150 is in effect. In response to device 122's query for a list of all devices attached to fabric 110, the SNS would reply 540 only with the identity of device 120 since it is the only device sharing a zone with device 122. The addresses of device 124 and loop 130 would be eliminated during the zone check 520 and therefore would not be included on the list of addresses sent to device 122 in step 530. Hence, device 122 would not know about device 124 or loop 130, making it more difficult for device 122 to communicate with those devices. Without device 124's address, device 122 cannot send messages to device 124. On the other hand, if the SNS provides to device 122 the correct address for a destination device, device 122 may send messages via the fabric 110 to that destination device.


In this embodiment, the functions performed by the SNS change depending on whether or not zoning is implemented. However, the SNS protocol itself and the manner in which the devices query the SNS are not changed by the implementation of zoning. In other words, the various devices query the SNS in the same manner, regardless of whether zoning is implemented. Zoning is implemented entirely by changing the SNS's responses to the queries. This is advantageous because no change is required in the devices themselves or their drivers in order to implement zoning. For example, to upgrade a fabric without zoning capability to one with zoning capability only requires the addition of the zone check software. No change to the devices is required.



FIG. 6 is a flow diagram of another preferred method of zoning. In step 600, a source device obtains the address of a destination device. If the two devices are in a common zone, then the source device should be permitted to send a message to the destination device. Otherwise, transmission of the message should be blocked. In step 610, the source device sends a message (i.e., a frame according to the fibre channel standard) to the fabric 110 for routing to the destination device. In step 620, the fabric 110 performs a zone check to confirm that the source and destination devices are in a common zone. If they are, the message is routed 630 to its final destination. Otherwise, the message is not routed 640. Not routing the message 640 may result in different actions being performed depending on the type of message being sent. For example, when the hardware zone check detects an illegal frame, a Class 3 frame is discarded, whereas a Class 2 frame is given to the switch firmware so that a reject signal can be transmitted to the source device.


The method illustrated in FIG. 6 is preferably implemented in addition to the SNS-based method shown in FIG. 5. This provides additional zoning protection in the event that a fabric device inadvertently obtains the address of a destination device not within its zone. For example, older devices connected to a fabric may not support the SNS function and rely instead on permanent device address lists which may be inconsistent with the actual fabric configuration. In such cases, it is desirable to have an additional method for enforcing zoning.


Within the fabric, the zone check may occur at any or all of a number of locations. For example, referring again to FIG. 4, supposed that device 122 desired to send a message to device 124 in violation of configuration 150. The communications path might be NPort 480 to FPort 442 to EPort 444 to EPort 424 to FPort 432 to NPort 470. The zone check may be performed at many different locations along this path.


In a preferred embodiment of the invention, the zone check is performed at the destination port of the fabric (FPort 432 in the above example). The zone check preferably is not implemented by the ports on the devices (i.e., the NxPorts) because this would require upgrading of all devices in order to implement zoning, as opposed to just upgrading the fabric 110. Of the various locations on the fabric 110, the source port FPort 442 and destination port FPort 432 are preferred because the communications path must contain these two ports. In contrast, the two EPorts 444 and 424 would be bypassed if the communications path was via switch 450.


Zone checking at the destination port is preferable because it is more important to protect devices from receiving messages sent by other devices outside their zone than it is to prevent devices from sending messages to other devices outside their zone. More specifically, each fabric switch 420, 440, 450 may or may not be zoning-enabled, depending on whether zoning software has been installed on that switch. If a switch is zoning-enabled, the devices connected to it are not expecting to see messages from devices outside of their zones because they expect the switch to enforce zoning. That is, the devices are zoning-aware. However, devices connected to a switch that is not zoning-enabled have no such expectations, i.e. they are zoning-unaware. A zoning-unaware device has no knowledge of zoning and is prepared to accept communications from any other device in the fabric system.


When the zone check is performed by the destination port within the fabric communication pathway, a zoning-enabled switch will block improper transmissions from being sent to its attached zoning-aware device, in accordance with the device's expectations. In contrast, a switch which is not zoning-enabled will not block improper transmissions, but this is also in accordance with the destination device's expectations since the destination device is zoning-unaware and is not expecting any screening of transmissions due to zoning.


Now consider the situation when the zone check is performed by the source port. If the switch attached to the source device is zoning-enabled, messages will be properly filtered based upon the enabled zoning configuration. However, if the switch attached to the source device is not zoning-enabled, messages will not be properly filtered. Unfortunately, in this case although the source device is zoning-unaware, the destination device may or may not be zoning-aware. Thus, a zoning-aware destination device may still receive an improper communication.


Referring again to FIG. 4, in a preferred embodiment, the zone check is implemented by a logic device on each FxPort. There are numerous ways to implement such logic devices, such as Application Specific Integrated Circuits (ASICs), Field Programmable Gate Arrays (FPGAs), Erasable Programmable Read-Only Memory (EPROMs), microprocessors or microcontrollers, or Digital Signal Processors (DSPs), including software executing on any of the foregoing. A preferred embodiment uses an ASIC as the logic device. Each ASIC contains fabric zoning configuration information in the form of a table providing a matrix of source and destination devices. Each potential source device and each destination device connected to the port would be contained in the matrix. This matrix is implemented as a bitmap, with a bit to be set or cleared in each position. Permitted source/destination device combinations would have their representative matrix bit set in the bitmap. Each port would contain such a bitmap.


Assume configuration 150 is in effect. As an example, the bitmap for FPort 432 would contains bits which correspond to each of the other FxPorts 422, 442, and 452. The bits for FPorts 422 and 442 would indicate that FPort 432 is not permitted to receive communications from these ports; whereas the bit for FLPort 452 would indicate that FPort 432 is permitted to receive communications from this port. Each of the ASICs for the other FxPorts would contain analogous information. When a message was received by FPort 432, the zone check would be implemented by referencing the bitmap.


In another embodiment of the method of zone checking illustrated in FIG. 6, the zone check may be performed on the devices themselves as opposed to the fabric. A logic device for performing this zone check could be installed on each device attached to the fabric system. Such a zone check could be performed by either the device sending the message or by the receiving device.


In a preferred embodiment, the basic management of zones and configurations is accomplished in part by a fabric system administrator who logs into a switch on the fabric and inputs zoning commands using a software interface. The administrator may use any switch in the fabric for this purpose because a change made to the zoning information on one switch is propagated throughout all switches in the fabric. Other types of management will be apparent to one of skill in the art. For example, the administrator may work from a dedicated device (e.g., a server dedicated to managing the fabric and/or zoning) rather than through the individual switches, or management functions may be performed automatically by the fabric in response to commands from other computers rather than in response to inputs from a system administrator.


In a preferred embodiment of the invention, zoning management is broken down into the following basic tasks: defining zones, defining zone configurations, and selecting which configuration in a set is to be in effect at any given time. To a certain extent, the software used to implement zoning is flexible in regard to the order in which these steps are performed. For example, it is possible to define a configuration that refers to specific zones that have not yet been defined. The zones may then be defined at a later time, although it is preferable to define the zones before the configuration containing the zones is put into effect. The following paragraphs describe preferred embodiments of each of the basic tasks; other embodiments will be apparent.


Zones preferably are defined by identifying the devices which are members of that zone. Devices are typically identified by Physical Fabric port number, Arbitrated Loop Physical Address (AL-PA), Node Worldwide Name (Node WWN), or Port Worldwide Name (Port WWN). Physical Fabric port numbers are specified as a pair of decimal numbers “s,p” where “s” is the switch number (domain ID from 0 to 31) and “p” is the port number on that switch (0 to 15). For example, “2,12” specifies port 12 on switch number 2. When a zone member is specified by physical fabric port number, then any and all devices connected to that port are in the zone. If this port is an arbitrated loop, then all devices on the loop are in the zone. ALPA addresses are 8-bit addresses used by private loop devices that operate in a fibre channel Private Loop Direct Attach (FC-PLDA) environment. ALPA is discussed in greater detail in fibre channel 2nd Generation Arbitrated Loop (FC-AL-2), revision 6.4 (Project 1133-D), which is incorporated by reference in its entirety herein.


A Worldwide Name uniquely identifies a fibre channel node or port on a device. Worldwide Names are specified as eight hex numbers separated by colons, for example “10:00:00:60:69:00:00:8a”. When a zone member is specified by Node Worldwide Name then all ports on that device are in the zone. When a zone member is specified by Port Worldwide Name then only that single device port is in the zone. Specifying zone members by Worldwide Name is advantageous because, for example, a device which is so specified may be coupled to the fabric at any point or via any fabric element and it will retain the same zone membership.


The type of zone members used to define a zone may be mixed and matched. For example, a zone defined with the following members: “2,12; 2,14; 10:00:00:60:69:00:00:8a” would contain whichever devices are connected to switch 2, ports 12 and 14, and the device with either the Node Worldwide Name or Port Worldwide Name of “10:00:00:60:69:00:00:8a”. Alternatively, a fabric system administrator may assign an alias to a zone to simplify repetitive entry of port numbers, ALPAs or Worldwide Names. For example, the name “host” could be used as an alias for “10:00:00:60:69:00:00:8a”.


Zone configurations preferably are defined by specifying which zones are members of that configuration. For example, zone configuration 150 in FIG. 1 may be defined as “zone140; zone142” where zone140 and zone142 are zones defined as described in connection with FIG. 1. When a zone configuration is in effect, all zones that are members of that configuration are in effect. As with the definition of zones, common naming conventions, such as aliasing, may also be used with the definition of zone configurations.


More than one zone configuration may be defined for any given fabric. For example, in FIGS. 1 and 2, configurations 150 and 210 are two different zone configurations which may be applied to fabric 110. The set of all zone configurations which have been defined for a fabric shall be referred to as the “total defined configuration set.”


The actual configuration which is in effect shall be referred to as the “effective configuration.” Communications between devices are based on the effective configuration. The effective configuration may be selected by the fabric administrator or it may be programmed into the fabric. For example, in FIGS. 1 and 2, the fabric 110 may be programmed to automatically implement configuration 210 every Saturday from 9–11 pm in order to allow for regularly scheduled maintenance on loop 130 and to implement configuration 150 at all other times.


A configuration is “compiled”, or reduced to a form usable by the fabric 110, each time that it is put into effect. For example, configuration 210 would be compiled every Saturday around 9 pm shortly before it is placed into effect, and configuration 150 would likewise be compiled every Saturday around 11 pm. The compilation procedure performs a number of functions, such as checking for undefined zone names or other inconsistencies, removing duplicate entries, resolving aliases, and converting Worldwide Names to switch and port addresses if, for example, the fabric routes primarily based on switch and port addresses.


As part of the management function, configurations may also be saved. In a preferred embodiment, saving will store a copy of the current “total defined configuration set” plus the name of the current “effective configuration” into a non-volatile storage medium, such as each switch's flash memory. This “saved configuration set” is automatically reloaded by the fabric switches upon power up, including reinstating the effective configuration from the saved configuration set. Note that the saved configuration set may not reflect the most current total defined configuration set since changes may have been made since the last save.


The zoning commands described above are only one specific embodiment of the zoning management features of the present invention. Other management functions and/or combinations of commands will be apparent. For example, when an administrator is modifying the total defined configuration set, changes may be periodically auto-saved rather than requiring the administrator to affirmatively save any changes. As another example, any number of command sets and user interfaces may be used to implement the basic tasks described above.


Another aspect of zoning management concerns the handling of changes to the fabric. For example, what happens to zoning when devices are added to the fabric, or if multiple fabrics are merged into a single fabric. The switch or fabric to be added may either be new, meaning it has no pre-existing zoning information, or it may contain a previously defined set of zone configuration data. The following paragraphs describe preferred embodiments for handling these situations, although other embodiments will be apparent.


If a new switch is added to a fabric, zoning information is copied from the fabric into the new switch. If a zone configuration is enabled in the fabric, then the same configuration becomes enabled in the new switch. Adding a new fabric (i.e., a fabric in which all the switches have no pre-existing zoning information) to an existing zoned fabric is very similar to adding a new switch. Zoning information is copied from the existing zoned fabric into the switches of the new fabric. If a zone configuration is enabled, then the same configuration becomes enabled in the new fabric switches.


If two fabrics that both contain some existing zone configuration information are joined, then the situation is more complex. The zoning software will attempt to merge the two sets of zone configuration data together, but this is only possible if the two sets of data are compatible. The simplest case is where both fabrics have identical zone configuration data and the same configuration is enabled. In this case, the fabrics are compatible and they will join to make one larger fabric with the same zone configuration in effect across the whole new fabric. If the fabrics have different zone configuration data, then the two sets of zoning information will be checked for compatibility and merged if possible.


If a merge is not possible because the two zoning configuration data sets are incompatible, the fabric will be segmented. A merge is not possible, for example, if the two zone configurations that are enabled are different, if different names are used by each fabric to refer to the same zone, or if a zone with the same name in each fabric contains different groups of devices in each fabric. If the merge is not possible, then the fabric is logically segmented into two separate fabrics even though physically is it connected as a single fabric. Each of the two new fabrics retains its original zone configuration.


Zones may also be configured to allow access between devices for only certain types of communication. For example, a zone may be configured to permit read-only access between devices, as opposed to the default read-write access generally permitted between devices within the same zone. Alternately, zones may also be configured as protocol zones, which restrict all devices within a zone to utilizing the same communications protocol. Such zone types may be implemented in a number of ways. For example, referring to the previously described embodiment based on the SNS and additional zoning software, the zoning software may be modified to differentiate between zone types (e.g., normal, read-only, or protocol) and the SNS may respond to a query for addresses by providing a list of other devices, including both address and type of communication. Similar changes may be made to the other embodiments described above.


Although the invention has been described in considerable detail with reference to certain preferred embodiments, other embodiments are possible. For example, zoning could be implemented via a centralized, versus distributed, method. In the previously described distributed method of implementing zoning, the zoning information is propagated to each switch. However, this zoning information could also be contained and accessed in a centralized way, such as via a central zoning server for the entire fabric system. Therefore, the scope of the appended claims should not be limited to the description of the preferred embodiments contained herein.

Claims
  • 1. In a system comprising a first fabric and a plurality of devices coupled to the first fabric by Fibre Channel connections, a method for logically organizing the devices comprising: accessing a definition of a first configuration including at least one zone, each zone including at least one device as a member of the zone; andresponsive to the definition of the first configuration, restricting communications between the devices coupled to the first fabric,wherein the step of restricting communications between the devices includes blocking communications from a first device to a second device if the first and second devices are not members of a common zone andwherein the step of blocking communications from a first device to a second device includes:accessing a bit in a bitmap, wherein the bit in the bitmap indicates whether the first device and the second device are members of a common zone; andblocking communications from the first device to the second device if the bit indicates that the first device and the second device are not members of a common zone.
  • 2. A fabric element for use in a system comprising a first fabric and a plurality of devices coupled to the first fabric by Fibre Channel connections, the fabric element comprising: a plurality of ports, each port adapted to be coupled to a device by a Fibre Channel connection;a storage medium for storing a definition of a first configuration including at least one zone, each zone including at least one device as a member of the zone; anda logic device coupled to the plurality of ports and to the storage medium, for, responsive to the definition of the first configuration, restricting communications for devices coupled to the plurality of ports,wherein the logic device is further for blocking communications from a first device to a second device if the first and second devices are not members of a common zone andwherein the logic device includes a bitmap having a plurality of bits, each bit indicating whether two of the devices coupled to the first fabric are members of a common zone.
  • 3. A Fibre Channel device for use in a Fibre Channel fabric, the fabric coupling a plurality of external devices, the fabric configured into at least two zones, where the external devices are allowed to exchange data packets only with external devices in the same zone, the Fibre Channel device enforcing the zones in hardware, the Fibre Channel device comprising: a source port for receiving data packets;a destination port transmitting data packets; anddevice logic connecting said source port and said destination port, wherein said device logic includes: zoning data storage for storing configuration data indicative of the zone configuration of the fabric; anda zoning check circuit connected to said zoning data storage and one of said source or destination port for screening the received data packet.
  • 4. The Fibre Channel device of claim 3, wherein said zoning check circuit blocks transmission of the data packet.
  • 5. The Fibre Channel device of claim 4, wherein said destination port does not transmit the data packet.
  • 6. The Fibre Channel device of claim 4, wherein said source port does not transmit the data packet.
  • 7. The Fibre Channel device of claim 3, wherein said zoning data storage and said zoning check circuit are included in said destination port.
  • 8. The Fibre Channel device of claim 3, wherein the external devices are fabric-attached, loop-attached or a combination of fabric-attached and loop-attached.
  • 9. The Fibre Channel device of claim 3, wherein said zoning check circuit includes a bitmap having a plurality of bits, each bit indicating whether two of the plurality of external devices are in the same zone.
  • 10. A Fibre Channel switch for use in a Fibre Channel fabric, the fabric coupling a plurality of external devices, the fabric configured into at least two zones, where the external devices are allowed to exchange data packets only with external devices in the same zone, the Fibre Channel switch enforcing the zones in hardware, the Fibre Channel switch comprising: a microprocessor;local memory connected to said microprocessor; anda Fibre Channel device connected to and controlled by said microprocessor, wherein said Fibre Channel device includes: a source port for receiving data packets;a destination port for transmitting data packets; anddevice logic connecting said source port and said destination port, wherein said device logic includes: zoning data storage for storing configuration data indicative of the zone configuration of the fabric; anda zoning check circuit connected to said zoning data storage and one of said source or destination port for screening the received data packet.
  • 11. The Fibre Channel switch of claim 10, wherein said zoning check circuit blocks the transmission of the data packet.
  • 12. The Fibre Channel switch of claim 11, wherein said destination port does not transmit the data packet.
  • 13. The Fibre Channel switch of claim 11, wherein said source port does not transmit the data packet.
  • 14. The Fibre Channel switch of claim 10, wherein said zoning data storage and said zoning check circuit are included in said destination port.
  • 15. The Fibre Channel switch of claim 10, wherein the external devices are fabric-attached, loop-attached or a combination of fabric-attached and loop-attached.
  • 16. The Fibre Channel switch of claim 10, wherein said zoning check circuit includes a bitmap having a plurality of bits, each bit indicating whether two of the plurality of external devices are in the same zone.
  • 17. A Fibre Channel fabric comprising: a plurality of external devices;a first Fibre Channel switch coupled to a first portion of said plurality of external devices; anda second Fibre Channel switch coupled to a second portion of said plurality of external devices and coupled to said first Fibre Channel switch,wherein the fabric is configured into at least two zones, where said external devices are allowed to exchange data packets only with external devices in the same zone and wherein said first and second Fibre Channel switches enforce the zones in hardware, each of said first and second Fibre Channel switches including:a microprocessor;local memory connected to said microprocessor; anda Fibre Channel device connected to and controlled by said microprocessor, wherein said Fibre Channel device includes: a source port for receiving data packets;a destination port for transmitting data packets; anddevice logic connecting said source port and said destination port, wherein said device logic includes: zoning data storage for storing configuration data indicative of the zone configuration of the fabric; anda zoning check circuit connected to said zoning data storage and one of said source or destination port for screening the received data packet.
  • 18. The Fibre Channel fabric of claim 17, wherein said zoning check circuit blocks the transmission of the data packet.
  • 19. The Fibre Channel fabric of claim 18, wherein said destination port does not transmit the data packet.
  • 20. The Fibre Channel fabric of claim 18, wherein said source port does not transmit the data packet.
  • 21. The Fibre Channel fabric of claim 17, wherein said zoning data storage and said zoning check circuit are included in said destination port.
  • 22. The Fibre Channel fabric of claim 17, wherein said external devices are fabric-attached, loop-attached or a combination of fabric-attached and loop-attached.
  • 23. The Fibre Channel fabric of claim 17, 2h343 in said zoning check circuit includes a bitmap having a plurality of bits, each bit indicating whether two of the plurality of external devices are in the same zone.
  • 24. A Fibre Channel device for use in a Fibre Channel fabric, the fabric coupling a plurality of external devices, the fabric configured into at least two zones, where the external devices are allowed to exchange data packets only with external devices in the same zone, the Fibre Channel device comprising: a source port for receiving data packets;a destination port transmitting data packets; anddevice hardware circuitry connecting said source port and said destination port, wherein said device hardware circuitry includes: zoning data storage for storing configuration data indicative of the zone configuration of the fabric; anda zoning check circuit connected to said zoning data storage and one of said source or destination port for screening the received data packet.
  • 25. The Fibre Channel device of claim 24, wherein said zoning check circuit blocks transmission of the data packet.
  • 26. The Fibre Channel device of claim 25, wherein said destination port does not transmit the data packet.
  • 27. The Fibre Channel device of claim 25, wherein said source port does not transmit the data packet.
  • 28. The Fibre Channel device of claim 24, wherein said zoning data storage and said zoning check circuit are included in said destination port.
  • 29. The Fibre Channel device of claim 24, wherein the external devices are fabric-attached, loop-attached or a combination of fabric-attached and loop-attached.
  • 30. The Fibre Channel device of claim 24, wherein said zoning check circuit includes a bitmap having a plurality of bits, each bit indicating whether two of the plurality of external devices are in the same zone.
  • 31. A Fibre Channel switch for use in a Fibre Channel fabric, the fabric coupling a plurality of external devices, the fabric configured into at least two zones, where the external devices are allowed to exchange data packets only with external devices in the same zone, the Fibre Channel switch comprising: a microprocessor;local memory connected to said microprocessor; anda Fibre Channel device connected to and controlled by said microprocessor, wherein said Fibre Channel device includes: a source port for receiving data packets;a destination port for transmitting data packets; anddevice hardware circuitry connecting said source port and said destination port, wherein said device hardware circuitry includes: zoning data storage for storing configuration data indicative of the zone configuration of the fabric; anda zoning check circuit connected to said zoning data storage and one of said source or destination port for screening the received data packet.
  • 32. The Fibre Channel switch of claim 31, wherein said zoning check circuit blocks the transmission of the data packet.
  • 33. The Fibre Channel switch of claim 32, wherein said destination port does not transmit the data packet.
  • 34. The Fibre Channel switch of claim 32, wherein said source port does not transmit the data packet.
  • 35. The Fibre Channel switch of claim 31, wherein said zoning data storage and said zoning check circuit are included in said destination port.
  • 36. The Fibre Channel switch of claim 31, wherein the external devices are fabric-attached, loop-attached or a combination of fabric-attached and loop-attached.
  • 37. The Fibre Channel switch of claim 31, wherein said zoning check circuit includes a bitmap having a plurality of bits, each bit indicating whether two of the plurality of external devices are in the same zone.
  • 38. A Fibre Channel fabric comprising: a plurality of external devices;a first Fibre Channel switch coupled to a first portion of said plurality of external devices; anda second Fibre Channel switch coupled to a second portion of said plurality of external devices and coupled to said first Fibre Channel switch,wherein the fabric is configured into at least two zones and where said external devices are allowed to exchange data packets only with external devices in the same zone, each of said first and second Fibre Channel switches including:a microprocessor;local memory connected to said microprocessor; anda Fibre Channel device connected to and controlled by said microprocessor, wherein said Fibre Channel device includes: a source port for receiving data packets;a destination port for transmitting data packets; anddevice hardware circuitry connecting said source port and said destination port, wherein said device hardware circuitry includes: zoning data storage storing configuration data indicative of the zone configuration of the fabric; anda zoning check circuit connected to said zoning data storage and one of said source or destination port for screening the received data packet.
  • 39. The Fibre Channel fabric of claim 38, wherein said zoning check circuit blocks the transmission of the data packet.
  • 40. The Fibre Channel fabric of claim 39, wherein said destination port does not transmit the data packet.
  • 41. The Fibre Channel fabric of claim 39, wherein said source port does not transmit the data packet.
  • 42. The Fibre Channel fabric of claim 38, wherein said zoning data storage and said zoning check circuit are included in said destination port.
  • 43. The Fibre Channel fabric of claim 38, wherein said external devices are fabric-attached, loop-attached or a combination of fabric-attached and loop-attached.
  • 44. The Fibre Channel fabric of claim 38, wherein said zoning check circuit includes a bitmap having a plurality of bits, each bit indicating whether two of the plurality of external devices are in the same zone.
  • 45. In a Fibre Channel device for use in a Fibre Channel fabric, the fabric coupling a plurality of external devices, the fabric configured into at least two zones, where the external devices are allowed to exchange data packets only with external devices in the same zone, the Fibre Channel device including a source port for receiving data packets; a destination port transmitting data packets; and device hardware circuitry connecting said source port and said destination port, wherein said device hardware circuitry includes zoning data storage and a zoning check circuit connected to said zoning data storage and one of said source or destination port, a method comprising: receiving data packets at the source port;storing configuration data indicative of the configuration of the fabric in the zoning data storage; andscreening the received data packets in the zoning check circuit based on the stored configuration data.
  • 46. The method of claim 45, further comprising: blocking transmission of the data packet based on the screening of the data packet.
  • 47. The method of claim 46 further comprising: not transmitting the data packet from the destination port if the data packet transmission is blocked.
  • 48. The method of claim 46, further comprising: not transmitting the data packet from the source port if the data packet transmission is blocked.
  • 49. The method of claim 45, where said zoning check circuit includes a bitmap having a plurality of bits, each bit indicating whether two of the plurality of external devices are in the same zone.
  • 50. A Fibre Channel device for use in a Fibre Channel fabric, the fabric coupling a plurality of external devices, the fabric configured into at least two zones, where the external devices are allowed to exchange data packets only with external devices in the same zone, the Fibre Channel device comprising: a source port for receiving data packets;a destination port transmitting data packets; anddevice logic contained in said destination port and connecting said source port and said destination port, said device logic for storing configuration data indicative of the zone configuration of the fabric and for screening the received data packet.
  • 51. The Fibre Channel device of claim 50, where said device logic blocks transmission of the data packet based on the screening of the received data packet.
  • 52. The Fibre Channel device of claim 51, where said destination port does not transmit the data packet.
  • 53. The Fibre Channel device of claim 50, wherein the external devices are fabric-attached, loop-attached or a combination of fabric-attached and loop-attached.
  • 54. The Fibre Channel device of claim 50, wherein said device logic includes a bitmap having a plurality of bits, each bit indicating whether two of the plurality of external devices are in the same zone.
  • 55. A Fibre Channel switch for use in a Fibre Channel fabric, the fabric coupling a plurality of external devices, the fabric configured into at least two zones, where the external devices are allowed to exchange data packets only with external devices in the same zone, the Fibre Channel switch comprising: a microprocessor;local memory connected to said microprocessor; anda Fibre Channel device connected to and controlled by said microprocessor, wherein said Fibre Channel device includes: a source port for receiving data packets;a destination port for transmitting data packets; anddevice logic contained in said destination port and connecting said source port and said destination port, said device logic for storing configuration data indicative of the zone configuration of the fabric and for screening the received data packet.
  • 56. The Fibre Channel switch of claim 55, wherein said device logic blocks the transmission of the data packet based on the screening of the received data packet.
  • 57. The Fibre Channel switch of claim 56, wherein said destination port does not transmit the data packet.
  • 58. The Fibre Channel switch of claim 55, wherein the external devices are fabric-attached, loop-attached or a combination of fabric-attached and loop-attached.
  • 59. The Fibre Channel switch of claim 55, wherein said device logic includes a bitmap having a plurality of bits, each bit indicating whether two of the plurality of external devices are in the same zone.
  • 60. A Fibre Channel fabric comprising: a plurality of external devices;a first Fibre Channel switch coupled to a first portion of said plurality of external devices; anda second Fibre Channel switch coupled to a second portion of said plurality of external devices and coupled to said first Fibre Channel switch,wherein the fabric is configured into at least two zones and where said external devices are allowed to exchange data packets only with external devices in the same zone, each of said first and second Fibre Channel switches including:a microprocessor;local memory connected to said microprocessor; anda Fibre Channel device connected to and controlled by said microprocessor, wherein said Fibre Channel device includes: a source port for receiving data packets;a destination port for transmitting data packets; anddevice logic contained in said destination port and connecting said source port and said destination port, said device logic for storing configuration data indicative of the zone configuration of the fabric and for screening the received data packet.
  • 61. The Fibre Channel fabric of claim 60, wherein said device logic blocks the transmission of the data packet based on the screening of the received data packet.
  • 62. The Fibre Channel fabric of claim 61, wherein said destination port does not transmit the data packet.
  • 63. The Fibre Channel fabric of claim 60, wherein said external devices are fabric-attached, loop-attached or a combination of fabric-attached and loop-attached.
  • 64. The Fibre Channel fabric of claim 60, wherein said device logic includes a bitmap having a plurality of bits, each bit indicating whether two of the plurality of external devices are in the same zone.
  • 65. A Fibre Channel device for use in a Fibre Channel fabric, the fabric coupling a plurality of external devices, the fabric configured into at least two zones, where the external devices are allowed to exchange data packets only with external devices in the same zone, the Fibre Channel device comprising: a source port for receiving data packets;a destination port transmitting data packets; anddevice logic contained in said source port and connecting said source port and said destination port, said device logic for storing configuration data indicative of the zone configuration of the fabric and for screening the received data packet.
  • 66. The Fibre Channel device of claim 65, wherein said device logic blocks transmission of the data packet based on screening of the data packet.
  • 67. The Fibre Channel device of claim 66, wherein said source port does not transmit the data packet.
  • 68. The Fibre Channel device of claim 65, wherein the external devices are fabric-attached, loop-attached or a combination of fabric-attached and loop-attached.
  • 69. The Fibre Channel device of claim 65, wherein said device logic includes a bitmap having a plurality of bits, each bit indicating whether two of the plurality of external devices are in the same zone.
  • 70. A Fibre Channel switch for use in a Fibre Channel fabric, the fabric coupling a plurality of external devices, the fabric configured into at least two zones, where the external devices are allowed to exchange data packets only with external devices in the same zone, the Fibre Channel switch comprising: a microprocessor;local memory connected to said microprocessor; anda Fibre Channel device connected to and controlled by said microprocessor, wherein said Fibre Channel device includes: a source port for receiving data packets;a destination port for transmitting data packets; anddevice logic contained in said source port and connecting said source port and said destination port, said device logic for storing configuration data indicative of the zone configuration of the fabric and for screening the received data packet.
  • 71. The Fibre Channel switch of claim 70, wherein said device logic blocks the transmission of the data packet based on the screening of the data packet.
  • 72. The Fibre Channel switch of claim 71, wherein said source port does not transmit the data packet.
  • 73. The Fibre Channel switch of claim 70, wherein the external devices are fabric-attached, loop-attached or a combination of fabric-attached and loop-attached.
  • 74. The Fibre Channel switch of claim 70, wherein said device logic includes a bitmap having a plurality of bits, each bit indicating whether two of the plurality of external devices are in the same zone.
  • 75. A Fibre Channel fabric comprising: a plurality of external devices;a first Fibre Channel switch coupled to a first portion of said plurality of external devices; anda second Fibre Channel switch coupled to a second portion of said plurality of external devices and coupled to said first Fibre Channel switch,wherein the fabric is configured into at lease two zones and where said external devices are allowed to exchange data packets only with external devices in the same zone, each of said first and second Fibre Channel switches including:a microprocessor;local memory connected to said microprocessor; anda Fibre Channel device connected to and controlled by said microprocessor, wherein said Fibre Channel device includes: a source port for receiving data packets;a destination port for transmitting data packets; anddevice logic contained in source port and connecting said source port and said destination port, said device logic for storing configuration data indicative of the zone configuration of the fabric and for screening the received data packet.
  • 76. The Fibre Channel fabric of claim 75, wherein said device logic blocks the transmission of the data packet based on the screening of the data packet.
  • 77. The Fibre Channel fabric of claim 76, wherein said source port does not transmit the data packet.
  • 78. The Fibre Channel fabric of claim 75, wherein said external devices are fabric-attached, loop-attached or a combination of fabric-attached and loop-attached.
  • 79. The Fibre Channel fabric of claim 75, wherein said device logic includes a bitmap having a plurality of bits, each bit indicating whether two of the plurality of external devices are in the same zone.
CROSS-REFERENCE TO RELATED APPLICATION

This application claims the benefit of U.S. Provisional Patent Application Ser. No. 60/105,423, “Zoning”, by David Banks, Kumar Malavalli, Paul Ramsay, Kha Sin Teow, and Jieming Zhu, filed Oct. 23, 1998, which subject matter is incorporated herein by reference. This application is a divisional application under 35 U.S.C. § 120 of patent application Ser. No. 09/426,567, entitled “Method and System for Creating and Implementing Zones Within a Fibre Channel Systsem,” by David C. Banks, Kumar Malavalli; Paul Ramsay, Kha Sin Teow and Jieming Zhu, filed Oct. 22, 1999 now U.S. Pat. No. 6,765,919, which is hereby incorporated by reference.

US Referenced Citations (24)
Number Name Date Kind
4845722 Kent et al. Jul 1989 A
5329579 Brunson Jul 1994 A
5394402 Ross Feb 1995 A
5442624 Bonomi et al. Aug 1995 A
5442791 Wrabetz et al. Aug 1995 A
5519695 Purohit et al. May 1996 A
5600644 Hayashi Feb 1997 A
5751715 Chan et al. May 1998 A
5752003 Hart May 1998 A
5774656 Hattori et al. Jun 1998 A
5805924 Stoevhase Sep 1998 A
5844887 Oren et al. Dec 1998 A
5872822 Bennett Feb 1999 A
5878232 Marimuthu Mar 1999 A
5894481 Book Apr 1999 A
5938732 Lim et al. Aug 1999 A
5944798 McCarty et al. Aug 1999 A
5968126 Ekstrom et al. Oct 1999 A
6041058 Flanders et al. Mar 2000 A
6147976 Shand et al. Nov 2000 A
6173399 Gilbrech Jan 2001 B1
6765919 Banks et al. Jul 2004 B1
20030095549 Berman May 2003 A1
20030126200 Wolff Jul 2003 A1
Related Publications (1)
Number Date Country
20020110125 A1 Aug 2002 US
Provisional Applications (1)
Number Date Country
60105423 Oct 1998 US
Divisions (1)
Number Date Country
Parent 09426567 Oct 1999 US
Child 10059753 US