Method and system for primary blade selection in a multi-module fibre channel switch

Information

  • Patent Grant
  • 7388861
  • Patent Number
    7,388,861
  • Date Filed
    Friday, December 8, 2006
    17 years ago
  • Date Issued
    Tuesday, June 17, 2008
    16 years ago
Abstract
A system and method for selecting a primary blade in a multi-module fibre channel switch with plural blades is provided. The system includes a state machine for sending exchangeable blade parameter(s) (“EBP”) to the plural blades; and determining if a primary blade flag is set. If the primary blade flag is set, selecting the blade with the EBP priority number. If the primary blade flag is not selected, then selecting a blade with an EBP priority number if the EBP priority number is less than a retained priority number.
Description
BACKGROUND

1. Field of the Invention


The present invention relates to networking systems, and more particularly to systems using fibre channel fabrics for interconnecting fibre channel devices.


2. Background of the Invention


Fibre channel is a set of American National Standard Institute (ANSI) standards which provide a serial transmission protocol for storage and network protocols such as HIPPI, SCSI, IP, ATM and others. Fibre channel provides an input/output interface to meet the requirements of both channel and network users.


Fibre channel supports three different topologies: point-to-point, arbitrated loop and fibre channel fabric. The point-to-point topology attaches two devices directly. The arbitrated loop topology attaches devices in a loop. The fibre channel fabric topology attaches host systems directly to a fabric, which are then connected to multiple devices. The fibre channel fabric topology allows several media types to be interconnected.


Fibre channel is a closed system that relies on multiple ports to exchange information on attributes and characteristics to determine if the ports can operate together. If the ports can work together, they define the criteria under which they communicate.


In fibre channel a path is established between two nodes where the path's primary task is to transport data from one point to another at high speed with low latency, performing only simple error detection in hardware. The fibre channel switch provides circuit/packet switched topology by establishing multiple simultaneous point-to-point connections.


Fibre channel fabric devices include a node port or “N_Port” that manages fabric connections. The N_port establishes a connection to a fabric element (e.g., a switch) having a fabric port or F_port. Fabric elements include the intelligence to handle routing, error detection, recovery, and similar management functions.


A fibre channel switch is a multi-port device where each port manages a simple point-to-point connection between itself and its attached system. Each port can be attached to a server, peripheral, I/O subsystem, bridge, hub, router, or even another switch. A switch receives a message from one port and automatically routes it to another port. Multiple calls or data transfers happen concurrently through the multi-port fibre channel switch.


Fibre channel switches may use multiple modules (also referred to as “blades”) connected by fibre channel ports. Conventionally, a multi-module switch is integrated as a single switch and appears to other devices in the fibre channel fabric as a single switch.


Conventional systems do not have an efficient way to select a primary blade so that a multi-module switch appears as a single switch.


Therefore, what is required is a process and system that efficiently selects a primary blade in a multi-module switch environment so that a multi-module switch appears as a single switch to other devices.


SUMMARY OF THE INVENTION

In one aspect, the present invention solves the foregoing drawbacks by providing a method for selecting a primary blade in a multi-module fibre channel switch with plural blades. The method includes sending exchangeable blade parameter(s) (“EBP”) to plural blades; and determining if a primary blade flag is set. If the primary blade flag is set, selecting the blade with the EBP priority number and blade slot number. If the primary blade flag is not selected, then selecting a blade with an EBP priority number less than a retained EBP priority number.


In yet another aspect, the method according to the present invention includes selecting a blade with an EBP priority number equal to the retained priority number and a EBP slot number less than a retained primary blade slot number. Thereafter the process sends EBPs to all blades notifying plural blades of the selected primary blade.


In yet another aspect, a method for selecting a primary blade in a multi-module fibre channel switch with plural blades is provided. The method includes intializing plural blade internal ports; starting a timer; sending EBPs to plural blades; selecting a primary blade; and notifying all blades regarding the selected primary blade.


In yet another aspect of the present invention, a system for selecting a primary blade in a multi-module fibre channel switch with plural blades is provided. The system includes a state machine for sending exchangeable blade parameter(s) (“EBP”) to the plural blades; and determining if a primary blade flag is set. If the primary blade flag is set, selecting the blade with the EBP priority number and blade slot number. If the primary blade flag is not selected, then the state machine selects a blade with an EBP priority number less than a retained EBP priority number.


In another aspect, the state machine selects a blade with an EBP priority number equal to the retained priority number and an EBP slot number is less than a retained primary blade slot number.


The state machine also sends EBPs to plural blades notifying the blades of the selected primary blade.


In yet another aspect, a system for selecting a primary blade in a multi module fibre channel switch with plural blades is provided. The system includes a state machine for intializing plural blade internal ports; starting a timer; sending EBPs to plural blades; selecting a primary blade; and notifying all blades regarding the selected primary blade.


In one aspect of the present invention, an efficient process for selecting a primary blade is provided so that the multiple modules in a fibre channel switch are able to self-configure to appear as a single switch, without user configuration or intervention. The foregoing process functions even if not all the modules are present, or if some of the internal ports linking modules have failed, as long as connectivity exists internally between the modules.


This brief summary has been provided so that the nature of the invention may be understood quickly. A more complete understanding of the invention can be obtained by reference to the following detailed description of the preferred embodiments thereof concerning the attached drawings.





BRIEF DESCRIPTION OF THE DRAWINGS

The foregoing features and other features of the present invention will now be described with reference to the drawings of a preferred embodiment of a disk drive. In the drawings, the same components have the same reference numerals. The illustrated embodiment is intended to illustrate, but not to limit the invention. The drawings include the following Figures:



FIG. 1, as described above, shows a block diagram of a fibre channel system using a fibre channel fabric;



FIG. 2 is a block diagram showing mutli-module switch;



FIG. 3 is block diagram of a switch module in a multi-module switch environment that can select a primary blade, according to one aspect of the present invention;



FIG. 4 is a process flow diagram of executable process steps for selecting a primary blade in a multi-module switch environment; and



FIG. 5 is a flow diagram of a executable process steps for processing exchange blade parameters for selecting a primary blade, according to one aspect of the present invention.





DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

Definitions:


The following definitions are provided as they are typically (but not exclusively) used in the fibre channel environment, implementing the various adaptive aspects of the present invention.


“Blade”: A module in a fibre channel switch.


“Blade_Id”: A unique identifier for identifying a switch module.


“B_S_TOV Timer”: A timer to detect inactivity during primary blade selection.


“EBP”: Exchange Blade Parameters, created by Multi-Blade Protocol


“Fibre channel ANSI Standard”: The standard describes the physical interface, transmission and signaling protocol of a high performance serial link for support of other high level protocols associated with IPI, SCSI, IP, ATM and others.


“FC-1”: Fibre channel transmission protocol, which includes serial encoding, decoding and error control.


“FC-2”: Fibre channel signaling protocol that includes frame structure and byte sequences.


“FC-3”: Defines a set of fibre channel services that are common across plural ports of a node.


“FC-4”: Provides mapping between lower levels of fibre channel, IPI and SCSI command sets, HIPPI data framing, IP and other upper level protocols.


“Fabric”: A system which interconnects various ports attached to it and is capable of routing fibre channel frames by using destination identifiers provided in FC-2 frame headers.


“Fabric Topology”: This is a topology where a device is directly attached to a fibre channel fabric that uses destination identifiers embedded in frame headers to route frames through a fibre channel fabric to a desired destination.


Multi Blade protocol: A protocol that operates on internal switch module ports to assign a primary blade.


Port: A general reference to N. Sub.-- Port or F.Sub.-- Port.


“Slot Number”: A unique identifier for each blade in a multi-module switch derived from the physical location of the blade in a chasis.


The Fibre Channel Specification used to build one embodiment of the present invention includes:


FC-SW-2 standard as published by the American National Standard Institute.


To facilitate an understanding of the preferred embodiment, the general architecture and operation of a fibre channel system will be described. The specific architecture and operation of the preferred embodiment will then be described with reference to the general architecture of the fibre channel system.



FIG. 1 is a block diagram of a fibre channel system 100 implementing the methods and systems in accordance with the adaptive aspects of the present invention. System 100 includes plural devices that are interconnected. Each device includes one or more ports, classified as node ports (N_Ports), fabric ports (F_Ports), and expansion ports (E_Ports). Node ports may be located in a node device, e.g. server 103, disk array 105 and storage device 104. Fabric ports are located in fabric devices such as switch 101 and 102. Arbitrated loop 105 may be operationally coupled to switch 101 using arbitrated loop ports (FL;Ports).


The devices of FIG. 1 are operationally coupled via “links” or “paths”. A path may be established between two N_ports, e.g. between server 103 and storage 104. A packet-switched path may be established using multiple links, e.g. an N-Port in server 103 may establish a path with disk array 105 through switch 102.


Switch 101 includes an E_Port that enables a path to another switch 102. An inter-switch link (“ISL”) enables N_Ports to operationally couple to other N-Ports in a fabric.



FIG. 2 is a block diagram that shows plural switch modules (or blades) 102A-102F (or 103) integrated into a single multi-module switch 200. Internal ports between the switch modules operate on a multi-blade protocol, while external ports operate under FC-SW-2 protocol. Because of the executable process steps described below, one of the switch modules out of 102A-102F operates as a primary blade so that to other devices in fibre channel system 100, switch module 200 appears as a single switch.



FIG. 3 is a block diagram of a blade in a multi-module switch, e.g. blade 102A, that implements the adaptive aspects of the present invention. Switch module 102A includes plural external ports (F_Ports operationally coupled to other devices, e.g. server 103; or E_Ports coupled to other switch modules) 300A through 300D; and internal ports 301A-301D that operate under the multi-blade protocol.


Blade 102A also includes a primary blade state machine 302 that uses EBPs under the multi-blade protocol to select the primary blade module for module 200.


Also included in blade 102A is a principal switch state machine 303 that selects a principal switch from among plural multi-module switches


Primary Blade Selection:



FIG. 4 shows a flow diagram of executable process steps for selecting a primary blade in a multi-module switch environment. In one aspect of the present invention EBP parameters are used to select a primary blade, and once a primary blade is selected other blades are notified of the primary blade selection. A blade with the lowest priority and slot number is selected as the primary blade. As defined above, a slot number is unique to a particular blade (or switch module, used interchangeably throughout this specification).


Turning in detail to FIG. 4, in step S400 the process starts and switch module 200 is initialized.


In step S401, retained primary blade priority and blade number is initialized to the blade's priority and blade number.


In step S402, internal ports 301A-301D are initialized.


In step S403, a B_S-TOV timer is started and thereafter, in steps S404, an EBP request is sent to all adjacent blades. In one aspect the B_S_TOV timer (not shown) is operationally coupled or integrated with state machine 302.


An example of an EBP request is provided below:









TABLE 1







EBP Request Payload











Byte



Item
Size







Command Code = hex′ 82′
1



Reserved
1



Payload Length
2



Reserved
3



Primary Blade Priority
1



Reserved
3



Primary Blade Slot
1



Number



Reserved
3



Primary Blade Assigned
1



Local Domain Id Status
1



Reserved
2



Local Domain Id
1



Reserved
3



Switch Priority
1



Design specific data
N










Payload Length: This field may contain a 16-bit unsigned integer that specifies the total payload length in bytes. This value is hex′18′+size of design specific data.


Primary Blade Priority: This field specifies the priority level of a blade that an EBP transmitting blade believes is the primary blade.


Primary Blade Slot Number: This field specifies the slot number of the blade that the EBP transmitting blade believes is the primary blade. This value uniquely identifies each blade in a switch derived from the physical location of the module in a chassis.


Primary Blade Assigned: This field indicates that the primary blade role is assigned. If zeros the primary blade has not been selected. If non-zero, the primary blade has been selected. Table 2 below shows an example of primary blade values.









TABLE 2







Primary Blade


Assigned Status








value
Comments





0
Unassigned. Primary



blade selection is



in progress.


1
Assigned. Primary



blade role assigned.









In step S405, the process determines if all switch modules have received an EBP payload. If an EBP payload has been received, then the EBP is processed in step S406, as shown in the process steps of FIG. 5. If a primary blade has been selected, as determined in step S407, the local blade is set as a non-primary blade in step S408. If the primary blade has not been selected, then the process moves back to step S405.


If an EBP is not received in step s405, then in step S405A, the process determines, if the B_S_TOV timer has expired. If the timer has not expired the process moves to step s405.


If the timer has expired, then in step S409, the process determines if the retained slot number is the local slot number. If not, the process moves to step s405.


If the retained slot number is the local slot number, then in step S410, the local blade is set as the primary blade.


In step S411, the primary blade sends EBPs to all internal ports and the selected blade operates as the primary blade in step S412.



FIG. 5 is a flow diagram of executable process steps that describes processing of EBPs (step S406) for selecting a primary blade, according to one aspect of the present invention.


Turning in detail to FIG. 5, in step S500, EBP's are received and the B_S_TOV timer is started.


In step S501, the EBP payload is analyzed by primary blade state machine 302, to determine whether a primary blade flag is set. If it is set, then the process moves to step S503, where the EBP priority and slot number replaces the retained priority and slot number.


If the primary blade flag is not set in step S501, then in step S502, the process determines if the EBP priority is less than the retained priority. If it is less, then the process moves to step S503.


If the EBP priority is not less than the retained priority, then in step S506, the process determines if the EBP priority is equal to the retained priority. If not, the process terminates at step S508.


If the EBP priority is equal to the retained priority, then in step S507, the process determines if the EBP slot number is less than the retained slot number. If it is less, then the process moves to step S503. If not, the process terminates at step S508.


Once the EBP priority and slot number are retained in step S503, in step S504 (similar to step S411), EBPs are sent to all internal ports with the selected primary blade and the process terminates in step S505.


In one aspect of the present invention, an efficient process for selecting a primary blade is provided so that the multiple modules in a fibre channel switch are able to self-configure to appear as a single switch, without user configuration or intervention. The foregoing process functions even if not all the modules are present, or if some of the internal ports linking modules have failed, as long as connectivity exists internally between the modules.


Although the present invention has been described with reference to specific embodiments, these embodiments are illustrative only and not limiting. Many other applications and embodiments of the present invention will be apparent in light of this disclosure and the following claims.

Claims
  • 1. A method for a multi-module switch, comprising: selecting a primary blade from among a plurality of blades by sending exchangeable blade parameter(s) (“EBP”) to the plural blades; andnotifying at least another blade of primary blade selection,wherein the method for selecting the primary blade, comprises:determining if a primary blade flag is set in an EBP payload; andselecting a blade with a EBP priority and a blade slot number if the primary blade flag is selected.
  • 2. The method of claim 1, further comprising: selecting a blade with an EBP priority number if the EBP priority number is less than a retained priority number and the primary blade flag is un-selected.
  • 3. The method of claim 1, further comprising: selecting a blade with an EBP priority number equal to a retained priority number and an EBP slot number is less than a retained primary blade slot number.
  • 4. The method of claim 1, further comprising: sending EBPs to plural blades notifying the blades of a selected primary blade.
  • 5. A system for selecting a primary blade in a multi-module fibre channel switch with plural blades, comprising; a port for sending exchangeable blade parameter(s) (“EBP”) to the plural blades; and determining if a primary blade flag is set in an EBP payload.
  • 6. The system of claim 5, wherein the port selects a blade with an EBP priority and a blade slot number if the primary blade flag is selected.
  • 7. The system of claim 5, wherein a blade is selected if the blade has an EBP priority number and the EBP priority number is less than a retained priority number and the primary blade flag is un-selected.
  • 8. The system of claim 5, wherein a blade is selected if the blade has an EBP priority number equal to a retained priority number and an EBP slot number is less than a retained primary blade slot number.
  • 9. The system of claim 5, wherein the port sends EBPs to the plural blades notifying the blades of the selected primary blade.
CROSS REFERENCE TO RELATED APPLICATION

This application is a continuation of application Ser. No. 10/200,487 filed Jul. 2, 2002, now U.S. Pat. No. 7,154,886 the disclosure of which is incorporated herein by reference. This application is related to U.S. patent Application entitled “METHOD AND SYSTEM FOR DYNAMICALLY ASSIGNING DOMAIN IDENTIFICATION IN A MULTI-MODULE FIBRE CHANNEL SWITCH”, U.S. Ser. No.10/200,393, having common inventors and Assignee, filed on Jul. 22, 2002, the disclosure of which is incorporated herein by reference in its' entirety.

US Referenced Citations (277)
Number Name Date Kind
4081612 Hafner Mar 1978 A
4162375 Schilichte Jul 1979 A
4200929 Davidjuk et al. Apr 1980 A
4268906 Bourke et al. May 1981 A
4333143 Calder Jun 1982 A
4382159 Bowditch May 1983 A
4425640 Philip et al. Jan 1984 A
4449182 Rubinson et al. May 1984 A
4546468 Christmas et al. Oct 1985 A
4549263 Calder Oct 1985 A
4569043 Simmons et al. Feb 1986 A
4725835 Schreiner et al. Feb 1988 A
4777595 Strecker et al. Oct 1988 A
4783730 Fischer et al. Nov 1988 A
4783739 Calder Nov 1988 A
4803622 Bain, Jr. et al. Feb 1989 A
4821034 Anderson et al. Apr 1989 A
4980857 Walter et al. Dec 1990 A
5051742 Hullett et al. Sep 1991 A
5090011 Fukuta et al. Feb 1992 A
5115430 Hahne et al. May 1992 A
5129064 Fogg, Jr. et al. Jul 1992 A
5144622 Takiyasu et al. Sep 1992 A
5212795 Hendry May 1993 A
5249279 Schmenk et al. Sep 1993 A
5260933 Rouse Nov 1993 A
5276807 Kodama et al. Jan 1994 A
5321816 Rogan et al. Jun 1994 A
5339311 Turner Aug 1994 A
5347638 Desai et al. Sep 1994 A
5367520 Cordell Nov 1994 A
5371861 Keener et al. Dec 1994 A
5390173 Spinney et al. Feb 1995 A
5448702 Garcia, Jr. et al. Sep 1995 A
5568165 Kimura Oct 1996 A
5568614 Mendelson et al. Oct 1996 A
5590125 Acampora et al. Dec 1996 A
5598541 Malladi et al. Jan 1997 A
5610745 Bennett Mar 1997 A
5623492 Teraslinna Apr 1997 A
5647057 Roden et al. Jul 1997 A
5666483 McClary Sep 1997 A
5671365 Binford et al. Sep 1997 A
5687172 Cloonan et al. Nov 1997 A
5701416 Thorson et al. Dec 1997 A
5706279 Teraslinna Jan 1998 A
5740467 Chmielecki et al. Apr 1998 A
5748612 Stoevhase et al. May 1998 A
5758187 Young May 1998 A
5761427 Shah et al. Jun 1998 A
5790840 Bulka et al. Aug 1998 A
5812525 Teraslinna Sep 1998 A
5818842 Burwell et al. Oct 1998 A
5821875 Lee et al. Oct 1998 A
5825748 Barkey et al. Oct 1998 A
5828475 Bennett et al. Oct 1998 A
5828903 Sethuram et al. Oct 1998 A
5835752 Chiang et al. Nov 1998 A
5850386 Anderson et al. Dec 1998 A
5875343 Binford et al. Feb 1999 A
5881296 Williams et al. Mar 1999 A
5892969 Young Apr 1999 A
5894560 Carmichael et al. Apr 1999 A
5905905 Dailey et al. May 1999 A
5917723 Binford Jun 1999 A
5937169 Connery et al. Aug 1999 A
5954796 McCarty et al. Sep 1999 A
5968143 Chisholm et al. Oct 1999 A
5978359 Caldara et al. Nov 1999 A
5978379 Chan et al. Nov 1999 A
5983292 Nordstrom et al. Nov 1999 A
5987028 Yang et al. Nov 1999 A
5999528 Chow et al. Dec 1999 A
6006340 O'Connell Dec 1999 A
6014383 McCarty Jan 2000 A
6021128 Hosoya et al. Feb 2000 A
6026092 Abu-Amara et al. Feb 2000 A
6031842 Trevitt et al. Feb 2000 A
6047323 Krause Apr 2000 A
6049802 Waggener, Jr. et al. Apr 2000 A
6055603 Ofer et al. Apr 2000 A
6055618 Thorson Apr 2000 A
6061360 Miller et al. May 2000 A
6078970 Nordstrom Jun 2000 A
6081512 Muller et al. Jun 2000 A
6085277 Nordstrom et al. Jul 2000 A
6108738 Chambers et al. Aug 2000 A
6108778 LaBerge Aug 2000 A
6115761 Daniel et al. Sep 2000 A
6118776 Berman Sep 2000 A
6128292 Kim et al. Oct 2000 A
6138176 McDonald et al. Oct 2000 A
6144668 Bass et al. Nov 2000 A
6160813 Banks et al. Dec 2000 A
6185620 Weber et al. Feb 2001 B1
6201787 Baldwin et al. Mar 2001 B1
6229822 Chow et al. May 2001 B1
6233244 Runaldue et al. May 2001 B1
6240096 Book May 2001 B1
6246683 Connery et al. Jun 2001 B1
6247060 Boucher et al. Jun 2001 B1
6252891 Perches Jun 2001 B1
6253267 Kim et al. Jun 2001 B1
6269413 Sherlock Jul 2001 B1
6289002 Henson et al. Sep 2001 B1
6308220 Mathur Oct 2001 B1
6324181 Wong et al. Nov 2001 B1
6330236 Ofek et al. Dec 2001 B1
6334153 Boucher et al. Dec 2001 B2
6343324 Hubis et al. Jan 2002 B1
6353612 Zhu et al. Mar 2002 B1
6370605 Chong Apr 2002 B1
6389479 Boucher et al. May 2002 B1
6393487 Boucher et al. May 2002 B2
6401128 Stai et al. Jun 2002 B1
6411599 Blanc et al. Jun 2002 B1
6411627 Hullett et al. Jun 2002 B1
6418477 Verma Jul 2002 B1
6424658 Mathur Jul 2002 B1
6427171 Craft et al. Jul 2002 B1
6427173 Boucher et al. Jul 2002 B1
6434620 Boucher et al. Aug 2002 B1
6434630 Micalizzi, Jr. et al. Aug 2002 B1
6449274 Holden et al. Sep 2002 B1
6452915 Jorgensen Sep 2002 B1
6457090 Young Sep 2002 B1
6463032 Lau et al. Oct 2002 B1
6467008 Gentry et al. Oct 2002 B1
6470026 Pearson et al. Oct 2002 B1
6470173 Okada et al. Oct 2002 B1
6470415 Starr et al. Oct 2002 B1
6502189 Westby Dec 2002 B1
6504846 Yu et al. Jan 2003 B1
6532212 Soloway et al. Mar 2003 B1
6546010 Merchant et al. Apr 2003 B1
6564271 Micalizzi et al. May 2003 B2
6570850 Gutierrez et al. May 2003 B1
6570853 Johnson et al. May 2003 B1
6591302 Boucher et al. Jul 2003 B2
6594231 Byham et al. Jul 2003 B1
6597691 Anderson et al. Jul 2003 B1
6597777 Ho Jul 2003 B1
6614796 Black et al. Sep 2003 B1
6657962 Barri et al. Dec 2003 B1
6697359 George Feb 2004 B1
6697368 Chang et al. Feb 2004 B2
6718497 Whitby-Strevens Apr 2004 B1
6721799 Slivkoff Apr 2004 B1
6738381 Agnevik et al. May 2004 B1
6744772 Eneboe et al. Jun 2004 B1
6760302 Ellinas et al. Jul 2004 B1
6775693 Adams Aug 2004 B1
6785241 Lu et al. Aug 2004 B1
6807181 Weschler Oct 2004 B1
6810440 Micalizzi, Jr. et al. Oct 2004 B2
6810442 Lin Oct 2004 B1
6816492 Turner et al. Nov 2004 B1
6816750 Klaas Nov 2004 B1
6859435 Lee et al. Feb 2005 B1
6865157 Scott et al. Mar 2005 B1
6886141 Kunz et al. Apr 2005 B1
6941357 Nguyen et al. Sep 2005 B2
6941482 Strong Sep 2005 B2
6952659 King et al. Oct 2005 B2
6968463 Pherson et al. Nov 2005 B2
7000025 Wilson Feb 2006 B1
7002926 Eneboe et al. Feb 2006 B1
7010607 Bunton Mar 2006 B1
7039070 Kawakatsu May 2006 B2
7039870 Takaoka et al. May 2006 B2
7047326 Crosbie et al. May 2006 B1
7050392 Valdevit May 2006 B2
7055068 Riedl May 2006 B2
7061862 Horiguchi et al. Jun 2006 B2
7061871 Sheldon et al. Jun 2006 B2
7092374 Gubbi Aug 2006 B1
7110394 Chamdani et al. Sep 2006 B1
7123306 Goto et al. Oct 2006 B1
7124169 Shimozono et al. Oct 2006 B2
7151778 Zhu et al. Dec 2006 B2
7171050 Kim Jan 2007 B2
7185062 Lolayekar et al. Feb 2007 B2
7188364 Volpano Mar 2007 B2
7190667 Susnow et al. Mar 2007 B2
7194538 Rabe et al. Mar 2007 B1
7200108 Beer et al. Apr 2007 B2
7215680 Mullendore et al. May 2007 B2
7221650 Cooper et al. May 2007 B1
7245613 Winkles et al. Jul 2007 B1
7248580 George et al. Jul 2007 B2
7269131 Cashman et al. Sep 2007 B2
7292593 Winkles et al. Nov 2007 B1
7327680 Kloth Feb 2008 B1
20010011357 Mori Aug 2001 A1
20010022823 Renaud Sep 2001 A1
20010038628 Ofek et al. Nov 2001 A1
20010047460 Kobayashi et al. Nov 2001 A1
20020016838 Geluc et al. Feb 2002 A1
20020034178 Schmidt et al. Mar 2002 A1
20020071387 Horiguchi et al. Jun 2002 A1
20020103913 Tawil et al. Aug 2002 A1
20020104039 DeRolf et al. Aug 2002 A1
20020124124 Matsumoto et al. Sep 2002 A1
20020147560 Devins et al. Oct 2002 A1
20020147843 Rao Oct 2002 A1
20020156918 Valdevit et al. Oct 2002 A1
20020159385 Susnow et al. Oct 2002 A1
20020172195 Pekkala et al. Nov 2002 A1
20020191602 Woodring et al. Dec 2002 A1
20020196773 Berman Dec 2002 A1
20030002503 Brewer et al. Jan 2003 A1
20030016683 George et al. Jan 2003 A1
20030021239 Mullendore et al. Jan 2003 A1
20030026267 Oberman et al. Feb 2003 A1
20030026287 Mullendore et al. Feb 2003 A1
20030035433 Craddock et al. Feb 2003 A1
20030046396 Richter et al. Mar 2003 A1
20030056000 Mullendore et al. Mar 2003 A1
20030072316 Niu et al. Apr 2003 A1
20030079019 Lolayekar et al. Apr 2003 A1
20030084219 Yao et al. May 2003 A1
20030086377 Berman May 2003 A1
20030091062 Lay et al. May 2003 A1
20030103451 Lutgen et al. Jun 2003 A1
20030117961 Chuah et al. Jun 2003 A1
20030120983 Vieregge et al. Jun 2003 A1
20030126223 Jenne et al. Jul 2003 A1
20030126320 Liu et al. Jul 2003 A1
20030137941 Kaushik et al. Jul 2003 A1
20030174652 Ebata Sep 2003 A1
20030174721 Black et al. Sep 2003 A1
20030174789 Waschura et al. Sep 2003 A1
20030179709 Huff Sep 2003 A1
20030179748 George et al. Sep 2003 A1
20030189930 Terrell et al. Oct 2003 A1
20030189935 Warden et al. Oct 2003 A1
20030191857 Terell et al. Oct 2003 A1
20030195983 Krause Oct 2003 A1
20030218986 DeSanti et al. Nov 2003 A1
20030229808 Heintz et al. Dec 2003 A1
20030236953 Grieff et al. Dec 2003 A1
20040013092 Betker et al. Jan 2004 A1
20040013125 Betker et al. Jan 2004 A1
20040015638 Bryn Jan 2004 A1
20040024831 Yang et al. Feb 2004 A1
20040028038 Anderson et al. Feb 2004 A1
20040057389 Klotz et al. Mar 2004 A1
20040081186 Warren et al. Apr 2004 A1
20040081394 Biren et al. Apr 2004 A1
20040085955 Walter et al. May 2004 A1
20040085994 Warren et al. May 2004 A1
20040100944 Richmond et al. May 2004 A1
20040109418 Fedorkow et al. Jun 2004 A1
20040123181 Moon et al. Jun 2004 A1
20040141521 George et al. Jul 2004 A1
20040151188 Maveli et al. Aug 2004 A1
20040153914 El-Batal Aug 2004 A1
20040174813 Kasper et al. Sep 2004 A1
20040208201 Otake Oct 2004 A1
20040267982 Jackson et al. Dec 2004 A1
20050023656 Leedy Feb 2005 A1
20050036499 Dutt et al. Feb 2005 A1
20050036763 Kato et al. Feb 2005 A1
20050073956 Moores et al. Apr 2005 A1
20050076113 Klotz et al. Apr 2005 A1
20050088969 Carlsen et al. Apr 2005 A1
20050117522 Basavaiah et al. Jun 2005 A1
20050177641 Yamagami Aug 2005 A1
20050198523 Shanbhag et al. Sep 2005 A1
20060013248 Mujeeb et al. Jan 2006 A1
20060034192 Hurley et al. Feb 2006 A1
20060047852 Shah et al. Mar 2006 A1
20060074927 Sullivan et al. Apr 2006 A1
20060107260 Motta May 2006 A1
20060184711 Pettey Aug 2006 A1
20060203725 Paul et al. Sep 2006 A1
20070206502 Martin et al. Sep 2007 A1
Foreign Referenced Citations (8)
Number Date Country
0649098 Apr 1995 EP
0738978 Oct 1996 EP
0856969 Aug 1998 EP
1059588 Dec 2000 EP
WO-9506286 Mar 1995 WO
WO-9836537 Aug 1998 WO
WO-0058843 Oct 2000 WO
WO-03088050 Oct 2003 WO
Related Publications (1)
Number Date Country
20070081527 A1 Apr 2007 US
Continuations (1)
Number Date Country
Parent 10200487 Jul 2002 US
Child 11608634 US