Patent Grant
7979656
This disclosure relates generally to an enterprise method, a technical field of software and/or hardware technology and, in one example embodiment, to minimizing configuration of nodes through a switch virtualization technique.
A production server (e.g. a web server, an application server etc.) may be coupled to a collection of devices (e.g. a storage appliance, a secondary storage device etc.) in a storage network (e.g. a storage area network (SAN), a network designed to attach computer storage devices, a network switch compatible with a Fiber Channel protocol such as a Brocade® (AP7600 class switch and/or a FA4-18 blade that plugs into a switch, etc). The storage network may utilize a hierarchy of protocols (e.g. a Fiber Channel zoning protocol, a LUN masking protocol, a small computer system interface (SCSI) reservation protocol, etc.) to control access to one or more nodes in the storage network.
The Fiber Channel (e.g. gigabit-speed network technology used for storage networking) zoning protocol (e.g., partition a Fiber Channel fabric into smaller subsets to restrict interference, add security, simplify management, etc.) may restrict communication between a group of nodes of a Fiber Channel fabric (e.g. a switched fabric of Fiber Channel devices enabled by a Fiber Channel switch).
The LUN masking protocol may be an authorization process that makes the LUN available to a set of the collection of production servers and/or the collection of devices and unavailable to another set of the collection of production servers and/or the collection of devices. The SCSI reservation may limit access by an initiator for input/output (I/O) operations to a portion of a LUN represented storage volume.
An event may occur that may lead to a loss of the data (e.g. a disaster destroys the appliance upon which the data is stored, a user may accidentally delete a data file, a data file may be corrupted, a computer virus may damage the data, a network failure, etc.) stored in the network. Thus, an enterprise class data protection system (e.g. making copies of data so that these additional copies may be used to restore the original after a data loss event, etc.) may be used to back up the data in a collection of back up storage devices.
The enterprise class data protection system may require that backup servers have access to the protected storage (e.g. the storage used by a collection of production servers) and/or the collection of backup servers in order to request a data read and/or a data write in order to back up the data. However, the hierarchy of protocols may block the access of the backup storage device to the collection of production servers and/or the collection of backup storage devices.
Consequently, the backup storage devices may not be able to read and/or write data from the other devices in the computer network without altering the hierarchy of protocols. Altering the hierarchy of protocols may require the manual reconfiguration of the hierarchy of protocols of the storage network. This process may be time consuming and expensive and thus decrease the value of the enterprise class data protection system.
A method, system, and apparatus of minimizing configuration of nodes through a switch virtualization technique are disclosed. In one aspect, the method includes configuring a switch (e.g., may be part of a storage area network) such that a write request (e.g., may originate from the physical initiator) to a primary storage device is transferred through a virtual initiator in the switch to the primary storage device and to a secondary storage device, configuring the switch such that a read request from the secondary initiator (e.g., may be bound to each of the physical initiators and using the binding to bypass a SCSI reservation) of a data (e.g., may be a current state of information on the primary storage device) in the primary storage device appears as though the read request is coming from a physical initiator rather than the secondary initiator (e.g., such that system protocol is bypassed because the switch intercepts a response having the data from the primary storage device through a virtual target which uses the virtual initiator of the switch to communicate the data to the secondary initiator rather than the physical initiator), and minimizing configuration of nodes (e.g., may include the physical initiator and/or the secondary initiator) of a continuous-backup system through the configuration of the switch and the interception of the response in the switch.
The write request may be transferred to the virtual target in the switch before being transferred through the virtual initiator in the switch to the primary storage device and/or to the secondary storage device. A binding between the primary storage device, the secondary storage device, the physical initiator, and/or the secondary initiator may be created through a frame redirect zone in a switch fabric and/or through an application of a twenty-four bit Fiber Channel address of the physical initiator to the virtual initiator in the switch (e.g., the virtual initiator may appear to the primary storage device as the physical initiator). The system protocol may be a Fiber Channel zoning protocol, logic unit number (LUN) masking protocol and/or a small computer system interface (SCSI) reservation protocol. This method, among others, may be used to create a binding.
In another aspect, a method includes receiving a write request from a physical initiator, transferring the write request through a virtual initiator of a switch (e.g., may be part of a storage area network) to a primary storage device and to a secondary storage device, bypassing at least one system protocol (e.g., may be Fiber Channel zoning protocol, logic unit number (LUN) masking protocol and/or a small computer system interface (SCSI) reservation protocol) when the switch intercepts a response having a data (e.g., may be a current state of information on the primary storage device) from the primary storage device through a virtual target of the switch which uses the virtual initiator of the switch to communicate the data to a secondary initiator rather than the physical initiator when the switch is configured such that a read request of the data of the primary storage device appears as though the read request is coming from the physical initiator rather than the secondary initiator.
The write request may be transferred to the virtual target in the switch before being transferred through the virtual initiator in the switch to the primary storage device and/or to the secondary storage device. A binding between the primary storage device, the secondary storage device, the physical initiator, and/or the secondary initiator may be created through a frame redirect zone in a switch fabric and/or through an application of a twenty-four bit Fiber Channel address of the physical initiator to the virtual initiator in the switch (e.g., the virtual initiator may appear to the primary storage device as the physical initiator). The switch may be part of a storage area network. The physical initiator and/or the secondary initiator may be nodes of the storage area network. The secondary initiator may bypass the SCSI reservation by using a multipath module to perform read input/output operations. The storage device may be presented across a plurality of backup servers.
A method includes algorithmically determining a set of physical initiators to perform a discovery operation upon, establishing a binding between each physical initiator of the set of physical initiators and a secondary initiator, determining a physical target associated with a physical initiator of the set of physical initiators, algorithmically determining a set of logic unit numbers (LUN's) behind the physical target as available to the physical initiator, and algorithmically querying a LUN paired to the physical initiator.
The set of physical initiators may be determined through a fabric nameserver database (e.g., a service and/or an entity that may run on a Fibre Channel network and/or a Fibre Channel connected network that provides registration, query and/or translation services to connected nodes (of nodes that may be FC initiators and/or targets)). In addition, the set of physical initiators may determined a fabric zoning database (e.g., a service or an entity that may run in a Fibre Channel network and/or a Fibre Channel connected network that provides for and/or enforces restrictions on which nodes can view and/or access each other's resources). The set of physical initiators may also be determined with an algorithm that takes as an input the fabric nameserver database and the fabric zoning database and reduces a number of physical initiator and a number of physical target combinations upon which discovery has to be performed on. The set of physical initiators may be determined with a manual input. This method, among others, may also be used to create a binding.
In yet another aspect, the system of switch includes a transfer module to communicate a write request to a primary storage device through a virtual initiator in the switch (e.g., may be part of a storage area network) to the primary storage device and to a secondary storage device, an intercept module to make a read request of a data (e.g., may be a current state of information on the primary storage device) in the primary storage device appear as though the read request is coming from a physical initiator rather than a secondary initiator, such that at least one system protocol (e.g., may be a Fiber Channel zoning protocol, logic unit number (LUN) masking protocol and a small computer system interface (SCSI) reservation protocol) is bypassed because the switch intercepts a response having the data from the primary storage device through a virtual target which uses the virtual initiator of the switch to communicate the data to the secondary initiator rather than the physical initiator, and an optimization module to minimize configuration of nodes (e.g., may include the physical initiator and/or the secondary initiator) of a continuous-backup system through the configuration of the switch and/or the interception of the response in the switch.
The write request may be transferred to the virtual target in the switch before being transferred through the virtual initiator in the switch to the primary storage device and/or to the secondary storage device. A binding between the primary storage device, the secondary storage device, the physical initiator, and/or the secondary initiator may be created through a frame redirect zone in a switch fabric and/or through an application of a twenty-four bit Fiber Channel address of the physical initiator to the virtual initiator in the switch (e.g., the virtual initiator may appear to the primary storage device as the physical initiator). This method, among others, may also be used to create a binding.
The methods, systems, and apparatuses disclosed herein may be implemented in any means for achieving various aspects, and may be executed in a form of a machine-readable medium embodying a set of instructions that, when executed by a machine, cause the machine to perform any of the operations disclosed herein. Other features will be apparent from the accompanying drawings and from the detailed description that follows.
Example embodiments are illustrated by way of example and not limitation in the figures of the accompanying drawings, in which like references indicate similar elements and in which:
Other features of the present embodiments will be apparent from the accompanying drawings and from the detailed description that follows.
A method, system, and apparatus of minimizing configuration of nodes through a switch virtualization technique are disclosed. Although the present embodiments have been described with reference to specific example embodiments, it will be evident that various modifications and changes may be made to these embodiments without departing from the broader spirit and scope of the various embodiments.
In one embodiment, a method includes configuring a switch (e.g., the switch 100 of
In another embodiment, the method includes receiving a write request from a physical initiator (e.g., the physical initiator(s) 102 of
In yet another embodiment, a switch (e.g., the switch 100 of
The switch 100 may be a device used for networking (e.g., connecting network segments) that may communicate the request/responses between the initiators, storage devices, storage area networks etc. to transfer the data between the devices. The physical initiator(s) 102 may be a computer, controllers, servers, other client devices etc., which may make a read/write request from the target machines in the network. The secondary initiator 104 be may be a server/data processing device, computer, etc. which may be one of the nodes of the switch 100.
The primary storage device 106 may be a memory device (e.g., RAM, cache memory, flash memory, hard drive, etc.) that may be used for storing (e.g., recording, holding information, etc.) the data. The secondary storage device 108 may be hard disk, optical storage devices (e.g., CD, DVD, etc.), flash memory etc. that may be used to store (e.g., hold information, etc.) the data. The SAN 110 may be architecture (e.g., arrangement, network, etc.) to attach remote storage devices (e.g., disk arrays, optical jukeboxes, flash devices, etc.) to the switch 100 in a way that makes the devices appear as locally attached to the operating system.
In an example embodiment, the switch 100 may connect the physical initiator(s) 102, the secondary initiator 104, the primary storage device 106, the secondary storage device 108 and the SAN 110. The switch 100 may communicate the read/write request to/from the physical initiator(s) 102, the secondary initiator 104, to the primary storage device 106, to the SAN 110 and/or to the secondary storage device. The switch 100 may communicate with storage Area Network (SAN) 110 to connect the other storage devices connected in the network.
In one embodiment, the switch 100 may be configured such that the write request to the primary storage device 106 may be transferred through the virtual initiator in the switch 100 to the primary storage device 106 and/or to the secondary storage device 108. The switch 100 may also be configured such that the read request from the secondary initiator 104 of the data in the primary storage device 106 may appear as though the read request is coming from the physical initiator(s) 102 rather than the secondary initiator 104 (e.g., such that system protocol may be bypassed because the switch 100 may intercept a response having the data from the primary storage device 106 through the virtual target which may use the virtual initiator of the switch 100 to communicate the data to the secondary initiator 104 rather than the physical initiator(s) 102). Configuration of nodes of the continuous-backup system may be minimized through the configuration of the switch 100 and/or the interception of the response in the switch 100.
The write request may originate from the physical initiator(s) 102. The set of physical initiators may be algorithmically determined to perform a discovery operation upon. The binding may be established between each physical initiator of the set of physical initiators and a secondary initiator. The physical target associated with the physical initiator(s) 102 may be determined of the set of physical initiators. The set of logic unit numbers (LUN's) behind the physical target may algorithmically determined as available to the physical initiator. The LUN paired to the physical initiator(s) 102 may be algorithmically queried. The set of physical initiators may be determined through a fabric nameserver database (e.g., A service and/or an entity that may run on a Fibre Channel network and/or a Fibre Channel connected network that provides registration, query and/or translation services to connected nodes (of nodes that may be FC initiators and/or targets)).
The set of physical initiators may determined a fabric zoning database (e.g., a service or an entity that may run in a Fibre Channel network and/or a Fibre Channel connected network that provides for and/or enforces restrictions on which nodes can view and/or access each other's resources). The set of physical initiators may also be determined with an algorithm that takes as an input the fabric nameserver database (e.g., A service and/or an entity that may run on a Fibre Channel network and/or a Fibre Channel connected network that provides registration, query and/or translation services to connected nodes (of nodes that may be FC initiators and/or targets)) and the fabric zoning database (e.g., a service or an entity that may run in a Fibre Channel network and/or a Fibre Channel connected network that provides for and/or enforces restrictions on which nodes can view and/or access each other's resources) and reduces a number of physical initiator and a number of physical target combinations upon which discovery has to be performed on. The set of physical initiators may be determined with a manual input.
The transfer module 202 may communicate a write request (e.g., a command packet for writing data) to a target device (e.g., may be the primary storage device 106, the secondary storage device 108, and/or to the SAN 110, etc.) through the virtual initiator in the switch 100. The intercept module 204 may make the read request of a data in the primary storage device appear as though the read request is coming from the physical initiator(s) 102 (e.g., may be by configuring the switch 100) rather than the secondary initiator 104 (e.g., may be by bypassing system protocols). The optimization module 206 may minimize the configuration (e.g., designing, assigning IP address, etc.) of nodes (e.g., point of connections where devices like computers, workstations, servers, etc. are connected) of the switch (e.g., the physical initiator(s) 102, the secondary initiator 104, etc.).
The virtual initiator module 208 may be a software (e.g., may be an application, program, etc.) that may be used to manage (e.g., control, communicate, route, etc.) request, responses, and/or flow of data through the switch 100. The virtual target module 210 may be used to intercept responses (e.g., resulting from requests such as data fetch, data transfer, etc.) from the storage devices (e.g., may be through the virtual target). The configure write module 212 may be used to configure (e.g., process) a write requests to the primary storage device 106, the SAN 110 and/or the secondary storage device 108 from the initiators. The configure read module 214 of the switch 100 may configure (e.g., process) a read request from the initiator to read the data (e.g., content, information) in the storage devices.
In example embodiment, the transfer module 202 may communicate with the configure write module 212. The intercept module 204 may communicate with the transfer module 202, the optimization module 206, and the virtual target module 210. The virtual target module 210 may communicate with the virtual initiator module 208. The virtual initiator module 208 may communicate with the transfer module 202.
In one embodiment, the transfer module 202 may communicate a write request to the primary storage device 106 through the virtual initiator in the switch 100 to the primary storage device 106 and/or to the secondary storage device 108. The intercept module 204 may make a read request of the data in the primary storage device 106 appear as though the read request is coming from the physical initiator(s) 102 rather than the secondary initiator 104 (e.g., such that system protocol may be bypassed because the switch 100 may intercept a response having the data from the primary storage device 106 through the virtual target which may use the virtual initiator of the switch 100 to communicate the data to the secondary initiator 104 rather than the physical initiator(s) 102).
The optimization module 206 may minimize configuration of nodes of the continuous-backup system through the configuration of the switch 100 and/or the interception of the response in the switch 100. The write request may be transferred to the virtual target in the switch 100 before being transferred through the virtual initiator in the switch 100 to the primary storage device 106 and to the secondary storage device 108. The binding between the primary storage device 106, the secondary storage device 108, the physical initiator(s) 102, and/or the secondary initiator 104 may be created through a frame redirect zone in a switch fabric and/or through an application of a twenty-four bit Fiber Channel address of the physical initiator(s) 102 to the virtual initiator in the switch 100 such that the virtual initiator may appear to the primary storage device 106 as the physical initiator(s) 102. The system protocol may be a Fiber Channel zoning protocol, logic unit number (LUN) masking protocol and/or a small computer system interface (SCSI) reservation protocol.
The command field 302 may indicate the commands such as read and/or write made by the initiators (e.g., the physical initiator(s) 102 and/or the secondary initiator 104 of
The target field 308 may indicate the target devices (e.g., storage devices, storage network, etc.) which of the commands may be executed by the switch to perform actions (e.g., read operation, write operation, etc.). The time received field 310 may illustrate the time (e.g., system time, server time, etc.) at which the command (e.g., read/write request) is issued by the initiators to perform operations associated to the command. The other field 312 may indicate other information associated to the operations that may be performed on the storage devices.
In example embodiment, the command field 302 may illustrate read command in first row, write command in second row, read command in third row, etc. The rule field 304 may illustrate rule numbers that may enable execution of certain operations. The rule field 304 may illustrate rule numbers such as rule “11654” in first row, rule “1514” in second row, and rule “1351” in third row. The initiator field 306 may illustrate initiator as “physical initiator” in the first row, “physical initiator” in the second row and “secondary initiator” in the third row. The target field 308 may illustrate target devices such as “primary storage device” in the first row, “primary storage device and secondary storage device” in the second row and “primary storage device” in the third row. The time received 310 may illustrate timing information such as “3:14 PM” in first row, “4:12 PM” in second row, “5:02 PM” in third row. The other field 312 may illustrate “data read” in the first row, “write successful” in the second row, and “request timed out” in the third row, according to one embodiment.
The diagrammatic system view 400 may indicate a personal computer and/or the data processing system in which one or more operations disclosed herein are performed. The processor 402 may be a microprocessor, a state machine, an application specific integrated circuit, a field programmable gate array, etc. (e.g., Intel® Pentium® processor). The main memory 404 may be a dynamic random access memory and/or a primary memory of a computer system.
The static memory 406 may be a hard drive, a flash drive, and/or other memory information associated with the data processing system. The bus 408 may be an interconnection between various circuits and/or structures of the data processing system. The video display 410 may provide graphical representation of information on the data processing system. The alpha-numeric input device 412 may be a keypad, a keyboard and/or any other input device of text (e.g., a special device to aid the physically handicapped).
The cursor control device 414 may be a pointing device such as a mouse. The drive unit 416 may be the hard drive, a storage system, and/or other longer term storage subsystem. The signal generation device 418 may be a bios and/or a functional operating system of the data processing system. The network interface device 420 may be a device that performs interface functions such as code conversion, protocol conversion and/or buffering required for communication to and from the network 426. The machine readable medium 422 may provide instructions on which any of the methods disclosed herein may be performed. The instructions 424 may provide source code and/or data code to the processor 402 to enable any one or more operations disclosed herein.
In operation 506, configuration of nodes of a continuous-backup system may be minimized (e.g., using the optimization module 206 of
The system protocol maybe a Fiber Channel zoning protocol, logic unit number (LUN) masking protocol and/or a small computer system interface (SCSI) reservation protocol. The switch 100 may be part of a storage area network. The nodes may include the physical initiator(s) 102 and/or the secondary initiator 104. The data may be a current state of information on the primary storage device 106.
In operation 606, a physical target associated with a physical initiator of the set of physical initiators may be determined. In operation 608, a set of logic unit numbers (LUN's) behind the physical target may be algorithmically determined as available to the physical initiator. In operation 610, a LUN paired to the physical initiator algorithmically queried.
The fabric nameserver database may be a service and/or entity that may run in a Fibre Channel network and/or a Fibre Channel connected network that provides registration, query and/or translation services to connected nodes (e.g., of nodes that may be FC initiators and/or targets). The fabric zoning database may be a service and/or an entity that may run in a Fibre Channel network and/or a Fibre Channel connected network that provides for and/or enforces restrictions on which nodes can view and/or access each other's resources.
The set of physical initiators may be determined through the fabric nameserver database. In addition, the set of physical initiators may be determined through the fabric zoning database. The set of physical initiators may also be determined with an algorithm that takes as an input the fabric nameserver database and the fabric zoning database and reduces a number of physical initiator and a number of physical target combinations upon which discovery has to be performed on. The set of physical initiators may be determined with a manual input.
Although the present embodiments have been described with reference to specific example embodiments, it will be evident that various modifications and changes may be made to these embodiments without departing from the broader spirit and scope of the various embodiments. For example, the various devices, modules, analyzers, generators, etc. described herein may be enabled and operated using hardware circuitry (e.g., CMOS based logic circuitry), firmware, software and/or any combination of hardware, firmware, and/or software (e.g., embodied in a machine readable medium). For example, the various electrical structure and methods may be embodied using transistors, logic gates, and electrical circuits (e.g., application specific integrated (ASIC) circuitry and/or in Digital Signal Processor (DSP) circuitry).
Particularly, the transfer module 202, the intercept module 204, the optimization module 206, the virtual initiator module 208, the virtual target module 210, the configure write module 212, and the configure read module 214 may be enabled using software and/or using transistors, logic gates, and electrical circuits (e.g., application specific integrated ASIC circuitry) such as a transfer circuit, an intercept circuit, an optimization circuit, a virtual initiator circuit, a virtual target circuit, a configure write circuit, and a configure read circuit and other circuits.
In addition, it will be appreciated that the various operations, processes, and methods disclosed herein may be embodied in a machine-readable medium and/or a machine accessible medium compatible with a data processing system (e.g., a computer system), and may be performed in any order (e.g., including using means for achieving the various operations). Accordingly, the specification and drawings are to be regarded in an illustrative rather than a restrictive sense.
The present invention is a continuation-in-part to U.S. Ser. No. 10/859,368, filed Jun. 1, 2004 now U.S. Pat. No. 7,698,401, U.S. Ser. No. 11/229,289, filed Sep. 16, 2005, and U.S. Ser. No. 11/438,036 filed May 19, 2006 and incorporates all of the disclosure of the priority cases at least by reference. U.S. Ser. No. 11/438,036 is a continuation-in-part of U.S. Ser. No. 10/859,368 and U.S. Ser. No. 11/229,289.
| Number | Name | Date | Kind |
|---|---|---|---|
| 5193181 | Barlow et al. | Mar 1993 | A |
| 5313612 | Satoh et al. | May 1994 | A |
| 5446871 | Shomler et al. | Aug 1995 | A |
| 5621882 | Kakuta | Apr 1997 | A |
| 5664189 | Wilcox et al. | Sep 1997 | A |
| 5805785 | Dias et al. | Sep 1998 | A |
| 5875479 | Blount et al. | Feb 1999 | A |
| 5930824 | Anglin et al. | Jul 1999 | A |
| 6175932 | Foote et al. | Jan 2001 | B1 |
| 6247141 | Homberg | Jun 2001 | B1 |
| 6269431 | Dunham | Jul 2001 | B1 |
| 6311288 | Heeren et al. | Oct 2001 | B1 |
| 6324654 | Wahl et al. | Nov 2001 | B1 |
| 6327579 | Crawford | Dec 2001 | B1 |
| 6490691 | Kimura et al. | Dec 2002 | B1 |
| 6647399 | Zaremba | Nov 2003 | B2 |
| 6691140 | Bogrett | Feb 2004 | B1 |
| 6714980 | Markson et al. | Mar 2004 | B1 |
| 6742139 | Forsman et al. | May 2004 | B1 |
| 6833073 | Agarwal | Dec 2004 | B2 |
| 6915315 | Autrey et al. | Jul 2005 | B2 |
| 6981177 | Beattie | Dec 2005 | B2 |
| 7093086 | Rietschote | Aug 2006 | B1 |
| 7155586 | Wagner et al. | Dec 2006 | B1 |
| 7165156 | Cameron et al. | Jan 2007 | B1 |
| 7206911 | Wolfgang et al. | Apr 2007 | B2 |
| 7237021 | Penney et al. | Jun 2007 | B2 |
| 7251749 | Fong et al. | Jul 2007 | B1 |
| 7254682 | Arbon | Aug 2007 | B1 |
| 7839865 | Doherty et al. | Nov 2010 | B2 |
| 20020008795 | Koyama et al. | Jan 2002 | A1 |
| 20020124013 | Loy et al. | Sep 2002 | A1 |
| 20030093579 | Zimmer et al. | May 2003 | A1 |
| 20040031030 | Kidder et al. | Feb 2004 | A1 |
| 20040093474 | Lin et al. | May 2004 | A1 |
| 20040199515 | Penney et al. | Oct 2004 | A1 |
| 20040205390 | Kanevsky et al. | Oct 2004 | A1 |
| 20050010835 | Childs et al. | Jan 2005 | A1 |
| 20050033930 | Haruma et al. | Feb 2005 | A1 |
| 20050044162 | Liang et al. | Feb 2005 | A1 |
| 20050050386 | Reinhardt et al. | Mar 2005 | A1 |
| 20050055603 | Soran et al. | Mar 2005 | A1 |
| 20050138090 | Augenstein et al. | Jun 2005 | A1 |
| 20050138204 | Iyer et al. | Jun 2005 | A1 |
| 20050182953 | Stager et al. | Aug 2005 | A1 |
| 20050188256 | Stager et al. | Aug 2005 | A1 |
| 20050198303 | Knauerhase et al. | Sep 2005 | A1 |
| 20050223181 | Jeppsen et al. | Oct 2005 | A1 |
| 20050240792 | Sicola et al. | Oct 2005 | A1 |
| 20050251540 | Sim-Tang | Nov 2005 | A1 |
| 20050257085 | Haustein et al. | Nov 2005 | A1 |
| 20050262097 | Sim-Tang et al. | Nov 2005 | A1 |
| 20050262377 | Sim-Tang | Nov 2005 | A1 |
| 20050267920 | Helliker et al. | Dec 2005 | A1 |
| 20060031468 | Atluri et al. | Feb 2006 | A1 |
| 20060047714 | Anderson et al. | Mar 2006 | A1 |
| 20060114497 | Anderson et al. | Jun 2006 | A1 |
| 20060149793 | Kushwah et al. | Jul 2006 | A1 |
| 20060155912 | Singh et al. | Jul 2006 | A1 |
| 20060218434 | Solhjell | Sep 2006 | A1 |
| 20070038998 | Fries | Feb 2007 | A1 |
| 20070168404 | Nakamura et al. | Jul 2007 | A1 |
| 20070244938 | Michael et al. | Oct 2007 | A1 |
| Number | Date | Country |
|---|---|---|
| WO-2004021677 | Mar 2004 | WO |
| Number | Date | Country | |
|---|---|---|---|
| 20080294843 A1 | Nov 2008 | US |
| Number | Date | Country | |
|---|---|---|---|
| Parent | 10859368 | Jun 2004 | US |
| Child | 12186636 | US | |
| Parent | 11229289 | Sep 2005 | US |
| Child | 10859368 | US | |
| Parent | 11438036 | May 2006 | US |
| Child | 11229289 | US |
