This invention relates to data storage, and more particularly, to a system and method for automatically providing and maintaining a copy or mirror of data stored at a location geographically remote from the main or primary data storage device.
Nearly all data processing system users are concerned with maintaining back-up data in order to insure continued data processing operations should their data become lost, damaged, or otherwise unavailable.
Large institutional users of data processing systems which maintain large volumes of data such as banks, insurance companies, and stock market traders must and do take tremendous steps to insure back-up data availability in case of a major disaster. These institutions recently have developed a heightened awareness of the importance of data recovery and back-up in view of the many natural disasters and other world events including the bombing of the World Trade Center in New York City.
Currently, data processing system users often maintain copies of their valuable data on site on either removable storage media, or in a secondary “mirrored” storage device located on or within the same physical confines of the main storage device. Should a disaster such as fire, flood, or inaccessibility to a building occur, however, both the primary as well as the secondary or backed-up data will be unavailable to the user. Accordingly, more data processing system users are requiring the remote storage of back-up data.
One prior art approach at data back-up involves taking the processor out of service while back-up tapes are made. These tapes are then carried off premises for storage purposes. Should access to the backed-up data be required, the proper tape must be located, loaded onto a tape drive, and restored to the host system requiring access to the data. This process is very time consuming and cost intensive, both in maintaining an accurate catalog of the data stored on each individual tape, as well as storing the large number of tapes required to store the large amounts of data required by these institutions. Additionally and most importantly, it often takes twenty-four hours before a back-up tape reaches its storage destination during which time the back-up data is unavailable to the user.
Additionally, today's systems require a significant amount of planning and testing in order to design a data recovery procedure and assign data recovery responsibilities. Typically, a disaster recovery team must travel to the test site carrying a large number of data tapes. The team then loads the data onto disks, makes the required network connections, and then restores the data to the “test” point of failure so processing can begin. Such testing may take days or even weeks and always involves significant human resources in a disaster recovery center or back-up site.
Some providers of prior art data storage systems have proposed a method of data mirroring whereby one host Central Processing Unit (CPU) or processor writes data to both a primary, as well as a secondary, data storage device or system. Such a proposed method, however, overly burdens the host CPU with the task of writing the data to a secondary storage system and thus dramatically impacts and reduces system performance.
Accordingly, what is required is a data processing system which automatically and asynchronously, with respect to a first host system, generates and maintains a backup or “mirrored” copy of a primary storage device at a location physically remote from the primary storage device, without intervention from the host which seriously degrades the performance of the data transfer link between the primary host computer and the is primary storage device.
This invention features a system which automatically, without intervention from a host computer system, controls storing of primary data received from a primary host computer on a primary data storage system, and additionally controls the copying of the primary data to a secondary data storage system controller which forms part of a secondary data storage system, for providing a back-up copy of the primary data on the secondary data storage system which is located in a geographically remote location from the primary data storage system.
Copying or mirroring of data from a primary data storage system to a secondary data storage system is accomplished without intervention of a primary or secondary host computer and thus, without affecting performance of a primary or secondary host computer system. Primary and secondary data storage system controllers are coupled via at least one high speed communication link such as a fiber optic link driven by LED's or laser.
At least one of the primary and secondary data storage system controllers coordinates the copying of primary data to the secondary data storage system and at least one of the primary and secondary data storage system controllers maintains at least a list of primary data which is to be copied to the secondary data storage device.
Additionally, the secondary data storage system controller provides an indication or acknowledgement to the primary data storage system controller that the primary data to be copied to the secondary data storage system in identical form as secondary data has been received or, in another embodiment, has actually been written to a secondary data storage device.
Accordingly, data may be transferred between the primary and secondary data storage system controllers synchronously, when a primary host computer requests writing of data to a primary data storage device, or asynchronously with the primary host computer requesting the writing of data to the primary data storage system, in which case the remote data copying or mirroring is completely independent of and transparent to the host computer system.
At least one of the primary data storage system controller and the secondary data storage system controller maintains a list of primary data which is to be written to the secondary data storage system. Once the primary data has been at least received or optionally stored on the secondary data storage system, the secondary data storage system controller provides an indication or acknowledgement of receipt or completed write operation to the primary data storage system.
At such time, the primary and/or secondary data storage system controller maintaining the list of primary data to be copied updates this list to reflect that the given primary data has been received by and/or copied to the secondary data storage system. The primary or secondary data storage system controllers and/or the primary and secondary data storage devices may also maintain additional lists for use in concluding which individual storage locations, such as tracks on a disk drive, are invalid on any given data storage device, which data storage locations are pending a format operation, which data storage device is ready to receive data, and whether or not any of the primary or secondary data storage devices are disabled for write operations.
Thus, an autonomous, host computer independent, geographically remote data storage system is maintained providing a system which achieves nearly 100 percent data integrity by assuring that all data is copied to a geographically remote site, and in those cases when a back-up copy is not made due to an error of any sort, an indication is stored that the data has not been copied, but instead must be updated at a future time.
Such a system is provided which is generally lower in cost and requires substantially less manpower and facilities to achieve than the prior art devices.
The present invention more particularly concerns a remote data mirroring system having a remote link adapter. In a preferred implementation, the primary data storage system includes a primary cache memory, and the secondary data storage system includes a secondary cache memory. The primary data storage system controller includes a first remote link adapter coupled between the primary cache memory and the communications link for transferring the data to the communications link. The secondary data storage system controller includes a second remote link adapter coupled between the communications link and the secondary cache memory for transferring the data from the communications link to the secondary cache memory. In this fashion, the first remote link adapter and the second remote link adapter automatically transfer the data to the secondary cache memory for writing of the data into at least one secondary data storage device.
These and other features and advantages of the present invention will be better understood when read together with the following drawings wherein:
The present invention features a system which provides a geographically remote mirrored data storage system which contains generally identical information to that stored on a primary data storage system. Utilizing such a system, data recovery after a disaster is nearly instantaneous and requires little, if any, human intervention. Using the present system, the data is retrieved from a remote device through the host data processing system.
A system in accordance with the present invention is shown generally at 10,
The primary data storage system 14 includes a primary data storage system controller 16 which receives data from the host 12 over data signal path 18. The primary data storage system controller 16 is also coupled to a storage device 20 which may include a plurality of data storage devices 22a-22c. The storage devices may include disk drives, optical disks, CD's or other data storage devices. The primary system controller 16 is coupled to the storage device 20 by means of data signal path 24.
The primary data storage system controller 16 includes at least one channel adapter (C.A.) 26 which is well known to those skilled in the art and interfaces with host processing system 12. Data received from the host is typically stored in cache 28, before being transferred through disk adapter (D.A.) 30 over data signal path 24 to the primary storage device 20. The primary data storage controller 16 also includes a data director 32 which executes one or more sets of predetermined micro-code to control data transfer between the host 12, cache memory 28, and the storage device 20. Although the data director 32 is shown as a separate unit, either one of a channel adapter 26 or disk adapter 30 may be operative as a data director, to control the operation of a given data storage system controller. Such a reconfigurable channel adapter and disk adapter is disclosed in Applicant's U.S. Pat. No. 5,335,352 entitled RECONFIGURABLE, MULTI-FUNCTION DATA STORAGE SYSTEM CONTROLLER SELECTIVELY OPERABLE AS AN INPUT CHANNEL ADAPTER AND A DATA STORAGE UNIT ADAPTER, which is fully incorporated herein by reference.
The primary data storage system 14 according to one embodiment of the present invention also includes a service processor 34 coupled to the primary data storage system controller 16, and which provides additional features such as monitoring, repair, service, or status access to the storage system controller 16.
The primary data storage system controller 16 of the present invention also features at least a second disk adapter 36 coupled to the internal bus 38 of the primary data storage system controller 16. The second disk adapter 36 is coupled, via a high speed communication link 40 to a disk adapter 42 on a secondary data storage system controller 44 of a secondary data storage system 46. Such high speed, point-to-point communication links between the primary and secondary data storage system controllers 16 and 44 include a fiber optic link driven by an LED driver, per IBM ESCON standard; a fiber optic link driven by a laser driver, and optionally T1 and T3 telecommunication links. Utilizing network connections, the primary and secondary data storage system controllers 16 and 44 may be connected to FDDI networks, T1 or T3 based networks and SONET networks.
The secondary data storage system 46 is located at a second site geographically removed from the first site. For this patent application, “geographically removed site” means not within the same building as the primary data storage system. There are presently known data processing systems which provide data mirroring to physically different data storage systems. The systems, however, are generally within the same building. The present invention is directed to providing complete data recovery in case of disaster, such as when a natural disaster such as a flood or a hurricane, or man-made disasters such as fires or bombings destroy one physical location, such as one building.
As in the case of the primary data storage system, the secondary data storage system 46 includes, in addition to the secondary data storage system controller 44, a secondary data storage device 48 including a plurality of storage devices 50a-50c. The plurality of storage devices on the secondary data storage system 46, as well as the primary data storage system 14, may have various volumes and usages such as a primary data storage device 50a which is primary with respect to the attached storage controller 44 and host 52 in the case of the secondary data storage system 46, and the primary storage device 22a which is primary with respect to the first or primary host 12 in the case of the primary data storage system 14.
Additionally, each storage device, such as storage device 48, may include a secondary storage volume 50b which serves as the secondary storage for the primary data stored on the primary volume 22a of the primary data storage system 14. Similarly, the primary data storage system 14 may include a secondary storage volume 22b which stores primary data received and copied from the secondary site and data storage system 46 and host 52.
Additionally, each storage device 20, 48, may include one or more local volumes or storage devices 22c, 50c, which are accessed only by their locally connected data processing systems.
The secondary storage system controller 44 also includes at least a first channel adapter 54 which may receive data from an optionally connected secondary host 52 or an optionally connected hotsite host or CPU 56. Optionally, the primary host 12 may include a data signal path 58 directly into the channel adapter 54 of the secondary data storage system 46, while the optional secondary host 52 may include an optional data path 60 into the channel adapter 26 of the primary data storage system 14. Although the secondary host 52 illustrated in
The high speed link 40 between the primary and secondary data storage systems 14 and 46 is designed such that multiple links between the primary and secondary storage system may be maintained for enhanced availability of data and increased system performance. The number of links is variable and may be field upgradeable. Additionally, the service processor 34 of the primary data storage system 14 and the service processor 62 of the secondary data storage system 46 may also be coupled to provide for remote system configuration, remote software programming, and to provide a host base point of control of the secondary data storage system.
The secondary data storage system controller 44 also includes cache memory 64 which receives data from channel adapter 54 and disk adapter 42, as well as disk adapter 66 which controls writing data to and from secondary storage device 48. Also provided is a data director 68 which controls data transfer over communication bus 70 to which all the elements of the secondary data storage system controller are coupled.
An additional feature of the system 10 of
The primary and secondary data storage systems may optionally be connected by means of currently available, off-the-shelf channel extender equipment using bus and tag or ESCON interfaces.
The data storage system 10 of
Thus, in the real time or synchronous mode, the primary data storage system automatically controls the duplication or copying of data to the secondary data storage system controller transparently to the primary host computer. Only after data is safely stored in both the primary and secondary data storage system, as detected by an acknowledgement from the secondary storage system to the primary storage system, does the primary data storage system acknowledge to the primary host computer that the data is synchronized. Should a disaster or facility outage occur at the primary data storage system site, the user will simply need to initialize the application program in the secondary data storage system utilizing a local host (52) or a commercial hotsite CPU or host 56.
The link between the primary and secondary storage system controllers 14 and 46 may be maintained in a unidirectional mode wherein the primary data storage system controller monitors and controls data copying or mirroring. Alternatively, a bi-directional implementation may be used wherein either controller can duplicate data to the other controller, transparently to the host computer. Should a disaster or facilities outage occur, recovery can be automatic with no human intervention since the operational host computer already has an active path (40, 58, 60) to the data through its local controller. While offering uninterrupted recovery, performance will be slower than in an unidirectional implementation due to the overhead required to manage intercontroller tasks.
In the second, point-in-time mode of operation, the primary data storage system transparently duplicates data to the secondary data storage system after the primary data storage system acknowledges to the host computer, via channel end and device end, that the data has been written to the storage device and the input/output operation has been completed. This eliminates the performance impact of data mirroring over long distances. Since primary and secondary data are not synchronized, however, the primary data storage system must maintain a log file of pending data which has yet to be written to the secondary data storage device. Such data may be kept on removable, non-volatile media, in the cache memory of the primary or secondary data storage system controller as will be explained below, or in the service processor 34, 62.
Accordingly, a feature of the system 10 of
A feature of the system 10 of
In the system 10 of
Thus, when a host computer writes data to a primary data storage system, it sets both the primary and secondary bits 104, 106 of the write pending bits 102 when data is written to cache. For these examples, the M1 bit will refer to the primary data storage system and the M2 bit will refer to the secondary data storage system. When the primary data storage system controller's disk adapter writes the data to the primary data storage device, it will reset bit 104 of the write pending indicator bits 102. Similarly, once the secondary data storage system has written the data to the secondary data storage device, the secondary data storage write pending indicator bit 106 will be reset.
The service processors in one embodiment of the present invention will periodically scan the index table for write pending indicator bits and invoke a copy task which copies the data from the primary data storage device to the secondary. In addition, one or more of the spare index or table bits 114, 116 may be utilized to store other data such as time stamp, etc.
In addition to the write pending and format pending bits described above, the system 10 also includes several additional general purpose flags to assist in error recovery. As shown in
Accordingly, each data storage device keeps data validity information about its mirrored device. If for some reason a device is not accessible, either the primary or the secondary device, every new write command goes to the accessible mirrored device along with information that the not accessible device has a track which is not valid. As soon as the non-accessible device becomes accessible, then automatically, as a background operation, the drives re-synchronize. In the case when a specific track is not shown on both the primary and secondary storage system, an indication of such will be assigned and the user will be alerted. A utility operating on the service processors will give the user a report of all the non-valid (out of sync) tracks. This report can be transferred from one site to another over the link 63,
Modifications and substitutions by one of ordinary skill in the art are considered to be within the scope of the present invention, which is not to be limited except by the claims which follow.
This application is a divisional of U.S. patent application Ser. No. 09/709,814 filed Nov. 10, 2000 now U.S. Pat. No. 6,502,205, which is a divisional of U.S. patent application Ser. No. 09/061,708 filed Apr. 17, 1998 (U.S. Pat. No. 6,173,377 issued Jan. 9, 2001), which is a continuation of U.S. patent application Ser. No. 08/654,511 filed May 28, 1996 (U.S. Pat. No. 5,742,792 issued Apr. 21, 1998), which is a continuation-in-part of U.S. patent application Ser. No. 08/052,039 filed Apr. 23, 1993, entitled REMOTE DATA MIRRORING (U.S. Pat. No. 5,544,347 issued Aug. 6, 1996), which are all incorporated herein by reference.
Number | Name | Date | Kind |
---|---|---|---|
3588839 | Belady et al. | Jun 1971 | A |
3623014 | Doeiz et al. | Nov 1971 | A |
3771137 | Barner et al. | Nov 1973 | A |
3835260 | Prescher et al. | Sep 1974 | A |
3866182 | Yamada et al. | Feb 1975 | A |
3936806 | Batcher | Feb 1976 | A |
4020466 | Cordi et al. | Apr 1977 | A |
4057849 | Ying et al. | Nov 1977 | A |
4084231 | Capozzi et al. | Apr 1978 | A |
4094000 | Brudevold | Jun 1978 | A |
4124843 | Bramson et al. | Nov 1978 | A |
4150429 | Ying | Apr 1979 | A |
4161777 | Ying | Jul 1979 | A |
4193113 | Cykowski | Mar 1980 | A |
4204251 | Brudevold | May 1980 | A |
4249802 | Muchel et al. | Feb 1981 | A |
4342079 | Stewart et al. | Jul 1982 | A |
4361855 | Igarashi | Nov 1982 | A |
4368532 | Imazeki et al. | Jan 1983 | A |
4384274 | Mao | May 1983 | A |
4396984 | Videki, II | Aug 1983 | A |
4430727 | Moore et al. | Feb 1984 | A |
4453215 | Reid | Jun 1984 | A |
4464713 | Benhase et al. | Aug 1984 | A |
4523206 | Sasscer | Jun 1985 | A |
4523275 | Swenson et al. | Jun 1985 | A |
4530055 | Hamstra et al. | Jul 1985 | A |
4577272 | Ballew et al. | Mar 1986 | A |
4594577 | Mao | Jun 1986 | A |
4598357 | Swenson et al. | Jul 1986 | A |
4608688 | Hansen et al. | Aug 1986 | A |
4618827 | Redington et al. | Oct 1986 | A |
4634100 | Glen | Jan 1987 | A |
4638424 | Beglin et al. | Jan 1987 | A |
4686620 | Ng | Aug 1987 | A |
4698808 | Ishii | Oct 1987 | A |
4707783 | Lee et al. | Nov 1987 | A |
4710870 | Blackwell et al. | Dec 1987 | A |
4726024 | Guziak et al. | Feb 1988 | A |
4727544 | Brunner et al. | Feb 1988 | A |
4736407 | Dumas | Apr 1988 | A |
4751578 | Reiter et al. | Jun 1988 | A |
4755928 | Johnson et al. | Jul 1988 | A |
4769764 | Levanon | Sep 1988 | A |
4771375 | Beglin et al. | Sep 1988 | A |
4773035 | Lee et al. | Sep 1988 | A |
4779189 | Legvold et al. | Oct 1988 | A |
4782486 | Lipcon et al. | Nov 1988 | A |
4783834 | Anderson et al. | Nov 1988 | A |
4785472 | Shapiro | Nov 1988 | A |
4797750 | Karweit | Jan 1989 | A |
4805106 | Pfeifer | Feb 1989 | A |
4807186 | Ohnishi et al. | Feb 1989 | A |
4814592 | Bradt et al. | Mar 1989 | A |
4823333 | Satoh et al. | Apr 1989 | A |
4831558 | Shoup et al. | May 1989 | A |
4837680 | Crockett et al. | Jun 1989 | A |
4841475 | Ishizuka | Jun 1989 | A |
4849978 | Dishon et al. | Jul 1989 | A |
4862411 | Dishon et al. | Aug 1989 | A |
4866611 | Cree et al. | Sep 1989 | A |
4879718 | Sanner | Nov 1989 | A |
4916605 | Beardsley et al. | Apr 1990 | A |
4949187 | Cohen | Aug 1990 | A |
4958270 | McLaughlin et al. | Sep 1990 | A |
4959774 | Davis et al. | Sep 1990 | A |
4960031 | Farrand | Oct 1990 | A |
4974156 | Harding et al. | Nov 1990 | A |
4985695 | Wilkinson et al. | Jan 1991 | A |
5003382 | Omi et al. | Mar 1991 | A |
5007053 | Iyer et al. | Apr 1991 | A |
5016876 | Loffredo | May 1991 | A |
5029199 | Jones et al. | Jul 1991 | A |
5051887 | Berger et al. | Sep 1991 | A |
5060142 | Menon et al. | Oct 1991 | A |
5060185 | Naito et al. | Oct 1991 | A |
5072368 | Foreman et al. | Dec 1991 | A |
5083271 | Thacher et al. | Jan 1992 | A |
5087968 | Omi et al. | Feb 1992 | A |
5088021 | McLaughlin et al. | Feb 1992 | A |
5089958 | Horton et al. | Feb 1992 | A |
5093787 | Simmons | Mar 1992 | A |
5097439 | Patriquin et al. | Mar 1992 | A |
5099485 | Bruckert et al. | Mar 1992 | A |
5101492 | Schultz et al. | Mar 1992 | A |
5109492 | Noguchi et al. | Apr 1992 | A |
5123099 | Shibata et al. | Jun 1992 | A |
5127048 | Press et al. | Jun 1992 | A |
5132787 | Omi et al. | Jul 1992 | A |
5134711 | Asthana et al. | Jul 1992 | A |
5140592 | Idleman et al. | Aug 1992 | A |
5146576 | Beardsley et al. | Sep 1992 | A |
5146605 | Beukema et al. | Sep 1992 | A |
5155814 | Beardsley et al. | Oct 1992 | A |
5155835 | Belsan | Oct 1992 | A |
5155845 | Beal et al. | Oct 1992 | A |
5157663 | Major et al. | Oct 1992 | A |
5157770 | Beardsley et al. | Oct 1992 | A |
5159671 | Iwami | Oct 1992 | A |
5170471 | Bonevento et al. | Dec 1992 | A |
5170480 | Mohan et al. | Dec 1992 | A |
5175837 | Arnold et al. | Dec 1992 | A |
5175839 | Ikeda et al. | Dec 1992 | A |
5185864 | Bonevento et al. | Feb 1993 | A |
5185884 | Martin et al. | Feb 1993 | A |
5201053 | Benhase et al. | Apr 1993 | A |
5202887 | Ueno et al. | Apr 1993 | A |
5206939 | Yanai et al. | Apr 1993 | A |
5210865 | Davis et al. | May 1993 | A |
5212772 | Masters | May 1993 | A |
5212784 | Sparks | May 1993 | A |
5214670 | Ballatore | May 1993 | A |
5235601 | Stallmo et al. | Aug 1993 | A |
5235687 | Bacot et al. | Aug 1993 | A |
5235690 | Beardsley et al. | Aug 1993 | A |
5235692 | Ayres et al. | Aug 1993 | A |
5239637 | Davis et al. | Aug 1993 | A |
5239659 | Rudeseal et al. | Aug 1993 | A |
5257144 | Curasi et al. | Oct 1993 | A |
5263154 | Eastridge et al. | Nov 1993 | A |
5269011 | Yanai et al. | Dec 1993 | A |
5274645 | Idleman et al. | Dec 1993 | A |
5276867 | Kenley et al. | Jan 1994 | A |
5276871 | Howarth | Jan 1994 | A |
5285451 | Henson et al. | Feb 1994 | A |
5307481 | Shimazaki et al. | Apr 1994 | A |
5313664 | Sugiyama et al. | May 1994 | A |
5317731 | Dias et al. | May 1994 | A |
5321826 | Ushiro | Jun 1994 | A |
5335352 | Yanai et al. | Aug 1994 | A |
5341493 | Yanai et al. | Aug 1994 | A |
5343477 | Yamada | Aug 1994 | A |
5357509 | Ohizumi | Oct 1994 | A |
5367698 | Webber et al. | Nov 1994 | A |
5375232 | Legvold et al. | Dec 1994 | A |
5377342 | Sakai et al. | Dec 1994 | A |
5379412 | Eastridge et al. | Jan 1995 | A |
5381539 | Yanai et al. | Jan 1995 | A |
5392390 | Crozier | Feb 1995 | A |
5404500 | Legvold et al. | Apr 1995 | A |
5404508 | Konrad et al. | Apr 1995 | A |
5410667 | Belsan et al. | Apr 1995 | A |
5412668 | Dewey | May 1995 | A |
5428796 | Iskiyan et al. | Jun 1995 | A |
5432922 | Polyzois et al. | Jul 1995 | A |
5434994 | Shaheen et al. | Jul 1995 | A |
5435004 | Cox et al. | Jul 1995 | A |
5437022 | Beardsley et al. | Jul 1995 | A |
5440727 | Bhide et al. | Aug 1995 | A |
5446872 | Ayres et al. | Aug 1995 | A |
5450577 | Lai et al. | Sep 1995 | A |
5459857 | Ludlam et al. | Oct 1995 | A |
5463752 | Benhase et al. | Oct 1995 | A |
5469503 | Butensky et al. | Nov 1995 | A |
5473776 | Nosaki et al. | Dec 1995 | A |
5479654 | Squibb | Dec 1995 | A |
5495601 | Narang et al. | Feb 1996 | A |
5495606 | Borden et al. | Feb 1996 | A |
5497483 | Beardsley et al. | Mar 1996 | A |
5502811 | Ripberger | Mar 1996 | A |
5504888 | Iwamoto et al. | Apr 1996 | A |
5506986 | Healy | Apr 1996 | A |
5522031 | Ellis et al. | May 1996 | A |
5526484 | Casper et al. | Jun 1996 | A |
5535381 | Kopper | Jul 1996 | A |
5537533 | Staheli et al. | Jul 1996 | A |
5537585 | Blickenstaff et al. | Jul 1996 | A |
5544345 | Carpenter et al. | Aug 1996 | A |
5544347 | Yanai et al. | Aug 1996 | A |
5555371 | Duyanovich et al. | Sep 1996 | A |
5574950 | Hathorn et al. | Nov 1996 | A |
5579318 | Reuss et al. | Nov 1996 | A |
5584039 | Johnson et al. | Dec 1996 | A |
5592618 | Micka et al. | Jan 1997 | A |
5592660 | Yokota et al. | Jan 1997 | A |
5596706 | Shimazaki et al. | Jan 1997 | A |
5613106 | Thurman et al. | Mar 1997 | A |
5613155 | Baldiga et al. | Mar 1997 | A |
5615329 | Kern et al. | Mar 1997 | A |
5615364 | Marks | Mar 1997 | A |
5625818 | Zarmer et al. | Apr 1997 | A |
5633999 | Clowes et al. | May 1997 | A |
5649089 | Kilner | Jul 1997 | A |
5649152 | Ohran et al. | Jul 1997 | A |
5673382 | Cannon et al. | Sep 1997 | A |
5680580 | Beardsley et al. | Oct 1997 | A |
5680640 | Ofek et al. | Oct 1997 | A |
5682396 | Yamamoto et al. | Oct 1997 | A |
5682513 | Candelaria et al. | Oct 1997 | A |
5689732 | Kondo | Nov 1997 | A |
5692155 | Iskiyan et al. | Nov 1997 | A |
5701429 | Legvold et al. | Dec 1997 | A |
5721916 | Pardikar | Feb 1998 | A |
5724500 | Shinmura et al. | Mar 1998 | A |
5734813 | Yamamoto et al. | Mar 1998 | A |
5740397 | Levy | Apr 1998 | A |
5742792 | Yanai et al. | Apr 1998 | A |
5758149 | Bierma et al. | May 1998 | A |
5764972 | Crouse et al. | Jun 1998 | A |
5819310 | Vishlitzky et al. | Oct 1998 | A |
5835954 | Duyanovich et al. | Nov 1998 | A |
5845295 | Houseman et al. | Dec 1998 | A |
5852715 | Raz et al. | Dec 1998 | A |
5889935 | Ofek et al. | Mar 1999 | A |
5901327 | Ofek | May 1999 | A |
5909483 | Weare et al. | Jun 1999 | A |
5978565 | Ohran et al. | Nov 1999 | A |
5987566 | Vishlitzky et al. | Nov 1999 | A |
6035412 | Tamer et al. | Mar 2000 | A |
6044444 | Ofek | Mar 2000 | A |
6052797 | Ofek et al. | Apr 2000 | A |
6092066 | Ofek | Jul 2000 | A |
6101497 | Ofek | Aug 2000 | A |
6108748 | Ofek et al. | Aug 2000 | A |
6484187 | Kern et al. | Nov 2002 | B1 |
6502205 | Yanai et al. | Dec 2002 | B1 |
20030005355 | Yanai et al. | Jan 2003 | A1 |
20040073831 | Yanai et al. | Apr 2004 | A1 |
Number | Date | Country |
---|---|---|
167322 | Jan 1986 | EP |
0239323 | Sep 1987 | EP |
0323123 | Dec 1988 | EP |
593062 | Apr 1994 | EP |
672985 | Sep 1995 | EP |
674263 | Sep 1995 | EP |
2086625 | May 1992 | GB |
56-153460 | Nov 1981 | JP |
57-111900 | Jul 1982 | JP |
62-89150 | Apr 1987 | JP |
62-274448 | Nov 1987 | JP |
63-278155 | Nov 1988 | JP |
1-19437 | Jan 1989 | JP |
1-19438 | Jan 1989 | JP |
1-120652 | May 1989 | JP |
2-32418 | Feb 1990 | JP |
2-32419 | Feb 1990 | JP |
2-32420 | Feb 1990 | JP |
2-35537 | Feb 1990 | JP |
2-37418 | Feb 1990 | JP |
2-91716 | Mar 1990 | JP |
2-91717 | Mar 1990 | JP |
2-93721 | Apr 1990 | JP |
3-40121 | Feb 1991 | JP |
3-92942 | Sep 1991 | JP |
3-93942 | Sep 1991 | JP |
3-250257 | Nov 1991 | JP |
3-256143 | Nov 1991 | JP |
3-256144 | Nov 1991 | JP |
3-256146 | Nov 1991 | JP |
5-158631 | Jun 1993 | JP |
5-233162 | Sep 1993 | JP |
6-175788 | Jun 1994 | JP |
7-73078 | Mar 1995 | JP |
7-191811 | Jul 1995 | JP |
7-239799 | Sep 1995 | JP |
WO9400816 | Jan 1994 | WO |
WO9425919 | Nov 1994 | WO |
WO8502926 | Jul 1995 | WO |
WO 9523376 | Aug 1995 | WO |
Number | Date | Country | |
---|---|---|---|
20030167419 A1 | Sep 2003 | US |
Number | Date | Country | |
---|---|---|---|
Parent | 09709814 | Nov 2000 | US |
Child | 10224195 | US | |
Parent | 09061708 | Apr 1998 | US |
Child | 09709814 | US |
Number | Date | Country | |
---|---|---|---|
Parent | 08654511 | May 1996 | US |
Child | 09061708 | US |
Number | Date | Country | |
---|---|---|---|
Parent | 08052039 | Apr 1993 | US |
Child | 08654511 | US |