Patent Application
20050216536
The present invention relates to data backup. More particularly, the present invention is a method and system for generating a snapshot in a consistent state.
BACKGROUND
Many schemes have been developed to protect data from loss or damage. One such scheme is hardware redundancy, such as redundant arrays of independent disks (RAID). Unfortunately, hardware redundancy schemes are ineffective in dealing with logical data loss or corruption. For example, an accidental file deletion or virus infection is automatically replicated to all of the redundant hardware components and can neither be prevented nor recovered from when using such technologies.
To overcome this problem, backup technologies have been developed to retain multiple versions of a production system over time. This allowed administrators to restore previous versions of data and to recover from data corruption.
One type of data protection system involves making point in time (PIT) copies of data. A first type of PIT copy is a hardware-based PIT copy, which is a mirror of a primary volume onto a secondary volume. The main drawbacks of the hardware-based PIT copy are that the data ages quickly and that each copy takes up as much disk space as the primary volume. A software-based PIT, or so called “snapshot,” is a “picture” of a volume at the block level or a file system at the operating system level.
It is desirable to generate a snapshot when an application or a file system is in a consistent state because it alleviates the need to replay a log of write streams and allows applications to be restarted rapidly. In order to achieve this, prior art systems suspend an application to update source data and flushes the source data to primary storage before generating a snapshot. However, this method is not efficient because the system has to be suspended for a while in order to generate a snapshot. Therefore, there is a need for a method and system for generating a snapshot in a consistent state without suspending an application or a system.
The present invention is a method and system for generating a snapshot in a consistent state. The system comprises a host computer, primary data storage, a data protection unit, and secondary data storage. The data protection unit monitors a state of an application which is running on the host computer. The data protection unit generates a snapshot of data stored in primary data storage when the application is in a consistent state, and stores the snapshot on secondary storage. In the event of a system failure, the data is recovered using the last snapshot. Snapshot generation may be triggered either by storing a data on a secondary storage or marking data that already exists on the secondary storage.
Alternatively, the system may identify a consistent snapshot by analyzing previous write streams. Snapshots are generated in accordance with a snapshot generation policy. In the event of a system failure, the data protection unit identifies a snapshot which is generated in a consistent state among a plurality of snapshots. The data is recovered from the identified snapshot.
A more detailed understanding of the invention may be had from the following description of a preferred embodiment, given by way of example, and to be understood in conjunction with the accompanying drawings, wherein:
The present invention will be described with reference to the drawing figures wherein like numerals represent like elements throughout. The present invention may be implemented, purely by way of example, in a Chronospan system, such as is described in U.S. patent application Ser. No. 10/771,613, which is incorporated by reference as if fully set forth.
A volume manager is a software module that runs on the host computer 102 or an intelligent storage switch 142 (see
The data protection unit 106 controls generation of snapshots. A plurality of snapshots are generated, stored and expired in accordance with a snapshot generation policy. The host computer 102 runs an application. Hereinafter, the terminology “application” means any software running on a computer or a file management system for managing and storing data including, but not limited to, a database system, an email system or a file system. The application running on the host computer 102 generates an output and the output is preferably stored in a memory (not shown) in the host computer. The output in the memory is flushed into the primary data volume 104 when the memory is full or a predetermined time expires or instructed by the application. Alternatively, the output may be directly stored in the primary volume.
The application running on the host computer 102 generates information which may be used in determining whether the application is in a consistent state or not. Various schemes may be used for this purpose. For example, a file system may be configured to generate an indicator that the system is in a consistent state. More particularly, the file system may set specific bits to indicate that the file system is in a clean state. The system reads the specific bit to figure out whether the system is in a consistent state, and generates a snapshot when the bits are set. Alternatively, it is possible to analyze the log of a journaling system to find out a consistent state when the log is empty.
The data protection unit 106 monitors state information in real time and detects when the application is in a consistent state. The data protection unit 106 generates a snapshot when the application is in a consistent state. With this scheme, in the case of a system failure, the need to replay a log of write streams to recover data is substantially alleviated, and the application may be restarted more rapidly. The snapshots do not have to be absolutely consistent. The snapshots may be generated slightly before or after the consistent point. The snapshots may be generated at any point that may be a good time in practice, (i.e., any time that requires a small time for replaying the log is a good candidate).
The consistent point may vary from application to application. A snapshot that may be consistent for one application may not be consistent for another application. Therefore, after generating one snapshot which is consistent for one application, if a consistent point is detected for another application, another snapshot is generated. In this case, the second snapshot probably does not have many changes.
It is noted that the primary data volume 104 and the secondary data volume 108 can be any type of data storage, including, but not limited to, a single disk, a disk array (such as a RAID), or a storage area network (SAN). The main difference between the primary data volume 104 and the secondary data volume 108 lies in the structure of the data stored at each location. The primary volume 104 is typically an expensive, fast, and highly available storage subsystem, whereas the secondary volume 108 is typically cost-effective, high capacity, and comparatively slow (for example, ATA/SATA disks).
It is noted that the data protection unit 106 operates in the same manner, regardless of the particular construction of the protected computer system 100, 120, 140. The major difference between these deployment options is the manner and place in which a copy of each write is obtained. To those skilled in the art it is evident that other embodiments, such as the cooperation between a switch platform and an external server, are also feasible.
If the data protection unit 106 determines that the application is not in a consistent state, the process 200 returns to step 204 to monitor the state of the application (step 206). If the data protection unit 106 determines that the application is in a consistent state, which means the output temporarily stored in the memory is flushed into the primary data volume 104, the data protection unit 106 generates a snapshot and stores it in the secondary data volume 108 (step 208). If a system failure or other problem is detected at step 210, the data is restored using the last snapshot (step 212).
In typical recovery scenarios, it is necessary to examine how the primary volume looked like at multiple points in time before deciding which point to recover to. For example, consider a system that was infected by a virus. In order to recover from the virus, it is necessary to examine the primary volume as it was at different points in time to find the latest recovery point where the system was not yet infected by the virus.
A host computer 102 runs an application (step 302). The output generated by the host computer 102 is first stored in a memory and later flushed into a primary data volume 104. A data protection unit 106 generates a snapshot of the data and stores the snapshot in a secondary data volume 108 (step 304). The snapshots may be generated periodically or non-periodically depending on a snapshot generation policy. If a system failure or other problem is detected at step 306, the data protection unit 106 inspects a log of previous writes. The application updates a log of writes every time it gets output to be recorded in the memory and the primary data volume 104. The data protection unit 106 replays the log of write streams and determines an exact point in time when the application was in a consistent state. The data protection unit 106 identifies a snapshot in a consistent state among a plurality of snapshots (step 310) and restores the data based on the consistent state snapshot (step 312).
The snapshot from which the system is recovered does not have to be absolutely consistent. A snapshot which is generated slightly before or after the consistent point may be utilized. Basically, a snapshot which minimizes the replay of the log is the best snapshot for recovery. The best snapshot may be different from one application to another. Alternatively, when the consistency determination is made in real-time for an application, it is necessary to use a host resident agent that reads non-persistent state information from a memory rather than only analyzing the write data stream.
While specific embodiments of the present invention have been shown and described, many modifications and variations could be made by one skilled in the art without departing from the scope of the invention. The above description serves to illustrate and not limit the particular invention in any way.
This application claims priority from U.S. provisional application Nos. 60/541,626 filed Feb. 4, 2004 and 60/542,011 filed Feb. 5, 2004, which are incorporated by reference as if fully set forth herein.
| Number | Date | Country | |
|---|---|---|---|
| 60541626 | Feb 2004 | US | |
| 60542011 | Feb 2004 | US |
