The present invention relates to methods, systems and computer program products for performing data protection operations, and more particularly, to a system and method for performing a data protection operation.
The importance of data has increased during the last decade while the cost of data storage medium has decreased, thus motivating data storage vendors to provide data protection schemes that are based upon duplication of data.
Various prior art method and systems define mapping between address ranges and data protection operations. When information is written to a target address the applicable data protection scheme is determined only by that target address. For example, a certain volume can be defined as asynchronously mirrored, and incoming writes to this volume are recorded in some manner and later transferred to a secondary site.
This mapping does not necessarily address dynamically changing needs and storage limitations.
There is a growing need to provide a dynamic system, method and computer program product for data protection.
A method, computer program product and storage system for performing a data protection operation, the method includes: receiving a write instruction that is associated with a writable entity; wherein the write instruction includes: a writable entity identifier; and data protection metadata indicative of a relevancy of at least one data protection operation to be applied in relation to the write instruction; and participating in an execution of a relevant data protection operation, if such a relevant data protection operation exists.
The write instruction comprises relevancy metadata indicative of a relevancy of the data protection metadata to at least one other write instruction that is associated with the writable entity.
The method includes: receiving a first write instruction that comprises a default indication and data protection metadata; receiving a second write instruction that lacks data protection metadata; wherein the first and second write instructions are associated with the writable entity; and determining a relevancy of at least one data protection operation to be applied in relation to the second write operation in response to the data protection metadata of the first write instruction.
The data protection metadata is indicative of a relevancy of at least one copy service operation. The data protection metadata is indicative of a relevancy of at least one copy service operation selected out of a group consisting of: change recording; in-order asynchronous remote copying; out-of-order asynchronous remote copying; and synchronous remote copying. The data protection metadata comprises a bitmap; wherein different bits of the bitmap are indicative of a relevancy of data protection operations of different types. The data protection metadata is indicative of at least one continuous data protection operation.
The present invention will be understood and appreciated more fully from the following detailed description taken in conjunction with the drawings in which:
a-3c illustrate write instructions according to various embodiments of the invention;
Methods, systems and computer program products for performing a data protection operation are provided. The method, systems and computer product programs provided herein are not bound to a fixed mapping between target addresses and data protection operations. Metadata such as data protection metadata can be associated with one or more write instructions and can determine which data protection operation to execute. This metadata can be changed over time thus facilitating a dynamically changing data protection scheme.
The data protection metadata can be indicative of a relevancy of at least one copy service operation, can be indicative of a relevancy of a change recording, can be indicative of an in-order asynchronous remote copying, can be indicative of an out-of-order asynchronous remote copying, can be indicative of a synchronous remote copying, can be indicative of at least one continuous data protection operation or a combination thereof.
The data protection metadata can include a bitmap but this is not necessarily so. The data protection metadata can be encoded but this is not necessarily so. The data protection metadata can indicate that a combination of data protection operations should be executed. The bit map can indicate which data protection operations should be executed.
Using data protection metadata may enable a better utilization of the data protection schemes, to match the data protection scheme to the information that is written and to match the data protection scheme to various storage system constraints.
By using data protection metadata only a portion of a larger memory volume can be associated with a more resource-consuming data protection scheme while other portions can be protected by other (less resource consuming) data protection schemes. In addition, information units that can be protected by different data protection schemes can be stored at the same location or in proximate locations.
For example, different write operations of different information types to the same track can be followed by a synchronous mirroring, by an asynchronous mirroring, by a continuous data protection operation (so as to enable retrieval of information as it was at certain points in time) or should not be followed by any data protection operation. The first write operation can involve writing critical business information, the second write information can involve writing low importance information and the fourth write operation can involve writing information that can be re-built in a case of loss, even without applying a data protection operation. In order to facilitate such dynamically changing data protection schemes, the data protection metadata of the first, second, third and fourth write instructions can represent these data protection operations. It is noted that a fixed mapping between addresses and data protection schemes can be used as a default, whereas in case of a conflict with the fixed mapping and data protection metadata the mapping the data protection metadata prevails.
Storage systems can execute one or more data protection schemes. A data protection scheme can be implemented by executing one or more data protection operations. These one or more data protection operations can include any operation (or operations) that can assist in restoring information. It can include copy operations, data transfer, encoding operations and the like.
For example, the different data protection schemes can include at least one of the following: change recording; in-order asynchronous remote copying; out-of-order asynchronous remote copying; synchronous remote copying; or continuous data protection. The first four data protection schemes are also referred to as copy services. Change recording can involve updating a data structure whenever a writeable entity (such as a track) is updated. It is noted that a write operation can be followed by a combination of at least one of the mentioned above data protection operations.
A storage system controller can intercept a write instruction that is sent to it from a user, determine which (if any) data protection operation to execute, and participate in such a data protection operation. For example, an incoming write instruction to a volume that was defined as a primary in a remote copy relation, will be checked in order to determine whether to initiate the synchronous remote copy operation, asynchronous in-order operation, or asynchronous out-of-order remote copy operation. This can involve modifying the controller code to enable such a determination.
According to an embodiment of the invention a write instruction can include metadata (such as relevancy metadata) that indicates that data protection metadata included in a certain write instruction should determine the data protection operations to be executed after other write instructions. For example, a write instruction can include relevancy metadata that determines the data protection operations (if any) to be executed in relation to subsequent write operations that are associated with the same writable entity. These subsequent write instructions can lack data protection metadata. The relevancy metadata can indicate the number of subsequent write operations that should be affected by the certain write instruction.
Write instructions that lack data protection metadata can be generated by users that are typically not aware of the data protection schemes. Write instructions that include data protection metadata can be generated by a storage system administrator, by a database administrator, or by a “root” that creates a file (or other application object) and specifies the data protection scheme that should be applied. The data protection scheme can be set persistent.
Control unit 12 is connected to users 50 via network 40. It is noted that the number of users can exceed two and typically well exceeds two. It is further noted that network 40 can be connected to various types of users and that it can be connected to a database administrator.
User 50 can generate a write instruction that is sent via network 40 to control unit 12. Control unit 12 and especially controller 20 checks whether the write instruction should be followed by one or more data protection operations.
a-3d illustrate write instructions 101, 102, 103 and 104 according to various embodiments of the invention.
Write instruction 101 of
a illustrates data protection metadata field 130 as a bit map that includes five bits: change recording bit 131, in-order asynchronous remote copying bit 132, out-of-order asynchronous remote copying bit 133, synchronous remote copying bit 134 and continuous data protection bit 135. The relevancy of a data protection operation (change recording, in-order asynchronous remote copying, out-of-order asynchronous remote copying, synchronous remote copying bit or continuous data protection) is indicated by the value of its corresponding bit.
Write instruction 102 of
Write instruction 103 of
Write instruction 104 of
Method 200 starts by stage 210 of receiving a write instruction that is associated with a writable entity. Conveniently, the write instruction includes a writable entity identifier. The write instruction is also referred to as a currently received write instruction. The writable entity can be a physical address, a physical range of addresses, a virtual address, a virtual range of addresses or a combination thereof. It can be, for example, a track, a volume and the like. The writable entity can be an application object such as a file, a database and the like. The write instruction includes writing information to the writable entity.
Stage 210 is followed by stage 220 and stage 230.
Stage 220 includes participating in a write operation of an information entity to the writable entity. The participation can include, for example, initiating the write operation, controlling the write operation or otherwise taking at least a part in the execution of the write operation.
Stage 230 includes determining if one or more data protection operations should be executed in relation to the information entity. Such a data protection operation is referred to as a relevant data protection operation.
The determination can be responsive to data protection metadata that is included in the currently received write instruction. If such data protection metadata is not included in the received write instruction the determination can be responsive to data protection metadata included in a previously received write instruction. If even such data protection metadata does not exist (or is not relevant to the currently received write instruction) then the determination can either result in not performing any data protection operation or performing a data protection operation according to a fixed mapping between data protection operations and addresses.
Accordingly, stage 230 can start by stage 232 of checking if the write instruction includes data protection metadata. The data protection metadata is indicative of a relevancy of at least one data protection operation to be applied in relation to the write instruction.
If the answer is positive then stage 232 is followed by stage 238 of determining if one or more data protection operations should be executed in response to the data protection metadata. In this case stage 238 is responsive to the data protection metadata included in the currently received write instruction.
If the answer is negative (the currently received write instruction does not include data protection metadata) then stage 232 is followed by stage 234 of checking if a previously received write instruction includes data protection metadata that is relevant to the currently received write instruction.
It is noted that the relevancy of a previously received write instruction can be learnt from relevancy metadata included in the previously received write instruction or from a default indication included in the previously received write instruction. The previously received write instruction can include relevancy metadata indicative of a relevancy of the data protection metadata to at least one other write instruction that is associated with the same writable entity. The previously received write instruction can include a default indication that indicates that the data protection metadata included in the previously received write instruction can be used as a default data protection metadata.
If the answer is positive then stage 234 is followed by stage 238. In this case stage 238 is responsive to the data protection metadata included in a previously received write instruction.
If the answer is negative (there is no relevant data protection metadata) then stage 234 is followed by stage 236 of checking if there is a fixed mapping that can assist in determining which data protection operation (if any) to apply.
If the answer is positive then stage 236 is followed by stage 237 of determining if one or more data protection operations should be executed in response to the fixed mapping.
If the answer is negative (there is no relevant data protection metadata and there is no fixed mapping) then stage 236 can be followed by determining not to apply any data protection operation.
Stage 230 is followed by stage 240 of participating in an execution of a relevant data protection operation, if such a relevant data protection operations exist. The participation can include, for example, initiating a relevant data protection operation, controlling the execution of the relevant data protection operation or otherwise taking at least a part in the execution of the relevant data protection operation.
It is noted that using the default indication can result in the following sequence of stages: (i) receiving (during an iteration of stage 210) a first write instruction that includes a default indication and data protection metadata; (ii) executing some other stages of method 200; (iii) receiving (during another iteration of method 200) a second write instruction that lacks data protection metadata; wherein the first and second write instructions are associated with the writable entity; and (iv) determining (during an iteration of stage 230) a relevancy of at least one data protection operation to be applied in relation to the second write operation in response to the data protection metadata of the first write instruction.
According to another embodiment of the invention a method can be provided for generating a write instruction. The write instruction is associated with a writable entity and it includes a writable entity identifier; and data protection metadata indicative of a relevancy of at least one data protection operation to be applied in relation to the write instruction. It can also include a default identifier, and additionally or alternatively relevancy metadata.
Furthermore, the invention can take the form of a computer program product accessible from a tangible computer-usable or a tangible computer-readable medium providing program code for use by or in connection with a computer or any instruction execution system. For the purposes of this description, a tangible computer-usable or a tangible computer readable medium can be any tangible apparatus that can contain, store, communicate, propagate, or transport the program for use by or in connection with the instruction execution system, apparatus, or device.
The tangible medium can be read by applying various methods and techniques such as but not limited to electronic, magnetic, optical, electromagnetic or infrared based techniques. The tangible medium can be a semiconductor system but can be made from other materials, especially those materials that can be read by the mentioned above techniques. Non limiting examples of a tangible computer-readable medium include a semiconductor or solid-state memory, magnetic tape, a removable computer diskette, a random access memory (RAM), a read-only memory (ROM), a rigid magnetic disk and an optical disk. Current examples of optical disks include compact disk-read only memory (CD-ROM), compact disk-read/write (CD-R/W) and DVD.
A data processing system suitable for storing and/or executing program code will include at least one processor coupled directly or indirectly to memory elements through a system bus. The memory elements can include local memory employed during actual execution of the program code, bulk storage, and cache memories which provide temporary storage of at least some program code in order to reduce the number of times code must be retrieved from bulk storage during execution.
Input/output or I/O devices (including but not limited to keyboards, displays, pointing devices, etc.) can be coupled to the system either directly or through intervening I/O controllers.
Network adapters may also be coupled to the system to enable the data processing system to become coupled to other data processing systems or remote printers or storage devices through intervening private or public networks. Modems, cable modem and Ethernet cards are just a few of the currently available types of network adapters.
Computer program product 410 includes tangible computer-usable or a tangible computer-readable medium 420 providing program code 430 for use by or in connection with a computer such as computer 440 or any instruction execution system such as system 10 of
Program code 430 (also referred to as computer readable program), when executed on computer 440 causes computer 440 to: (i) receive a write instruction that is associated with a writable entity; wherein the write instruction includes: a writable entity identifier; and data protection metadata indicative of a relevancy of at least one data protection operation to be applied in relation to the write instruction; and (ii) participate in an execution of a relevant data protection operation, if such a relevant data protection operation exists.
Variations, modifications, and other implementations of what is described herein will occur to those of ordinary skill in the art without departing from the spirit and the scope of the invention as claimed.
Accordingly, the invention is to be defined not by the preceding illustrative description but instead by the spirit and scope of the following claims.