Patent Application
20210286680
This application claims priority to Chinese Patent Application No. CN202010177767.7, on file at the China National Intellectual Property Administration (CNIPA), having a filing date of Mar. 13, 2020 and having “METHOD, ELECTRONIC DEVICE AND COMPUTER PROGRAM PRODUCT FOR STORAGE MANAGEMENT” as a title, the contents and teachings of which are herein incorporated by reference in their entirety.
Embodiments of the present disclosure generally relate to a computer technology, and in particular, to a storage management method, an electronic device, and a computer program product.
In the field of storage technologies, snapshots are widely used for data backup. Snapshots can be created on many objects. These objects can be referred to as basic storage objects, such as a Logic Unit Number (LUN), a file system, and a database. With the development of storage technologies, functions for realizing migration of basic storage objects continue to increase. For example, such a migration function can migrate a block storage resource such as a LUN across storage pools or within the same storage pool. However, conventional storage technologies cannot migrate snapshots with their basic storage objects, resulting in low storage management efficiency.
Embodiments of the present disclosure provide a storage management method, an electronic device, and a computer program product.
According to a first aspect of the present disclosure, a storage management method is provided. The method includes: acquiring a first source snapshot for a source storage object stored in a source storage device; determining first difference data between the first source snapshot and the source storage object or a second source snapshot for the source storage object, creation time of the first source snapshot being associated with creation time of the second source snapshot; and sending the first difference data to a destination storage device to enable the destination storage device to create a first destination snapshot for a destination storage object stored in the destination storage device based on the first difference data.
According to a second aspect of the present disclosure, an electronic device is provided. The device includes at least one processing unit and at least one memory. The at least one memory is coupled to the at least one processing unit and stores an instruction utilized to be executed by the at least one processing unit. The instruction, when executed by the at least one processing unit, causes the device to perform actions, and the actions include: acquiring a first source snapshot for a source storage object stored in a source storage device; determining first difference data between the first source snapshot and the source storage object or a second source snapshot for the source storage object, creation time of the first source snapshot being associated with creation time of the second source snapshot; and sending the first difference data to a destination storage device to enable the destination storage device to create a first destination snapshot for a destination storage object stored in the destination storage device based on the first difference data.
According to a third aspect of the present disclosure, a computer program product is provided. The computer program product is tangibly stored on a non-transient computer-readable medium and includes a machine-executable instruction. The machine-executable instruction, when executed, causes a machine to perform actions, and the actions include: acquiring a first source snapshot for a source storage object stored in a source storage device; determining first difference data between the first source snapshot and the source storage object or a second source snapshot for the source storage object, creation time of the first source snapshot being associated with creation time of the second source snapshot; and sending the first difference data to a destination storage device to enable the destination storage device to create a first destination snapshot for a destination storage object stored in the destination storage device based on the first difference data.
The summary is provided in order to introduce the selection of concepts in a simplified form, which will be further described in the detailed description below. The summary is neither intended to identify key features or essential features of the present disclosure, nor intended to limit the scope of the present disclosure.
The above and other objectives, features and advantages of the present disclosure will become more apparent by describing example embodiments thereof in more detail with reference to the accompanying drawings, and in the example embodiments of the present disclosure, the same reference numerals generally represent the same components.
In the various drawings, identical or corresponding numerals represent identical or corresponding parts.
The individual features of the various embodiments, examples, and implementations disclosed within this document can be combined in any desired manner that makes technological sense. Furthermore, the individual features are hereby combined in this manner to form all possible combinations, permutations and variants except to the extent that such combinations, permutations and/or variants have been explicitly excluded or are impractical. Support for such combinations, permutations and variants is considered to exist within this document.
It should be understood that the specialized circuitry that performs one or more of the various operations disclosed herein may be formed by one or more processors operating in accordance with specialized instructions persistently stored in memory. Such components may be arranged in a variety of ways such as tightly coupled with each other (e.g., where the components electronically communicate over a computer bus), distributed among different locations (e.g., where the components electronically communicate over a computer network), combinations thereof, and so on.
Preferred embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. Although the drawings illustrate the preferred embodiments of the present disclosure, it should be understood that the present disclosure may be implemented in various forms and should not be limited to the embodiments illustrated herein. Rather, these embodiments are provided to make the present disclosure more thorough and complete, and will fully convey the scope of the present disclosure to those skilled in the art.
The terms “include” and variants thereof as used herein represent open-ended inclusion, i.e., “including but not limited to.” Unless specifically stated, the term “or” means “and/or.” The term “based on” means “based at least in part on.” The terms “one example embodiment” and “one embodiment” mean “at least one example embodiment.” The term “another embodiment” means “at least one additional embodiment.” The terms “first,” “second,” etc. may refer to different or identical objects. Other explicit and implicit definitions may be included below.
As described above, a conventional storage technology cannot migrate a snapshot together with its basic storage object. Some functions can migrate an attribute of a snapshot together with its basic storage object. However, due to some performance issues, such a function can only migrate an attribute such as a snapshot schedule, but cannot migrate the snapshot with its basic storage object, leading to a considerable limitation. In addition, in the case of migrating a snapshot with its basic storage object, since redundant data may exist in the snapshot, full replication of the snapshot will reduce the system performance.
According to an example embodiment of the present disclosure, an improved solution for storage management is provided. In this solution, a source storage device acquires a source snapshot (hereinafter referred to as “first source snapshot”) for a source storage object stored in the source storage device, and determines difference data (hereinafter referred to as “first difference data”) between the first source snapshot and a source storage object or another source snapshot (hereinafter referred to as “second source snapshot”) for the source storage object. The creation time of the first source snapshot is associated with the creation time of the second source snapshot. Then, the source storage device sends the first difference data to a destination storage device to enable the destination storage device to create a destination snapshot (hereinafter referred to as “first destination snapshot”) for a destination storage object stored in the destination storage device based on the first difference data.
Thus, this solution can migrate the snapshot from the source storage device to the destination storage device together with its basic storage object. In addition, by using the difference data, this solution can create a complete copy of the snapshot at the destination storage device when only a small amount of data is transmitted. Therefore, this solution can improve the efficiency and reliability of storage management and provide better user experience.
In the following, the specific examples of this solution will be described in more detail with reference to
As shown in
These copies stored in destination storage device 120 may be created based on source storage object 114 and source snapshot 112. Specifically, in order to create these copies, the source storage device 110 may determine difference data (for example, difference data 116-1 to difference data 116-N (hereinafter collectively referred to as “difference data” 116)) between source snapshot 112 and source storage object 114 or another source snapshot 112, and send the difference data to destination storage device 120. Destination storage device 120 may create destination snapshot 122 for destination storage object 124 based on received difference data 116.
In the following, a storage management operation performed by source storage device 110 will be described with reference to
At 210, source storage device 110 acquires first source snapshot 112 for source storage object 114 stored in source storage device 110. In some embodiments, source storage device 110 may determine whether the first source snapshot is to be copied to destination storage device 120. For example, in the process of migrating source snapshot 112 together with its source storage object 114, after source storage object 114 is copied into destination storage device 120, source storage device 110 may determine whether there is first source snapshot 112 with no copy created in destination storage device 120, and this first source snapshot 112 needs to be copied to destination storage device 120. When first source snapshot 112 is to be copied into destination storage device 120, source storage device 110 may acquire to-be-acquired first source snapshot 112.
At 220, source storage device 110 determines first difference data 116 between first source snapshot 112 and source storage object 114 or second source snapshot 112 for source storage object 114. In some embodiments, source storage device 110 may determine whether the creation time of first source snapshot 112 is later than a predetermined time point. For example, whether first source snapshot 112 is a source snapshot created based on source storage object 114 and having the latest creation time is determined. When the creation time of first source snapshot 112 is later than the predetermined time point, source storage device 110 may determine first difference data 116 between first source snapshot 112 and source storage object 114.
For example, as shown in
When the creation time of first source snapshot 112 is earlier than the predetermined time point, source storage device 110 may acquire second source snapshot 112. The creation time of first source snapshot 112 is associated with the creation time of second source snapshot 112. In some embodiments, the creation time of second source snapshot 112 is later than the creation time of first source snapshot 112. For example, second source snapshot 112 may be created immediately after the creation of first source snapshot 112. In this case, source storage device 110 may determine first difference data 116 between first source snapshot 112 and second source snapshot 112.
For example, as shown in
At 230, source storage device 110 sends first difference data 116 to destination storage device 120 to enable destination storage device 120 to create first destination snapshot 122 for destination storage object 124 stored in destination storage device 120 based on first difference data 116. As described above, destination storage object 124 is a copy of source storage object 114 in destination storage device 120. The created first destination snapshot 122 is also a copy of first source snapshot 112 in destination storage device 120. In this way, source snapshot 112 may be migrated together with its source storage object 114 to destination storage device 120.
Further, as described above, first difference data 116 may be determined in two ways. On one hand, in some embodiments, when first difference data 116 are determined based on first source snapshot 112 and source storage object 114, in addition to first difference data 116, source storage device 110 may further send an identifier of source storage object 114 to destination storage device 120 to instruct destination storage device 120 to create first destination snapshot 122 based on first difference data 116 and destination storage object 124 corresponding to the identifier of source storage object 114.
For example, in addition to difference data 116-N, source storage device 110 may further send the identifier of source storage object 114 to destination storage device 120 to instruct destination storage device 120 to create first destination snapshot 122-N based on difference data 116-N and destination storage object 124 corresponding to the identifier of source storage object 114.
Alternatively, even if source storage device 110 does not send the identifier of source storage object 114 to destination storage device 120, destination storage device 120 may determine that first difference data 116 aims at destination storage object 124 and to-be-created first destination snapshot 122 based on destination storage object 124 that has been stored on the destination storage device, so that first destination snapshot 122 may be created based on first difference data 116 and destination storage object 124. For example, upon receiving difference data 116-N, destination storage device 120 may create destination snapshot 122-N based on difference data 116-N and destination storage object 124.
On the other hand, in some embodiments, when first difference data 116 is determined based on first source snapshot 112 and second source snapshot 112, in addition to first difference data 116, source storage device 110 may further send an identifier of second source snapshot 112 to destination storage device 120 to instruct destination storage device 120 to create first destination snapshot 122 based on first difference data 116 and second destination snapshot 122 corresponding to the identifier of second source snapshot 112.
For example, in addition to difference data 116-1, source storage device 110 may further send the identifier of source snapshot 112-2 to destination storage device 120 to instruct destination storage device 120 to create destination snapshot 122-1 based on difference data 116-1 and destination snapshot 122-2 corresponding to the identifier of source snapshot 112-2.
Alternatively, even if source storage device 110 does not send the identifier of second source snapshot 112 to destination storage device 120, destination storage device 120 may also determine that first difference data 116 aims at second destination snapshot 122 and to-be-created first destination snapshot 122 based on second destination snapshot 122 that has been stored on destination storage device, so that first destination snapshot 122 may be created based on first difference data 116 and second destination snapshot 122. For example, upon receiving difference data 116-1, destination storage device 120 may create destination snapshot 122-1 based on difference data 116-1 and destination snapshot 122-2.
Source storage device 110 may repeatedly determine difference data 116 in the manner described above and provide the difference data to destination storage device 120 for re-creating the snapshot until source storage device 110 does not include a snapshot to be migrated to destination storage device 110.
Therefore, this solution may create a complete snapshot copy at the destination storage device, and may also use the difference data to achieve a relatively small network overhead. Therefore, the efficiency and reliability of storage management may be improved, and the cost of storage management may be reduced, thereby providing better user experience.
It should be understood that storage objects and snapshots may be stored in various structures. In some embodiments, the storage objects and the snapshots may be stored in a dendritic structure.
For this dendritic structure,
When source storage object 114 and source snapshot 112 are stored in the dendritic structure, after difference data 116 for first source snapshot 112 is determined and sent to destination storage device 120, at 410, source storage device 110 may determine whether there is sub source snapshot 112 stored in association with first source snapshot 112 based on the dendritic structure. For example, after source snapshot 112-6 is processed, source storage device 110 may determine whether there is sub source snapshot 112 stored in association with source snapshot 112-6.
When it is determined that there is sub source snapshot 112, at 420, source storage device 110 may determine difference data (hereinafter referred to as “second difference data”) between first source snapshot 112 and sub source snapshot 112. As shown in
At 430, source storage device 110 may send the second difference data to destination storage device 120 to enable destination storage device 120 to create sub destination snapshot 122 for destination storage object 124 based on the second difference data. For example, source storage device 110 may send the difference data between source snapshot 112-6 and sub source snapshot 112-7 to destination storage device 120 to enable destination storage device 120 to create sub destination snapshot 122-7 based on the difference data.
In addition to the second difference data, source storage device 110 may further send an identifier of first source snapshot 112 to destination storage device 120 to instruct destination storage device 120 to create sub destination snapshot 122 based on the second difference data and first destination snapshot 122 corresponding to the identifier of first source snapshot 112. For example, in addition to the difference data between source snapshot 112-6 and sub source snapshot 112-7, source storage device 110 may also send the identifier of source snapshot 112-6 to destination storage device 120 to instruct destination storage device 120 to create sub destination snapshot 122-7 based on the difference data and destination snapshot 122-6 corresponding to the identifier of source snapshot 112-6.
Alternatively, even if source storage device 110 does not send the identifier of first source snapshot 112 to destination storage device 120, destination storage device 120 may also determine that the second difference data aims at first destination snapshot 122 and to-be-created sub destination snapshot 122 based on first destination snapshot 122 that has been stored on the destination storage device, so that sub destination snapshot 122 may be created based on the second difference data and first destination snapshot 122. For example, upon receiving the difference data between source snapshot 112-6 and sub source snapshot 112-7, destination storage device 120 may create sub destination snapshot 122-7 based on the difference data and destination snapshot 122-6.
Source storage device 110 may use various algorithms to traverse snapshot tree 300, so as to migrate source snapshot 112. For example, when source storage device 110 uses a breadth-first algorithm, the processing order of source snapshot 112 is source snapshot 112-6, source snapshot 112-7, source snapshot 112-4, source snapshot 112-2, source snapshot 112-3, source snapshot 112-8, source snapshot 112-9, source snapshot 112-5, and source snapshot 112-1. Correspondingly, destination storage device 120 also creates a copy of snapshot tree 300 in this order and structure.
Thus, when the storage objects and the snapshots are stored in a dendritic structure, this solution can easily and efficiently migrate the snapshots together with their basic storage objects from the source storage device to the destination storage device.
Multiple components in device 500 are connected to I/O interface 550, including: input unit 560, such as a keyboard or a mouse; output unit 570, such as various types of displays or speakers; storage unit 580, such as a magnetic disk or an optical disk; and communication unit 590, such as a network card, a modem, or a wireless communication transceiver. Communication unit 590 allows device 500 to exchange information/data with other devices over a computer network such as the Internet and/or various telecommunication networks.
The various processes and processing described above, such as method 200 or method 400, may be performed by processing unit 510. For example, in some embodiments, method 200 or method 400 may be implemented as a computer software program that is tangibly included in a machine-readable medium, such as storage unit 580. In some embodiments, some or all of the computer program may be loaded and/or installed onto device 500 via ROM 520 and/or communication unit 590. When the computer program is loaded into RAM 530 and executed by CPU 510, one or more actions of method 200 or method 400 described above may be executed.
The present disclosure may be a method, an apparatus, a system, and/or a computer program product. The computer program product may include a computer-readable storage medium having computer-readable program instructions for performing various aspects of the present disclosure.
The computer-readable storage medium may be a tangible device that may retain and store instructions used by an instruction execution device. For example, the computer-readable storage medium may be, but is not limited to, an electrical storage device, a magnetic storage device, an optical storage device, an electromagnetic storage device, a semiconductor storage device, or any suitable combination of the foregoing. More specific examples (a non-exhaustive list) of the computer-readable storage medium include: a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or a flash memory), a static random access memory (SRAM), a portable compact disk read-only memory (CD-ROM), a digital versatile disk (DVD), a memory stick, a floppy disk, a mechanically encoded device such as punch cards or raised structures in a groove having instructions recorded thereon, and any suitable combination of the foregoing. The computer-readable storage medium as used herein is not to be interpreted as a transient signal itself, such as a radio wave or other freely propagating electromagnetic waves, an electromagnetic wave propagating through a waveguide or other transmission media (e.g., a light pulse through a fiber optic cable), or an electrical signal transmitted through an electrical wire.
The computer-readable program instructions described herein may be downloaded from the computer-readable storage medium to various computing/processing devices or downloaded to an external computer or an external storage device over a network, such as the Internet, a local area network (LAN), a wide area network (WAN), and/or a wireless network. The network may include copper transmission cables, fiber optic transmissions, wireless transmissions, routers, firewalls, switches, gateway computers, and/or edge servers. A network adapter card or network interface in each computing/processing device receives a computer-readable program instruction from the network and forwards the computer-readable program instruction for storage in the computer-readable storage medium in each computing/processing device.
The computer program instructions for performing the operations of the present disclosure may be assembly instructions, instruction set architecture (ISA) instructions, machine instructions, machine-related instructions, microcodes, firmware instructions, state setting data, or source codes or object codes written in any combination of one or more programming languages, including object-oriented programming languages such as Smalltalk or C++, as well as conventional procedural programming languages such as the “C” language or similar programming languages. The computer-readable program instructions may be executed entirely on a user computer, executed partly on a user computer, executed as a stand-alone software package, executed partly on a user computer while executed partly on a remote computer, or executed entirely on a remote computer or a server. In the case of a remote computer, the remote computer may be connected to a user computer through any type of network, including an LAN or a WAN, or may be connected to an external computer (e.g., connected through the Internet using an Internet service provider). In some embodiments, an electronic circuit, such as a programmable logic circuit, a field programmable gate array (FPGA), or a programmable logic array (PLA), may be customized by utilizing state information of the computer-readable program instructions. The electronic circuit may execute the computer-readable program instructions to implement various aspects of the present disclosure.
Various aspects of the present disclosure are described herein with reference to flow charts and/or block diagrams of methods, apparatuses (systems) and computer program products according to embodiments of the present disclosure. It should be understood that each block of the flow charts and/or block diagrams and combinations of blocks in the flow charts and/or block diagrams can be implemented by computer-readable program instructions.
These computer-readable program instructions may be provided to a processing unit of a general purpose computer, a special purpose computer, or other programmable data processing apparatuses, thereby producing a machine such that when these instructions are executed by the processing unit of the computer or other programmable data processing apparatuses, an apparatus of implementing functions/actions specified in one or more blocks in the flow charts and/or the block diagrams is generated. The computer-readable program instructions may also be stored in the computer-readable storage medium. These instructions cause the computer, the programmable data processing apparatuses, and/or other devices to operate in a specific manner, so that the computer-readable medium storing the instructions includes an article of manufacture that includes instructions for implementing various aspects of functions/actions specified in one or more blocks in the flow charts and/or the block diagrams.
The computer-readable program instructions may also be loaded onto the computer, other programmable data processing apparatuses, or other devices to perform a series of operational steps on the computer, other programmable data processing apparatuses, or other devices to produce a computer-implemented process. Thus, instructions executed on the computer, other programmable data processing apparatuses, or other devices implement functions/actions specified in one or more blocks in the flow charts and/or the block diagrams.
The flow charts and the block diagrams in the drawings illustrate possible implementations of system architectures, functions and operations of the system, the method, and the computer program product according to various embodiments of the present disclosure. In this regard, each block in the flow charts or the block diagrams may represent a part of a module, a program segment or an instruction, and the part of the module, the program segment or the instruction includes one or more executable instructions for realizing a specified logic function. Functions marked in the blocks may also happen in an order different from that marked in the accompanying drawings in some alternative implementations. For example, actually, two successive blocks may be basically concurrently executed and may also be executed according to an opposite order sometimes, which is decided by the related functions. It should also be noted that each block in the block diagrams and/or the flow charts as well as a combination of the blocks in the block diagrams and/or the flow charts may be realized by using a special and hardware-based system used for executing specified functions or actions or may be realized by using a combination of special hardware and a computer instruction.
The various embodiments of the present disclosure have been described above. The foregoing description is an example, not exhaustive, and is not intended to be limited to the disclosed embodiments. Multiple modifications and variations will be apparent to those skilled in the art without departing from the scope and spirit of the various illustrated embodiments. The terms used herein were chosen to best explain the principles and practical applications of the embodiments, or improvements on technologies in the marketplace or to enable others of ordinary skill in the art to understand the embodiments disclosed herein.
| Number | Date | Country | Kind |
|---|---|---|---|
| 202010177767.7 | Mar 2020 | CN | national |
