This application claim priority from Chinese Patent Application Number CN201710525356.0, filed on Jun. 30, 2017 at the State Intellectual Property Office, China, titled “METHOD, APPARATUS AND COMPUTER PROGRAM PRODUCT FOR MANAGING A STORAGE SYSTEM” the contents of which is herein incorporated by reference in its entirety.
Embodiments of the present disclosure generally relate to the field of data storage, and more specifically, to method, device and computer program product for managing a storage system.
A storage system generally has a plurality of disks which can be organized into a disk array. For example, a Redundant Array of Independent Disks (RAID) is a data storage virtualization technology that organizes a plurality of disks into a single logic unit for the purpose of data redundancy and/or performance improvement. Taking the traditional RAID5 for example, a RAID group (RG) can be bound on a set of disks and the RG will consume all the space of this set of disks to store data and parity information. Besides, generally there exists a spare disk for this RG. For the consideration of consistency of input/output (I/O) performance, this spare disk usually has the same type as the disks in this RG (for instance, a disk). When a certain disk of this RG fails, the spare disk can be selected to replace the faulty disk and all of the data on the faulty disk will be rebuilt and written into the spare disk.
As all of the writing operations for rebuilding the faulty disk are targeted for the spare disk for this RG, the writing bandwidth of the spare disk will become a bottleneck for the whole rebuilding process. Besides, during the rebuilding process, the storage system may still receive random I/O requests for the faulty RG from upper-layer applications. Since the RG is being rebuilt, the response time of such random I/O requests might be affected. In addition, a large number of such random I/O requests may also cause the rebuilding process to slow down or even be interrupted. In this case, if another disk in the RG also fails, data loss might be incurred.
Embodiments of the present disclosure provide method, device and computer program product for managing a storage system.
In a first aspect of the present disclosure, there is provided a method for managing a storage system which includes a disk array. The method includes determining, based on a first number of disks in the disk array, a second number of spare disks for the disk array. The method further includes creating a spare disk array with the second number of spare disks. The method further includes, in response to a first disk in the disk array failing, allocating a spare logic storage unit from the spare disk array for rebuilding the first disk. In addition, the method further includes rebuilding the first disk with the spare logic storage unit.
In a second aspect of the present disclosure, there is provided a device for managing a storage system which includes a disk array. The device includes at least one processing unit and at least one memory. The at least one memory is coupled to the at least one processing unit and stores instructions for execution by the at least one processing unit, the instructions, when executed by the at least one processing unit, causing the device to perform acts including: determining, based on a first number of disks in the disk array, a second number of spare disks for the disk array; creating a spare disk array with the second number of spare disks; in response to a first disk in the disk array failing, allocating a spare logic storage unit from the spare disk array for rebuilding the first disk; and rebuilding the first disk with the spare logic storage unit.
In a third aspect of the present disclosure, there is provided a storage system which includes a disk array and a storage processor. The storage processor is configured to perform acts including: determining, based on a first number of disks in the disk array, a second number of spare disks for the disk array; creating a spare disk array with the second number of spare disks; in response to a first disk in the disk array failing, allocating a spare logic storage unit from the spare disk array for rebuilding the first disk; and rebuilding the first disk with the spare logic storage unit.
In a fourth aspect of the present disclosure, there is provided a computer program product which is tangibly stored on a non-volatile computer readable medium and includes machine-executable instructions, the instructions, when executed by device, causing the device to perform any steps of the method according to the first aspect of the present disclosure.
This Summary is provided to introduce a selection of concepts in a simplified form that are further described below in the Detailed Description. This Summary is not intended to identify key features or essential features of the present disclosure, nor is it intended to limit the scope of the present disclosure.
Through the following detailed description with reference to the accompanying drawings, the above and other objectives, features, and advantages of the present disclosure will become more apparent. In the example embodiments of present disclosure, the same reference signs usually represent the same components.
Throughout the drawings, the same or corresponding reference symbols are used to indicate the same or corresponding parts.
Preferred embodiments of the present disclosure will be described below in greater detail with reference to the drawings. Although preferred embodiments of present disclosure are displayed in the drawings, it is to be understood that the present disclosure can be implemented in various manners, not limited to the embodiments illustrated herein. On the contrary, these embodiments are provided to make the present disclosure more thorough and complete and convey the scope of the present disclosure completely to those skilled in the art.
As used herein, the term “includes” and its variants are to be read as open-ended terms that mean “includes, but is not limited to.” The term “or” is to be read as “and/or” unless the context clearly indicates otherwise. The term “based on” is to be read as “based at least in part on.” The terms “one example embodiment” and “an example embodiment” are to be read as “at least one example embodiment.” The term “another embodiment” is to be read as “at least one other embodiment.” Terms “a first”, “a second” and others can denote different or identical objects. The following text may also contain other explicit or implicit definitions.
As stated above, in a traditional disk array, when a certain disk of the disk array group fails, a spare disk can be selected to replace the faulty disk, and all of the data on the faulty disk will be rebuilt and written into the spare disk. As all of the writing operations for rebuilding the faulty disk are targeted for the spare disk, the writing bandwidth of the spare disk will become a bottleneck for the whole rebuilding process. For example,
Through the above depiction, it can be seen that in the conventional scheme, as all of the writing operations for rebuilding the faulty disk are targeted for a same spare disk, the writing bandwidth of the spare disk will become a bottleneck of the whole rebuilding process. Besides, during the rebuilding process, the storage system may still receive random I/O requests for the faulty RG from upper-layer applications. Since the RG is being rebuilt, the response time of such random I/O requests might be affected. In addition, a large number of such random I/O requests may also cause the rebuilding process to slow down or even be interrupted. In this case, if another disk in the RG also fails, data loss might be incurred.
In order to solve the above problem and one or more of other potential problems, example embodiments of the present disclosure provide a scheme for managing a storage system. The scheme accelerates the rebuilding of the faulty disk by using a SSD with a lower Write Per Day (WPD) as a spare disk, so as to reduce the number of spare disks required by the storage system. The scheme further organizes a plurality of SSDs into a spare disk array group and allocates spare logic storage units from the spare disk array group on demand to serve for the rebuilding of the faulty disk. Therefore, the scheme can serve for rebuilding of a plurality of disk array groups simultaneously and the writing operations for rebuilding a faulty disk can be distributed to a plurality of different SSDs. Besides, the scheme further proposes a mechanism for reclaiming a spare logic storage unit and improves the utilization efficiency of a spare disk by freeing up the storage space occupied by the spare logic storage unit timely.
The storage processor 310 may be used to manage one or more disks. As used herein, a “disk” may refer to any non-volatile storage medium currently known or to be developed in the future, such as a magnetic disk, optical disk or solid state disk (SSD), and the like. Only for the ease of depiction, in the description of the present disclosure, a magnetic disk will be used as an example of the disk. However, it is to be understood that this is only for the ease of depiction, without suggesting any limitations to the scope of the present disclosure.
The storage processor 310, for instance, may organize one or more disks into a disk array 320 (also referred to as “storage resource pool”). The disk array 320 may include one or more disk array groups. As shown in
The disk array 320, for instance, may be a Redundant Array of Independent Disks (RAID) which organizes a plurality of disks into a logic storage unit for the purpose of data redundancy and/or performance improvement. According to the required level of redundancy and performance, RAID may have different levels, such as RAID 0, RAID 1, . . . , RAID 5 and so on. Each of the disk array groups 121 may be consisted of a plurality of RAID stripes, each of which may include data extents for storing data and parity extents for storing parity information. Take RAID 5 with a structure of 4D+1P as an example, where each RAID stripe may include four data extents and one parity extent. In the following depiction, the structure of a RAID stripe, such as “4D+1P,” may also be referred to as “width of a RAID.” Generally, disk array groups in the same storage resource pool (namely, same disk array) may have the same RAID level and RAID width. In the depiction of the present disclosure, RAID 5 with a structure of 4D+1P is taken as an example for the disk array 320. However, it is to be understood that this is only for the ease of depiction, without suggesting any limitations to the scope of the present disclosure.
The storage system 300 may further include one or more spare disks for the disk array 320. As shown in
At block 410, the storage processor 310 determines, based on the number of disks in the disk array 320 (also referred to as “first number”), a number of spare disks for the disk array 320 (also referred to as “second number”).
In some embodiments, the spare disks for creating the disk array 320 may have a different type than the disks in the disk array 320. For example, the spare disks may have a relatively lower latency and a relatively higher throughput than the disks in the disk array 320, so as to accelerate the rebuilding of the faulty disk. For example, the disks in the disk array 320 may be magnetic disks while the spare disks for the disk array 320 may be SSDs. Particularly, as the spare disks in the storage system are generally only used for the rebuilding of the faulty disk, the number of I/O operations for the spare disk may be less than that for the disks. Therefore, in some embodiments, SSDs with lower WPD (for instance, 0.5 WPD or 1 WPD) can be utilized as spare disks to reduce the cost. As used herein, “WPD” refers to the number of Writes Per Day while ensuring the rated service life of SSD. A SSD with lower WPD usually costs less than a SSD with higher WPD.
In some embodiments, the second number of spare disks for creating the spare disk array 330 may be determined based on the first number of disks in the disk array 320. Assuming that in the traditional scheme, the spare disks have the same type (such as, magnetic disks) and size as the disks, the ratio of the number of spare disks and the number of disks may be 1:30. In some embodiments, as SSDs with higher throughput than the disks (such as, 10 times higher) are utilized as spare disks, the ratio of the number of spare disks and the number of disks may be, for instance, 1:300. In other words, embodiments of the present disclosure can reduce the number of spare disks required by the storage system.
At block 420, the storage processor 310 utilizes the second number of spare disks to create the disk array 330. In some embodiments, the storage processor 310 may determine the type of the spare disk array 330 based on the second number, and then create the spare disk array 330 of this type.
For instance, it is assumed that the second number of spare disks determined at block 410 is 1˜4. In an embodiment, for instance, in the case of only one spare disk, the storage processor 310 may create a spare disk array 330 with the type of RAID 0. Alternatively, in the case of two spare disks, the storage processor 330 may create a spare disk array 330 with the type of RAID 0 or RAID 1. Alternatively, in another embodiment, for example, in the case of three spare disks, the storage processor 310 may create a spare disk array 330 with the type of RAID 0, RAID 1 or RAID 5. Alternatively, in still another embodiment, in the case of four spare disks, the storage processor 310 may create a spare disk array 330 with the type of RAID 0, RAID 10 (a combination of RAID 0 and RAID 10, which realizes stripe set mirroring with parity check) or RAID 5. In some embodiments, under consideration of the cost of the SSD, it is possible to create a spare disk array 330 with the type of RAID 0. In some other embodiments, to provide better data protection and provide I/O processing capability, a spare disk array 330 with the type of RAID 1 or RAID 5 may be created.
Only a part of types of the spare disk array 330 that can be created are illustrated as above only for exemplary purposes. It is to be understood that the embodiments of the present disclosure can create the spare disk array 330 with any technology currently known or to be developed in the future, and the scope of the present disclosure is not limited in this regard.
Additionally or alternatively, in some embodiments, in response to the spare disk array 330 being crated, the storage processor 310 may further create a data structure for recording a state of the disk array 330. For example, the storage processor 310 may create a global list to record the states of a storage space on the spare disk array 330 being allocated, utilized, re-allocated and so on.
At block 430, in response to a failure of a disk of the disk array 320 (such as, the disk array group 321-1), the storage processor 310 may allocate a spare logic storage unit from the spare disk array 330 for rebuilding the faulty disk. The faulty disk is also referred to as “first disk” in the following depiction.
In some embodiments, the storage processor 310 may allocate a spare logic storage unit (such as, a logic unit number) with a same size as the first disk on the spare disk array 330. In some embodiments, the spare logic storage unit may provide a same device access interface as the first disk. In other words, the spare logic storage unit may be operated similarly as a physical disk.
In some embodiments, in response to failures of disks of a plurality of disk array groups in the disk array 320, the storage processor 310 may allocate a plurality of spare logic storage units from the spare disk array 330 to serve for different disk array groups.
In some embodiments, in response to the spare storage unit being allocated, the storage processor 310 may update the data structure recording the state of the spare disk array 330 accordingly, indicating that storage space corresponding to the spare storage unit is allocated.
At block 440, the storage processor 310 rebuild the faulty first disk with the spare logic storage unit. In some embodiments, as the spare logic storage unit provides the same device access interface as a physical disk, the rebuilding process may be similar to that as shown in
In some embodiments, if the disk (such as, the first disk) in the disk array 320 fails, the user of the storage system 300 may receive a notice of replacing the faulty disk. In this case, if the user adds a disk to the storage system 300 for replacing the faulty disk, the storage processor 310 may copy data in the spare logic storage unit back into the replacing disk and re-allocate the storage space occupied by the spare logic storage unit timely, thereby improving the utilization efficiency of the spare disk array 330. For example,
At block 510, in response to a disk for replacing the first disk being added to the storage system 300, the storage processor 310 copies data in the spare logic storage units to the second disk. In the following depiction, the disk for replacing the first disk is also referred to as “second disk.” It is to be understood that although the data copy takes some time, as the spare logic storage unit still preserves complete copy of the original data of the first disk at that time, even if another disk in the disk array group (such as, the array group 321-1) where the first disk is located fails during the copying process, data loss will not happen.
At block 520, in response to the copying being completed, the storage processor 310 re-allocates the spare logic storage unit. In some implementations, in response to the completion of the copying, the spare logic storage unit may be removed from the disk array group 321-1 where the first disk is located, and the second disk may be added to the disk array group 321-1. Besides, the storage processor 310 may free up the storage space occupied by the spare logic storage unit, and update the data structure recording the state of the spare disk array 330 accordingly to indicate that the storage space corresponding to the spare storage unit is released.
Through the above depiction, it can be seen that the scheme according to the embodiments of the present disclosure accelerate the rebuilding of the faulty disk by using a SSD with a lower Write Per Day (WPD) as a spare disk, so as to reduce the number of spare disks required by the storage system. The scheme further organizes a plurality of SSDs into a spare disk array group and allocates spare logic storage units from the spare disk array group on demand to serve for the rebuilding of the faulty disk. Therefore, the scheme can serve for rebuilding of a plurality of disk array groups simultaneously and the writing operations for rebuilding a faulty disk can be distributed to a plurality of different SSDs. Besides, the scheme further proposes a mechanism for reclaiming a spare logic storage unit and improves the utilization efficiency of a spare disk by freeing up the storage space occupied by the spare logic storage unit timely.
A plurality of components in the apparatus 600 are connected to the I/O interface 605, comprising: an input unit 606, such as keyboard, mouse and the like; an output unit 607, such as various types of displays, loudspeakers and the like; a storage unit 608, such as disk, optical disk and the like; and a communication unit 609, such as network card, modem, wireless communication transceiver and the like. The communication unit 609 allows the apparatus 600 to exchange information/data with other devices through computer networks such as Internet and/or various telecommunication networks.
Each procedure and processing as described above, such as the method 400 and/or 500, can be executed by the processing unit 601. For example, in some embodiments, the method 400 and/or 500 can be implemented as computer software programs, which are tangibly included in a machine-readable medium, such as the storage unit 608. In some embodiments, the computer program can be partially or completely loaded and/or installed to the device 600 via the ROM 602 and/or the communication unit 609. When the computer program is loaded to the RAM 603 and executed by the CPU 601, one or more steps of the above described method 400 and/or 500 are implemented.
The present disclosure may be a system, an apparatus, a device, a method, and/or a computer program product. The computer program product may include a computer readable storage medium (or media) having computer readable program instructions thereon for causing a processor to carry out aspects of the present disclosure.
The computer readable storage medium can be a tangible device that can retain and store instructions for use by an instruction execution device. The computer readable storage medium may be, for example, but is not limited to, an electronic storage device, a magnetic storage device, an optical storage device, an electromagnetic storage device, a semiconductor storage device, or any suitable combination of the foregoing. A non-exhaustive list of more specific examples of the computer readable storage medium includes the following: a portable computer diskette, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or Flash memory), a static random access memory (SRAM), a portable compact disc read-only memory (CD-ROM), a digital versatile disk (DVD), a memory stick, a floppy disk, a mechanically encoded device such as punch-cards or raised structures in a groove having instructions recorded thereon, and any suitable combination of the foregoing. A computer readable storage medium, as used herein, is not to be construed as being transitory signals per se, such as radio waves or other freely propagating electromagnetic waves, electromagnetic waves propagating through a waveguide or other transmission media (e.g., light pulses passing through a fiber-optic cable), or electrical signals transmitted through a wire.
Computer readable program instructions described herein can be downloaded to respective computing/processing devices from a computer readable storage medium or to an external computer or external storage device via a network, for example, the Internet, a local region network, a wide region network and/or a wireless network. The network may comprise copper transmission cables, optical transmission fibers, wireless transmission, routers, firewalls, switches, gateway computers and/or edge servers. A network adapter card or network interface in each computing/processing device receives computer readable program instructions from the network and forwards the computer readable program instructions for storage in a computer readable storage medium within the respective computing/processing device.
Computer readable program instructions for carrying out operations of the present disclosure may be assembler instructions, instruction-set-architecture (ISA) instructions, machine instructions, machine dependent instructions, microcode, firmware instructions, state-setting data, or either source code or object code written in any combination of one or more programming languages, including an object oriented programming language such as Smalltalk, C++ or the like, and conventional procedural programming languages, such as the “C” programming language or similar programming languages. The computer readable program instructions may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the latter scenario, the remote computer may be connected to the user's computer through any type of network, including a local region network (LAN) or a wide region network (WAN), or the connection may be made to an external computer (for example, through the Internet using an Internet Service Provider). In some embodiments, electronic circuitry including, for example, programmable logic circuitry, field-programmable gate arrays (FPGA), or programmable logic arrays (PLA) may execute the computer readable program instructions by utilizing state information of the computer readable program instructions to personalize the electronic circuitry, in order to perform aspects of the present disclosure.
Aspects of the present disclosure are described herein with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the present disclosure. It will be understood that each block of the flowchart illustrations and/or block diagrams, and combinations of blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer readable program instructions.
These computer readable program instructions may be provided to a processor of a general purpose computer, special purpose computer, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions/acts specified in the flowchart and/or block diagram block or blocks. These computer readable program instructions may also be stored in a computer readable storage medium that can direct a computer, a programmable data processing apparatus, and/or other devices to function in a particular manner, such that the computer readable storage medium having instructions stored therein comprises an article of manufacture including instructions which implement aspects of the function/act specified in the flowchart and/or block diagram block or blocks.
The computer readable program instructions may also be loaded onto a computer, other programmable data processing apparatus, or other device to cause a series of operational steps to be performed on the computer, other programmable apparatus or other device to produce a computer implemented process, such that the instructions which execute on the computer, other programmable apparatus, or other device implement the functions/acts specified in the flowchart and/or block diagram block or blocks.
The flowchart and block diagrams illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flowchart or block diagrams may represent a module, snippet, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). In some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems that perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.
The descriptions of the various embodiments of the present disclosure have been presented for purposes of illustration, but are not intended to be exhaustive or limited to the embodiments disclosed. Many modifications and variations will be apparent to those of ordinary skill in the art without departing from the scope and spirit of the described embodiments. The terminology used herein was chosen to best explain the principles of the embodiments, the practical application or technical improvement over technologies found in the marketplace, or to enable others of ordinary skill in the art to understand the embodiments disclosed herein.
Number | Date | Country | Kind |
---|---|---|---|
201710525356.0 | Jun 2017 | CN | national |