Patent Application
20090300315
The present invention relates to technology for controlling virtualized storage systems, and in particular to a technology for managing pools of storage in virtualized storage systems.
The rapidly growing requirements placed on virtualised storage systems have increased the complexity of predicting where additional storage capacity will be required. A virtualised storage system typically divides the real storage into a number of pools each of which may contain storage devices with similar characteristics. Virtual storage devices are then created from the unallocated storage available within a single pool. When a pool runs out of unallocated storage, new storage must be added to that pool by the systems administrator before further virtual devices can be created or existing ones expanded. This means that creating new virtual devices (or expanding existing ones) becomes a two stage process—adding a device to the real storage pool and then creating or expanding a virtual device. The complexity of this activity is increased by the existence of two “views” of the storage—the virtual view as presented to applications and the real view, as presented to the underlying physical storage control components. Furthermore, the use of the underlying real storage may be manipulated automatically by the physical storage infrastructure without affecting the virtual view, for example, by automated consolidation of the real extents that compose a virtual file in order to improve retrieval efficiency. Correlating the information from the two views of storage thus presents considerable difficulty to the system administrator.
The problem becomes more complex with late allocated virtual devices as the amount of allocated storage within a pool can change at any time (outside the control of a systems administrator). Typically when a late allocated device needs to allocate more storage and none is available the device is taken offline. The systems administrator must monitor the unallocated space within all pools and ensure that new storage is added to those pools where unallocated space is running low before virtual devices within that pool become unavailable. In such an environment the decision as to which pool to add the new storage to is complex.
In one illustrative embodiment, an apparatus is provided for managing pooled real storage having a usable real storage pool and a reserve real storage pool in a virtualized storage system. An extent controller is configured to allocate and free storage extents in the usable real storage pool. A storage use monitor is configured to monitor storage use in the usable real storage pool. A reserve pool manager responsive to the storage use monitor is configured to transfer storage extents between the usable real storage pool and the reserve real storage pool.
In another illustrative embodiment, a method is provided for managing pooled real storage having a usable real storage pool and a reserve real storage pool in a virtualized storage system. The method comprises allocating and freeing storage extents by an extent controller in the usable real storage pool. The method further comprises monitoring storage use in the usable real storage pool and responsive to monitoring storage use, transferring by a reserve pool manager storage extents between the usable real storage pool and the reserve real storage pool.
In another illustrative embodiment, a computer program comprises a computer recordable medium having a computer readable program recorded thereon. The computer readable program, when loaded into a computer system and executed thereon, causes said computer system to allocate and free storage extents by an extent controller in said usable real storage pool, monitor storage use in said usable real storage pool, and responsive to monitoring storage use, transfer by a reserve pool manager storage extents between said usable real storage pool and said reserve real storage pool.
These and other features and advantages of the present invention will be described in, or will become apparent to those of ordinary skill in the art in view of, the following detailed description of the example embodiments of the present invention.
Turning to
A late allocated volume is one which is not mapped to any extents in a pool until that extent is written to. An extent from the pool is then mapped to the volume and the data is written to it. For example in
A data migration is a scheme that can modify the rank extents that hold the data for a volume. It is therefore a sequence of operations that moves data that is mapped to a volume currently held on an extent (the source extent) to another extent (the target extent). The target extent replaces the source extent for the volume's data map. For example a data migration may modify the mapping for volume A so that it is constructed from extents (rankB,extent 0), (rankB,extent1), (rankB,extent3), and (rankB,extent4) from extent pool 1.
A preferred embodiment creates a new kind of pool that contains ranks that are unavailable to be used by volumes. We call this type of pool a reserve pool. The systems administrator adds ranks to a reserve pool when new storage capacity is added to the system. The system can then move any rank from a reserve pool to any normal extent pool as additional capacity.
A rank may be moved from a reserve pool to a normal pool in the following situations:
1. A pool has a predetermined minimum number of extents that must be available for over-allocation. If the number of extents not mapped to a volume falls below this threshold a rank will be taken from a reserve pool. If no ranks are available in a reserve pool the late allocated volume may be offlined.
2. A volume is created or expanded and there are not enough free extents in the pool, but enough additional extents can be found by adding in ranks from a reserve pool. The appropriate ranks are then taken from a reserve pool.
3. A volume is migrated from one pool to another and there are not enough free extents in the target pool, but enough additional extents can be found by adding in ranks from a reserve pool. The appropriate ranks are then taken from a reserve pool.
A rank may be moved from a normal pool to a reserve pool in the following situations:
1. A volume is deleted or shrunk and the result may mean that the extent pool has enough free capacity that a rank could be returned to a reserve pool. This may require migrating all extents on the rank to be removed onto other ranks in the pool and once complete the rank can be returned to a reserve pool.
2. A volume is migrated to another extent pool. This could result in the same procedure as in 1.
3. When extents are deallocated for a late allocation volume, for example due to writing zeros to an extent. This could result in the same procedure as in 1.
Turning now to
In
Turning now to
If no new storage has been detected at step 202, a test is made at test step 206 to determine whether there is underuse of normal pool storage, that is, if any storage in a normal pool is unused and can be freed. If so, the storage is placed in the reserve pool at process step 204, and the method steps continue as from START step 200.
If, at test step 208, it is determined that one or more extents are required for allocation in the normal pool, an attempt is made at process step 210 to allocate storage from the normal pool. If, at test step 212, it is determined the allocation attempt has been successful, the method steps continue as from START step 200. However, if test step 212 shows that the threshold would be exceeded by allocation of storage from the normal pool, a further test is made at test step 214 to determine if the reserve pool has available storage, or if the reserve pool is empty.
If the reserve pool is determined at test step 214 to be empty, the normal system response as in the prior art is processed. In the exemplary embodiment, this takes the form of placing the device in need of additional storage in an offline state at process step 216 and issuing an administrator alert at process step 218. If the reserve pool is determined at test step 214 not to be empty, at process step 220 the extent is moved from the reserve pool to the normal pool and allocated to satisfy the attempt from process step 210, and the method steps continue as from START step 200. The process completes at END step 222.
The illustrative embodiments thus advantageously address the problem of providing a technical framework for controlling virtualized storage systems, and in particular to a technology for managing pools of storage in virtualized storage systems.
It will be clear to one of ordinary skill in the art that all or part of the illustrative embodiments may suitably and usefully be embodied in a logic apparatus, or a plurality of logic apparatus, comprising logic elements arranged to perform the steps of the method and that such logic elements may comprise hardware components, firmware components or a combination thereof.
It will be equally clear to one of skill in the art that all or part of a logic arrangement according to the illustrative embodiments may suitably be embodied in a logic apparatus comprising logic elements to perform the steps of the method, and that such logic elements may comprise components such as logic gates in, for example a programmable logic array or application-specific integrated circuit. Such a logic arrangement may further be embodied in enabling elements for temporarily or permanently establishing logic structures in such an array or circuit using, for example, a virtual hardware descriptor language, which may be stored and transmitted using fixed or transmittable carrier media.
It will be appreciated that the method and arrangement described above may also suitably be carried out fully or partially in software running on one or more processors (not shown in the figures), and that the software may be provided in the form of one or more computer program elements carried on any suitable data-carrier (also not shown in the figures) such as a magnetic or optical disk or the like. Channels for the transmission of data may likewise comprise storage media of all descriptions as well as signal-carrying media, such as wired or wireless signal-carrying media.
The illustrative embodiments may further suitably be embodied as a computer program product for use with a computer system. Such an implementation may comprise a series of computer-readable instructions either fixed on a tangible medium, such as a computer readable medium, for example, diskette, CD-ROM, ROM, or hard disk, or transmittable to a computer system, using a modem or other interface device, over either a tangible medium, including but not limited to optical or analogue communications lines, or intangibly using wireless techniques, including but not limited to microwave, infrared or other transmission techniques. The series of computer readable instructions embodies all or part of the functionality previously described herein.
Those skilled in the art will appreciate that such computer readable instructions can be written in a number of programming languages for use with many computer architectures or operating systems. Further, such instructions may be stored using any memory technology, present or future, including but not limited to, semiconductor, magnetic, or optical, or transmitted using any communications technology, present or future, including but not limited to optical, infrared, or microwave. It is contemplated that such a computer program product may be distributed as a removable medium with accompanying printed or electronic documentation, for example, shrink-wrapped software, pre-loaded with a computer system, for example, on a system ROM or fixed disk, or distributed from a server or electronic bulletin board over a network, for example, the Internet or World Wide Web.
In an alternative, the illustrative embodiments may be realized in the form of a computer implemented method of deploying a service comprising steps of deploying computer program code operable to, when deployed into a computer infrastructure and executed thereon, cause said computer system to perform all the steps of the method.
In a further alternative, the illustrative embodiments may be realized in the form of a data carrier having functional data thereon, said functional data comprising functional computer data structures to, when loaded into a computer system and operated upon thereby, enable said computer system to perform all the steps of the method.
It will be clear to one skilled in the art that many improvements and modifications can be made to the foregoing example embodiments without departing from the scope of the present invention.
| Number | Date | Country | Kind |
|---|---|---|---|
| 0613660.0 | Jul 2006 | GB | national |
| Filing Document | Filing Date | Country | Kind | 371c Date |
|---|---|---|---|---|
| PCT/EP2007/056107 | 6/20/2007 | WO | 00 | 1/7/2009 |
