The present invention relates generally to data storage systems and, more particularly, to data integrity validation.
Storing and retrieving data from large capacity storage systems (e.g., systems with a plurality of disk drives) generally requires certain safeguards against data corruption to ensure data integrity and system reliability.
U.S. patent application Ser. No. 11/860,461 discloses features for protecting user data in a storage system. Protection information, including version numbers for a set of user data blocks, is generated for validating data. The protection information is then embedded with the data and copied over to a separate volume that uses low latency non-volatile storage such as flash memory or solid state drives.
Systems and methods are needed to implement the above-mentioned features into an existing architecture of a storage controller.
The present disclosure is directed to systems, methods and corresponding products that facilitate data integrity validation using hierarchical volume management.
For purposes of summarizing, certain aspects, advantages, and novel features of the invention have been described herein. It is to be understood that not all such advantages may be achieved in accordance with any one particular embodiment of the invention. Thus, the invention may be embodied or carried out in a manner that achieves or optimizes one advantage or group of advantages without achieving all advantages as may be taught or suggested herein.
In accordance with one embodiment, a method for reading data from data blocks in a data storage system is provided. The method comprises requesting a virtual data volume to access data from one or more data blocks in the data storage system, in response to receiving a read request from a host interface; requesting a virtual protection information volume to access protection information associated with the data blocks, wherein the protection information is stored on the virtual protection information volume; validating the data using the protection information; and providing the data to the host interface, in response to successful validation of the data.
In accordance with one embodiment, a method for writing data to data blocks in a data storage system is provided. The method comprises receiving data to be written to one or more data blocks in the data storage system from a host interface, wherein the data is stored in a cache; generating protection information to be stored on a virtual protection information volume; requesting a virtual data volume to update the data blocks with the data; and requesting the virtual protection information volume to store the protection information.
In accordance with another embodiment, a system comprising one or more logic units is provided. The one or more logic units are configured to perform the functions and operations associated with the above-disclosed methods. In accordance with yet another embodiment, a computer program product comprising a computer useable medium having a computer readable program is provided. The computer readable program when executed on a computer causes the computer to perform the functions and operations associated with the above-disclosed methods.
One or more of the above-disclosed embodiments in addition to certain alternatives are provided in further detail below with reference to the attached figures. The invention is not, however, limited to any particular embodiment disclosed.
Embodiments of the present invention are understood by referring to the figures in the attached drawings, as provided below.
Features, elements, and aspects of the invention that are referenced by the same numerals in different figures represent the same, equivalent, or similar features, elements, or aspects, in accordance with one or more embodiments.
The present disclosure is directed to systems and corresponding methods that facilitate data integrity validation using hierarchical volume management.
In the following, numerous specific details are set forth to provide a thorough description of various embodiments of the invention. Certain embodiments of the invention may be practiced without these specific details or with some variations in detail. In some instances, certain features are described in less detail so as not to obscure other aspects of the invention. The level of detail associated with each of the elements or features should not be construed to qualify the novelty or importance of one feature over the others.
By way of example, certain embodiments are disclosed herein as applicable to a Redundant Array of Independent Disks (RAID) architecture. It should be noted, however, that such exemplary embodiments should not be construed as limiting the scope of the invention to a RAID implementation. The principles and advantages disclosed herein may be equally applicable to other data storage environments.
U.S. patent application Ser. No. 12/246,195 discloses systems and methods that implement the above-mentioned features using a proxy disk virtualization layer below a RAID volume. The systems and methods provided herein also implement the above-mentioned features, but with minimal impact to software architecture and controller performance
Referring to
Storage devices 170 stores data received from host 100 along with protection information embedded with the data. Storage devices 180 comprise one or more storage devices for storing protection information separately from the data.
RAID I/O manager 140 comprises a protected volume 141, a data volume 142, and a protection information volume 143. These three virtual volumes implement a multilevel volume hierarchy for protecting data stored in storage system 110. Protected volume 141 maps data received from host 100 into data volume 142 and stores protection information generated for validating the data on protection information volume 143.
Data volume 142 and protection information volume 143 are managed by RAID I/O manager 140 and RAID configuration manager 150 according to their respective RAID properties. In an exemplary embodiment, data volume 142 may be a RAID5 volume using Fibre Channel hard disk drives, for example, and protection information volume 143 may be a RAID1 volume using high speed solid state dries also using a Fibre Channel interface, for example.
Referring to
Protection information volume 143 comprises a block of protection information for each group of n data blocks in data volume 142. For example, protection information for blocks 1 to n of data volume 142 is stored on block 1 of protection information volume 143, and protection information for blocks n+1 to 2n of data volume 142 is stored on block 2 of protection information volume 143. It is noteworthy that a block of protection information may correspond to a physical or logical sector or to a smaller or larger unit of storage on protection information volume 143.
Referring to
Advantageously, no version number is necessary because the match between the data and the protection information implicitly verifies the version of the protection information. The CRC, checksum, or other value for validating data is derived from the content of the data itself, so if the data changes, the value also changes. Version numbers verify the container of the data (e.g., by identifying when the data was written); the CRC, checksum, or other value verifies the data itself.
Referring to
Regardless of whether embedding of protection information is implemented (P410), protected volume 141 requests protection information volume 143 to access protection information associated with the data blocks (P430) and validates the data using the protection information and any embedded protection information (P440). Upon successful validation (P450), protected volume 141 returns the data, exclusive of any embedded protection information (P460).
Referring to
If embedding of protection information is implemented (P510), protected volume 141 generates embedded protection information for validating the data (P520). If the generated embedded protection information is incomplete (P530), protected volume 141 requests missing embedded protection information from data volume 142 and merges the generated and missing embedded protection information (P535). Protection information is incomplete, for example, if the protection information does not fill a complete minimal I/O unit of protected information volume 143. Upon determining that the embedded protection information is complete (P530), protected volume 141 stores the embedded protection information with the data in the cache (P540).
Regardless of whether embedding is implemented (P510), protected volume 141 requests data volume 142 to update the data blocks with the data and any embedded protection information stored in the cache (P550). Protected volume 141 also generates protection information to store on protection information 143 (P560). If the generated protection information is incomplete (P570), protected volume 141 requests missing protection information from protection information volume 143 and merges the generated and missing protection information (P575). Upon determining that the protection information is complete (P570), protected volume 141 requests protection information volume 143 to store the protection information (P580).
Any operations internal to either data volume 142 or protection information volume 143 are coordinated by protected volume 141. For example, if a write request from protected volume 141 (e.g., P580) causes data volume 142 to read data as part of a read-modify write implementation, data volume 142 first requests protected volume 141 to validate the data using associated protection information from protection information volume 143.
In different embodiments, the invention may be implemented either entirely in the form of hardware or entirely in the form of software, or a combination of both hardware and software elements. For example, storage system 110 may be comprised in a controlled computing system environment that can be presented largely in terms of hardware components and software code executed to perform processes that achieve the results contemplated by the system of the present invention.
Referring to
As provided here, the software elements that are executed on the illustrated hardware elements are described in terms of specific logical/functional relationships. It should be noted, however, that the respective methods implemented in software may be also implemented in hardware by way of configured and programmed processors, ASICs (application specific integrated circuits), FPGAs (Field Programmable Gate Arrays) and DSPs (digital signal processors), for example.
Software environment 700 is divided into two major classes comprising system software 702 and application software 704. System software 702 comprises control programs, such as the operating system (OS) and information management systems that instruct the hardware how to function and process information.
In one embodiment, processes provided above may be implemented as system software 702 or application software 704 executed on one or more hardware environments to facilitate data integrity validation using hierarchical volume management. Application software 704 may comprise but is not limited to program code, data structures, firmware, resident software, microcode or any other form of information or routine that may be read, analyzed or executed by a microcontroller.
In an alternative embodiment, the invention may be implemented as computer program product accessible from a computer-usable or computer-readable medium providing program code for use by or in connection with a computer or any instruction execution system. For the purposes of this description, a computer-usable or computer-readable medium can be any apparatus that can contain, store, communicate, propagate or transport the program for use by or in connection with the instruction execution system, apparatus or device.
The computer-readable medium may be an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system (or apparatus or device) or a propagation medium. Examples of a computer-readable medium include a semiconductor or solid-state memory, magnetic tape, a removable computer diskette, a random access memory (RAM), a read-only memory (ROM), a rigid magnetic disk and an optical disk. Current examples of optical disks include compact disk read only memory (CD-ROM), compact disk read/write (CD-R/W) and digital videodisk (DVD).
Referring to
A user interface device 612 (e.g., keyboard, pointing device, etc.) and a display screen 614 can be coupled to the computing system either directly or through an intervening I/O controller 616, for example. A communication interface unit 618, such as a network adapter, may be also coupled to the computing system to enable the data processing system to communicate with other data processing systems or remote printers or storage devices through intervening private or public networks. Wired or wireless modems and Ethernet cards are a few of the exemplary types of network adapters.
In one or more embodiments, hardware environment 600 may not include all the above components, or may comprise other components for additional functionality or utility. For example, hardware environment 600 may be a laptop computer or other portable computing device embodied in an embedded system such as a set-top box, a personal data assistant (PDA), a mobile communication unit (e.g., a wireless phone), or other similar hardware platforms that have information processing and/or data storage and communication capabilities.
In certain embodiments of the system, communication interface 618 communicates with other systems by sending and receiving electrical, electromagnetic or optical signals that carry digital data streams representing various types of information including program code. The communication may be established by way of a remote network (e.g., the Internet), or alternatively by way of transmission over a carrier wave.
Referring to
Software environment 700 may also comprise browser software 708 for accessing data available over local or remote computing networks. Further, software environment 700 may comprise a user interface 706 (e.g., a Graphical User Interface (GUI)) for receiving user commands and data. Please note that the hardware and software architectures and environments described above are for purposes of example, and one or more embodiments of the invention may be implemented over any type of system architecture or processing environment.
It should also be understood that the logic code, programs, modules, processes, methods and the order in which the respective steps of each method are performed are purely exemplary. Depending on implementation, the steps may be performed in any order or in parallel, unless indicated otherwise in the present disclosure. Further, the logic code is not related, or limited to any particular programming language, and may comprise of one or more modules that execute on one or more processors in a distributed, non-distributed or multiprocessing environment.
Therefore, it should be understood that the invention may be practiced with modification and alteration within the spirit and scope of the appended claims. The description is not intended to be exhaustive or to limit the invention to the precise form disclosed. These and various other adaptations and combinations of the embodiments disclosed are within the scope of the invention and are further defined by the claims and their full scope of equivalents.
Pursuant to 35 U.S.C. § 119, this application claims right of priority to U.S. patent application Ser. No. 11/860,461, filed on Sep. 24, 2007, and U.S. patent application Ser. No. 12/246,195, filed on Oct. 6, 2008, the contents of which are hereby incorporated by reference herein in its entirety. A portion of the disclosure of this patent document contains material, which is subject to copyright protection. The owner has no objection to the facsimile reproduction by any one of the patent document or the patent disclosure, as it appears in the Patent and Trademark Office patent file or records, but otherwise reserves all copyrights whatsoever. Certain marks referenced herein may be common law or registered trademarks of third parties affiliated or unaffiliated with the applicant or the assignee. Use of these marks is for providing an enabling disclosure by way of example and shall not be construed to limit the scope of this invention to material associated with such marks.