The present invention relates to a storage device system (hereafter referred to as a storage system) for storing data used by a computer, and more particularly relates to a storage system comprising a controller and a recording medium controlled by the controller in which the data block size handled by the controller and the data block size handled by the recording medium are different.
A disk array system is a type of storage system connected to a computer. Disk array systems, which are also known as RAID (Redundant Array of Inexpensive Disks) systems, constitute storage systems that comprise a plurality of disk devices arranged in an array and a controller for controlling said. Disk array systems, based on the parallel operation of the plurality of disk devices, facilitate the high-speed processing of read requests (hereafter referred to as read requests) and data write requests (hereafter referred to as write requests) and, in addition, the imparting of redundancy to data. Disk arrays systems, as is disclosed in D. Patterson and 2 others, “A case for Redundant Arrays of Inexpensive Disks (RAID)”, ACM SIGMOD Conference Proceeding, June 1988, p. 109-116 (Non-patent Document), are classified into five levels on the basis of the type of data to which redundancy has been imparted and the configuration thereof.
Redundant data is produced in disk array systems in such a way that data can be restored when damage to a disk device occurs, and the redundant data is stored in disk devices different to those for the data. However, with the objective of further increasing the reliability of the disk array system as a whole, guarantee codes are sometimes added to the logic blocks stored in the disk devices. A description of guarantee codes is given in, for example, U.S. Pat. No. 5,819,054 and U.S. Pat. No. 5,706,298. In the guarantee code of U.S. Pat. No. 5,819,054, a logical address (hereafter LA (Logical Address) of the logic block designated by the computer in the accessing of a logic block and an LRC (Longitudinal Redundancy Check) obtained by the implementation of an exclusive OR operation on the logic block data are added to the logic block and the guarantee code and logic block are stored in the disk device. The LA and LRC are employed as error detection codes for detecting address errors in the storage region in which the logic block data is written and detection errors in the logic block data respectively.
One example of a recording medium employed in a storage system is a low-cost ATA (AT Attachment) designed for personal computers. The structure of an ATA disk device is sometimes simplified in order to reduce development costs and component part costs, and in the majority of instances the size of the block (sector) that constitutes the unit at which data is handled in an ATA disk device is a fixed length.
In some cases in the employment in a storage system of a recording medium of fixed block length (sector length) such as an ATA disk device it is a possibility that the data unit of the data input/output processing performed on the recording medium by the storage system controller will be different to the data unit of the data input/output processing performed by the recording medium thereof. A problem inherent thereto is that this leads to the inability for data input/output processing to the recording medium to be performed. In addition, a similar problem arises in the case where a condition exists in which, when the data unit handled by the recording medium is not fixed, the data unit of the input/output processing performed on the recording medium by the storage system controller and the data unit handled by the recording medium cannot be formed to the same size.
By way of example, a case in which the disk array system controller, employing the technique and so on disclosed in U.S. Pat. No. 5,819,054, adds a guarantee code to data received from a computer and writes this data in a recording medium can be thought of as a specific example in which this kind of problem is liable to occur. That is to say, even if the size of the logic block data that serves as the unit for the handling of data in the accessing of data within a disk array system by a computer and the sector length of the ATA disk device are the same size, because the disk array system controller writes the data in the ATA device with a further guarantee code added to the logic block received from the computer, there are times when the data unit handled by the controller in the writing of data in the ATA disk device and the sector length of the ATA disk device differ. In cases such as this there are times when the controller cannot write the data to which the guarantee code has been added into the ATA disk device of fixed sector length.
Accordingly, a demand exists for a technique by which, where the data unit for the input/output of data to a recording medium implemented by the storage system controller and the data unit handled by the recording medium differ, the input/output processing of the data to the recording medium can be performed by the controller.
Considering the demand, one example of a storage system is provided. The storage system comprising a disk controller for receiving read commands and write commands from a computer, and a plurality of disk devices, connected to the disk controller, from/to which data is read/written in accordance with the control of the disk controller. A first block size that constitutes the data unit handled by the disk controller in the execution of input/output processing in accordance with the read commands and write commands, and a second block size that constitutes the data unit handled in the execution of the input/output processing of the data by the plurality of disk devices differ. The disk controller issues an instruction for the writing of data in the disk devices using a third block unit of a size corresponding to a common multiple of the size of the first block and the size of the second block.
The input/output processing of data to the recording medium is possible even when the data unit handled in the implementation of the input/output of data to the recording medium performed by the storage system controller and the data unit handled by the recording medium differ.
An outline of one embodiment of the present invention is given below. It should be noted that the present invention is not restricted to the embodiments outlined below.
Embodiment 1 provides an example of the input/output processing of data from a controller to a recording medium where the data unit handled in the implementation of the input/output of data to the recording medium performed by the storage system controller and the data unit handled by the recording medium differ. It should be noted that, although the description given for embodiment 1 is of one embodiment of the present invention in which, as one example of a storage system, a disk array is employed, the storage system of embodiment 1 is able to have application in not only a storage system that comprises redundant data such as the disk array system described in Non-patent Document but also in a storage system that does not comprise redundant data.
(1) Description of the System Configuration
The disk array controller 200 comprises a CPU 201 for executing the control processing of the disk array system 110, a memory 202, a cache 203 for buffering the data accessed from the host 100, a cache controller 204 for controlling the cache 203, a host interface controller (hereafter, host FC I/F) 205 for the transmission of data with the host 100, a disk interface controller (hereafter, disk I/F) 206 for the transmission of data with a disk device formed as a disk group 300, and a management interface controller (hereafter, management I/F) 207 for the transmission of control information with the management terminal 400, each of which is line-connected by means of communication lines.
It should be noted that the cache controller 204 comprises a guarantee code addition/deletion circuit 240 for adding guarantee codes to data and deleting guarantee codes from data, a guarantee code check circuit 260 for checking the data in which the guarantee codes are employed, and a redundant data generating circuit 250 for implementing a generation processing of redundant data. In addition, although an FC interface controller that uses an FC (Fibre Channel) protocol is indicated as one example of the host interface controller 205 in this embodiment, the host interface controller 205 may be an interface controller that uses another protocol such as an iSCSI interface.
A RAID control program 210 executed by the CPU 201 for controlling the disk array system 110 and a management terminal communication program 220 executed by the CPU 201 for implementing communication with the management terminal 400 are recorded in the memory 202.
The disk group 300 comprises disk devices 301, 302, 303 and 304. An LU (Logical Unit) 310, which constitutes a logical storage region (logical volume) that forms the access target from the host 100, is configured from the storage region within the disk devices 301 to 304. The disk I/F 206 is connected to the disk devices 301 to 304. It should be noted that the number of disk devices 301 to 304 connected to the disk I/F 206 illustrated in
The management terminal 400 comprises, in the setting of the disk array controller 200 by the user or operator of the disk array system 110, an input part 401 employed for the input of information to the disk array controller 200, and an output part 402 for the output of information of the disk array system 110 acquired from the disk array controller 200. The input part is a keyboard and mouse or the like, and the output part is a display or the like.
(2) Corresponding Block Size Relationship
The upper level of
The lower level indicates the data unit handled in the input and output of data by the disk devices 301 to 304 and is defined as the “physical block 510”. The physical block 510 constitutes a block of length 512 bytes.
It should be noted that, provided the size of the expanding logic block 500 and the size of the physical block 510 differ, the actual size of the blocks is not restricted to the example illustrated in
Although, in the example shown in
Where the plurality of expanding logic blocks 500 that constitute the write target to the disk devices 301 to 304 exist in a boundary matching state these expanding logic blocks 500 can be written into the disk devices 301 to 304 as a plurality of physical blocks 510. That is to say, in the example of
(3) Another Example of Corresponding Block Size Relationship
Although
In the example of
In the expanding logic blocks 530 illustrated in
It should be noted that, although
Hereafter a description will be given of an embodiment of the present invention based on the large-size block illustrated in
In a summary of the above, provided a boundary matching state is formed, the size of the physical blocks 510 assembled with the expanding logic blocks 500, expanding logic blocks 530, logic blocks 520 and guarantee code block and so on is arbitrary, and the number of physical blocks 510 assembled with the number of, by way of example, expanding logic blocks 500, expanding logic blocks 530, logic blocks 520 and guarantee code blocks for forming the boundary matching is arbitrary.
(4) Write Processing
Next, a description will be given of the write processing of data from the disk array controller 200 to the disk devices of this embodiment.
When the host 100 issues a write command to the disk array system 110, the disk array controller 200 receives the write command by way of the host FC I/F 205 (Step 1001). It should be noted that the host 100, using a logic block of length 512 bytes as a single unit, issues a write command of N times (N is an integer of 1 or more) the logic block, and an LA of the lead data written by the write command and the write data size (number of logic blocks that express of which logic block the data is) are contained in the write command.
The CPU 201 executes a RAID control program 210 and, in accordance with the LA contained in the write command, determines the write destination disk device for the write data (Step 1002) and, furthermore, guarantees in the cache 203 a buffering destination for the write data received in response to the write command and a storage destination for the redundant data generated for the write data (Step 1003). It should be noted that the CPU 201 guarantees in the cache 203 a storage destination for the guarantee code part added to the write data.
Next, the CPU 201, by way of the host FC I/F 205, notifies the host 100 that preparation for the receipt of data has been completed (Step 1004). The host 100 sends write data of the number of logic blocks designated by the write command to the host FC I/F 205. The write data received by the host FC I/F 205 is sent to the cache controller 204, and the guarantee codes (that is to say, the lead LA of the logic block and the LRC) for each logic block of length 512 bytes is generated by the guarantee code addition/deletion circuit 240, whereupon the logic block and guarantee code are stored in the storage region of the cache 203 guaranteed by Step 1003 (Step 1005). It should be noted that the method for the generating of the LA and LRC is described in detail in U.S. Pat. No. 5,819,054.
Furthermore, the host FC I/F 205 provides notification to the CPU 201 of receipt of the write data. When the CPU 201 detects notification from the host FC I/F 205 of the receipt of the write data (Step 1006), it controls the redundant data generating circuit 250 in such a way that, employing the RAID control program 210, redundant data correspondent to the received write data is generated, whereupon the redundant data generating circuit 250 generates redundant data (Step 1007). The generated redundant data is stored in the region of the cache 203 guaranteed by Step 1003.
Next, the CPU 201 issues an instruction to the disk I/F 206, and the disk I/F 206, in accordance with the order from the CPU 201, writes either the write data and the guarantee codes or the redundant data stored in the cache 203 in any one of the disk devices from 301 to 304 (Step 1008).
A detailed description is given next, with reference to
In the writing of data into the disk devices the disk array controller 200 executes write processing using a large-size block as the unit data. Thereupon, first of all, the CPU 201 judges whether the data that is to be stored in the cache 203 and that is to be written in the disk devices exists in an amount that, in the corresponding relationship with the physical blocks 510, will form the boundary matching state (Step 2001). That is to say, a judgment is made as to whether the logic blocks and guarantee codes written into the cache 203 in Seep 1005 of
It should be noted that, in the abovementioned embodiment, the logic block data received from the host 100 and the redundant data generated by the disk array controller 200 in Step 1007 of
Where the data that is to be stored in the cache 203 and that is to be written in the disk devices forms a boundary matching state, the disk array controller 200, by way of the disk I/F 206, writes the data of a large-size block amount into any one of the disk devices (Step 2003).
On the other hand, where the data that is to be stored in the cache 203 and that is to be written in the disk devices does not form the boundary matching state, in other words, where part of the data from which the large-size block is configured is not aligned in the cache 203, the disk array controller 200 reads from the disk devices data of an amount equivalent to the shortfall in the data from which the large-size block is configured (in other words, the amount not stored in the cache 203), whereupon the large-size block is configured from the data stored in the cache 203 and the newly read data (Step 2002) and data equivalent to the amount of a large-size block is written by way of the disk I/F 206 into any one of the disk devices (Step 2003).
The description given above represents one example of the write processing to the disk devices implemented in Step 1008 of
Next, a description will be given with reference to
The disk devices 301 to 304 handle data using the physical blocks 510 of the lower stage illustrated in the lower level of
On the other hand, a description is given with reference to
The disk array controller 200 which has received write data from the host 100 (Step 1) stores the write data and generated guarantee codes for the write data in the cache 203 (
Where the CPU 201 in Step 2001 of
(5) Read Processing
Next, a description will be given of the read processing of the embodiment with reference to
The CPU 201 of the disk array controller 200 that has received a read command from the host 100 (Step 3001) performs a check of the lead LA of the read target data designated by the read command and the number of logic blocks that indicate the size of the read target data. The CPU 201 specifies from the lead LA and the logic blocks the logic blocks 520 to be read from the disk devices and the guarantee codes that have been added to these logic blocks. Furthermore, the CPU 201 specifies the physical blocks 510 in which the specified logic blocks and guarantee codes are stored and determines from which disk device data is to be read (Step 3002). By virtue of the fact that the CPU 201 is aware of the corresponding relationship between the expanding logic blocks 500 and the physical blocks 510, the physical blocks 510 that are to be read can be determined in accordance with this corresponding relationship.
By way of example, for the large-size blocks of the configuration illustrated in
It should be noted that, for the purpose of decreasing the number of commands issued to the disk device from the disk array controller 200, the data of physical blocks other than the physical blocks that correspond to logic blocks designated by the read command and the guarantee codes added thereto may be read together using a single command whereupon only the required information within the read data is used. By way of example, where the data that is to be read is stored in discrete logic blocks 520, data may be read out in a single command from a plurality of continuous physical blocks containing the discreet logic blocks 520. In this case, the CPU 201, in Step 3002, reads most of the physical blocks and specifies them as read physical blocks 510.
Next, the CPU 201 guarantees a storage region in the cache 203 for the storing of the read physical block data and guarantee codes (Step 2003).
The CPU 201 issues an instruction to the disk I/F 206 and the disk I/F that has received this instruction issues a read command to the disk device designated by the CPU 201 in such a way that the physical block data designated by the CPU 201 is read. The disk I/F 206 stores the data read out from the disk device in the storage region of the cache 203 guaranteed by Step 3003 (Step 3004).
When data from the disk device is read out from the cache 203 a guarantee code check circuit 260 performs a check of the guarantee codes using the method described in U.S. Pat. No. 5,819,054. When it has been confirmed that there are no errors in the read data, data of the logic blocks of the data stored in the cache 203 without a guarantee code is sent to the host 100 (Step 3005).
(6) Effect
Based on this embodiment, the disk array controller 200 writes data in the disk devices using a unit at which the boundary for the data block that is handled by the disk devices (that is to say, the physical blocks 510) and the boundary of the data block handled by the disk array controller 200 (that is to say, the logic blocks 520) are matching (that is to say, a large-size block). As a result, data can be written from the disk array controller 200 into the disk devices even if the data unit handled by the disk array controller 200 and the data unit of the data handled by the disk devices differ.
In addition, data to which a guarantee code has been added can be written in disk devices of fixed data block size and, accordingly, the reliability of the disk array system 110 can be increased.
[Embodiment 2 ]
In a second embodiment a description is given of a method for the writing of redundant data into a disk array system 110 using a large-size block unit. It should be noted that the configuration of the disk array system 110 may be the same as the example illustrated in
(1) Write Processing on an LU of a RAID 5 Configuration
That is to say, in cases such as this, when the disk array controller 200 receives new data A from the host device 100 (Step 1), the disk array controller reads data A (old data) to generate new redundant data D (Step 2) and, furthermore, reads redundant data D (old redundant data) to generate new redundant data D (Step 3). The disk array controller 200 performs an exclusive OR operation employing the new data A, data A and redundant data D to generate new redundant data D (Step 4). After this, the disk array controller writes the new data A in the disk devices (Step 5) and writes the new redundant data D in the disk devices (Step 6).
It should be noted that guarantee codes as described for embodiment 1 may be generated for the new data A, and the guarantee coded new data A may be written in the disk devices. This is the same in the processing of
(2) Example of Read/Modify/Write Processing Using a Large-Size Block Unit
As is described for the first embodiment, the writing of data from the disk array controller 200 to the disk devices is performed using a large-size block. This is the same for not only the writing of data received from the host device 100 but also the redundant data of the LU of the RAID 5 configuration. Here, with reference to
When a write command is received from the host 100 the disk array controller 200 is able to recognize the size of the new data (write data) received from the host 100 based on the number of physical blocks contained in the write command. Thereupon, where the disk array controller 200 judges that, when new data is received from the host 100, new redundant data cannot be generated, it executes read/modify/write processing to generate new redundant data from old data, old redundant data and new data.
More specifically, to generate new redundant data, the disk array controller 200 reads from the cache 203 the physical blocks containing old data and the guarantee codes thereof (Step 1) and the physical blocks containing old redundant data (Step 2). The read processing of the old data and guarantee codes and the old redundant data is the same as that of the processing illustrated in
Next, each of the new data and the new redundant data are written in the disk devices from the disk array controller 200. Here, where the size of the new data and guarantee codes or the size of the new redundant data is smaller than the size of the large-size block, the small-size write described with reference to
First of all, to write the new data in the disk devices, the disk array controller 200 reads data from the new data write destination disk devices equivalent to the shortfall amount (Step 3). The disk array controller 200 merges the new data and guarantee codes thereof with the read data to configure a large-size block, and writes the large-size block in the disk devices (Step 4).
Next, the new redundant data is written in the disk devices in the same way. That is to say, the disk array controller 200 reads from the new redundant data write destination disk device data equivalent to a shortfall amount (Step 5). The disk array controller 200 merges the new redundant data with the read data to configure a large-size block, and writes the large-size block in the disk devices (Step 6).
Based on the processing outlined above, the disk array controller 200 can write data and redundant data using a large-size block unit in a plurality of disk devices from which a RAID is configured.
(3) Another Example of Read/Modify/Write Processing Using a Large-Size Block Unit
In the processing illustrated in
In the example of
In other words, in the read/modify/write processing, the disk array controller 200 first reads large-size block data containing old data from the disk devices to the cache 203 (Step 1), and then reads large-size block data containing old redundant data from the disk devices to the cache 203 (Step 2). Next, the disk array controller 200 implements an exclusive IR operation to generate new redundant data from old data, old redundant data and new data received from the host 100.
Next, the disk array controller 200 performs updating employing data of the section of the large-size block data read in Step 1 equivalent to the new data and the guarantee codes thereof, and writes the updated large-size block data into the disk devices (Step 3).
In the same way for the new redundant data, the disk array controller 200 performs updating employing the redundant data of the section of the large-size block data read in Step 2 equivalent to the new redundant data, and writes the updated large-size block data into the disk devices (Step 4).
In the example of the read/modify/write processing illustrated in
By virtue of the fact that, as a result, the number of times access to the disk devices required for the processing of a write command received from the host device 100 can be reduced, the number of write commands that can be produced per unit proportionate to the access performance of the disk devices is increased. Accordingly, the performance of the disk array system 110 can be improved.
(3) Effect
Based on the present embodiment, new data and new redundant data can be written into the disk devices in large-size block units. In addition, the number of times access of the device required for this can be reduced, and the number of times access to the disk devices required for the processing of a single write command can be reduced. Accordingly, the write performance of the disk array controller 110 can be improved.
It should be noted that, in this embodiment, although new data and redundant data are written into the disk devices using a large-size block, in reality, where the size of the data that is to be written (new data and guarantee code group or new redundant data) is the size of the large-size block or less, the data may be written in the disk devices using a multiple unit of the physical blocks.
In this case, the disk array controller 200 reads data of the physical blocks in which overwritten predetermined data and guarantee codes (or redundant data) are stored, updates part of the data of the read physical blocks using the new data and the guarantee codes (or the new redundant data), and writes the updated data into the disk devices in multiple units of the physical blocks.
Furthermore, where read/modify/write processing is required, in the same way as that for the second embodiment the number of times access to the disk devices can be reduced by the implementation of a processing in which, in the reading of old data or the reading of old redundant data for generating redundant data, “data of the physical blocks in which overwritten predetermined data and guarantee codes (or redundant data) are stored is read from the disks”.
It should be noted that, although embodiment 2 cites the use of a RAID 5 as the example RAID configuration of the disk array system 110 in which a redundant configuration is adopted, other configurations may be used such as RAID 3 or RAID 6 configurations to which 2 types of redundant codes have been added. The same applies for embodiment 1.
In addition, although the guarantee code add/delete/check and redundant data generation are executed on the data using the cache controller 204 in embodiment 1 and embodiment 2, these processings may be executed by other regions and, by way example, they may be executed by the CPU 201 using a program in the memory 202.
Furthermore, although embodiment 1 and embodiment 2 cite, as an example of the disk devices 301 to 304, an ATA device disk in which the size of the data bock is fixed, other types of disk devices may be used. In addition, even if the data block size handled by the disk device is variable, embodiment 1 and embodiment 2 are effective as long as the data block size handled by the disk devices and the disk array controller 200 are not the same.
Number | Date | Country | Kind |
---|---|---|---|
2005-008513 | Jan 2005 | JP | national |
This application relates to and claims priority from Japanese Patent Application No. 2005-008513, filed on Jan. 17, 2005, and is a continuation of U.S. patent application Ser. No. 13/078,674, filed Apr. 1, 2011, now U.S. Pat. No. 8,131,922 which is a continuation of U.S. patent application Ser. No. 12/849,424, filed Aug. 3, 2010, now U.S. Pat. No. 7,941,600, which is a continuation of U.S. patent application Ser. No. 12/068,260, filed Feb. 5, 2008, now U.S. Pat. No. 7,797,486, which is a continuation application of U.S. application Ser. No. 11/086,239, filed Mar. 23, 2005, now U.S. Pat. No. 7,346,732, the entire disclosures of which are incorporated herein by reference.
Number | Name | Date | Kind |
---|---|---|---|
4809273 | Jackowski et al. | Feb 1989 | A |
5706298 | Sandorfi | Jan 1998 | A |
5742934 | Shinohara | Apr 1998 | A |
5819054 | Ninomiya et al. | Oct 1998 | A |
6467060 | Malakapalli et al. | Oct 2002 | B1 |
6751757 | Biskup et al. | Jun 2004 | B2 |
6952797 | Kahn et al. | Oct 2005 | B1 |
20040148461 | Steinmetz et al. | Jul 2004 | A1 |
Number | Date | Country |
---|---|---|
1 477 898 | Nov 2004 | EP |
2004-288078 | Oct 2004 | JP |
Entry |
---|
D. Patterson et al, “A Case for Redundant Arrays of Inexpensive Disks (RAID)”, ACM SIGMOD Conference Proceeding, Jun. 1988, pp. 109-116. |
Number | Date | Country | |
---|---|---|---|
20120159068 A1 | Jun 2012 | US |
Number | Date | Country | |
---|---|---|---|
Parent | 13078674 | Apr 2011 | US |
Child | 13407253 | US | |
Parent | 12849424 | Aug 2010 | US |
Child | 13078674 | US | |
Parent | 12068260 | Feb 2008 | US |
Child | 12849424 | US | |
Parent | 11086239 | Mar 2005 | US |
Child | 12068260 | US |