Patent Grant
7937513
1. Field of the Invention
The present invention relates to a method for controlling a storage system and to a storage control apparatus.
2. Description of the Related Art
In recent years, the environment surrounding information systems is rapidly changing such as the progress of information technology (IT) and measures for the shift to broadband. Along with this, the rapid increase of the amount of data handled is a serious problem in various occasions.
To deal with such an increase of the amount of data, storage systems operated in data centers are being subjected to larger capacities and higher performances of the storage control apparatuses such as disk array units. Therefore, for example, in data centers, introductions of and replacements with storage control apparatuses having higher performances and larger capacities are frequently carried out in order to respond to the rapid shift to larger capacities of storage control apparatuses.
There are methods for introducing a storage control apparatus, such as the ones in which the operation using the old storage control apparatuses has been completely shifted to the operation using only the newly introduced storage control apparatuses, and the ones in which the operation is carried out where the old storage control apparatuses coexist with the newly introduced storage control apparatuses.
As one of the former methods, there is a technology described in Japanese Patent Application Laid-open (Kokai) Publication No. Hei10-508967. In this method, all the data can be operated by the new storage control apparatuses having a higher performance and a larger capacity, however, effective use of the old storage control apparatuses cannot be facilitated.
On the other hand, in one of the latter methods, the effective use of the old storage control apparatuses can be facilitated. However, the number of the storage control apparatuses directly connected to networks becomes necessarily increased because both of the new and the old storage control apparatuses coexist, and network structure information must be re-constructed because the new storage control apparatuses have been introduced to the existing networks. Therefore, an increase in management load imposed by the shift and the operation is inevitable.
One object of the invention is to facilitate effective use of old storage control apparatuses when, for example, introducing new storage control apparatuses to an existing storage system.
Another object of the invention is to facilitate the use of old storage control apparatuses without increasing the management load of the storage system after introducing new storage control apparatuses. Yet another object of the invention is, in that situation, to make specification changes and modifications to the old storage control apparatuses unnecessary or minimal.
Further object of the invention is to enable the use of storage control apparatuses designed for being used directly connected to a host computer without any modification or with minimal necessary specification changes not only when introducing new storage control apparatuses to an existing storage system but also when operating a storage control apparatus which is connected to another storage control apparatus.
In order to achieve the above and other objects, an aspect of the invention provides a method for controlling a storage system including a host computer, and a first and a second storage control apparatuses each having a function for receiving a data input/output request transmitted from the host computer and executing a data input/output process for a storage device in response to the data input/output request received, comprising:
connecting a first communication path between the host computer and the first storage control apparatus to each other;
connecting a second communication path between the first storage control apparatus and the second storage control apparatus to each other;
receiving by the first storage control apparatus a first data input/output request transmitted from the host computer through the first communication path;
when the first storage control apparatus has judged that the first data input/output request is not to be handled by the first storage control apparatus, transmitting by the first storage control apparatus a second data input/output request corresponding to the first data input/output request, to the second storage control apparatus through the second communication path; and
by the second storage control apparatus, receiving the second data input/output request and executing a data input/output process corresponding to the second data input/output request received.
Features and objects of the present invention other than the above will become clear by reading the description of the present specification with reference to the accompanying drawings.
For a more complete understanding of the present invention and the advantages thereof, reference is now made to the following description taken in conjunction with the accompanying drawings wherein:
At least the following facts will be revealed by the description herein and the illustration of the accompanying drawings.
<Overview of Disclosure>
In the above invention, each of the first and the second storage control apparatuses is, for example, a storage apparatus provided to a user as one product such as a disk array apparatus. More specifically, the first storage control apparatus has a communication interface for connecting it to the first and the second communication means, a CPU for executing a data input/output process for a disk drive in response to the first data input/output request and a cache memory for storing data input to/output from the disk drive during the data input/output process.
The second storage control apparatus has a communication interface for connecting it to the second communication means, a CPU for executing a data input/output process for the storage device in response to the second data input/output request and a cache memory for storing data input to/output from the disk drive during the data input/output process.
Each of the first and the second storage control apparatuses operates as one single disk array apparatus when they are introduced to a network such as, for example, SAN, and can respectively receive as one single apparatus the data input/output request transmitted from the host computer and can execute a data input/output process in response to the data input/output request, to a storage device such as an integrated or externally-connected disk drive.
In the above structure, the first storage control apparatus and the second storage control apparatus are connected in series when seen from the host computer and, in this situation, the second storage control apparatus can be operated as an apparatus for extending the functions of, for example, the first storage control apparatus. This will be described more specifically. The first storage control apparatus receives from the host computer also a data input/output request directed to the second storage control apparatus as the first data input/output request in addition to a data input/output request directed to itself through the first communication path (corresponding to a first network described later) constituted of, for example, SAN. At this stage, if the received data input/output request is directed to the second storage control apparatus, the first storage control apparatus transmits the data input/output request to the second storage control apparatus through a second communication path (corresponding to a second network described later). That is, the first storage control apparatus functions as a relay apparatus between the host computer and the second storage control apparatus.
The second data input/output request relayed by the first storage control apparatus to the second storage control apparatus can be arranged such that it is transmitted in a format or protocol as in the first data input/output request received by the first storage control apparatus from the host computer, or such that it is transmitted in a format or protocol that has been changed in the first storage control apparatus into that of the second storage control apparatus. When it is arranged that communications between the first storage control apparatus and the second storage control apparatus are carried out using SCSI command conforming to ANSI (American National Standards Institute) or a standardized or normalized format or protocol, no special specification is required as a part of the structure of the second storage control apparatus as far as the second storage control apparatus has a standard communication interface. Therefore, in a storage center such as, for example, an IDC (Internet Data Center), even when a change in operation has been carried out in which the first storage control apparatus has been introduced as a new-model disk array apparatus and the old disk array apparatus that has been used is used being connected in series to the first storage control apparatus, no special specification change or modification is required for the second storage control apparatus. When the second storage control apparatus is an optional block device (an apparatus for random accesses represented by a disk apparatus), the invention can be applied. That is, when the second storage control apparatus is a large-scale storage control apparatus having high-level control functions equivalent to those of the first storage control apparatus, i.e., an optical disk apparatus with a block access interface, the invention can be applied.
It can be arranged that the first storage control apparatus stores information concerning a storage device for which the second storage control apparatus executes data input/output processes and the first storage control apparatus determines based on the stored information concerning the storage device whether it will transmit to the second storage control apparatus the second data input/output request corresponding to the first data input/output request.
As the example of the information concerning the storage device, there is information described in structure information management table described later. As practical examples, there is management information of storage area of one or more logic volume(s) organized on a storage area provided by a storage device, information concerning the performance of the logic volume, information concerning storage capacities and information concerning remaining amounts.
For example, when the first data input/output request is a data write-in request, the determination of whether to transmit the second data input/output request to the second storage control apparatus or not is carried out based on whether the data size of the data to be written in the logic volume of the second storage control apparatus in response to the data write-in request is within the range of the storage capacity of the logic volume. Furthermore, for example, when it has been determined that the data input/output request cannot be normally processed in the second storage control apparatus because, for example, the size of the data to be written in exceeds the capacity of the logic volume, the first storage control apparatus does not relay the second data input/output request to the second storage control apparatus.
In this manner, since it is arranged that the first storage control apparatus executes the process that should be originally executed by the second storage control apparatus, taking the role of the second storage control apparatus, even in a structure in which the second storage control apparatus is connected in series to the first storage control apparatus as described above, no special mechanism is required to be provided to the second storage control apparatus. According to the above function, the logic volume in the second storage control apparatus is provided to the host computer as if the logic volume were a logic volume of the first storage control apparatus.
It can be arranged that the first storage control apparatus stores access limit information concerning a storage device for which the second storage control apparatus executes data input/output processes, and the first storage control apparatus, when it has received the first data input/output request, determines by referring the contents of the received request to the access limit information whether to transmit to the second storage control apparatus the second data input/output request corresponding to the first data input/output request or not. There can be cases where the access limit information stored by the first storage control apparatus is, for example, registered from a management computer connected to the first storage control apparatus, or created and stored by the first storage control apparatus based on the received access limit information or the information as the basis of the access limit information that has been transmitted from the second storage control apparatus to the first storage control apparatus.
More specifically, for example, it is arranged that, when the second storage control apparatus organizes one or more logic volume (s) on a storage area provided by the storage device for which the second storage control apparatus itself executes data input/output processes, the first storage control apparatus stores the correlation X between IDs given to each host computer and an ID of the logic volume to which the host computer can make access and the first storage control apparatus determines whether to transmit the second data input/output request to the second storage control apparatus by referring the correlation between the ID of the host computer that is the source of the request described in the first data input/output request and the logic volume to which a data input/output process of the request described in the first data input/output request is directed, to the correlation X.
For example, in a storage system operated in an IDC, a storage control apparatus such as a disk array apparatus is not so rarely operated such that it carries out services to a plurality of host computers. In this case, each host computer often limits the storage control apparatuses that can access to that host computer. The access limit is generally carried out by, for example, managing the combinations such as port numbers or switch numbers of WWN or Fiber Channel switches such as zoning or LU masking when a host computer and storage control apparatuses are connected by SAN. In short, in this method, it is arranged that the first storage control apparatus executes the processes concerning the access limit taking the role of the second storage control apparatus when such access limit is required to be carried out between the host computer and a logic volume of the second storage control apparatus.
It can be arranged that a plurality of routes are included in the second communication path, the first storage control apparatus receives information concerning the second communication path from a relay apparatus existing on the second communication path and the first storage control apparatus determines, based on the information, a route for transmitting the second data input/output request. The information concerning the second communication path is, for example, network topology information, information of nodes in the network etc. conforming to the Fiber Channel standard, the SCSI standard or the iSCSI standard. The relay apparatus is, for example, a Fiber Channel switch, a Fiber Channel director, a Fiber Channel hub, an iSCSI router, an iSCSI switch etc.
The determination of the route is carried out based on at least any one of the conditions such as performance, reliability and stability of the plurality of paths grasped based on the information concerning the second communication path.
It can also be arranged that each of the first and the second storage control apparatuses respectively organizes one or more logic volume (s) on a storage area provided by the storage device for which the first and the second storage control apparatuses execute respective data input/output processes, the second storage control apparatus has a second logic volume being the target of data input/output processes of the second storage control apparatus and storing data of the first logic volume being the target of data input/output processes of the first storage control apparatus, the first storage control apparatus receives a data input/output request from the host computer and updates the contents of the first logic volume in response to the received request, the first storage control apparatus transmits to the second storage control apparatus a data input/output request instructing to the second logic volume an execution of a data update process corresponding to the updating, the second storage control apparatus receives the data input/output request and updates the contents of the second logic volume in response to the received request, and the first storage control apparatus stores information for grasping data not yet reflected on a logic volume of the second logic volumes among the data in the first logic volume. The information for grasping data not yet reflected is, for example, information describing whether the data in the first logic volume is reflected on the second logic volume in units of area organized in zones on a storage area in the first logic volume.
The information grasped in this manner is used, for example, in a case where updating to the second logic volume has been impossible due to a network failure etc., however, the failure has been recovered thereafter and data not yet reflected on the second logic volume is reflected. More specifically, for example, first, the first storage control apparatus transmits to the second storage control apparatus a data write-in request directed to the second logic volume concerning the data not yet reflected on the second volume, that has been grasped from the information for grasping the data not yet reflected, and the second storage control apparatus receives the data input/output request and executes to the second logic volume a write-in process corresponding to the data write-in request. In this manner, by arranging that the first storage control apparatus grasps the data not yet reflected on the second logic volume, it is not necessary to provide a special mechanism to the second storage control apparatus.
It can be arranged that each of the first and the second storage control apparatuses organizes one or more logic volume(s) on a storage area provided by a storage device for which the first and the second storage control apparatuses execute respective data input/output processes, the first storage control apparatus, when it writes new data in a first logic volume for which the first storage control apparatus executes data input/output processes, has transmitted to the second storage control apparatus a data write-in request of the old data stored in the area for write-in of the new data before the write-in process is executed, the second storage control apparatus receives the data write-in request and writes the old data in the second logic volume being the target of data input/output processes of the second storage control apparatus, the second storage control apparatus transmits to the first storage control apparatus the storage position of the old data in the second logic volume, and the first storage control apparatus stores the storage position of the new data in the first logic volume and the storage position of the old data in the second logic volume transmitted as above, relating both of them to each other.
A specific example for this method is, for example, a snapshot function described later. This function enables the data stored at a past time in the logic volume of the first storage control apparatus to be referred to. In this method, the data at a past time, i.e., the old data is stored in the logic volume of the second storage control apparatus.
Furthermore, the first storage control apparatus stores information designating the storage position of the old data in the logic volume of the second storage control apparatus by relating the information to the storage position where the old data was stored in the logic volume of the first storage control apparatus. By utilizing this, the first storage control apparatus can provide to the host computer the old data corresponding to the read-out request when, for example, a read-out request for an old data stored in a certain storage position in the first logic volume has been issued from the host computer.
It can be arranged that, when the first storage control apparatus has received from the host computer a data write-in request of new data for writing the new data to the first logic volume being the target of data input/output processes of the first storage control apparatus, the first storage control apparatus transmits to the second storage control apparatus the data write-in request of the new data without writing the new data to the first logic volume, the second storage control apparatus receives the data input/output request and writes the new data to a second logic volume being the target of data input/output processes of the second storage control apparatus, the second storage control apparatus transmits to the first storage control apparatus the storage position of the new data in the second logic volume, the first storage control apparatus stores the storage position of the old data in the first logic volume and the storage position in the second logic volume of the new data to be transmitted, relating both of them to each other. This method also relates to the snapshot function. However, in this method, being different from the former snapshot function, it is arranged that the old data is stored in the first storage control apparatus and the newest data in the logic volume of the first storage control apparatus is stored on the second storage control apparatus side.
As described above, according to the invention, the second storage control apparatus can be effectively utilized when the system is operated such that it has a copy of data, and when services such as the snapshot are provided. Especially when a first storage control apparatus is introduced as a substituting apparatus for the second storage control apparatus, the old-type second storage control apparatus can be effectively utilized continuously after introducing the first storage control apparatus. Therefore, effects such as reduction of the operation load of the storage system and reduction of the operation costs can be obtained.
<Overview of the System>
The host computer 30 is connected to the first storage control apparatus 10 through a first network 50 and the second storage control apparatus 20 is connected to the first storage control apparatus 10 through a second network 51. The first and the second networks are, for example, SANs (Storage Area Network) consisting of network devices conforming to the Fiber Channel. However, the networks are not limited to this but can be LANs (Local Area Network), general telephone lines, dedicated lines and networks of main frame system such as a protocol conforming to ESCON (Enterprise Systems CONnection) or FICON (Fiber CONnection).
The first storage control apparatus 10 receives a data input/output request transmitted from the host computer 30 through the first network 50. The second storage control apparatus 20 receives the data input/output request from the first storage control apparatus 10 through the second network 51. The second storage control apparatus 20 can be an apparatus having an equivalent performance as or a higher performance than that of the first storage control apparatus 10, or can be an apparatus having a performance lower than that of the first storage control apparatus 10.
As a case where the operation form shown in
The basic apparatus structure of the first storage control apparatus 10 will be described. The first storage control apparatus 10 is mounted with a storage apparatus 60 with one or more disk drive (s), as a storage device for providing a data storage area. The storage apparatus 60 can be structured such that it is connected to outside of the housing through, for example, a communication line conforming to the SCSI standard. As described above, the disk drive (s) are operated in RAID scheme, for example.
The first storage control apparatus 10 organizes one or more logic volume (s) 11 (hereinafter referred to as “logic volume”) on a storage area provided by one or more disk drive (s). Each logic volume 11 is respectively given a specific identifier (hereinafter referred to as “LUN (logical unit number)”). A LUN for designating a data storage area is described in a data input/output request transmitted by the host computer 30 to the first storage control apparatus 10. The first storage control apparatus 10 has a function for providing a storage area to the host computer 30 by a LUN designation.
A microprocessor 12 (hereinafter referred to as “MP”) executes the various processes of the first storage control apparatus 10 such as, for example, data input/output processes to the disk drive(s). MP 12 consists of one or more CPU(s). A microprocessor specialized in certain functions can be provided as MP 12. A cache memory 13 is mainly used for storing temporarily data input to/output from the disk drive(s) such as write-in data to the disk drive (s) and read-out data from the disk drive(s).
A control memory 14 is, for example, utilized as a working area for MP 12 or is used for storing various control data and tables. For example, a structure information management table 41 described later, a bit map 42, an access limit information table 43, an update management table 44 etc. are usually stored in this control memory 14.
An external interface 15 is a Fiber Channel interface. The external interface 15 connects the first storage control apparatus 10 to the first network 50 or the second network 51. The external interface 15 is provided with a plurality of ports 16 connected to ports of a Fiber Channel switch constituting a SAN. As is known in the field of the Fiber Channel, a WWN (world wide name) being an identifier for identifying an apparatus on a SAN is given to each port 16 of the external interface 15. The storage apparatus 60 is connected to the first storage control apparatus 10 through a device port 19 of a device interface 18.
The first storage control apparatus 10 has been described as above and the second storage control apparatus 20 also has a same structure as the first storage control apparatus 10 concerning the basic structure except the performance and the size of each component contained.
On the other hand, the host computer 30 is, for example, a personal computer, a work station or a general-purpose computer and is provided with a HBA (Host Bus Adapter) (not shown) being a Fiber Channel interface that is an interface for connecting to the first network 50. A WWN is also given to an HBA.
<Structure Information Management Table>
The second storage control apparatus 20 provides to the first storage control apparatus 10 its own logic volume as a logic volume of the first storage control apparatus 10. To realize this function, the first storage control apparatus 10 stores the structure information management table 41 shown in
In this structure information management table 41, information concerning a logic volume handled by the first storage control apparatus 10 is described. In the structure information management table 41, information concerning not only the logic volume for which the first storage control apparatus 10 executes data input/output processes (hereinafter referred to as “first logic volume”) but also the logic volume for which the second storage control apparatus 20 executes data input/output processes (hereinafter referred to as “second logic volume”) is described (In
In
Identifiers of the second logic volume related to their ports and LUNs are described in a column 214 for mapping LUN. That is, when a description exists in the column for mapping LUN, that means the logic volume is the second logic volume 21, therefore, other logic volumes are the first logic volumes 11.
The contents of the structure information management table 41 is, for example, registered by an operator from a management computer (not shown) etc. connected to the first storage control apparatus 10 and the first storage control apparatus 10 has an information collection function (discovery function) described later. With this function, the first storage control apparatus 10 detects an apparatus connected to the second network 51 through the second network 51, transmits to the detected apparatus a transmission request of the information concerning the logic volumes of the detected apparatus, receives information transmitted as per the request and registers the information in the structure information management table 41.
The apparatus being the destination of the information for the apparatus exists on the second network 51 can be otherwise predetermined fixedly. Various settings for the conditions are possible such that only the products from a certain manufacturer are targeted by checking the model number of the apparatuses, that only the logic volumes having capacities more than a certain capacity are targeted and that only the logic volumes connected to a predetermined port are targeted.
The first storage control apparatus 10 provides to the host computer 30 the second logic volume 21 of the second storage control apparatus 20 as if it were the first logic volume 11 of the first storage control apparatus 10, using the structure information management table 41 described above and in a mechanism described later. That is, the host computer 30 can execute to the first storage control apparatus 10 a data input/output request directed to the logic volume 21 of the second storage control apparatus 20.
Since the first storage control apparatus 10 stores the structure information management table 41 as described above, the first storage control apparatus 10 can transmit a response by a proper response message to the host computer 30 not only when a data input/output request has been transmitted from the host computer 30 but also even when, for example, commands such as “Inquiry” or “Read Capacity” has been transmitted from the host computer 30 directed to the second logic volume 21.
<Data Input/Output Process>
Next, the operation of the storage system in a case where a data input/output request is issued from the host computer 30 to the first storage control apparatus 10 through the first network 50 directed to the first logic volume 11 or the second logic volume 21 will be described.
A process of the storage system for the case where the data input/output request transmitted from the host computer 30 is a data write-in request will be described with
Next, the first storage control apparatus 10 refers to the structure information management table 41 to judge whether the data write-in request can be executed or not. The case where it can not be executed is, for example, that the logic volume being the target of the process of data input/output request does not exist or that, even when the logic volume exists, the size of the data being the target of the write-in process exceeds the size of the storage area of the logic volume.
The first storage control apparatus 10 checks referring to the structure information management table 41 whether the logic volume being the target of the process really exists, or whether the logic volume being the write-in destination has an enough capacity for being written the data to be written in by the data write-in request and judges whether a data input/output request corresponding to the data input/output request can be executed (S414). At this stage, if the first storage control apparatus 10 judges the data input/output request cannot be executed as a result of this judgment, it transmits to the host computer 30 a message in which that judgment is described and completes the process corresponding to the data input/output request (S415 in
Furthermore, the first storage control apparatus 10 stores in the control memory 14 the access limit information table 43 in which the combinations of the port ID or WWN of the host computer 30 of the request source of the data input/output request, the first logic volume 11 or the second logic volume 21 to be the request target of the data input/output request and access type (read-out/write-in) are registered. There are cases where the contents of this access limit information table 43 is registered by an operator from a management computer (not shown) etc. connected to the first storage control apparatus 10, where the first storage control apparatus 10 receives the access limit information or information being the basis of that information, transmitted from the second storage control apparatus 20 and the first storage control apparatus 10 creates and stores the contents based on that information. The latter operation can be carried out, for example, when the second storage control apparatus 20 itself has a mechanism concerning an access limit function for the logic volume 21 of the second storage control apparatus 20.
The first storage control apparatus 10 executes an access limit process that is a process for checking whether the combination of the ID of the port having received the data input/output request or WWN of the host computer 30 being the source described in the data input/output request, and the port ID of the first logic volume 11 or the second logic volume 21 designated in the data input/output request as the write-in destination matches the authorized access conditions (S416).
The concept of an access limit process is shown in
The above processes concerning the access limit are executed not only when the logic volume being the target of the process of the data input/output request is the first logic volume 11 but also when the logic volume being the target is the second logic volume 21. That is, the first storage control apparatus 10 substitutes in carrying out a research of the access limit to the second logic volume 21.
On the other hand, as shown in
As a result of the above processes, when the logic volume being the target of the process of the data input/output request has been judged to be possible to be written in (that is, the logic volume exists, its capacity is large enough and its access limit has no problem), the first storage control apparatus 10 transmits a data write-in request to the second storage control apparatus 20 (S417). The second storage control apparatus 20 receives this data write-in request and writes the write-in data in the second logic volume 21.
The data write-in request in this case conforms to the same protocol (for example, the data format is same) as that of the data write-in request directly received from the host computer 30 by the second storage control apparatus 20. Therefore, when the operation of the second storage control apparatus 20 is changed, because the first storage control apparatus 10 is newly introduced, such that the second storage control apparatus 20 functions as an apparatus for providing logic volumes to the first storage control apparatus 10, there is no need to carry out any change or modification especially for the apparatus structure and specification of the second storage control apparatus 20. Therefore, an effective use of the second storage control apparatus 20 becomes possible with the minimal effort and at a low cost.
The access limit function of the first storage control apparatus 10 described above can be applied in various environments such as the case where the second storage control apparatus 20 does not have any access limit function and the first storage control apparatus 10 dedicatedly support the access limit function of the second storage control apparatus 20 in addition to the case where the second storage control apparatus 20 originally has a function concerning the access limit.
The first storage control apparatus 10, when having transmitted a data input/output request to the second storage control apparatus 20, transmits to the host computer 30 a message to communicate the completion of the write-in process without waiting for the completion notice of the process of the data input/output request from the second storage control apparatus 20 (S415). Therefore, the host computer 30 can confirm quickly the response to the data input/output request and can start the following process quickly without a long waiting time.
A write-in process has been described as above. However, in the case of a read-out process from a logic volume, the process is also executed in a same mechanism except that data is transferred in the opposite direction in contrast to the above case for a write-in process. For data input/output requests except the ones for write-in and read-out processes, the first storage control apparatus 10 returns responses as usual to the host computer 30.
As described above, in the storage system, the host computer 30 accesses the second logic volume as if it were a logic volume in the first storage control apparatus 10. Furthermore, even when the logic volume being the target of a data input/output request is originally for the second storage control apparatus 20, the management load and the management cost for security can be minimized since the judgment of whether a data input/output request can be normally processed and management of access right setting etc. can be carried out concentrated and intensively in the first storage control apparatus 10. Furthermore, by executing the processes to be executed by the second storage control apparatus 20 using the first storage control apparatus 10, the process load on the second storage control apparatus 20 side can be reduced.
<Data Copy Function>
Next, a data copy function executed in this storage system will be described. The function described in this section is utilized for realizing functions such as, for example, data replication or data mirroring and is a function that works such that the second storage control apparatus 20 also has a logic volume having the same contents as that of a logic volume of the first storage control apparatus 10.
The first logic volume 11 being the copy source and the second logic volume 21 being the copy destination can be provided in a relation of 1:N in addition to in a relation of 1:1. The case where they are provided in the relation of 1:1 will be described as an example for simplification of description. However, even in the case where they are provided in the relation of 1:N, the basic process can be executed similarly simply because a plurality of relations of 1:1 exist.
In order to realize the data copy function, for example, a mechanism for managing the difference of the contents between the first logic volume 11 and the second logic volume 21 is necessary as a preparation for the case where a communication failure occurs on the second network 51. As this mechanism, the one in which a bit map where a bit is related to each block or block group organized in zones in the storage area of a logic volume of the first storage control apparatus 10 is prepared and every bit for which a difference is generated between those logic volumes is made “on” is known.
When the first storage control apparatus 10 has transmitted the write-in process completion report to the host computer 30, it makes on the bits corresponding to the update address of the logic volume being the write-in destination of this write-in process in the bit map 42 (S614).
Next, the first storage control apparatus 10 starts the process for matching the contents of the logic volumes 11 and 21 being the copy source and the copy destination with each other at a proper timing such as the time when an instruction has been issued from a management computer (not shown).
First, the first storage control apparatus 10 refers to the bit map 42 and transmits to the second storage control apparatus 20 a write-in request of the data stored in a storage area of the logic volume 11 of the copy source corresponding to blocks or block groups that have discord in contents, i.e., that the bit is on (S615).
When the second storage control apparatus 20 has received the data write-in request and the write-in data, it writes the received write-in data to the targeted storage area of the second logic volume 21 being the copy destination and transmits to the first storage control apparatus 10 a write-in completion report (S616).
At the moment when the first storage control apparatus 10 receives the data write-in completion report from the second storage control apparatus 20, the first storage control apparatus 10 sets off the bit of the bit map 42 corresponding to the storage area of the data written in the copy destination (S617). That is, the contents of the bit map 42 are managed in real time such that only the bits corresponding to the storage area for the contents of the first logic volume 11 and the second logic volume 21 are different. In this manner, the contents of the logic volumes being the copy source and the copy destination are synchronized with each other.
It is not necessary that the storage capacities of the logic volumes being the copy source and the copy destination are always same. In the case where the logic volumes being the copy source and the copy destination are different as described above, for example, addresses are converted and stored in another volume, or the data size is reduced using a compression process and is stored.
In the above description, the first logic volume 11 is the copy source and the second logic volume 21 is the copy destination. However, in contrast to this, it may be structured that the copy source is the second logic volume 21 and the copy destination is the first logic volume 11.
<Re-Synchronization Process>
Next, a re-synchronization process executed for the case where the contents of the first logic volume 11 and the second logic volume 21 are different due to a failure of the second storage control apparatus 20 or the second network 51, etc. And, thereafter, the failure is recovered and it is possible to synchronize the contents of the logic volumes 11 and 21.
The first storage control apparatus 10 detects a failure of the second network 51 by, for example, a time-out of communication between the first and the second storage control apparatuses 10 and 20. The difference of the contents can be caused not only by the failure of the second network 51 but also by operations of a user such as back-up process and application tests.
First, the processes for the case where the first storage control apparatus 10 detects a failure of the second network 51 will be described. When the first storage control apparatus 10 has detected a failure, it switches the operation from the normal operation condition described above to a separated condition (S621) and stops a transmission process to the second storage control apparatus 20 of a data write-in request about update finite difference data. As to a write-in process to the first logic volume 11, the processes from (S611) to (S614) are executed (S622). Therefore, the bits on the bit map corresponding to the blocks or block groups updated during the separated condition are set to on and the difference between the first logic volume 11 and the second logic volume 21 is managed.
Next, when the failure has been recovered and the second logic volume 21 becomes available, first, the first storage control apparatus 10 transmits to the second storage control apparatus 20 a data write-in request directed to the second logic volume 21 about the data stored in a storage area of the first logic volume 11 corresponding to the blocks or block groups of which the bit in the bit map 42 is on.
When the second storage control apparatus 20 has received the data write-in request, it writes the write-in data received with the request to a storage area corresponding to a targeted logic volume. In this write-in process, for example, when the system is operated such that the data stored in a storage area of a certain address in the logic volume 11 being the copy source is stored in a storage area designated by the same address in the logic volume 21 being the copy destination, the data is stored in a storage area of the second logic volume 21 designated by the same address as the address in the first logic volume 11 where the data has been stored (S623).
In the above processes, it is arranged that the first storage control apparatus 10 transmits to the second storage control apparatus 20 only the data stored in the updated storage area. Therefore, the amount of the data transmitted to the second network 51 can be almost minimized. When the re-synchronization process of the contents of those logic volumes has been completed in this manner, the first storage control apparatus 10 re-starts the transmission of the data write-in request of the updated finite difference data.
The above processes are on the premise that the update of the logic volume 21 being the copy destination is not executed as far as the logic volume 11 being the copy source has not been updated. However, an update of the logic volume 11 being the copy destination may have been executed before an update of the logic volume 21 being the copy source is executed depending on a form of use of the storage system. In this case, the contents of those logic volumes cannot be re-synchronized using the bit map 42 and the re-synchronization process is executed, for example, in a manner in which all the data in the logic volume 11 of the first storage control apparatus 10 is transferred to the logic volume 21 of the second storage control apparatus 20.
It can be arranged that the update situation of the second logic volume 21 is managed by managing a bit map concerning the second logic volume 21. In this case, the bit map is stored, for example, in the control memory 14 of the first storage control apparatus 10, in a control memory (not shown) of the second storage control apparatus 20 or in the logic volume 21. Furthermore, in this case, re-synchronization can be executed by, for example, transferring the data stored in blocks or block groups that have been updated from the first logic volume 11 and writing it to the second logic volume 21.
<Snapshot>
(1) Snapshot Function 1
Next, snapshot function will be described. This function enables the data stored in a logic volume at a past time designated by a user to be obtained. Whether the snapshot function is operated or not can be set for each logic volume.
The case where the first storage control apparatus 10 operates the snapshot function for the first logic volume 11 will be described. The snapshot function described here is a function that stores in the second logic volume 21 old data stored in a storage area of the first logic volume 10 being the target of a write-in process and enables old data to be utilized afterward, for example, from the host computer 30 when a write-in process has been executed to the first logic volume with new data.
The first storage control apparatus 10 stores in the control memory 14 the update management table 44 in which the correlation is registered between addresses designating the storage area where writing has been effected among the storage areas of the first logic volume 11 and addresses of the second logic volume 21 which is a refuge for the old data stored in that storage area.
The mechanism for realizing the snapshot function will be described. First, when the first storage control apparatus 10 has received a data write-in request directed to the first logic volume 11 transmitted from the host computer 30 (S711), the first storage control apparatus 10 stores in the cache memory 13 the write-in data (new data) received with the data write-in request (S712).
Next, the first storage control apparatus 10 reads out the data already stored in the storage area of the first logic volume 11 being the destination of the data write-in process (old data) being the target of this data write-in process and stores the old data in the cache memory 13 (S713). Thereafter, the first storage control apparatus 10 writes the write-in data received from the host computer 30 (new data) in the storage area (S714).
The first storage control apparatus 10 transmits a write-in completion report to the host computer 30 at the moment when it has stored the write-in data in the cache memory 13. Therefore, the real write-in process of the write-in data in the first logic volume 11 may be executed after the write-in completion report has been transmitted.
Next, the first storage control apparatus 10 transmits the old data stored in the cache memory 13 to the second storage control apparatus 20. When the second storage control apparatus 20 has received the old data, the second storage control apparatus 20 stores the data in the second logic volume 21. At this stage, the second storage control apparatus 20 transmits the storage position of the second logic volume 21 where the old data is stored with an address indicating the original storage position in the logic volume 11 of the first storage control apparatus 10 where the old data has been stored (this address is received from the first storage control apparatus 10 with, for example, the write-in data). On the other hand, the first storage control apparatus 10 receives the transmitted storage position and stores it in the update management table 44 of the control memory 14 (S715). As described above, the old data (hereinafter referred to as “snapshot”) is stored in the second logic volume 21 of the second storage control apparatus 20.
When, for example, the first storage control apparatus 10 has received from the host computer 30 a data read-out request for the first logic volume 11 being the target of creating a snapshot, the first storage control apparatus 10 executes a read-out process by an ordinary process from the first logic volume 11 of the first storage control apparatus 10 and transmits the read out data to the host computer 30.
On one hand, when, for example, the first storage control apparatus 10 has received from the host computer 30 a data read-out request for the old data of the logic volume 11 and an area corresponding to the storage area designated by the read-out request is stored in the update management table 44, the first storage control apparatus 10 transmits to the second storage control apparatus 20 a read-out request of the targeted data from the second logic volume 21. The second storage control apparatus 20, in response to this, transmits the targeted old data to the first storage control apparatus 10. Then, the first storage control apparatus 10 receives the transmitted old data and transmits it to the host computer 30.
On the other hand, when the storage area designated by the read-out request is not stored in the update management table 44, the first storage control apparatus 10 reads out the targeted data from the first logic volume 11 of the first storage control apparatus 10 and transmits it to the host computer 30.
(2) Snapshot Function 2
Next, another method for realizing the snapshot function will be described referring to
In this method, when a data write-in request for the first logic volume 11 of the first storage control apparatus 10 has been transmitted from the host computer 30, the first storage control apparatus 10 writes write-in data (new data) to the second logic volume 21 of the second storage control apparatus 20 without executing any update of the first logic volume 11 itself. That is, different from the above-described method, in an ordinary write-in process, new data to be originally written in the first logic volume 11 is not written to the first logic volume 11 and the old data is kept stored as it is in the first logic volume 11 and the new data is stored in the second logic volume 21.
In this method, a data write-in request for the first logic volume 11 of the first storage control apparatus 10 has been transmitted from the host computer 30 and, when the first storage control apparatus 10 has received the data write-in request (S811), it stores in the cache memory 13 the write-in data (new data) transmitted with the data write-in request (S812).
Next, the first storage control apparatus 10 transmits to the second storage control apparatus 20 the new data stored in the cache memory 13 and a data write-in request for the new data. Then, the second storage control apparatus 20 having received this stores the new data in the second logic volume 21.
For the above case, as the addresses designating the storage area in the second logic volume 21 of the new data, there is, for example, an address where no new data has been stored yet is designated. This address is transmitted from the second storage control apparatus 20 to the first storage control apparatus 10 and the first storage control apparatus 10 stores the address in the update management table 44 relating it to an address designated as a write-in destination of the data write-in request. (S813). This relating is carried out by, for example, exchanging between the first storage control apparatus 10 and the second storage control apparatus 20 the information necessary for the relating.
In a case where a snapshot is created as described above, when a data read-out request is issued from the host computer 30, the first storage control apparatus 10 first checks the update management table 44. Then, if the address of the read-out destination designated by the read-out request is not contained in the update management table 44, the first storage control apparatus 10 reads out the targeted data from the first logic volume 11 and transmits the data to the host computer 30.
On the other hand, if the address of the read-out destination is contained in the update management table 44, the first storage control apparatus 10 transmits to the second storage control apparatus 20 a read-out request for the data at the address of the second logic volume of the second storage control apparatus 20 stored in the update management table 44 being related to the address.
When the second storage control apparatus 20 has received the read-out request, the second storage control apparatus 20 reads out the data from the second logic volume 21 and transmits the data to the first storage control apparatus 10. When the first storage control apparatus 10 has received the data, it transmits the data to the host computer 30 (S814).
When, for example, the first storage control apparatus 10 has received from the host computer 30 a data read-out request for the old data of a certain first logic volume 11, and the storage area designated by the read-out request is not stored in the update management table 44, the first storage control apparatus 10 reads out the data from the logic volume 11 of the first storage control apparatus 10 and transmits the data to the host computer 30.
In the above description, it is arranged that the update management table 44 is stored in the control memory 14 of the first storage control apparatus 10, however, it can also be arranged that the update management table 44 is stored in a control memory (not shown) of the second storage control apparatus 20, the second logic volume 21 or another logic volume 21 in the second storage control apparatus 20. When it is arranged as described above, the snapshot function can be realized without providing any special mechanism to the second storage control apparatus 20.
(3) Reflecting of New Data
When the snapshot function 2 described above operates, the new data is not reflected on the first logic volume 11. However, there are times when old data becomes not necessary to be stored in the first logic volume 11 and new data stored in the second logic volume 21 is required to be reflected on the first logic volume 11 such as when, for example, the old data of the first logic volume 11 has finished its role due to the completion of user's work. Furthermore there are times when new data is required on the first logic volume 11 at a timing regularly or not regularly since the storage area of the second logic volume 21 is decreased by new data stored one after another in the second logic volume 21. Then, a mechanism for reflecting new data on the first logic volume 11 for these cases will be described.
The description will be given referring to
When the second storage control apparatus 20 has received the read-out request, the second storage control apparatus 20 reads out from the second logic volume 21 the new data stored in the storage position identified from the information and transmits the new data to the first storage control apparatus 10.
When the first storage control apparatus 10 has received the new data, the first storage control apparatus 10 stores the new data in the cache memory 13 (S912) and writes the new data in the storage position of the first logic volume 11 specified by the update management table 44 (i.e., the storage position in the first logic volume 11, where the new data should originally be stored, designated in the data write-in request transmitted from the host computer 30) (S913).
The new data is reflected on the first logic volume 11 by the above mechanism. As to new data, it can also be arranged that all the new data stored in the second logic volume 21 are reflected on the first logic volume 11 simultaneously at a certain timing, or that only the specific new data selected based on the conditions such as whether the time at which the new data was stored in the second logic volume 21 is before a predetermined time is reflected or not.
New data can be reflected on the first logic volume by the above mechanism for the cases where the old data in the first logic volume finishes its role due to the completion of user's work, or where storage area of the second logic volume is required to be released.
In the above mechanism, though the first storage control apparatus 10 stores once the new data in the cache memory 13 of the first storage control apparatus 10 itself at the timing when the first storage control apparatus 10 has received a data write-in request from the host computer 30 (for example, (S813) in
Then, as shown in
In this case, whether the new data is kept stored in the cache memory 13 or not is managed by, for example, as shown in the table 1200 in
In this mechanism, the storage area of the cache memory 13 tends to decrease due to the new data kept stored. Therefore, it can also be arranged that, when the first storage control apparatus 10 has received a data write-in request from the host computer 30, whether the new data is kept stored in the cache memory 13 or not is determined depending on the use status such as the remaining amount of the storage area of the cache memory 13. As shown in the table 1300 in
It can be arranged that, when the new data is reflected on the first logic volume 11, whether the new data is stored in the cache memory 13 is checked and, if it is stored, the read-out request is not transmitted and the new data stored in the cache memory 13 is stored at a storage position in the first logic volume 11 corresponding to the new data and, if it is not stored, a read-out request for the new data is transmitted to the second storage control apparatus 20 and the new data transmitted back in response to the read-out request is stored in the storage position of the first logic volume 11 corresponding to the new data. According to this method, a system in which the new data is not necessarily stored in the cache memory can be flexibly coped with since the processes are switched between the cases where the new data is stored in the cache memory and where it is not. It can also be arranged that the first storage control apparatus 10 determines whether the new data is kept stored in the cache memory 13 or not depending on the use status of the cache memory 13.
According to the above mechanism, the influence on the second network 51 caused by the reflecting of the new data on the first logic volume 11 is suppressed. Furthermore, high-speed processes can be realized since no communication is generated between the first and the second storage control apparatus 10 and 20 because the new data can be reflected on the first logic volume 11 only with the processes of the first storage control apparatus 10 itself.
<Exchange of Roles of Logic Volumes>
For example, in the above-described data copy function, an exchange of roles of the copy source and the copy destination between the first logic volume 11 and the second logic volume 21 may be desired. Similarly in the above-described snapshot function, an exchange of roles between the first logic volume 11 and the second logic volume 21 may be desired.
In these cases, it is considered that an exchange of the data stored in the first logic volume 11 and the data stored in the second logic volume 21 is carried out by, for example, transmitting those data respectively to the opposite logic volume between the first storage control apparatus 10 and the second storage control apparatus 20 through the second network 51 and their roles are exchanged thereafter. However, in this case, the communication on the second network 51 is influenced by the above transmission.
Then, the first storage control apparatus 10 of this embodiment has a mechanism for exchanging those roles at a timing when the contents of the first logic volume 11 and the contents of the second logic volume 21 becomes same such as, for example, when the contents of the logic volumes being the copy source and the copy destination are synchronized in the above-described data copy function, or when the new data is reflected on the logic volume that stored the old data in the above-described snapshot function.
That is, for example, as shown in the table 1400 in
According to the above mechanism, the roles of the first logic volume 11 and the second logic volume 21 recognized by the program realizing the data copy function and snapshot function etc. can be exchanged without carrying out any data transmission through the second network 51. In a case where the data copy function and the snapshot function are applied in a connection structure shown in
<Check Code>
The first storage control apparatus 10 attaches a check code to data to be stored in the first logic volume 11 for the purpose of securing the data reliability, etc. The check code is an error correction code (ECC) such as, for example, a check sum, a parity bit, a Hamming code, cyclic redundancy check code (CRC code). The first storage control apparatus 10 creates a check code for, for example, at every predetermined length of data and attaches it to the data.
The first storage control apparatus 10 has a mechanism for checking the consistency and the validity of data by, for example, checking whether any error such as a bit garbling exists in the data or not using the check code when the first storage control apparatus 10, for example, reads data from or writes data in the first logic volume 11. The first storage control apparatus 10 also has a mechanism for correcting errors and notifying the management computer that it has detected an error. The first storage control apparatus 10 further has a mechanism for carrying out such processes concerning the check code also to the data stored in the second logic volume 21 of the second storage control apparatus 20. This mechanism will be described referring to
When a data write-in request received from the host computer (S1811) is to be handled by the second storage control apparatus 20, the first storage control apparatus 10 creates a check code about a write-in data transmitted from the host computer 30 attached to the data write-in request (S1812) and transmits to the second storage control apparatus 20 a data write-in request about the write-in data, to which the created check code is attached (S1813).
The second storage control apparatus 20 receives the data write-in request and stores in the second logic volume 21 the write-in data to which the check code is attached (S1814). At this stage, it can also be arranged that, as shown in
In this case, it is arranged that information indicating which data the check code is about (for example, an identifier and an address of the logic volume where the corresponding data is stored) is attached to each check code. When they are stored in different logic volumes, it is arranged that, for example, data input/output requests corresponding to each of them are transmitted from the first storage control apparatus 10 to the second storage control apparatus 20.
According to the above mechanism, even when the second storage control apparatus 20 does not have the mechanism concerning check codes that the first storage control apparatus 10 has, the mechanism concerning check codes can be applied to the data to be stored in the second logic volume 21.
<Extension of Scope to Apply Commands>
The first storage control apparatus 10 has a mechanism for interpreting and executing commands which the second storage control apparatus 20 does not support (hereinafter referred to as “specific commands”). The first storage control apparatus 10 further has a mechanism for applying the specific commands also to the data stored in the second logic volume 21 of the second storage control apparatus 20. This mechanism is effective when, for example, the second storage control apparatus 20 does not support the specific commands.
When the first storage control apparatus 10 has received from a host computer a data input/output request targeting a storage device of the second storage control apparatus 20, the first storage control apparatus 10 checks whether the command described in the data input/output request is a specific command or not. Then, if the command is a specific command, the first storage control apparatus 10 creates a command, which the second storage control apparatus 20 can interpret and execute, for allowing the second storage control apparatus 20 to execute a process for responding the command and transmits to the second storage control apparatus 20 a data input/output request in which the created command is described. That is, the first storage control apparatus 10 functions in a sense as a command converting apparatus that converts the specific commands that the second storage control apparatus 20 cannot interpret and execute into commands that the second storage control apparatus 20 can interpret and execute.
Since the first storage control apparatus 10 functions as a command converting apparatus for the second storage control apparatus 20 in this manner, even when the second storage control apparatus 20 does not have any intelligent functions, the host computer can utilize the storage resources of the second storage control apparatus 20 as if the second storage control apparatus 20 has such functions (or as if the first storage control apparatus 10 is integrated with the second storage control apparatus 20).
Furthermore, the scope to apply commands that only the first storage control apparatus 10 can interpret and execute can be extended to the second storage control apparatus 20. Therefore, when, for example, the first storage control apparatus 10 is introduced to an environment where the second storage control apparatus 20 is installed, while the extension of storage resource is being progressed by a storage device of the second storage control apparatus 20 being an existing asset, the commands which only the first storage control apparatus 10 can interpret and execute can be applied when the storage resource of the second storage control apparatus 20 is utilized and, for example, in a data center etc., the second storage control apparatus 20 being an existing asset can be effectively utilized.
A structure for realizing the above mechanisms will be described in detail.
(1) Specific Reservation Command
A case where the specific commands are specific reservation commands defined in SCSI standard will be described as an example. In addition to the conventional reservation command function conforming to the SCSI standard, for each LU, setting such as write-in enable/unable, read-out enable/unable etc. for each WWN (World Wide Name) (for example, a WWN given to the host computer 30) attached to a data input/output request can be carried out to the specific reservation commands.
A specific reservation command is transmitted from the first host computer 31 to the first storage control apparatus 10 and the first storage control apparatus 10 receives the command (S2211). The specific reservation command received by the first storage control apparatus 10 is referred to the LU map information table 2300 shown in
Next, a data input/output request in which a data write-in command (“Write” command) is described is transmitted from the first host computer 31 to the first storage control apparatus 10 and the first storage control apparatus 10 receives it (S2214). Then, the command analysis/execution unit 1011 checks whether the WWN described in the received data input/output request is same as the WWN registered in the reservation information table 2400 as to the LU being the target of the data input/output request (S2215). In this case, the WWNs match and the command analysis/execution unit 1011 progresses the process for the data write-in command.
Next, the command analysis/execution unit 1011 instructs the data-caching unit 1013 to store in the cache memory 13 (not shown in
Next, the command analysis/execution unit 1011 controls the remote I/O control unit 1012 (52216) and the remote I/O control unit 1012 transmits to the second storage control apparatus 20 the data write-in command about the write-in data stored in the cache memory 13 (S2219). At this stage, the data write-in command is a command conforming to the SCSI standard that the second storage control apparatus 20 also can analyze and execute.
The data write-in command received by the second storage control apparatus 20 is analyzed in the command analysis/execution unit 2011 of the second storage control apparatus 20 and the data caching unit 2013 stores in the cache memory (not shown) the data of write-in target received with the data write-in command (S2220). Then, the disk input/output control unit 19 stores in the storage device (not shown) the data of write-in target stored in the cache memory of the second storage control apparatus 20.
On the other hand, when a data input/output request in which a command targeting an LU during reservation is described has been transmitted from a computer other than the first host computer 31, for example, a second host computer 32 to the first storage control apparatus 10 (S2231), the command analysis/execution unit 1011 of the first storage control apparatus 10 checks whether the WWN described in the received data input/output request is same as the WWN registered in the reservation information table 2400 for the LU being the target of the data input/output request (S2232). At this stage, in this case, since the WWNs are not same, the command analysis/execution unit 2011 transmits to the second host computer 32 a message telling that the LU is in reservation (S2233).
According to the above mechanism, the scope to apply the specific reservation commands that only the first storage control apparatus 10 can interpret/execute can be extended to the second storage control apparatus 20. Therefore, when, for example, the second storage control apparatus 20 having no function for interpreting/executing the specific commands is installed and the first storage control apparatus 10 having such functions is introduced, while extension of the storage resource is being progressed by the storage device of the second storage control apparatus 20 being an existing asset, the function for the specific reservation commands can be applied when the storage resource of the second storage control apparatus 20 is utilized. Therefore, the existing assets can be effectively utilized in, for example, data centers.
(2) E-Copy Command
Next, the case where the specific commands are extended copy commands (E-copy commands) defined in SCSI will be described. The commands are used when, for example, the device itself that has issued the command does not copy the data but the copying is carried out between other devices.
First, an E-copy command is transmitted from the first host computer 31 to the first storage control apparatus 10 and the first storage control apparatus 10 receives this command. (S2511).
The E-copy command received by the first storage control apparatus 10 is referred to the LU map information table 2300 shown in
Next, the command analysis/execution unit 1011 instructs the remote I/O execution unit 1012 to transmit a data read-out command to the second storage control apparatus 20 organizing the second logic volume 21 designated by the source address (S2514). Then, the remote I/O execution unit 1012 having received this instruction transmits to the second storage control apparatus 20 a data read command being a command conforming to SCSI standard that can be analyzed/executed in the second storage control apparatus 20 (S2515).
When the second storage control apparatus 20 has received the data read command, the command analysis/execution unit 2011 of the second storage control apparatus 20 analyzes this command, reads out the targeted data by instructing the disk input/output control unit 19 to do so (S2516) and transmits the data to the first storage control apparatus 10 (S2517). This read-out process is executed utilizing the data in the cache memory of the second storage control apparatus 20 if the data exists there. If the data does not exist there, the disk input/output control unit 19 reads out the data from the second logic volume 21 and stores it in the cache memory and the read-out is executed utilizing the data in the cache memory.
Next, when the remote I/O execution unit 1012 of the first storage control apparatus 10 has received data transmitted from the second storage control apparatus 20, the remote I/O execution unit 1012 notifies the data caching unit 1013 accordingly (S2518). The data caching unit 1013 having received this notice stores the data in the cache memory 13 and notifies the command analysis/execution unit 1011 that it has stored the data (S2519).
Next, the command analysis/execution unit 1011 having received this notice notifies the remote I/O execution unit 1012 that it will transmit the data and a data write-in command about the data to the third storage control apparatus 80 connected to the back-up device 90 designated by a destination address (S2520). The remote I/O execution unit 1012 having received this notice transmits to the third storage control apparatus 80 the data and a data write-in command (S2521). Then, when the third storage control apparatus 80 has received the data and the data write-in command, it controls the back-up device 90 and starts writing the data in a storage medium (S2522). As the back-up device 90, there are, for example, a disk drive, a DAT tape drive, DVD-RAM, MO, CD-R, cassette tape etc.
According to the above mechanism, the scope to apply the E-copy commands that only the first storage control apparatus 10 can interpret/execute can be extended to the second storage control apparatus 20. Therefore, when, for example, the second storage control apparatus 20 having no function for interpreting the E-copy commands is installed and the first storage control apparatus 10 having that function is introduced, while extension of the storage resource is being progressed by the storage device of the second storage control apparatus 20, the function for the E-copy commands can be applied when the storage resource of the second storage control apparatus 20 is utilized. Therefore, the old storage control apparatus can be effectively utilized.
<Details of Information Collection Function>
Next, the details of the above-described information collection function will be described. This function is executed taking the opportunities such as, for example, when the first storage control apparatus 10 is introduced newly to the storage system, when the structure of another apparatus has been changed and when start-up direction has been issued by a user.
In the above judgment, when the first storage control apparatus 10 has found an apparatus that can be used as the second storage control apparatus 20, it transmits to the apparatus a “Read Capacity” command conforming to the SCSI standard following the “Inquiry” command (S2613). Therefore, information provided by the apparatus such as storage capacity can be obtained. The first storage control apparatus 10 stores in the structure information management table 41 the information obtained in this manner (S2614).
<Route Dynamic Selection Function>
In this storage system, the first storage control apparatus 10 has a function for dynamically select the data transmission route between the first storage control apparatus 10 and the second storage control apparatus 20. This function will be described in detail in this section.
First, the mechanism for collecting information concerning the second network 51, that the first storage control apparatus 10 needs for this dynamic selection function will be described. First, the first storage control apparatus 10 obtains the information concerning the network from relay apparatuses such as, for example, Fiber Channel switches on the second network 51 and stores the information in the control memory 14. The information concerning the network is network topology information and node information in the network conforming to the Fiber Channel standard, the SCSI standard or the iSCSI standard. This information is stored in devices such as switches constituting the network.
When, for example, a plurality of network routes for reaching the second storage control apparatus 20, the first storage control apparatus 10, based on the information collected as above, selects one of the routes or selects different routes to a plurality of ports for the purpose of load distribution, and instructs the network to set the route (s). At this stage, the first storage control apparatus 10 selects dynamically the optimal network route(s) considering the congestion on the network and access status to the second storage control apparatus 20. When it has been confirmed by checking the access status of the network that the selected route(s) is/are interrupted by obstacle(s), a dynamic route control is executed in which the route (s) is/are automatically switched.
Furthermore, the first storage control apparatus 10 changes the zoning setting for the purpose of improving security etc., dynamically selects the route(s) such that the interference with other apparatuses existing on the second network 51 is suppressed and selects automatically only the route(s) being permitted to access in association with the above-described access limit function.
A storage system and a method for controlling the storage system according to the invention has been described based on embodiments. However, the above-described embodiments of the invention only facilitates the understanding of the invention and is not intended to limit the invention. The invention can be changed and improved without departing from the scope and the spirit of the invention and includes its equivalents.
In the above description, the first network 50 and the second network 51 can be connected to each other or each of them can be independent.
It can be structured such that a plurality of second storage control apparatus 20 exist for one first storage control apparatus 10.
In the above description, the first storage control apparatus 10 and the second storage control apparatus 20 are described as disk array apparatuses, however, they are not limited to disk array apparatuses and can be, for example, semiconductor disk apparatuses using semiconductor memories as storage devices.
The storage system can be structured such that the first and the second storage control apparatus 10 and 20 are connected through a communication line conforming to the SCSI standard.
According to the invention, it is possible to effectively utilize the old storage control apparatuses when, for example, a storage control apparatus has been newly introduced to an existing storage system.
While illustrative and presently preferred embodiments of the present invention have been described in detail herein, it is to be understood that the inventive concepts may be otherwise variously embodied and employed and that the appended claims are intended to be construed to include such variations except insofar as limited by the prior art.
| Number | Date | Country | Kind |
|---|---|---|---|
| 2002-127058 | Apr 2002 | JP | national |
| 2002-333540 | Nov 2002 | JP | national |
This is a continuation application of U.S. Ser. No. 11/338,796, filed Jan. 25, 2006 now U.S. Pat. No. 7,457,899, which is continuation application of U.S. Ser. No. 10/424,563, filed Apr. 25, 2003, now U.S. Pat. No. 7,051,121, and is related to U.S. Ser. No. 11/338,797, filed Jan. 25, 2006, now U.S. Pat. No. 7,412,543, the contents of all of which are hereby incorporated by reference and which claim priority to Japanese Patent Application No. 2002-127058 filed on Apr. 26, 2002 and Japanese Patent Application No. 2002-333540 filed on Nov. 18, 2002, which are herein incorporated by reference.
| Number | Name | Date | Kind |
|---|---|---|---|
| 3771137 | Barner et al. | Nov 1973 | A |
| 4025904 | Adney et al. | May 1977 | A |
| 5155845 | Beal et al. | Oct 1992 | A |
| 5193184 | Belsan et al. | Mar 1993 | A |
| 5408465 | Gusella et al. | Apr 1995 | A |
| 5459857 | Ludlam et al. | Oct 1995 | A |
| 5504882 | Chai et al. | Apr 1996 | A |
| 5548712 | Larson et al. | Aug 1996 | A |
| 5680580 | Beardsley et al. | Oct 1997 | A |
| 5680640 | Ofek et al. | Oct 1997 | A |
| 5758118 | Choy et al. | May 1998 | A |
| 5835954 | Duyanovich et al. | Nov 1998 | A |
| 5870537 | Kern et al. | Feb 1999 | A |
| 5895485 | Loechel et al. | Apr 1999 | A |
| 5917723 | Binford | Jun 1999 | A |
| 5956750 | Yamamoto et al. | Sep 1999 | A |
| 5978890 | Ozawa et al. | Nov 1999 | A |
| 6012123 | Pecone et al. | Jan 2000 | A |
| 6098129 | Fukuzawa et al. | Aug 2000 | A |
| 6108748 | Ofek et al. | Aug 2000 | A |
| 6173374 | Heil et al. | Jan 2001 | B1 |
| 6195730 | West | Feb 2001 | B1 |
| 6219753 | Richardson | Apr 2001 | B1 |
| 6230239 | Sakaki et al. | May 2001 | B1 |
| 6240486 | Ofek et al. | May 2001 | B1 |
| 6240494 | Nagasawa et al. | May 2001 | B1 |
| 6247099 | Skazinski et al. | Jun 2001 | B1 |
| 6247103 | Kern et al. | Jun 2001 | B1 |
| 6356977 | Ofek et al. | Mar 2002 | B2 |
| 6374327 | Sakaki et al. | Apr 2002 | B2 |
| 6393537 | Kern et al. | May 2002 | B1 |
| 6393540 | Blumenau et al. | May 2002 | B1 |
| 6446141 | Nolan et al. | Sep 2002 | B1 |
| 6446175 | West et al. | Sep 2002 | B1 |
| 6457139 | D'Errico et al. | Sep 2002 | B1 |
| 6484173 | O'Hare et al. | Nov 2002 | B1 |
| 6490659 | McKean et al. | Dec 2002 | B1 |
| 6523096 | Sanada et al. | Feb 2003 | B2 |
| 6529976 | Fukuzawa et al. | Mar 2003 | B1 |
| 6540291 | Hoffman et al. | Apr 2003 | B2 |
| 6542961 | Matsunami et al. | Apr 2003 | B1 |
| 6553408 | Merrel et al. | Apr 2003 | B1 |
| 6598134 | Ofek et al. | Jul 2003 | B2 |
| 6640278 | Nolan et al. | Oct 2003 | B1 |
| 6647474 | Yanai et al. | Nov 2003 | B2 |
| 6647476 | Nagasawa et al. | Nov 2003 | B2 |
| 6654830 | Taylor et al. | Nov 2003 | B1 |
| 6654831 | Otterness et al. | Nov 2003 | B1 |
| 6675258 | Bramhall et al. | Jan 2004 | B1 |
| 6681303 | Watabe et al. | Jan 2004 | B1 |
| 6681339 | McKean et al. | Jan 2004 | B2 |
| 6684310 | Anzai et al. | Jan 2004 | B2 |
| 6708232 | Obara | Mar 2004 | B2 |
| 6728848 | Tamura et al. | Apr 2004 | B2 |
| 6745281 | Saegusa | Jun 2004 | B1 |
| 6775830 | Matsunami et al. | Aug 2004 | B1 |
| 6799255 | Blumenau | Sep 2004 | B1 |
| 6816948 | Kitamura et al. | Nov 2004 | B2 |
| 6826666 | Berkowitz et al. | Nov 2004 | B2 |
| 6826778 | Bopardikar et al. | Nov 2004 | B2 |
| 6836830 | Yamagami et al. | Dec 2004 | B1 |
| 6851020 | Matsumoto et al. | Feb 2005 | B2 |
| 6880062 | Ibrahim et al. | Apr 2005 | B1 |
| 6883064 | Yoshida et al. | Apr 2005 | B2 |
| 6976134 | Lolayekar et al. | Dec 2005 | B1 |
| 6981115 | Yamagami et al. | Dec 2005 | B2 |
| 7032131 | Lubbers et al. | Apr 2006 | B2 |
| 7082462 | Matsunami et al. | Jul 2006 | B1 |
| 7203730 | Meyer et al. | Apr 2007 | B1 |
| 7734591 | Mercier et al. | Jun 2010 | B1 |
| 20010050915 | O'Hare et al. | Dec 2001 | A1 |
| 20010052018 | Yokokura | Dec 2001 | A1 |
| 20020004857 | Arakawa et al. | Jan 2002 | A1 |
| 20020019908 | Reuter et al. | Feb 2002 | A1 |
| 20020019920 | Reuter et al. | Feb 2002 | A1 |
| 20020019922 | Reuter et al. | Feb 2002 | A1 |
| 20020019923 | Reuter et al. | Feb 2002 | A1 |
| 20020026558 | Reuter et al. | Feb 2002 | A1 |
| 20020029326 | Reuter et al. | Mar 2002 | A1 |
| 20020065864 | Hartsell et al. | May 2002 | A1 |
| 20020087544 | Selkirk et al. | Jul 2002 | A1 |
| 20020103889 | Markson et al. | Aug 2002 | A1 |
| 20020112113 | Karpoff | Aug 2002 | A1 |
| 20020133735 | McKean et al. | Sep 2002 | A1 |
| 20020156887 | Hashimoto | Oct 2002 | A1 |
| 20020156984 | Padovano | Oct 2002 | A1 |
| 20020156987 | Gajjar et al. | Oct 2002 | A1 |
| 20020174306 | Gajjar et al. | Nov 2002 | A1 |
| 20020178335 | Selkirk et al. | Nov 2002 | A1 |
| 20020188592 | Leonhardt et al. | Dec 2002 | A1 |
| 20020188711 | Meyer et al. | Dec 2002 | A1 |
| 20021094523 | Ulrich et al. | Dec 2002 | |
| 20030037071 | Harris et al. | Feb 2003 | A1 |
| 20030037127 | Shah et al. | Feb 2003 | A1 |
| 20030051109 | Cochran | Mar 2003 | A1 |
| 20030056038 | Cochran | Mar 2003 | A1 |
| 20030079018 | Lolayekar et al. | Apr 2003 | A1 |
| 20030079019 | Lolayekar et al. | Apr 2003 | A1 |
| 20030093541 | Lolayekar et al. | May 2003 | A1 |
| 20030093567 | Lolayekar et al. | May 2003 | A1 |
| 20030097607 | Bessire | May 2003 | A1 |
| 20030101228 | Busser et al. | May 2003 | A1 |
| 20030115432 | Biessener et al. | Jun 2003 | A1 |
| 20030126327 | Pesola et al. | Jul 2003 | A1 |
| 20030145168 | LeCrone et al. | Jul 2003 | A1 |
| 20030145169 | Nagasawa et al. | Jul 2003 | A1 |
| 20030158999 | Hauck et al. | Aug 2003 | A1 |
| 20030167419 | Yanai et al. | Sep 2003 | A1 |
| 20030182525 | O'Connell | Sep 2003 | A1 |
| 20030200387 | Urabe et al. | Oct 2003 | A1 |
| 20030204597 | Arakawa et al. | Oct 2003 | A1 |
| 20030212854 | Kitamura et al. | Nov 2003 | A1 |
| 20030212860 | Jiang et al. | Nov 2003 | A1 |
| 20040003022 | Garrison et al. | Jan 2004 | A1 |
| 20040049553 | Iwamura et al. | Mar 2004 | A1 |
| 20040054850 | Fisk et al. | Mar 2004 | A1 |
| 20040064610 | Fukuzawa et al. | Apr 2004 | A1 |
| 20040064641 | Kodama | Apr 2004 | A1 |
| 20040088417 | Bober et al. | May 2004 | A1 |
| 20040123180 | Soejima et al. | Jun 2004 | A1 |
| 20040143832 | Yamamoto et al. | Jul 2004 | A1 |
| 20040148443 | Achiwa | Jul 2004 | A1 |
| 20040172510 | Nagashima et al. | Sep 2004 | A1 |
| 20040230980 | Koyama et al. | Nov 2004 | A1 |
| 20040260875 | Murotani et al. | Dec 2004 | A1 |
| 20040260966 | Kaiya et al. | Dec 2004 | A1 |
| 20050010743 | Tremblay et al. | Jan 2005 | A1 |
| 20050081009 | Williams et al. | Apr 2005 | A1 |
| 20050240741 | Nagasawa et al. | Oct 2005 | A1 |
| 20070016754 | Testardi | Jan 2007 | A1 |
| Number | Date | Country |
|---|---|---|
| 0981091 | Feb 2000 | EP |
| 1130514 | Sep 2001 | EP |
| 1158386 | Nov 2001 | EP |
| 09-288547 | Apr 1997 | JP |
| 10-283272 | Oct 1998 | JP |
| 11-184641 | Jul 1999 | JP |
| 2000-242434 | Sep 2000 | JP |
| 2000293317 | Oct 2000 | JP |
| 2000-347811 | Dec 2000 | JP |
| 2001067187 | Mar 2001 | JP |
| 2001-075853 | Mar 2001 | JP |
| 2001-159979 | Jun 2001 | JP |
| 2001-312483 | Nov 2001 | JP |
| 2002157091 | May 2002 | JP |
| 2002230246 | Aug 2002 | JP |
| 97-09676 | Mar 1997 | WO |
| 03027886 | Apr 2003 | WO |
| 03030431 | Apr 2003 | WO |
| 03030449 | Apr 2003 | WO |
| Number | Date | Country | |
|---|---|---|---|
| 20090049241 A1 | Feb 2009 | US |
| Number | Date | Country | |
|---|---|---|---|
| Parent | 11338796 | Jan 2006 | US |
| Child | 12258514 | US | |
| Parent | 10424563 | Apr 2003 | US |
| Child | 11338796 | US |
