The present invention relates to a disk array system and a CABLE information setting method in the disk array system. More particularly, the present invention relates to a setting method of CABLE information when the type of the cable is different depending on the section of the transmission path.
When the data transmission rate of a storage interface in a disk array system increases, the signal frequency also increases. As a result, the influence of the attenuation and reflection of the signal in the transmission path increases, so that it tends to be difficult to maintain the signal quality. This tendency is particularly significant for the SAS 2.0 standard in which the data transmission rate is 6 Gbps. There is a technology for maintaining the signal quality by setting parameters, such as the amplitude value (the proper value of the amplitude) of the output signal of a transmission LSI (large Scale Integration) as well as the emphasis (correction of the frequency characteristics, in particular, in the high frequency region), to appropriate values. The appropriate values of the parameters are different depending on the characteristics of the transmission path.
There are a plurality of transmission paths that are connected by a storage interface. For example, there is a transmission path that connects an EXP (Expander, which has a function of allowing connection of a larger number of end devices than the number of ports such as SAS Controllers, and a function of amplifying the signal attenuated in the transmission) mounted on an SSW (SAS-Switch) substrate, and a HDD (Hard Disk Drive) to each other. Another example is a transmission path that connects EXPs mounted on different PCBs (Printed Circuit Boards) by a CC (Copper Cable). With respect to the path for connecting the EXP and the HDD, there are different transmission paths for the number of HDDs that can be mounted on one substrate. Also in the CC connection, there are a plurality of transmission paths within the CC. Further, even in the same transmission path, the characteristics of the transmission path are different depending on the cable length. Patent Documents 1 and 2 are known to support these different transmission paths.
Patent Document 1 describes a technology for reading parameters from mounted drives to set the parameters corresponding to the mounting position of each drive.
Patent Document 2 describes a technology for identifying the physical positions of EXPs, identifying the cable length of the CC between the EXPs, and setting the appropriate parameters.
Further, Patent Document 3 is also known as a technology for automatically correcting the loss of the cable.
Patent Document 1: US Patent Application Publication No. 2011/0252195
Patent Document 2: U.S. Pat. No. 8,190,790
Patent Document 3: Japanese Patent Laid-Open Publication No. 2002-124893
Cable types supported by the SAS 2.0 standard and by the SAS 2.1 standard and subsequent standards are shown in
When both CC and AOC are present in a transmission path of a disk array system, a transmission error may occur unless appropriate parameters are not set for each of the CC and the AOC. In particular, the AOC may produce a protocol error if an appropriate protocol setting is not made. Thus, it is necessary to identify the CC and the AOC. In the disk array system, a plurality of EXPs are connected in a daisy chain (connection in a bucket-brigade manner) through a plurality of cables, so that it will take time for setting by acquiring CABLE information from all the cables.
Accordingly, an object of the present invention is to solve the above problem.
In order to solve the above problem, according to the present invention, there is provided a disk array system in which an EXP performs the following operations to connect a plurality of disks in a daisy chain fashion through a plurality of cables including CC and AOC.
The operations include accessing a cable built-in MEM, determining whether the cable is CC or AOC from the acquired CABLE information, and setting the appropriate protocol and parameters based on the determination result. Further, the operations also include identifying the EXP that requires a connection between cases based on the SAS address, acquiring the CABLE information of the cable to be connected to the particular EXP, and making the appropriate setting.
According to the present invention, even if CC and AOC are mixed in a transmission path of a disk array system, it is possible to set the appropriate parameters for the CC and the AOC to the EXP.
When AOC is used for a transmission path of a disk array system for implementing the present invention, it is necessary for the AOC connection to make the appropriate protocol setting (the protocol corresponding to the data transmission method, in particular, the idle method). For example, the SAS standard has the status (D.C. Idle) in which the electrical signal level is 0 (direct current). When the cable is CC, the D.C. Idle can be transmitted as it is. However, when the cable is AOC, the signal of level 0 may not be transmitted. Thus, instead of D.C. Idle, it is necessary to generate an alternating current signal with a specific wave pattern and transmit the generated AC signal.
Previously until the SAS 2.0 standard, the protocol includes the signal only based on the CC connection. However, in general, the AOC connection may not be established with this protocol. After the SAS 2.1 standard, the protocol is specified by the assumption of the AOC connection, so that it is possible to set the particular protocol to be used for the AOC connection.
The AOC connection requires an appropriate parameter setting (setting of the proper value of the amplitude of the output signal, as well as the emphasis). The characteristics of the transmission path are different in the CC connection and the AOC connection. Thus, it is possible to improve the signal quality by setting appropriate parameters for each of the connections.
The difference in the transmission path between the CC connection and the AOC connection is shown in
Even if the length of the cable is short, the attenuation of the CC connection is greater than the attenuation of the AOC. In order to correct such attenuation, it is necessary to appropriately set the values of the transmission signal parameters (the proper value of the amplitude, the emphasis, and the like) to the EXP. If the CC connection and the AOC connection are set to the same parameters, a signal transmission error may occur. The length of the transmission path between the EXP and the AOC on the transmission side SSW substrate is short, so that the signal is over corrected in the reception part of the EOC.
As an example,
The configuration of the disk array system for implementing the present invention is shown in
The disk array system includes a DKC (Disk Controller) part 41 for receiving a writing/reading request from a host computer (not shown) to a disk and exchanging data between the host computer and the disk, and a DKU (Disk Unit) part 42 having a plurality of disks. The present invention can be applied not only to the disk shown in
The DKC part 41 includes: a CHA (Channel Adopter) 413 for controlling the interface with the host computer; a plurality of CMs (Cache Memories) 415 for temporarily storing data written to the disk or data read from the disk, as well as various control information for controlling the disk array system, and the like; a plurality of MPs (Micro Processors) 412 for controlling the transmission and reception of requests and data between the host computer and each of the disks; a plurality of CTLs (Controller Boards) 416 for controlling the transmission and reception of requests and data with a plurality of drive boxes 420 each including at least one disk; a SW (Switch) 414 for connecting MP 412, CHA 413, CM 415, and CTL 416 to each other; and a plurality of management terminals 411 by which the user manages the operations of the individual MPs 412. It is redundant according to the multiplicity of the process. An input device, such as a keyboard and a mouse, as well as a management terminal device having a display are provided outside the DKC part 41. A management terminal 411 shown in
In the DKU part 42, a plurality of drive boxes 420 each including at least one auxiliary memory device (disk) are connected in a daisy chain fashion. One drive box 420 includes two EXPs 421, which correspond to two access paths to a plurality of auxiliary memory devices (disks) 423.
An upstream cable 427 and a downstream cable 429 are connected to the SSW 424. Each of the transmission and reception terminals (connectors) of the cable includes MEMs (memories) 426 and 428. The SSW 424 has the EXP 421, and a MEM (Memory) 425 which is used for control and connected to the EXP 421. Note that when the cable is AOC, as shown in
In the disk array system shown in
Each drive box 420 is assigned an address including a number for identifying the CTL-EXP path as well as a number sequentially assigned from the upper stream to the lower stream, with the disk access path of a plurality of disks connected in a daisy chain fashion. Thus, the MP 412 or the CTL 416 issues a request including this address to each drive box 420 to acquire specific information. Further, each drive box 420 transmits the particular address and the specific information to the MP 412 or the CTL 416. In this way, the MP 412 or the CTL 416 can identify the source of the received information.
In the range of the storage interface to be used, the cable connection is required in the range of CTL-EXP and the range of EXP-EXP.
An EXP 421a close to the CTL 416 is defined as an upstream EXP (U-EXP), and an EXP 421b connected through the cable 427 is defined as a downstream EXP (L-EXP). The connection between CTL and EXP is made by only replacing the upstream EXP (U-EXP) of the connection between EXP and EXP, with the CTL 416. Thus, there is no change in the cable connection configuration. The EXP (U-EXP) 421a and the CTL 416 acquire the CABLE information by accessing the MEM (U-CB-MEM) 426a on the upstream side of the connected cable 427.
In the following, the transmission path is referred to as “cable” and the name of the information is referred to as “CABLE information”.
The EXP or the CTL acquires the CABLE information from the upstream MEM (U-CB-MEM) 426a of the cable 427, and sets the acquired information to the MEM (U-EX-MEM) 425a of the upstream EXP and to the MEM (L-EX-MEM) 425b of the downstream EXP, respectively. It is also possible that the same process is performed on the upstream side, while on the downstream side, the upstream EXP transmits an information acquisition request to the downstream EXP, acquires the CABLE information from the MEM (L-CB-MEM) 426b on the downstream side of the cable 427, and sets the acquired CABLE information to the MEM (L-EX-MEM) 425b of the downstream EXP.
The CABLE information including the cable type and the setting information (protocols and parameters) are stored in advance in the built-in MEM (Memory, for example, flash memory or ROM) included in each of the transmission and reception terminals (connectors) on the upstream and downstream sides of the cable 427.
When the cable 427 is CC, the electrical signal is directly transmitted to the cable 427. When the cable 427 is AOC, the electrical signal from the transmission side EXP 421a is converted to an optical signal by the EOC 430a. Then, the optical signal is transmitted to the cable 427. On the reception side, the optical signal is converted to an electrical signal by the EOC 430b. Then the converted electrical signal is input to the EXP 421b.
Exchange of information, as well as transmission and reception of request and notification messages will be described with reference to
The CABLE information includes the cable type and the setting information (the proper protocol and parameters). In the following process procedure, it is assumed that these pieces of information are acquired by separate procedures.
Before the acquisition and setting of the CABLE information, the disk array system sets the connection to the settings (for example, the AOC protocol setting, and the setting of the signal rate lower than the rate of normal operation) to be able to transmit signals, without performing the optimal protocol setting and parameter setting.
(A) The process of identifying the cable type will be described with reference to
(1) The upstream EXP (U-EXP) 421a receives a CABLE information acquisition request from the CTL 416 (or the MP 412).
(2) The upstream EXP (U-EXP) 421a reads the cable type included in the CABLE information stored in the MEM (U-CB-MEM) 426a on the upstream side of the cable.
(3) The upstream EXP (U-EXP) 421a transmits the read cable type to the CTL 416.
(4) The upstream EXP (U-EXP) 421a stores the cable type included in the CABLE information in the MEM (U-EX-MEM) 425a of the upstream EXP.
(5) The upstream EXP (U-EXP) 421a also transmits the cable type included in the CABLE information to the downstream EXP (L-EXP) 421b.
(6) The downstream EXP (L-EXP) 421b stores the cable type included in the CABLE information received from the upstream EXP (U-EXP) 421a, in the MEM (L-EX-MEM) 425b of the downstream EXP.
(The above (5)-(6) can be replaced by the following alternative procedure of (5)′-(6)′ using the information stored in the MEM (L-CB-MEM) 426b on the downstream side of the cable.)
(5)′ The downstream EXP (L-EXP) 421b receives the CABLE information acquisition request from the upstream EXP (U-EXP) 421a.
(6)′ The downstream EXP (L-EXP) 421b reads the cable type included in the CABLE information that is stored in the MEM (L-CB-MEM) 426b on the downstream side of the cable, and stores the read cable type in the MEM (L-EX-MEM) 425b of the downstream EXP.
(7) The CTL 416 stores the cable type included in the CABLE information received from the upstream EXP (U-EXP) 421a.
(8) The CTL 416 identifies the type of the cable (CC or AOC) based on the address showing the cable type included in the CABLE information.
(B) The setting information acquisition process will be described with reference to
(1) The upstream EXP (U-EXP) 421a receives the request to acquire the setting information (the proper protocol and parameters) corresponding to the cable type, from the CTL 416.
(2) The upstream EXP (U-EXP) 421a reads the setting information included in the CABLE information stored in the MEM (U-CB-MEM) 426a on the upstream side of the cable.
(3) The upstream EXP (U-EXP) 421a stores the setting information included in the CABLE information in the MEM (U-EX-MEM) 425a of the upstream EXP.
(4) The upstream EXP (U-EXP) 421a transmits the setting information included in the CABLE information to the CTL 416.
(5) The upstream EXP (U-EXP) 421a transmits the setting information included in the CABLE information to the downstream EXP (L-EXP) 421b.
(6) The downstream EXP (L-EXP) 421b stores the setting information included in the CABLE information received from the upstream EXP (U-EXP) 421a, in the MEM (L-EX-MEM) 425b of the downstream EXP.
(The above (5)-(6) can be replaced by the following alternative procedure of (5)′-(5)″-(6)′-(6)″ using the information stored in the MEM (L-CB-MEM) 426b on the downstream side of the cable.)
(5)′ The upstream EXP (U-EXP) 421a transmits a setting information acquisition request to the downstream EXP (L-EXP) 421b.
(5)″ The downstream EXP (L-EXP) 421b receives the setting information acquisition request from the upstream EXP (U-EXP) 421a.
(6)′ The downstream EXP (L-EXP) 421b reads the setting information included in the CABLE information stored in the MEM (L-CB-MEM) 426b on the downstream side of the cable.
(6)″ The downstream EXP (L-EXP) 421b stores the setting information include in the CABLE information, in the MEM (L-EX-MEM) 425b of the downstream EXP.
(7) The downstream EXP (L-EXP) 421b notifies the upstream EXP (U-EXP) 421a that the setting information acquisition has been completed.
(8) In response to the notification of the completion of the setting information acquisition from the downstream EXP (L-EXP) 421b, the upstream EXP (U-EXP) 421a reports to the CTL 416 that the setting information acquisition has been completed by the EXP 421 on the upstream and downstream sides.
(9) In response to the notification of the completion of the setting information acquisition by the upstream and downstream EXPs 421 from the upstream EXP (U-EXP) 421a, the CTL 416 stores the received setting information.
(C) The process of setting the setting information will be described with reference to
(1) The upstream EXP (U-EXP) 421a receives a request from the CTL 416 to set the setting information corresponding to the cable type.
(2) The upstream EXP (U-EXP) 421a reads the setting information from the CABLE information stored in the MEM (U-EX-MEM) 425a of the upstream EXP.
(3) The upstream EXP (U-EXP) 421a sets the setting information to the upstream EXP (itself) (U-EXP) 421a.
(4) The upstream EXP (U-EXP) 421a transmits the setting information setting request to the downstream EXP (L-EXP) 421b.
(5) The downstream EXP (L-EXP) 421b receives the setting information setting request from the upstream EXP (U-EXP) 421a.
(6) The downstream EXP (L-EXP) 421b sets the setting information stored in the MEM (L-EX-MEM) 425b of the downstream EXP, in the downstream EXP (itself) (L-EXP) 421b.
(7) The downstream EXP (L-EXP) 421b notifies the upstream EXP (U-EXP) 421a of the completion of the setting information setting.
(8) In response to the notification of the completion of the setting information setting from the downstream EXP (L-EXP) 421b, the upstream EXP (U-EXP) 421a reports to the CTL 416 that the setting information setting has been completed by the EXP 421 on the upstream and downstream sides.
(9) In response to the notification of the completion of the setting information setting by the upstream and downstream EXPs 421 from the upstream EXP (U-EXP) 421a, the CTL 416 stores the received setting completion report.
After the completion of the acquisition and setting of the CABLE information, the disk array system sets the connection to a high transmission rate for normal operation.
In the above exemplary embodiment, the CABLE information is stored in the MEM (U-CB-MEM) on the upstream side of the cable and in the MEM (L-CB-MEM) on the downstream side of the cable. However, if the amount of data is large, not all the setting information may be stored in the MEM (U-CB-MEM) 426 included in the cable 427. In this case, only the information of the type of the cable is stored in the CABLE information, and the setting information (the protocol and parameters) corresponding to the type is stored in the MP 412 or the CTL 416. In this way, the MP 412 or the CTL 416 can identify the type of the cable to set the setting information corresponding to the identified cable type, to the EXP 421.
In
The upstream EXP (U-EXP) 421a receives the CABLE information acquisition request from the MP 412 through the CTL 416. Then, the upstream EXP (U-EXP) 421a accesses the MEM (U-CB-MEM) 426a on the upstream side of the cable within the CABLE by using an I2C (Inter-Integrated Circuit) bus (701 to 703), and acquires the CABLE information (704).
The CABLE information is transmitted to the MP 412 through the EXP 421 and the CTL 416 (705 to 707). Then, the MP 412 stores the CABLE information in a CABLE information storage table (708). Then, the MP 412 identifies the type of the particular cable based on the information of cable type included in the CABLE information.
An example of the CABLE information is shown in
The upstream EXP (U-EXP) 421 receives the setting information acquisition request from the MP 412 through the CTL 416. Then, the upstream EXP (U-EXP) 421 accesses the MEM (U-CB-MEM) 426a on the upstream side of the cable within the CABLE by using the I2C (Inter-Integrated Circuit) bus (901 to 903). Then, the upstream EXP (U-EXP) 421 acquires the setting information included in the CABLE information (904).
The setting information is transmitted to the MP 412 through the EXP 421 and the CTL 416 (905 to 907). The MP 412 stores the setting information in the CABLE information storage table (908).
In Step 905, the protocol setting information and parameter setting information, which are appropriate for the cable type included in the CABLE information, are acquired from the MEM (U-EX-MEM) 425a of the upstream EXP on the upstream SSW 424. Further, it is also possible to store the setting information in the user area of the MEM (U-CB-MEM) 426a on the upstream side of the cable within the CABLE in advance, and to access the MEM 426 within the CABLE to acquire the setting information.
An example of the setting information is shown in
The acquired CABLE information and setting information, as well as the setting completion information described below, are stored in the CABLE information storage table within the MP 412 (or the CTL 416), which is shown in
Note that, when each of the CTL-EXP paths includes two paths as shown in
The M-th EXP 421, which is the last stage of one CTL-EXP path, for example, EXP-0(M) 421-1b shown in
In
In the disk array system, there are a plurality of CTLs 416. Thus, the disk array system acquires and sets the CABLE information for one CTL-EXP path based on the CABLE information storage table shown in
The disk array system acquires and sets the CABLE information to be connected to the CTL 416 for one CTL-EXP path based on the CABLE information storage table shown in
After the setting status completion has been confirmed, the CC connection part and the AOC connection part are operated with the appropriate settings.
Note that in the setting information setting, the protocol setting specifies the protocol corresponding to the data transmission method, in particular, the idle method, and the parameter setting includes the proper value of the signal amplitude, the emphasis, or other settings.
According to the first embodiment, even if CC and AOC are mixed in the transmission path of the disk array system, it is possible to set the appropriate parameters for the CC and the AOC to the EXP.
Further, the present invention is not limited to the SAS standards and cable types shown in
In the second embodiment, a description will be given of an example of limiting the target part of the cable type determination operation, in view of the configuration of the disk connection in the disk array system. According to the present embodiment, it is possible to reduce the process time associated with the determination operation by limiting the target part of the cable type determination operation. The second embodiment can be combined with the first embodiment.
In the DKU part 42 of the disk array system, a plurality of EXPs 421 are connected as shown in
For example, as shown in
The CABLE information acquisition necessity determination table shown in
As an example of the method of determining the information acquisition necessity in
Next, the flow of the information acquisition necessity determination from the SAS address is shown in
The disk array system issues a CABLE information acquisition request to the EXP 421 within the drive box 420a provided in each frame 140 by the AOC protocol, and acquires the SAS address shown in
In order to acquire all the SAS addresses, it is necessary to access the EXPs 421 from the first to the last stages. Thus, when the SAS addresses are acquired, the disk array system sets all the cable-to-cable connections to the settings (for example, the AOC protocol setting, and the setting of the signal rate lower than the rate of normal operation) to be able to transmit signals, without performing the optimal protocol setting and parameter setting.
In general, AOC does not allow DC (direct current) transmission while CC allows DC transmission. On the other hand, the low rate AOC protocol can be applied not only to AOC but also to CC, but the low rate CC protocol may not be applied to AOC for the reasons described above. Thus, like the SAS address acquisition, when it is unknown whether the cable is CC or AOC and when the transmission process can be performed with a low rate, the AOC protocol is used to be able to perform the transmission process regardless of whether the cable is CC or AOC.
The AOC protocol is different from the CC protocol in that the part (D.C. Idle) of the DC (Direct Current) component used in the initialization sequence is replaced by a specific signal pattern. The CC connection can be used when both transmission and reception LSIs are set to the AOC protocol with the transmission characteristics that can transmit the signal pattern of the AOC protocol.
When the information acquisition necessity is determined, the part requiring no information acquisition uses the CC connection, so that the setting is returned to the CC setting. Then, the disk array system acquires the information for the part requiring the information acquisition and makes the appropriate settings.
In the third embodiment, a description will be given of an example of automatic switching when the CABLE information has not been acquired. According to the present embodiment, it is possible to make the appropriate setting for the cable without acquiring the CABLE information.
It will show an example of performing the appropriate setting when the CABLE information has not been acquired. The expected value of the number of connected stages of the EXP 421 of the DKU part 42 is stored on the disk array system in advance. The “expected value” is a value that is determined by the number of drive boxes 420 managed by the disk array system.
After power on the disk array system, the MP 412 or the CTL 416 performs the initialization sequence by the CC protocol and parameters.
In the initialization sequence, the number of connected stages of the EXP 421 can be found, as shown in
When it is determined that the number of connected stages of the EXP 421 is different from the expected value, it is assumed that AOC is connected to the EXP 421 of the last stage that can be accessed. The MP 412 or the CTL 416 changes the setting of the part ranging from the EXP 421 of the last accessible stage to the subsequent stage into the AOC protocol and parameters, and performs again the initialization sequence. The same process is repeated several times until the number of connected stages of the EXP 421 is equal to the expected value of the number of connected stages of the EXP 421. The MP 412 or the CTL 416 determines the threshold by the number of retries of the initialization sequence or by the retry time. If the value exceeds the threshold, the MP 412 or the CTL 416 notifies that the initialization sequence is not done, on the management terminal. This flow is shown in
The MP 412 or the CTL 416 performs the initialization sequence of the SAS address acquisition shown in
In the fourth embodiment, a description will be given of an example of using the method of limiting the target part of the cable determination operation according to the second embodiment, as well as the automatic switching when the CABLE information has not been acquired according to the third embodiment.
After the information acquisition necessity is determined by the method of the second embodiment, the disk array system makes the CC setting or the AOC setting by the automatic switching of the third embodiment, instead of performing the CABLE information acquisition with respect to the part requiring the information acquisition. The connection status between the frames can be checked by the method described in the third embodiment.
According to the fourth embodiment, it is possible to reduce the time for the cable determination operation and to automate the process for the part requiring information acquisition.
In the fifth embodiment, an operation example of the SAS 2.0 based CTL/EXP and the SAS 2.0 compliant AOC will be described. According to the present embodiment, it is possible to set the appropriate setting information according to the cable type based on the product part number of the cable that the user knows.
The SAS 2.0 based CTL/EXP has no AOC protocol setting. Thus, when a general AOC is connected, a protocol violation occurs. When the SAS 2.0 compliant AOC is used, the SAS 2.0 based CTL/EXP can be connected by AOC. The information of which standard corresponds to the particular AOC according to the vender and the part number, is stored in the MP 412 or the CTL 415, as a table of the correspondence between the AOC products and the standards as shown in
The disk array system acquires the CABLE information connected to the SAS 2.0 based CTL/EXP. When it is identified as the SAS 2.0 compliant AOC, the only parameters are changed to the AOC parameters, while the CC protocol (SAS 2.0 based) setting as the protocol setting is unchanged. When the CABLE information is not the SAS 2.0 compliant AOC, the disk array system instructs to replace with the appropriate AOC on the management terminal.
The MP 412 or the CTL 416 issues a CABLE information acquisition request to each EXP 421 by the CC protocol, and acquires the CABLE information to establish the CTL/EXP connection shown in
Filing Document | Filing Date | Country | Kind |
---|---|---|---|
PCT/JP2013/050861 | 1/17/2013 | WO | 00 |