Reliability of crossbar switches in an information processing system

Abstract

An information processing apparatus includes a crossbar switch having a plurality of switching circuits for data transfer; connection lines having address data transfer paths of m-bit unit connected to each of the input/output ports of the switching circuits, control signal transfer paths of m-bit unit connected to each of the input/output ports of the control circuits and back-up transfer paths of m-bit unit connected to each of the input/output ports of the back-up circuits; and transfer path processing circuit connected correspondingly to the connection lines constructed by the n-bit provided on each of the processing units, monitored transfer of data and control signal between the processing units through the switching circuit and the control circuit in the crossbar switch, and detected a failure of at least the switching circuit and the control circuit to thereby change the connection of at least one of the failed switching circuit and control circuit to a connection of the back-up circuit.

Description

BACKGROUND OF THE INVENTION

The invention relates to an information processing apparatus and, more particularly, to a data transfer system in various computers such as a personal computer, workstation, server apparatus, office computer, minicomputer, main frame, super computer, and the like. Especially, the invention relates to an information processing apparatus by a crossbar switch in a multiprocessor apparatus.

In recent years, multiprocessor construction has been widespread in an upper apparatus such as personal computer or workstation, a server apparatus, and the like. It is an important subject to improve the performance of a data transfer system for connecting among a plurality of CPUs (Central Processing Units), main storages, and I/O (Input/Output) devices.

As one construction of such data transfer systems, there is a construction by a crossbar switch connection. For example, this construction is disclosed in "The Advanced System Architecture", Sun World magazine, Vol. January, pp 29-32, 1996.

Generally, in the construction by the crossbar switch, even if any one of the modules which are connected to the crossbar switch fails, the other portions of the system can continue the operation. However, when at least a part of the crossbar switch itself fails, the whole system shuts down. Therefore, in order to improve the reliability of the whole system, it is necessary to duplicate the crossbar switch.

In many cases, the data transfer system has a construction by a bus connection. In this case, although failure of the bus itself is rare because it doesn't need any device such as an LSI (Large-Scale Integrated Circuit) or the like, there is a possibility such that the whole system is shut down when each module connected to the bus fails. Therefore, the bus is duplicated in order to improve the reliability of the system and such a method has been disclosed in, for example, JP-A-6-51910.

SUMMARY OF THE INVENTION

In a construction using a crossbar switch, it is an object of the invention to provide an information processing apparatus in which the reliability of a system is improved to a one point failure tolerance level that is equivalent to the duplication of the entire crossbar switch or the duplication of the bus, namely, to a level at which the system can endure a failure of an arbitrary LSI while minimizing any increase in costs.

To accomplish the above object, according to the invention, in an information processing apparatus comprising a plurality of apparatus units such as a CPU, memory, I/O device, and the like, there is provided a data transfer system for transferring data among the apparatus units through a crossbar switch which has a plurality of input/output ports connected to the apparatus units and is constructed by a plurality of LSIs, wherein each of the I/O ports of the crossbar switch includes an address data transfer path width of or more, each of the address data transfer paths each having the n-bit width is divided into slices of m-bit units, the slices are individually connected to the plurality of LSIs, the address data transfer path includes a redundant slice, and the plurality of LSIs are constructed so as to include an LSI to which the redundant slice can be connected.

Each of the I/O ports of the crossbar switch includes a signal transfer path for controlling the address data transfer path and an LSI to which the signal transfer path for controlling is connected is provided, thereby duplicating the LSI.

The system has means for, when a fault occurs in an arbitrary one of the plural LSIs, switching the connection between each slice connected to the fault LSI and the apparatus units to a non-connection and for reconstructing the address data transfer path by using the slices connected to the non-fault LSIs and the redundant slice without using the fault LSI, the operation as a crossbar switch is continued or restarted, and parts exchange of the fault LSI can be performed.

As means for reconstructing the address data transfer path, the apparatus units connected to the I/O ports of the crossbar switch have a selecting circuit for selecting the transfer path in which each of the slices is set to a unit on the basis of fault information regarding the LSI.

At the time of the parts exchange, a reducing operation to narrow a width an address data transfer path is executed.

When a fault occurs in any one of the LSIs, the selecting circuit stops the selection of the slice transfer path connected to the fault LSI, selects the slice transfer path adjacent to the slice transfer path whose selection is stopped in place of such a slice transfer path, and sequentially shifts the slice transfer path one by one after that, thereby selecting the slice transfer path.

The selecting circuit has 2-to-1 selectors of the number corresponding to only the number of slice transfer paths and the slice transfer paths are sequentially connected to outputs of the 2-to-1 selectors.

A first output of the apparatus units is connected to an input of the first 2-to-1 selector, the first output and a second output of the apparatus units are connected to an input of the second 2-to-1 selector, the second output and a third output of the apparatus units are connected to an input of the third 2-to-1 selector, and a last output of the apparatus units is likewise connected to an input of the last 2-to-1 selector, respectively. When there is no fault, the last 2-to-1 selector doesn't supply any output to the slice transfer paths and the other 2-to-1 selectors selects the output of the former number from the apparatus unit and supplies the selected output to the slice transfer path.

When there is a fault, the 2-to-1 selector to which the slice transfer path connected to the fault LSI is connected doesn't generate any output and the 2-to-1 selector connected to the slice transfer path subsequent to the slice transfer path connected to the fault LSI selects the output of the latter number from the apparatus unit and supplies the selected output to the slice transfer path.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a constructional diagram for system hardware of a multiprocessor system to which the invention is applied;

FIG. 2 is a constructional diagram of another system hardware for a multiprocessor system to which the invention is applied;

FIG. 3 is a constructional diagram of LSIs of a crossbar switch according to the invention;

FIGS. 4A and 4B are constructional diagrams of a line connection between the crossbar switch and the other system component elements in the multiprocessor system according to the invention;

FIGS. 5A, 5B, and 5C are internal constructional diagrams of transfer path connection LSIs to the crossbar switch from the other system component elements in the multiprocessor system according to the invention;

FIG. 6 is a constructional diagram of LSI input/output signals of the crossbar switch according to the invention;

FIG. 7 is another LSI constructional diagram of the crossbar switch according to the invention;

FIG. 8 is a constructional diagram of a line connection corresponding to FIG. 7 between the crossbar switch and the other system component elements in the multiprocessor system according to the invention;

FIG. 9 is an internal constructional diagram corresponding to FIG. 7 of a connection interface to the crossbar switch from the other system component elements in the multiprocessor system according to the invention;

FIG. 10 is a diagram showing a construction in which a service processor board is added to the system of FIG. 2; and

FIG. 11 is a diagram showing a construction to which a logic for connecting the service processor board is added to a switch connection LSI in FIG. 5.

DESCRIPTION OF THE PREFERRED EMBODIMENTS

Embodiments of the present invention will now be described hereinbelow with reference to the drawings.

FIGS. 1 and 2 are constructional diagrams each showing system hardware of a multiprocessor system to which the invention is applied. FIGS. 3 and 7 are diagrams each showing an LSI construction of a crossbar switch according to the invention. FIGS. 4 and 8 are constructional diagrams each showing a line connection between the crossbar switches and the other system component elements in the multiprocessor system according to the invention. FIGS. 5 and 9 are diagrams each showing an internal construction of a connection interface to the crossbar switch from the other system component elements in the multiprocessor system according to the invention. FIG. 6 is a constructional diagram of LSI input/output signals of the crossbar switch according to the invention.

A system construction will be first described with reference to FIGS. 1 and 2.

FIG. 1 is a system hardware constructional diagram of the multiprocessor system to which the invention is applied.

In FIG. 1, reference numeral 11 denotes a plurality of processor boards; 12 a plurality of memory boards; 13 a plurality of I/O connection boards; and 14 a crossbar switch.

In FIG. 1, eight processor boards, four memory boards, and four I/O connection boards are connected to the crossbar switch of 16 ports, thereby constructing the multiprocessor system.

A plurality of CPUs 111 are installed on the processor board 11. A switch connection LSI 112 controls the plurality of CPUs 111 and a common cache memory 113 and is connected to the crossbar switch 14 through a connection interface 114.

In FIG. 1, although the CPUs 111 and switch connection LSI 112 are connected by a plurality of CPU buses 115, they can be also connected by one bus or switch. As for the common cache memory 113, a system which is not described in the embodiment and a system of only a cache tag or the like is also considered.

A main memory 121 is installed on the memory board 12. A switch connection LSI 122 controls the main memory 121 via a driver 123 and is connected to the crossbar switch 14 through a connection interface 124.

A plurality of I/O connection interfaces 131 are installed on the I/O connection board 13. An I/O switch connection LSI 132 controls the I/O connection interfaces 131 via a driver 133 and is connected to the crossbar switch 14 through a connection interface 134.

In FIG. 1, the crossbar switch 14 has an address data transfer path of an 8-byte width and another transfer path for transmitting a function control signal as connection interfaces with respect to each of the sixteen ports. The 16 ports are divided into eight ports for the processor boards 11, four ports for the I/O connection boards 13, and four ports for the memory boards 12.

The address data transfer path having the 8-byte width is divided into slices (2-byte) on a 2-byte (16 bits) unit basis and is connected by five switching LSIs 141 by a 5-slice construction in which one back-up slice is added.

A function control signal is connected by function control LSIs 142. The function control LSIs 142 have been duplicated and are made up of two LSIs.

Although the crossbar switch 14 is made up of total of seven LSIs, the active LSIs which operate in the normal state among them are seven LSIs comprising four switching LSIs 141 and one function control LSI 142. Two LSIs comprising one switching LSI 141 and one function control LSI 142 are back-up LSIs.

Although ten LSIs are necessary to duplicate the whole crossbar switch 14, the crossbar switch is made up of five LSIs in the form of the invention, so that costs are reduced. A width of address data transfer path and the contents of the transfer path of the function control signal can also be made different in dependence on each of the three kinds of connection interfaces 114, 124, and 134.

FIG. 2 is another system hardware constructional diagram of a multiprocessor system to which the invention is applied.

In FIG. 2, reference numeral 21 denotes a plurality of processor memory boards and 14 indicates the crossbar switch.

In FIG. 2, sixteen processor memory boards 21 are connected to the crossbar switch 14 of 16 ports, thereby constructing the multiprocessor system. The processor memory boards 21 have a construction similar to the ordinary multiprocessor.

A plurality of CPUs 211, a multiprocessor control chip set 216, a main memory 217, and an I/O connection interface 218 are installed on the processor memory board 21 and have a construction similar to the ordinary multiprocessor.

Further, a switch connection LSI 212 controls the plurality of CPUs 211 and a common cache memory 213 and is connected to the crossbar switch 14 via a connection interface 214. In FIG. 2, the crossbar switch 14 has substantially the same construction as in FIG. 1.

The constructions of FIGS. 1 and 2 are similar to the well-known system constructions except the crossbar switch 14 and the connection interface 214 to the crossbar switch 14.

The construction and operation of the crossbar switch 14 according to the invention will now be described with reference to FIGS. 3 to 6.

FIG. 3 is an LSI constructional diagram of the crossbar switch 14 in FIG. 1.

As mentioned above, the crossbar switch 14 is made up of seven LSIs comprising five switching LSIs 141 and two function control LSIs 142. In FIG. 3, seven LSIs are installed on each of the seven package boards and their parts exchanges can be performed one by one.

In FIG. 3, explanation will now be given by allocating reference numerals to the five switching LSIs 141 and two function control LSIs 142, respectively.

A construction shown at (1) is a construction in the normal operating mode. Among five switching LSIs 31 to 35, four switching LSIs 31 to 34 take charge of every two bytes of the address data transfer path of eight bytes, respectively, and the switching LSI 35 is a back-up LSI. The function control LSIs 142 have been duplicated, a function control LSI 36 is an active LSI, and a function control LSI 37 is a back-up LSI.

Among the above LSIs, a construction in the case where one of the switching LSIs 31 to 34 fails is shown at (2) and a construction in the case where one function control LSI 36 fails is shown at (3).

The construction shown at (2) is a construction in the case where the switching LSI 33 fails. The switching LSI 34 takes charge of the function of the switching LSI 33 and the back-up switching LSI 35 takes charge of the function of the switching LSI 34, thereby reconstructing the data transfer path so as not to use the failed LSI. With respect to the dividing order of the data transfer path in this instance, the data transfer path is reconstructed by a method of excluding the failed LSI and sequentially shifting the dividing order.

The construction shown at (3) is a construction in the case where the function control LSI 36 fails and the function control LSI 37 serving as a back-up LSI in the duplicated configuration is switched to the active LSI.

According to the invention as mentioned above, even if one arbitrary LSI of the crossbar switch 14 fails, the operation can be continued or restarted without deteriorating the performance as a crossbar switch 14.

FIGS. 4A and 4B show line connection constructions between the crossbar switch 14 and the switch connection LSIs 112, 122, and 132 in order to enable the above reconstruction. In FIGS. 4A and 4B, since the switch connection LSIs 112, 122, and 132 which have already been described in FIG. 1 and the switch connection LSI 212 described in FIG. 2 have the common construction, those transfer path connection LSIs are represented by reference numeral 41.

Reference numeral 42 denotes an internal logic circuit in the transfer path connection LSI 41; 44 an input/output interface circuit in the transfer path connection LSI 41; 45 internal connection paths between the internal logic circuit 42 and input/output interface circuit 44; 43 a selecting circuit; 46 connection lines between the transfer path connection LSI 41 and crossbar switch 14; and 31 to 37 the seven switching LSIs of the crossbar switch 14 shown in FIG. 3.

FIG. 4A shows the connection in the normal operating mode.

Although the transfer path connection LSI 41 has the input/output interface circuit 44 and connection lines 46 which are connected to all of the seven switching LSIs 31 to 37 of the crossbar switch 14, the internal logic circuit 42 has only address data transfer lines 46a of an 8-byte width (2 bytes.times.4) and one set of function control signal transfer paths 46b and a well-known logic can be applied with respect to the internal logic circuit 42.

In FIG. 4A, the selecting circuit 43 connects the internal connection paths 45 to the switching LSIs 31 to 34 and switching LSI 36 among the seven switching LSIs 31 to 37 of the crossbar switch 14 and realizes a connection corresponding to the construction shown at (1) in FIG. 3. In this case, among the connection lines 46, the lines shown by solid lines enable the signal transmission and the lines shown by broken lines are the back-up lines.

The construction shown in FIG. 4B shows a reconstruction in the case where the switching LSI 33 fails.

In this case, in the transfer path connection LSI 41, the internal logic circuit 42 monitors the operation in an interlocking relation with the switching LSIs 31 to 37. When the internal logic circuit 42 detects a failure, the selecting circuit 43 changes the internal connection between the internal logic circuit 42 and the I/O interface circuit 44 and connects the internal connection paths 45 to the switching LSIs 31 and 32 and switching LSIs 34 to 36 among the seven switching LSIs 31 to 37 of the crossbar switch 14, thereby realizing the connection corresponding to the construction shown at (2) in FIG. 3. In this case as well, among the connection lines 46, the lines shown by solid lines enable the signal transmission and the lines shown by broken lines are the back-up lines.

Thus, the switching LSI 33 can be eliminated from the connection. Since the switching LSIs 31 to 37 of the crossbar switch 14 are individually installed on the package boards, a parts exchange of the switching LSI 33 can be performed by exchanging the package board.

Since the function control LSIs 36 and 37 have been duplicated, when the active LSI fails, the connection is switched to the back-up LSI and the parts exchange can be performed in a manner similar to the well-known duplicated system.

FIG. 5A shows a detailed construction of the transfer path connection LSI 41.

In FIG. 5A, the construction of the internal logic circuit 42, I/O interface circuit 44, and connection lines 46 is substantially the same as FIG. 4. The selecting circuit 43 is made up of 2-to-1 selectors 51 to 53.

The 2-to-1 selector 51 selects the signal lines which are outputted from the internal logic circuit 42 to the I/O interface circuit 44 with respect to the address data transfer paths 46a. Selection targets are a signal line to be connected in the normal state (lower side on the drawing, namely, a signal line on the lower side between two signal lines shown by arrows to the 2-to-1 selector 51 in FIG. 5A) and a signal line to be connected by eliminating the failed switching LSI in the reconstruction at the time of the occurrence of the failure and by sequentially shifting the dividing order (upper side on the drawing, namely, an upper signal line between the two signal lines shown by the arrows to the 2-to-1 selector 51 in FIG. 5A).

In the normal operating mode, in case of outputting, all of the 2-to-1 selectors 51 select the signal lines on the lower side in the input signal lines, so that the connection corresponding to FIG. 4A can be realized.

When the internal logic circuit 42 detects that the switching LSI 33 fails as shown in FIG. 4B, the 2-to-1 selector 51 selects the signal lines on the lower side in the connection to the switching LSIs 31 and 32 and selects the signal lines on the upper side in the connection to the switching LSIs 33 to 35, respectively. Thus, the connection corresponding to FIG. 4B can be realized.

In case of inputting, with respect to the address data transfer paths 46a, the 2-to-1 selector 52 selects the signal lines which are inputted from the I/O interface circuit 44 to the internal logic circuit 42. Selection targets and a selecting method are substantially the same as those of the foregoing 2-to-1 selector 51 and the outputs and the inputs certainly correspond to one another.

A blank circle added to each of the input lines with the arrows to the 2-to-1 selectors denotes that the input line is not used.

Further, the operation of the transfer path connection LSI 41 will now be described in detail with reference to FIGS. 5B and 5C. FIG. 5B shows states of the 2-to-1 selectors 51, 52, and 53 in the normal operating mode. FIG. 5C shows states of the 2-to-1 selectors 51, 52, and 53 when the switching LSI 33 fails. An explanation of the function control signal transfer paths 46b have been duplicated as mentioned above, therefore, its description is omitted and the address data transfer paths 46a will be explained.

In the normal operating mode shown in FIG. 5B, the switching LSIs 31 to 34 in the crossbar switch 14 are used for transmission and reception of data and the switching LSI 35 is used as a back-up LSI. In this example, all of the 2-to-1 selectors 51 select the inputs on the lower side shown by solid lines on the drawing. All of the 2-to-1 selectors 52 select the inputs on the upper side shown by solid lines on the drawing. As mentioned above, outputs (1) to (4) from the internal logic circuit 42 and inputs (1) to (4) to the internal logic circuit 42 are connected to the switching LSIs 31 to 34 in the crossbar switch 14 via the address data transfer paths 46a, thereby enabling the data to be transmitted and received.

In the example shown in FIG. 5C, since the switching LSI 33 is failed, the switching LSIs 31, 32, 34, and 35 can transmit and receive data through the address data transfer paths 46a. In this example, the 2-to-1 selector 51 selects the inputs on the lower side for the switching LSIs 31 and 32 as shown by solid lines on the drawing. The inputs on the upper side of the 2-to-1 selector 51 are selected for the switching LSIs 34 and 35. With respect to the 2-to-1 selector 52, as shown by the solid lines on the drawing, the inputs on the upper side are selected as for the inputs (1) and (2) to the internal logic circuit 42 and the inputs on the lower side are selected as for the inputs (3) and (4) to the internal logic circuit 42. As mentioned above, the outputs (1) to (4) from the internal logic circuit 42 and the inputs (1) to (4) to the internal logic circuit 42 are connected to the switching LSIs 31, 32, 34, and 35 of the crossbar switch 14, so that the transmission and reception of data can be performed. That is, the outputs (3) and (4) and inputs (3) and (4) of the internal logic 42 are changed from the connecting relation shown in FIG. 5B to a connecting relation in which they are shifted one by one so as to be connected to the crossbar switching LSIs 34 and 35 and the back-up switching circuit 35 is used.

As for the output to the switching LSI 35 from the transfer path connection LSI 41 shown in FIG. 5B and the output to the switching LSI 33 shown in FIG. 5C, since there is no influence on the data transmission, any of the inputs on the upper side and the inputs on the lower side of the 2-to-1 selectors 51 and 52 corresponding to those outputs can be selected.

It will be understood from the above description that with respect to the address data transfer paths 46a, in the reconstruction when a failure occurs, so long as the method in which the switching LSIs are connected by eliminating the failed switching LSI and by sequentially shifting the dividing order is used, the selecting circuit 43 can be easily constructed by the 2-to-1 selectors. On the other hand, as another method, for example, a method of connecting only the failed switching LSI to the back-up LSI and performing a reconstruction without changing the connection of the other switching LSIs is considered. However, with this method, means for selecting any one of many-to-1 selectors is necessary to realize the selecting circuit 43 and a circuit construction becomes more complicated.

With respect to the function control signal, the 2-to-1 selector 53 selects the function control signal transfer paths 46b which are inputted from the I/O interface circuit 44 to the internal logic 42. Since the function control LSIs 36 and 37 have been duplicated, the active side is selected. A well-known duplication control circuit can be applied for the purpose of the duplication.

An example of a control method of the selecting circuit 43 having the 2-to-1 selectors 51 to 53 in FIG. 5A will now be described hereinbelow with reference to FIGS. 10 and 11.

FIG. 10 is a diagram in which a service processor board 101 is added to the system of FIG. 2.

In FIG. 10, reference numeral 101 denotes the service processor board; 102 a bus interface logic circuit for controlling; 103 a bus for controlling; 104 a service processor; and 105 a monitor port.

A method of adding the service processor board to the system such as a server or the like is generally performed in the present products. For example, a serial bus IEEE 1394 is used as a controlling bus 103, a commercially available microcontroller is used as a service processor 104, and an RS232C interface or the like is used as a monitor port 105. In the invention as well, those well-known techniques can be used.

In FIG. 10, the controlling bus 103 is connected to each of the LSIs such as switch connection LSI 212, chip set 216, switching LSI 141, function control LSIs 142, and the like. The service processor 104 receives a notification of error information from the transfer path connection LSI 41 shown in FIG. 4 via the controlling bus 103 and can collect state information corresponding to the notification and generate a control command.

Thus, when any one of the switching LSIs 141 constructing the crossbar switch 14 fails, the service processor 104 detects it by receiving error information and, as a corresponding control command, can instruct the switch connection LSI such as a switch connection LSI 212 or the like so as to control the selecting circuit 43 having the 2-to-1 selectors 51 to 53. The construction shown in FIG. 1 will be further embodied when explaining by adding the service processor board 101 shown in FIG. 10 to the crossbar switch 14 shown in FIG. 1.

A construction on the transfer path connection LSI 41 side will now be described with reference to FIG. 11.

FIG. 11 is a diagram in which a logic to connect the service processor board 101 is added to the transfer path connection LSI 41 in FIG. 5A.

In FIG. 11, reference numeral 103 denotes the controlling bus connected to the service processor board 101 as shown in FIG. 10; 201 a bus interface logic circuit for controlling; and 202 a register for controlling the selecting circuit.

In FIG. 11, the transfer path connection LSI 41 notifies error information and state information to the service processor 104 via the controlling bus 103 and can receive a control command corresponding to those information. The construction shown in FIG. 5 will be further embodied if the controlling bus interface logic circuit 201, selecting circuit controlling register 202, a signal line 203, and controlling bus 103 shown in FIG. 11 are added to the construction shown in FIG. 5.

In the embodiment, values of selection signals of the 2-to-1 selectors 51 to 53 are individually set in accordance with set values in the selecting circuit controlling register 202.

The transfer path connection LSI 41 can change the setting of the selecting circuit controlling register 202 by an instruction from the service processor 104. Thus, when any one of the switching LSIs 31 to 37 constructing the crossbar switch 14 fails, the 2-to-1 selectors 51 to 53 can be controlled in accordance with an instruction of the service processor 104.

For instance, when one of the switching LSIs 31 to 37 fails, the service processor 104 receives an error notification from the controlling bus 103 and detects a failure. In response to the failure detection, the service processor 104 first instructs to interrupt the operation of each of the switching LSIs 31 to 34 and 36 including the transfer path connection LSI 41 via the controlling bus 103, collects state information, and determines the occurrence of a failure of, for instance, the switching LSI 33. The service processor instructs each of the switching LSIs 31 to 34 and 36 including the transfer path connection LSI 41 so as to change the setting of the 2-to-1 selectors to a construction in which the switching LSI 33 is not used, and to restart the operation of each of the switching LSIs 31, 32, 34, 35, and 36 including the transfer path connection LSI 41 after that.

By connecting an external monitor to the monitor port, the error information can be displayed to the external monitor. A parts exchange or the like can be executed in accordance with the display contents.

FIG. 6 shows a construction of input and output signals of the switching LSIs 31 to 37 of the crossbar switch 14.

In FIG. 6, the switching LSIs 31 to 37 are similar to those in FIG. 3. That is, the switching LSIs 31 to 35 are included in the switching LSIs 141 and the switching LSIs 36 and 37 are included in the function control LSIs 142.

Each of the switching LSIs 31 to 37 has general LSI control signal interfaces such as clock for controlling (CLK), reset (RESET), boundary scan (B-SCAN), signal for testing (TEST), and the like.

With respect to the sixteen ports of the switching LSIs 141, signals of a transfer request (REQ), a slice (DATA) 46a of the address data transfer paths of two bytes (16 bits), a parity (PARITY) regarding the slices 46a, a parity error notification (PER), an input of a transfer clock (CLKIN), and an output of the transfer clock (CLKOUT) from the respective ports are connected. There are sixteen sets of those signals.

In the embodiment, as for the data and parity, a clock input and a clock output are provided on the assumption of a source synchronous transfer by a bi-directional transfer path. However, the kinds of those signals depend on a protocol of the crossbar switch 14. Each set of those signals is shown at 46 in FIG. 4.

As interfaces with the function control LSIs 142, signals of a function control command (FCCMD), a status report (STATUS) for the FCCMD, and a transfer suspending instruction (GRPBSY) due to a busy state are connected to the switching LSIs 141. The kinds of those signals depend on the protocol of the crossbar switch 14.

As for the sixteen ports of the function control LSIs 142, signals of a transfer request (REQ), data for a function control (FCDATA), a parity (PARITY) regarding the FCDATA, a command for a function control (CMD), a parity error notification (PER), an input of the transfer clock (CLKIN), and an output of the transfer clock (CLKOUT) are connected. There are sixteen sets of those signals.

In the embodiment, as for the data and parity, a clock input and a clock output are provided on the assumption of a source synchronous transfer by a bi-directional transfer path. However, the kinds of those signals depend on the protocol of the crossbar switch 14. Each set of those signals is shown at 46 in FIG. 4.

The function control LSIs 142 have the interface signals with the switching LSIs 141 mentioned above and, further, have a transfer suspending request (BSY) due to a busy state and a machine checking command (MCCMD) as interface signals with the ports having a specified function. Although the kinds of those signals depend on the protocol of the crossbar switch 14, all of them have been duplicated.

Another construction and operation of the crossbar switch 14 according to the invention will now be described with reference to FIGS. 7 to 9.

FIG. 7 is an LSI constructional diagram of the crossbar switch whose scale is larger than that of the crossbar switch 14 in FIG. 1.

The crossbar switch 14 of the embodiment is made up of total twelve LSIs of ten switching LSIs and two function control LSIs. Switching LSIs (or package boards) 71 to 76 included in the switching LSIs 141 take charge of the address data transfer paths 46a of a total 18-byte width of (16 bytes+2 bytes) on a 2-byte slice unit basis.

However, the address data transfer paths 46a have a function to operate by reducing the portion of 16 bytes to only either upper 8 bytes or lower 8 bytes.

The switching LSIs 141 and function control LSIs 142 are LSIs having functions similar to those in case of the crossbar switch 14.

In FIG. 7, twelve switching LSIs 71 to 76 are installed at every two LSIs on six package boards and can be parts exchanged at every two LSIs.

In FIG. 7, a construction shown at (1) is a construction in the normal operation. Among the ten switching LSIs (SW-AD), nine switching LSIs take charge of the address data transfer paths 46a of 18 bytes every two bytes and one switching LSI are back-up LSIs. Function control LSIs (SW-FC) on package boards 75 and 76 have been duplicated. One function control LSI is an active LSI and another function control LSI is a back-up LSI.

Among those switching LSIs (AD.phi. to AD8), a construction in the case where one of the LSIs on package boards 71 to 74 fails is shown at (2). A construction in case of performing the parts exchange in the state of the construction of (2) is shown at (3). A construction in the case where one of the LSIs on the package boards 75 and 76 fails is shown at (4).

A construction shown at (2) is a construction in the case where the switching LSI shown by AD3 on the package board 72 in the construction shown at (1) fails. The switching LSIs are reconstructed by a method of eliminating the failed switching LSI and sequentially shifting the dividing order.

A construction shown at (3) is a construction in case of performing the parts exchange in the state of the construction shown at (2). The portion of 16 bytes of the address data transfer paths 46a is reduced to only lower eight bytes and is made operative, thereby enabling the package board 72 to be parts exchanged.

In case of a failure of an LSI on the package board 73 or 74, the portion of 16 bytes of the address data transfer paths 46a is reduced to only upper eight bytes and is made operative, thereby enabling the package board 73 or 74 to be parts exchanged.

A construction shown at (4) is a construction when the function control LSI (SW-FC) on the package board 75 fails. The function control LSI (SW-FC) on the package board 76 serving as a back-up LSI in the duplication is switched to the active LSI.

In this case, the switching LSI (SW-AD) on the package board 75 is also simultaneously switched to the switching LSI (SW-AD) on the package board 76, thereby enabling the package board 75 to be parts exchanged. Even if the switching LSI (SW-AD) on the package board 75 fails as well, since the function control LSI (SW-FC) is simultaneously switched, thereby enabling the package board 75 to be parts exchanged.

According to the invention as mentioned above, even if one arbitrary LSI in the crossbar switch 14 fails, the operation can be continued or restarted, thereby enabling the parts exchange to be performed by using the reducing function. A well-known logic can be applied to realize the reducing function.

FIG. 8 shows a line connection construction between the crossbar switch 14 and the switch connection LSIs 112, 122, 132, and 212 in order to enable the foregoing reconstruction.

In FIG. 8, the transfer path connection LSI 41, internal logic circuit 42, I/O interface circuit 44, internal connection paths 45 between the internal logic circuit 42 and I/O interface circuit 44, and selecting circuit 43 are similar to those in FIG. 4.

Reference numeral 46 denotes the connection lines between the switch connection LSI 41 and crossbar switch 14. Reference numerals 71 to 76 denote the six package boards.

A construction shown at (1) in FIG. 8 indicates the connection in the normal operation.

The transfer path connection LSI 41 has the I/O interface circuit 44 and connection lines 46 to connect to all of the 12 LSIs of the crossbar switch 14. However, the internal logic circuit 42 has only the address data transfer lines 46a of a 18-byte width (2 bytes.times.9) and one set of function control signal transfer paths 46b. A well-known logic can be applied with regard to the internal logic circuit 42.

In a construction of (1) shown in FIG. 8, the selecting circuit 43 connects the internal connection paths 45 to ten LSIs on the package boards 71 to 75 among the 12 LSIs of the crossbar switch 14, thereby realizing a connection corresponding to the construction of (1) shown in FIG. 7. In this case, among the connection lines 46, the lines shown by solid lines operate and the lines shown by broken lines are back-up lines.

A construction of (2) shown in FIG. 8 shows a reconstruction in case of the construction of (2) shown in FIG. 7.

In this case, in the transfer path connection LSI 41, the selecting circuit 43 changes the internal connection between the internal logic circuit 42 and the I/O interface circuit 44 and connects the internal connection paths 45 by a method of eliminating the failed LSI and sequentially shifting them, thereby realizing a connection corresponding to the construction of (2) shown in FIG. 7. In this case as well, among the connection lines 46, the lines shown by solid lines operate and the lines shown by broken lines are back-up lines.

A construction of (3) shown in FIG. 8 shows a state corresponding to the construction of (3) shown in FIG. 7.

Since the portion of 16 bytes of the address data transfer paths 46a are reduced to only lower eight bytes and is made operative, the operation of a meshed portion in the diagram is stopped. Among the connection lines 46, the lines shown by solid lines operate and the lines shown by broken lines are back-up lines. Thus, the parts exchange of the package board 72 can be performed.

Since the package boards 75 and 76 have actually been duplicated, in the case where the active LSI fails, the connection is switched to the back-up LSI and the parts exchange can be performed in a manner similar to the well-known duplicated system.

FIG. 9 shows a detailed construction of the selecting circuit 43 and internal connection paths 45 in FIG. 8.

In FIG. 9, the internal logic circuit 42, I/O interface circuit 44, and connection lines 46 between the transfer path connection LSI 41 and crossbar switch 14 are similar to those in FIG. 8.

The selecting circuit 43 is made up of the 2-to-1 selectors 51 to 53 and are substantially the same as those in FIG. 5. However, when the LSI on the package board 75 or 76 fails, the connections of the two LSIs of the switching LSI (SW-AD) and function control LSI (SW-FC) are simultaneously switched and they operate so as to reconstruct.

According to the invention as mentioned above, in the construction using the crossbar switch, a data transfer system in which the reliability is improved to a one point failure tolerate level can be constructed.

Claims

1. An information processing apparatus, comprising:

a plurality of processing units;

a plurality of input/output ports connected to said processing units; and

a crossbar switch which executes a data transfer among said processing units, said crossbar switch being composed of a plurality of circuits, wherein

each of said input/output ports of said crossbar switch is constructed to have an address data transfer path of at least an n-bit width; wherein

said address data transfer path of the n-bit width is divided into slice transfer paths of an m-bit unit and said slice transfer paths are individually connected to said plurality of circuits; wherein

said address data transfer path is constructed by being added with a redundant slice transfer path; wherein

said plurality of circuits are constructed to include a circuit to which said redundant slice transfer paths can be connected; and wherein

each of said input/output ports of said crossbar switch includes a signal transfer path for controlling other than said address data transfer path and is provided with a circuit to connect said signal transfer path for controlling, and said circuit is duplicated.

2. An apparatus according to claim 1, wherein said plurality of processing units include a CPU (Central Processing Unit) a memory, and input/output unit.

3. An information processing apparatus, comprising:

a plurality of processing units;

a plurality of input/output ports connected to said processing units;

a crossbar switch which executes a data transfer among said processing units, said crossbar switch being composed of a plurality of circuits;

wherein each of said input/output ports of said crossbar switch is constructed to have an address data transfer path of at least an n-bit width;

wherein said address data transfer path of the n-bit width is divided into slice transfer paths of an m-bit unit and said slice transfer paths are individually connected to said plurality of circuits;

wherein said address data transfer path is constructed by being added with a redundant slice transfer path;

wherein said plurality of circuits are constructed to include a circuit to which said redundant slice transfer paths can be connected;

said apparatus further comprising:

a fault processing circuit constructed in such a manner such that when a fault occurs in an arbritrary one of said plurality of circuits, the connection between each of said slice transfer paths connected to said fault circuit and said processing units is switched to a non-connection, and the address data transfer paths are reconstructed by using each of said slice transfer paths connected to said non-fault circuits and said redundant slice transfer paths so as not to use said fault circuit;

wherein further the operation of said crossbar switch is continued or restarted and a parts exchange of said fault circuit is enabled; and

an internal logic circuit to perform a reducing operation for narrowing a width of said address data transfer paths at the time of a parts exchange of said fault circuit.

4. An apparatus according to claim 3, wherein said plurality of processing units include a CPU (Central Processing Unit) a memory, and input/output unit.

5. An information processing apparatus, comprising:

a plurality of processing units;

a plurality of input/output ports connected to said processing units;

a crossbar switch which executes a data transfer among said processing units, said crossbar switch being composed of a plurality of circuits;

wherein each of said input/output ports of said crossbar switch is constructed to have an address data transfer path of at least an n-bit width;

wherein said address data transfer path of the n-bit width is divided into slice transfer paths of an m-bit unit and said slice transfer paths are individually connected to said plurality of circuits;

wherein said address data transfer path is constructed by being added with a redundant slice transfer path;

wherein said plurality of circuits are constructed to include a circuit to which said redundant slice transfer paths can be connected;

said apparatus further comprising:

a fault processing circuit constructed in such a manner such that when a fault occurs in an arbritrary one of said plurality of circuits, the connection between each of said slice transfer paths connected to said fault circuit and said processing units is switched to a non-connection, and the address data transfer paths are reconstructed by using each of said slice transfer paths connected to said non-fault circuits and said redundant slice transfer paths so as not to use said fault circuit;

wherein further the operation of said crossbar switch is continued or restarted and a parts exchange of said fault circuit is enabled;

wherein said fault processing circuit is provided for said processing unit which is connected to each of said input/output ports of said crossbar switch and has a selecting circuit to select said slice transfer paths on the basis of fault information with respect to said fault circuit; and

wherein when a fault occurs in any one of said circuits, said selecting circuit stops the selection of the slice transfer paths connected to said fault circuit, selects the slice transfer path adjacent to the slice transfer path in place of said slice transfer path in which the selection is stopped, and subsequently connects the slice transfer paths while sequentially shifting the slice transfer paths one by one.

6. An apparatus according to claim 5, wherein:

said selecting circuit has 2-to-1 selectors of only the number corresponding to the number of said slice transfer paths and said slice transfer paths are sequentially connected to outputs of said 2-to-1 selectors;

a first output of said processing unit is connected to an input of the first 2-to-1 selector, the first output and a second output of said processing unit are connected to an input of the second 2-to-1 selector, the second output and a third output of said processing unit are connected to an input of the third 2-to-1 selector, and a last output of said processing unit is similarly connected to an input of the last 2-to-1 selector, respectively;

when there is no fault, the last 2-to-1 selector has no output signal to the slice transfer paths and the other 2-to-1 selectors select outputs of latter numbers from said processing unit and outputs them to the slice transfer paths; and

when there is a fault, the 2-to-1 selector connected to the slice transfer path connected to said fault circuit has no output signal and the 2-to-1 selector connected to the slice transfer path subsequent to the slice transfer path connected to said fault circuit selects the output of the former number from said processing unit and outputs it to the slice transfer path.

7. An apparatus according to claim 5, wherein said plurality of processing units include a CPU (Central Processing Unit) a memory, and input/output unit.

8. An information processing apparatus including a plurality of processing units having at least a CPU (Central Processing Unit), a memory, and an input/output unit, for transferring data, through a crossbar switch having a plurality of LSIs, said apparatus comprising:

a crossbar switch having a plurality of switching circuits for data transfer, a plurality of control circuits for control signal transfer and back-up circuits, each of which are connected to input/output ports;

connection lines having address data transfer paths of m-bit units connected to each of the input/output ports of the switching circuits, control signal transfer paths of m-bit unit connected to each of the input/output ports of the control circuits and back-up transfer paths of m-bit unit connected to each of the input/output ports of the backup circuits, the connection lines being constructed by n-bit having integer times of the m-bit to include the address data transfer paths, the control signal transfer paths and the back-up transfer paths; and

a transfer path processing circuit, connected correspondingly to the connection lines constructed by the n-bit provided on each of the processing units, which monitors transfer of data and control signals between the processing units through the switching circuit and the control circuit in the crossbar switch, and detects a failure of at least the switching circuit and the control circuit to thereby change the connection of at least one of the failed switching circuit and control circuit to a connection of the back-up circuit.

9. An apparatus according to claim 8, wherein said transfer path processing circuit has a plurality of input/output interface circuits, said input/output interface circuits are separately connected to said address data transfer paths, control signal transfer paths, and back-up transfer paths and are connected in correspondence to said switching circuits, control circuits, and back-up circuits of said crossbar switch.

10. An apparatus according to claim 8, wherein said transfer path processing circuit has an internal logic circuit for monitoring operations of said switching circuits and control circuits of said crossbar switch through said connection lines and for detecting a failure of any one of said operations.

11. An apparatus according to claim 10, wherein said transfer path processing circuit has a selecting circuit for switching a connection relation between said transfer path processing circuit and the input/output ports of said crossbar switch corresponding to any one of the failures of said switching circuits and control circuits detected by said internal logic circuit to the input/output ports corresponding to any one of said other switching circuits and control circuits.

12. An apparatus according to claim 11, wherein said selecting circuit comprises:

a plurality of first 2-to-1 selectors which are connected to one side of said input/output interface circuits so as to transmit data through said address data transfer paths and have two inputs and one output;

a plurality of second 2-to-1 selectors which are connected to the other side of said input/output interfaces so as to receive data through said address data transfer paths and have two inputs and one output; and

a plurality of third 2-to-1 selectors which are connected to one side of said two input/output interface circuits so as to transmit control signals through said control signal transfer paths, are connected to the other side of said two input/output interface circuits so as to receive control signals through said control signal transfer paths, and have two inputs and one output.

13. An apparatus according to claim 12, wherein said one output of said first 2-to-1 selector is connected to the input side of said input/output interface circuit, one side of said two inputs is connected to said internal logic circuit and is also connected to the other side of said two inputs of the first 2-to-1 selector on the adjacent side, at the time of a normal operation of said switching circuits of said crossbar switch, said internal logic circuit supplies the data to one side of said two inputs of said first 2-to-1 selector, and when any one of said switching circuits fails, said internal logic circuit supplies the data to the other side of said two inputs of said first 2-to-1 selector, thereby disconnecting the connection relation by the address data transfer paths between the failed switching circuit and the input/output interface circuits, the connection relation of said address data transfer paths after the failed switching circuit is shifted one by one, and a connection relation of the address data transfer paths between said back-up circuits and said address data transfer paths is formed.

14. An apparatus according to claim 12, wherein said third 2-to-1 selectors connected to one side of said two input/output interface circuits so as to transmit the control signals through said control signal transfer paths are connected to said internal logic circuit, at the time of a normal operation of said control circuits of said crossbar switch, said internal logic circuit supplies the control signal to one of said two input/output interface circuits, and when any one of said control circuits fails, said internal logic circuit supplies the control signal to the other one of said two input/output interface circuits, thereby disconnecting a connection relation between the failed control circuit and said input/output interface circuit, the connection relation between the failed control circuit and said control signal transfer paths is shifted one by one, and a connection relation of the control signal transfer paths between said back-up circuits and said control signal transfer paths is formed.

15. An apparatus according to claim 12, further comprising:

a selecting circuit control register for prescribing the operations of said first, second, and third 2-to-1 selectors in an interlocking relation with said internal logic circuit; and

a control interface circuit for transmitting and receiving control signals between said selecting circuit control register and other processing apparatuses.