Switching control in a fault tolerant system

BACKGROUND
The invention relates to host switching.
A network, such as a local area network (LAN), typically includes multiple workstations connected to a network communications channel, as well as computer servers each having a mass storage system on which shared data or files are stored. To prevent unexpected failures in the network, many fault tolerant schemes have been developed. As a computer server is the "heart" of the network, its failure could cause the entire network to stop functioning.
Examples of fault tolerant systems include the "SFT III" or system fault tolerant 3 system, which is a server operating system standard endorsed by Novell, Incorporated. In the SFT III network operating system (NOS), each "virtual" server is actually two servers which mirror each other's data and processor operation. If one of the servers fails, the other keeps running without an interruption in network service.
Another fault tolerant system is the NetGuard system, in which a primary server is monitored by a backup server. Both the primary and backup servers are connected to one mass storage system, with each server connected to the mass storage subsystem via a SCSI link (for transmitting data) and a serial link (to allow the backup server to inform the storage system that it will take over control from the primary server). Such communication between the backup server and the main storage system is referred to as "out of band" signalling.
SUMMARY
In general, in one aspect, the invention features a method of switching control from a first server to a second server in a fault tolerant system. An indication is provided to the second server of the active state of the first server, and communication between the first server and the expansion bus is disabled if the indication indicates that the first server is inactive.
Certain implementations of the invention may include one or more of the following features. The first server communicates with the expansion bus through a first expansion card, and communication is disabled by tri-stating output pins at the first expansion card. The second server communicates with the expansion bus through a second expansion card. The second expansion card asserts a failover signal to the first expansion card to tri-state the first expansion card. Communication is disabled between the second server and the expansion bus if the indication indicates that the first server is active. Communication is enabled between the second server and the expansion bus if the indication indicates that the first server is inactive. A slot on the expansion bus which was disabled when the first server was active is identified. The slot is maintained disabled when communication between the second server and the expansion bus is enabled. The slot was disabled because it is associated with a faulty device. The first server communicates with the expansion bus through a first expansion card and the second server communicates with the expansion bus through a second expansion card. Communication between the first server and the expansion bus is disabled by tri-stating output pins of the first expansion card, and communication between the second server and the expansion bus is disabled by tri-stating output pins of the second expansion card. The first expansion card includes a first bridge for providing communication between the expansion bus and a bus in the first server. The second expansion card includes a second bridge for providing communication between expansion bus and a bus in the second server. The second server sets a command bit in the second expansion card to begin the first server of disabling and second server enabling steps. Communication between the second server and expansion bus is enabled by switching output pins of the second server from tri-state mode to active driving mode. The first server active indication includes a heartbeat message periodically transmitted by the first server. Communication between the first server and expansion bus is disabled if the heartbeat message is not transmitted within a predetermined period of time. The expansion bus includes a PCI bus.
In general, in another aspect, the invention features a system having a first server, a second server, and a link over which the first server provides an indication to the second server of the activity state of the first server. The first and second servers communicate with an expansion bus in the expansion box, in which communication between the first server and the expansion bus is disabled if the indication indicates the first server is inactive. The expansion box includes a mask storage system accessible by the first and second servers.
Certain implementations of the invention may include one or more of the following features. The first server communicates with the expansion bus through a first expansion card, and communication between the first server and the expansion bus is disabled by tri-stating output pins of the first expansion card. The second server communicates with the expansion bus through the second expansion card. The second expansion card asserts a failover signal to the first expansion card to tri-state the first expansion card. The expansion box disables communication between the second server and the expansion bus if the indication indicates that the first server is active. The expansion box enables communication between the second server and the expansion bus if the indication indicates that the first server is inactive. The expansion box includes a device for identifying a slot on the expansion bus which was disabled when the first server was active. The device maintains the slot disabled when communication between the second server and the expansion bus is enabled. The slot was disabled because it is associated with a faulty device. Each of the first and second servers include an internal bus, and the first expansion card includes a first bridge for providing communication between the expansion bus and the first server bus, and the second expansion card includes a second bridge for providing communication between the expansion bus and the second server bus. The second expansion card includes a command bit set by the second server to begin disabling the first server and enabling the second server. Communication between the second server and the expansion bus is enabled by switching output pins of the second server from tri-state mode to active driving mode. The first server active indication includes a heartbeat message periodically transmitted by the first server. The first server is disabled if the heartbeat message is not transmitted within a predetermined period of time. The expansion bus includes a PCI bus. Both the first and second servers are connected to a network. The link includes a serial link.
In general, in another aspect, the invention features a system having a network, a first server connected to the network, a second server connected to the network, and a serial link connected between the first and second servers. The first server provides a heartbeat message to the second server over the serial link. The first server is connected to an expansion bus in an expansion box through a first expansion card, and the second server is connected to the expansion bus through a second expansion card. The output pins of the second expansion card are tri-stated if the heartbeat message is provided by the first server, and the output pins of the first expansion card are tri-stated and the output pins of the second expansion card are enabled if the heartbeat message has not been detected for a predetermined period of time.
Certain implementations of the invention may include one or more of the following features. Each of the first and second servers include an internal bus. The first expansion card includes a first bridge for providing communication between the expansion bus and the first server bus. The second expansion card includes a second bridge for providing communication between the expansion bus and the second server bus. The second expansion card includes a command bit set by the second server to being disabling the first server and enabling the second server. The second server is enabled by switching out the pins of the second server from tri-state mode to active driving mode. The first server active indication includes a heartbeat message periodically transmitted by the first server. The first server is disabled if the heartbeat message is not transmitted within a predetermined period of time. The expansion bus includes a PCI bus. Both the first and second servers are connected to a network. The link includes a serial link.
Advantages of the invention include one or more of the following. An entire expansion bus can be switched between a primary server and a standby server. Information relating to faulty devices is not lost in switching between the primary server and the standby server.

Other advantages and features will become apparent from the following description and from the claims.
DESCRIPTION
FIG. 1 is a block diagram of a computer system.
FIG. 2 is a block diagram of an expansion box of the computer system of FIG. 1.
FIG. 3 is a block diagram of the bridge chips in the computer system.
FIG. 4 is a block diagram of a queue block in each of the bridge chips.
FIG. 5 is a block diagram of the clock routing scheme in the bridge chips.
FIG. 6 is a block diagram of a clock generator in each of the bridge chips.
FIG. 7 is a block diagram of a master cable interface in each of the bridge chips for transmitting data over a cable connecting the bridge chips.
FIG. 8 is a timing diagram of signals in the master cable interface.
FIG. 9 is a block diagram of a slave cable interface in each of the bridge chips for receiving data transmitted over the cable.
FIG. 10 is a block diagram of logic generating input and output pointers for the receiving logic in the slave cable interface.
FIG. 11 is a timing diagram of signals in the slave cable interface.
FIG. 12 is a timing diagram of the input and output pointers and their relation to the received cable data.
FIG. 13 is a block diagram of the placement of flip flops and input and output pads in each of the bridge chips.
FIG. 14 is a table of the information carried by the cable.
FIG. 15A is a table showing the type of information carried by the cable signals associated with single address cycle transactions.
FIG. 15B is a table showing the type of information carried by the cable signals associated with dual-address cycle transactions.
FIG. 16 is a table of parameters associated with the cable.
FIG. 17 is a logic diagram of an error detection and correction circuit.
FIG. 18 is a parity-check matrix for generating check bits in the error detection and correction circuit.
FIG. 19 is a syndrome table for generating fix bits in the error detection and correction circuit.
FIG. 20A is a state diagram showing a round-robin arbitration scheme.
FIG. 20B is a state diagram showing a two-level arbitration scheme.
FIG. 21 is a logic diagram of an arbiter in each of the bridge chips.
FIG. 22 is a state diagram of a grant state machine in an arbiter.
FIG. 23 is a state diagram of a level one arbitration state machine in the arbiter.
FIG. 24 is a table showing generation of new grant signals based on the current master.
FIG. 25 is a block diagram of logic for generating mask bits and multi-threaded master indication bits.
FIG. 26A is a logic diagram of circuits for generating the masked bits.
FIG. 26B is a block diagram of a computer system with multiple layers of buses.
FIG. 27A is a side view of an expansion card inserted into a slot.
FIGS. 27B-C are schematic diagrams of lever circuitry.
FIGS. 28-30 and 31A-E are schematic diagrams of circuitry of the expansion box.
FIG. 32A is a state diagram from the circuitry of the expansion box.
FIG. 32B are waveforms from the circuitry of the expansion box.
FIG. 33A is a schematic diagram of circuitry of the expansion box.
FIG. 33B are waveforms from the circuitry of the expansion box.
FIGS. 33C-H are a state diagram from the circuitry of the expansion box.
FIG. 34 is a schematic diagram of circuitry of the expansion box.
FIG. 35A is a state diagram from the circuitry of the expansion box.
FIG. 35B are waveforms from the circuitry of the expansion box.
FIG. 36 is a schematic diagram of circuitry of the expansion box.
FIG. 37 is a flow diagram of a non-maskable interrupt handler invoked in response to detection of a bus hang condition in the computer system.
FIG. 38 is a flow diagram of a BIOS routine that is invoked by a computer system lock-up event.
FIG. 39 is a flow diagram of a BIOS isolate routine invoked in response to a bus-hang condition or the computer lock-up event.
FIG. 40 is a block diagram of a bus watcher in each of the bridge chips.
FIG. 41 is a state diagram of logic in the bus watcher for returning the bus to an idle state.
FIG. 42 is a logic diagram of status signals in the bus watcher.
FIG. 43 is a logic diagram of bus history FIFOs and bus state vector FIFOs in the fault isolation circuit.
FIG. 44 is a logic diagram of circuitry for generating ready signals for indicating when the bus history and state vector information are available.
FIG. 45 is a flow diagram of a routine for assigning a bus number to a powered down or empty slot.
FIG. 46 is a flow diagram of a routine for allocating memory space for the computer system.
FIG. 47 is a flow diagram of a routine for allocating I/O space for the computer system.
FIG. 48 is a flow diagram of a routine for handling a recently powered up card.
FIG. 49 is a block diagram of configuration space for a PCI-PCI bridge circuit.
FIG. 50A is a block diagram of a computer system.
FIG. 50B is a bus number assignment tree.
FIG. 51 is a block diagram showing type 0 and type 1 configuration transactions.
FIG. 52 is a table showing mapping of address from a primary bus to a secondary bus.
FIGS. 53A and 53B are a logic diagram of circuitry for handling type 0 and type 1 configuration cycles.
FIG. 54A is a block diagram of circuitry for storing information to allow calculation of bus performance parameters.
FIG. 54B is a block diagram of prefetch counters.
FIG. 55 is a block diagram of a computer system.
FIG. 56 is a block diagram of a PCI arbitration scheme.
FIG. 57 is a schematic diagram of a buffer flush logic block.
FIG. 58 is a schematic diagram of a cable decoder.
FIGS. 59-62 are schematic diagrams of a posted memory write queue, including control logic.
FIGS. 63-65 are schematic diagrams of a delayed request queue, including control logic.
FIGS. 66-69b are schematic diagrams of a delayed completion queue, including control logic.
FIGS. 70-72, 73A-D, and 74 are schematic diagrams and a table of a master cycle arbiter.
FIGS. 75, 76A-B, 77-80, 81A-C, 82A-B, 83, 84A-C, and 85-87 are schematic and state transition diagrams of a queue-block-to-PCI-bus interface.
FIG. 88 is a schematic block diagram showing bus devices connected to an expansion bus.
FIG. 89 is a schematic block diagram showing circuitry to route interrupt requests.
FIG. 90 is a schematic diagram of device select logic.
FIGS. 91-94 are schematic block diagrams of registers.
FIG. 95 is a graph showing waveforms for the computer system.
FIG. 96 is a schematic diagram of the multiplexing circuitry.
FIGS. 97A-D are schematic diagrams of the interrupt receiving block.
FIG. 98 is a schematic diagram of the interrupt output block.
FIG. 99 is a chart showing the time multiplexing of interrupt request signals.
FIG. 100 is a chart showing interrupt request mapping.
FIG. 101 is a schematic block diagram showing bus devices connected to an expansion bus.
FIGS. 102A, 102B, and 102C are block diagrams of systems including a standby server and a primary server.
FIG. 103 is a block diagram of expansion cards connected to a secondary PCI bus.
FIG. 104 is a block diagram of software running in the system.
FIG. 105 is a schematic diagram of a failover recovery block in the expansion cards.
FIG. 106 is a state diagram of a failover state machine in the failover recovery block.
FIGS. 107A-107D are flow diagrams of a power-on self-test software code.
FIGS. 108-110 are flow diagrams of a network health driver software code.
FIG. 111 is a block diagram of cable connections on a serial link between the standby and primary servers.

OVERVIEW
In the ensuing description, all signal mnemonics followed or preceded by a "#", ".sub.-- " or "|" signify inverted logic states.
As shown in FIG. 1, a computer system 10 includes a primary PCI bus 24 that is coupled to a bridge chip 26a and a bridge chip 26b, both of common design 26. The bridge chip 26a is coupled to a bridge chip 48a through a cable 31, and the bridge chip 26b is coupled to the bridge chip 48b through a cable 28. The bridge chips 48a and 48b are of common design 48, which is common to design 26 except that design 26 is in an upstream mode and design 48 is in a downstream mode.
The PCI bus 24 is interfaced to a local bus 22 through a system controller/host bridge circuit 18. The system controller/host bridge circuit 18 also controls access to a system memory 20 which is also coupled to the local bus 22 along with the CPU 14 and a level two (L2) cache 16.
A PCI-Extended Industry Standard Architecture (EISA) bridge 15 interfaces the PCI bus 24 to an EISA bus 17. Both a keyboard controller 21 and a Read Only Memory (ROM) 23 are coupled to the EISA bus 17. A non-volatile random access memory (NVRAM) 70 connected to the EISA bus 17 stores information which should survive the computer system shutting off. An automatic server recovery timer 72 monitors the computer system for inactivity. If the system locks up, the ASR timer 72 will expire after about 10 minutes. A keyboard 19 is monitored by the keyboard controller 21 for detection of depressed keys.
Referring to FIG. 2, the bridge chip 48a furnishes an interface to a PCI bus 32a, and the bridge chip 48b furnishes an interface to a PCI bus 32b. The PCI buses 32a and 32b are located on two expansion boxes 30a and 30b, of common design 30, and each expansion box 30 has six hot-plug slots 36 (36a-f) which are capable of receiving conventional expansion cards 807 (FIG. 27A). One slot 34 on the expansion box receives a card 46 which has the bridge chip 26. Each hot-plug slot 36 has associated switch circuitry 41 for connecting and disconnecting the slot 36 to and from the PCI bus 32. Six mechanical levers 802 are used to selectively secure (when closed or latched) the cards 807 to corresponding slots, as further described in U.S. patent application Ser. No. 08/658,385, entitled "Securing a Card in an Electronic Device," filed on the same date as this application and incorporated by reference. Each expansion box 30 includes registers 52 and 82 for monitoring the levers 802 and status signals of the expansion box 30 and a register 80 for controlling connection and disconnection of slots 36 to the PCI bus 32.
Referring to FIG. 3, the bridge chip is designed to be used in pairs 26 and 48 to form a PCI-PCI bridge between the primary PCI bus 24 and the secondary PCI bus 32. The programming model is that of two hierarchical bridges. To the system software, the cable 28 appears as a PCI bus which contains exactly one device, the downstream bridge chip 48. This greatly simplifies the configuration of the 2-chip PCI-PCI bridge joining the primary and secondary buses. The bridge chip 26, which is closer to the CPU 14, joins the primary PCI bus 24 to the cable 28. The second PCI-PCI bridge 48 resides in the expansion box 30 and joins the cable 28 to the secondary PCI bus 32. A mode pin UPSTREAM.sub.-- CHIP determines whether the bridge chip operates in the upstream mode or the downstream mode. Some non-bridge functions such as a bus monitor 106 and hot plug logic in an SIC 50 are used only in the expansion box 30, and are non-functional in the upstream mode chip 26.
A clock generator 102 in the bridge chip 26 generates clocks based on the clock PCICLK1 on the primary PCI bus 24, with one of the generated clocks being provided through the cable 28 to a clock generator 122 in the downstream bridge chip 48. The clock generator 122 generates and drives the PCI clocks in the expansion box 30 at the same frequency of the primary PCI bus 24, which results in both bridge chips 26 and 48 being run at the same frequency. The downstream bridge chip 48 lags the upstream bridge chip 26 in phase by the delay of the cable 28. An asynchronous boundary in the upstream bridge chip 26 at the point where data is taken off of the cable 28 allows the phase delay to be any value (and therefore the cable to be of any length), with the only requirement only being that the frequency of the two bridge chips be the same.
The core logic of each bridge chip is the bridge logic block (100 or 120), which includes a PCI master (101 or 123) for acting as a master on the respective PCI bus, a PCI target or slave (103 or 121) for acting as a slave device on the respective PCI bus, configuration registers (105 or 125) which contain the configuration information of the corresponding bridge chip, and a queue block (107 or 127) containing several queues in which data associated with transactions between the primary PCI bus and the secondary PCI bus 32 are queued and managed. The data transferred between the upstream bridge chip 26 and the downstream bridge chip 48 are buffered by cable interfaces 104 and 130 in the bridge chips 26 and 48, respectively.
Interrupt routing logic is also included in each bridge chip. There are 8 interrupts, 6 from the secondary bus slots, 1 from an SIO circuit 50, and 1 from the downstream bridge chip 48. In the downstream chip 48, the interrupts are received by an interrupt receiving block 132 and sent up the cable 28 as a serial stream in sequential time slices. In the upstream bridge chip 26, the interrupts are received by an interrupt output block 114, which routes the interrupts to an interrupt controller.
The SIO circuit 50 furnishes control signals for lighting LEDs, for controlling reset, and for selectively connecting the slots 36 to the bus 32. It also includes logic for reading the engagement status of the levers 802, and the status of the cards 807 in each slot 36.
The bridge circuit 26 also includes support for interrupts in the expansion box 30, and, when installed in a slot in the host system with a proprietary interface to a multichannel interrupt controller, it sends the states of each interrupt in a serial stream. The bridge circuit 26 also can be configured to drive standard PCI INTA, INTB, INTC, and INTD signals if it is installed in a standard slot in the host system.
Each bridge chip also includes a PCI arbiter (116 or 124) for controlling access to up to seven bus masters. As the upstream bridge 26 is installed in a slot, the PCI arbiter 116 in the upstream bridge chip 26 is disabled. Each bridge chip also includes an I.sup.2 C controller (108 or 126) for communication with devices such as EEPROMS, temperature sensors, and so forth, a JTAG master (110 or 128) for performing test cycles, a bus monitor (106 or 127) for measuring bus utilization and efficiency and the efficiency of the bridge chip's prefetch algorithm, and a bus watcher (119 or 129) for storing bus history and state vector information and for notifying the CPU 14 of a bus hang condition. Certain blocks are disabled in each bridge chip as they are not used. In the upstream bridge chip 26, the bus watcher 119, the SIO 118, the PCI arbiter 116, and the bus monitor 106 are disabled. In addition, the interrupt receiving block 112 in the upstream chip 26 and the interrupt output block 134 in the downstream chip 48 are disabled.
QUEUE BLOCK OVERVIEW
Referring to FIG. 4, the queue blocks 107 and 127 manage transactions flowing between the primary PCI bus 24 (in the upstream chip) or the secondary PCI bus 32 (in the downstream chip) and the cable interface 130. (From here on, the downstream bridge chip will be referred to with the assumption that upstream chip works identically, unless otherwise noted). The queue block 127 includes a cable decoder 146 that receives from the cable interface 130 transactions to be completed on the secondary PCI bus 32. After decoding a transaction, the decoder 146 places the transaction, along with all information included in the transaction, into one of three queues 140, 142, and 144. Each queue contains several transaction buffers, each of which stores a single transaction and therefore is able to handle several transactions simultaneously.
The first queue, a posted memory write queue (PMWQ) 140, stores posted memory write cycles issued by the CPU on the primary bus along with all information required to execute each cycle on the secondary bus 32. The PMWQ 140 has four transaction buffers, each of which holds one posted memory write transaction containing up to eight cache lines (256 bytes) of data. Under some circumstances, a posted memory write transaction having more than eight cache lines of data may overflow into one or more subsequent buffers, as described below.
The second queue, a delayed request queue (DRQ) 142, stores delayed request transactions (i.e., delayed read requests (DRR), such as memory read (MR), memory read line (MRL), and memory read multiple (MRM) requests; and, in the downstream chip, input/output (I/O) read/writes and configuration (config) read/writes) issued by the CPU on the primary bus along with all information required to execute each transaction on the secondary bus 32. The DRQ 142 has three transaction buffers, each of which is capable of holding one double-word, or "dword", of data for delayed writes.
The third queue, a delayed completion queue (DCQ) 144, stores delayed completion information provided by the upstream chip in response to delayed request transactions generated on the secondary bus 32. For a delayed read request, the corresponding completion information contains the read data requested by the initiating device and the read status (i.e., an indication of whether a parity error on target abort occurred). The delayed completion information returned for a delayed write transaction is the same as that returned for a delayed read request, except that no data is returned for delayed writes. Since I/O and config read/writes occur only on the downstream bus, only the upstream DCQ will contain delayed completion information corresponding to one of these transactions. The DCQ 144 has eight completion buffers, each of which can hold up to eight cache lines of completion information for a single delayed request. In addition to the completion information, each completion buffer also contains a copy of the delayed request that generated the information. For delayed read transactions, a data "stream" can be established between the primary bus 24 and the secondary bus 32 if the requesting device begins retrieving the requested data before the target device stops providing it to the DCQ 144. Under some circumstances, the DCQ 144 automatically will retrieve, or "prefetch," additional data when a requesting device retrieves all of the requested data from the corresponding buffer in the DCQ 144. Both streaming and automatic prefetching are discussed in more detail below.
A queue-to-PCI interface (QPIF) 148 manages transactions flowing from the queues 140, 142, and 144 to the PCI bus 32, and from the PCI bus 32 to the DCQ 144 and to the upstream chip through the cable interface 130. The QPIF 148 enters a "master" mode to run posted memory write and delayed request transactions from the PMWQ 140 and the DRQ 142 on the secondary bus. For both posted memory write and delayed read transactions, the QPIF 148 can "promote" a transaction that may involve less than a cache line of data (i.e., a memory write (MW) or a memory read (MR) transaction) to one that requires one or more cache lines (i.e., a memory write and invalidate (MWI) transaction or a memory read line (MRL) or memory read multiple (MRM) transaction) if certain conditions are met. The QPIF 148 also may convert a read transaction involving a single cache line of data (i.e., a MRL transaction) into one involving several cache lines of data (i.e., a MRM transaction). The QPIF 148 also may "correct" a MRL or MRM transaction that begins in the middle of a cache line by reading the entire cache line and then throwing away the unrequested portion of the data. Transaction promotion and read correction, both of which are described in more detail below, improve system efficiency by reducing the time required to retrieve data from a memory device.
The QPIF 148 enters a "slave" mode to provide data from the DCQ 144 to a requesting PCI device or to send transactions from the PCI bus 32 to the DCQ 144 and to the upstream chip through the cable. When the QPIF 148 receives a posted write transaction from the bus 32, it forwards the transaction to the upstream chip if a corresponding one of a group of transaction counters 159 indicate that the PMWQ in the other bridge chip is not full, as discussed below. When the QPIF 148 receives a delayed request, it first forwards the request to the DCQ 144 to determine whether the transaction already has been placed in the DCQ and, if so, whether the corresponding delayed completion information has been returned to the DCQ 144. If the delayed completion information is in the DCQ, the information is provided to the requesting device and the transaction is terminated. If the request already is enqueued but the delay completion information has not been returned, the requesting device is retried and the transaction is terminated on the PCI bus 32. If the transaction is not yet enqueued, the DCQ 144 reserves a completion buffer for the transaction and the QPIF 148 forwards the transaction to the upstream chip through the cable interface 130, as long as the corresponding transaction counter 159 indicates that the other bridge chip is not full.
If the DCQ 144 determines that one of its buffers contains data intended for a requesting device but different than the data requested in the current transaction, the buffer may be flushed to prevent the requesting master from receiving stale data. The buffer is flushed when it contains prefetch data (i.e., data left in the buffer after the requesting device has retrieved some of the data, or data that was not specifically requested by the device), but is not flushed when it contains completion data (i.e., specifically requested by a device that has not yet returned to retrieve it). If the buffer contains completion data and the requesting device has issued a request that does not "hit" the buffer, the DCQ 144 tags the device as a "multi-threaded" device (i.e., one that is capable of maintaining more than one transaction at once) and allocates another completion buffer for the new request. The buffer flushing and multiple buffer allocation schemes are described in more detail below.
A master cycle arbiter (MCA) 150 in the queue block 127 maintains standard ordering constraints between posted memory write, delayed request, and delayed completion transactions, as set forth in the PCI Bridge Architecture Specification, Version 2.1. These constraints require that bus cycles maintain strong write ordering and that deadlocks do not occur. Therefore, the MCA 150 determines the order in which posted memory write transactions in the PMWQ 140 and delayed request transactions in the DRQ 142 are run on the PCI bus 32. The MCA 150 also controls the availability of delayed completion information stored in the DCQ 144. To ensure compliance with these rules, the downstream MCA 150 gives each posted memory write cycle an opportunity to bypass earlier-issued delayed request cycles, while both the downstream and the upstream MCAs 150 do not allow delayed request and delayed completion cycles to bypass earlier-issued posted memory write cycles. Transaction ordering by the MCA 150 is described in more detail below.
The transaction counters 159 in the downstream queue lock 127 maintain a count of the number of transactions enqueued in the upstream bridge chip. A posted memory write (PMW) counter 160 indicates the number of PMW transactions held in the upstream posted memory write queue. The PMW counter 160 is incremented each time a PMW transaction is sent to the cable interface 130. The counter 160 is decremented each time the QPIF 148 receives a signal from the cable decoder 146 indicating that a PMW cycle has been completed on the upstream PCI bus 24. When the upstream PMWQ has enqueued the maximum number (four) of PMW transactions, the PMW counter 160 asserts a PMW full signal (tc.sub.-- pmw.sub.-- full) that tells the QPIF 148 to retry additional PMW cycles from the PCI bus 32. Likewise, a delayed request (DR) counter 161 counts the number of DR transactions held in the upstream delayed request queue. When the DRQ is holding the maximum number (three) of DR transactions, the DR counter 161 asserts a DR full signal (tc.sub.-- dr.sub.-- full) indicating that the QPIF 148 must retry all subsequent DR transactions from the PCI bus 32. A delayed completion (DC) counter 162 counts the number of delayed completions that are enqueued in the upstream master cycle arbiter. When the MCA is holding the maximum number (four) of delayed completions, the DC counter 162 asserts a DC full signal (tc.sub.-- dc.sub.-- full) that prevents the downstream QPIF 148 from running delayed request transactions on the secondary PCI bus 32. As soon as the full condition disappears, delayed completion information may be sent to downstream DCQ.
A PCI interface block 152 resides between the PCI bus 32 and the queue block 127. The PCI interface 152 includes a master block 123 and a slave (target) block 121. The slave block 121 allows PCI devices on the bus 32 to access the bridge chip's internal registers (e.g., target memory range registers 155 and configuration registers), to claim completion information stored in the DCQ 144, and to initiate transactions that are passed through the QPIF 148 and the cable interface 130 to the primary bus. The slave block 121 controls the availability of the PCI bus 32 to the PCI devices on the bus 32 by recognizing when each device asserts its REQ# line and forwarding the REQ# signals to the PCI arbiter 124. When the PCI arbiter 124 selects a requesting device to receive control of the bus, the slave block 121 grants the bus to the device by asserting the device's GNT# line. As soon as the bus 32 is granted to the requesting device and the device asserts its FRAME# signal indicating the beginning of a transaction, the slave block 121 latches the transaction information (e.g., address, command, data, byte enables, parity, etc.) into a slave latching register 156. The queue block 127 then is able to retrieve the transaction information from the latching register 156 and provide it to the DCQ 144 and/or the cable interface 130.
Transactions supported by the PCI slave block 121 are shown in the following table.
______________________________________PCI Interface Slave TransactionsTransaction Type Primary Interface Secondary Interface______________________________________Interrupt Acknowledge Not supported Not supportedSpecial Cycle Delayed DelayedI/O Read Delayed DelayedI/O Write Delayed DelayedMemory Read Delayed DelayedMemory Write Posted PostedConfiguration Read Immediate Not supported(type 0)Configuration Write Immediate Not supported(type 0)Configuration Read Delayed Not supported(type 1)Configuration Write Delayed Not supported(type 1)Memory Read Multiple Delayed (Streaming) Delayed (Streaming)Dual Address Cycle Not Supported ImmediateMemory Read Line Delayed DelayedMemory Write and Posted PostedInvalidate______________________________________
The master block 123 of the PCI interface 152 runs only cycles initiated by the queue block 127 (i.e., transactions held in the PMWQ 140 and DRQ 142). The queue block 127 requests the PCI bus by sending a request signal (q2p.sub.-- req) to the PCI master 123, which then determines whether to assert a corresponding request signal (blreq.sub.--) to the PCI arbiter 124. The master block 123 asserts blreq.sub.-- if the queue block 127 is not running a locked cycle and the PCI bus 32 is not locked by another PCI device. When the PCI arbiter 124 selects the queue block 127, the master block 123 sends an acknowledge signal (p2q.sub.-- ack) to let the queue block 127 know it has control of the bus 32. If the PCI arbiter 124 has no outstanding requests from other devices on the bus 32, the master block 123 automatically sends the p2q.sub.-- ack grant signal to queue block 127, even if the queue block 127 has not asserted the q2p.sub.-- req signal. As soon as the queue block 127 wins arbitration (i.e., the arbiter 124 asserts the blgnt.sub.-- signal) and asserts its q2p.sub.-- frame signal to indicate the beginning of a transaction, the PCI master 123 latches outgoing transaction information (i.e., address, command, data, byte enables, parity, etc.) into a master latching register 158 in the PCI interface 152. The transaction information then is used to complete the transaction on the PCI bus 32.
Transactions supported by the master block 123 are shown in the following table.
______________________________________PCI Interface Master TransactionsTransaction Type Primary Interface Secondary Interface______________________________________Interrupt Acknowledge Not supported Not supportedSpecial Cycle Supported SupportedI/O Read Supported SupportedI/O Write Supported SupportedMemory Read Supported SupportedMemory Write Supported SupportedConfiguration Read Not Supported SupportedConfiguration write Not Supported SupportedMemory Read Multiple Supported SupportedDual Address Cycle Supported Not SupportedMemory Read Line Supported SupportedMemory Write and Supported SupportedInvalidate______________________________________
In general, the master block 123 operates as a standard PCI master. However, unlike standard PCI bridges, the master block will not terminate a MRL, MRM, or MWI transaction until a cache line boundary is reached, even after the master latency timer (MLT) expires. Also, the master block 123 does not assert "initiator ready" (IRDY) wait states. The master block 123 runs a locked cycle on the PCI bus 32 if the queue block 127 asserts its "lock" signal (q2p.sub.-- lock) and releases its lock on the bus 32 when the queue block 127 asserts its "unlock" signal (q2p.sub.-- unlock).
Referring also to FIG. 57, the PCI interface 152 contains buffer flushing logic 154 that determines when one or all of the DCQ completion buffers should be flushed by the queue block 127. The PCI slave 121 generates two signals that are used by the queue block 127 to flush the completion buffers: a flush signal (p2q.sub.-- flush) that indicates when a buffer should be flushed, and a slot selection signal (p2q.sub.-- slot�2:0!) that indicates which PCI device (i.e., which slot on the PCI bus) should have data flushed. The following table shows the relationship between p2q.sub.-- slot�2:0! and the PCI slot number.
______________________________________Creation of p2q.sub.-- slot�2:0! p2.sub.-- slot�2:0! slot number______________________________________ 000 all 001 1 010 2 011 3 100 4 101 5 110 6 111 7______________________________________
When p2q.sub.-- flush is asserted, the queue block 127 will flush either all of the completion buffers in the DCQ 144 if p2q.sub.-- slot�2:0! is equal to "000" or the corresponding one of the eight completion buffers if p2q.sub.-- slot�2:0! has any other value. The queue block 127 keeps track of which completion buffers, if any, correspond to each PCI slot at any given time.
The p2q.sub.-- flush signal is asserted at the rising edge of the first PCI clock (CLK) cycle after a config write (wr.sub.-- cfg) cycle occurs or after an I/O write (iowr) cycle occurs or a memory write (memwr) cycle hits a downstream target (hit.sub.-- tmem) during a command check state (cmd.sub.-- chk.sub.-- st). Gates 2014, 2016, 2018, and 2020, and flip-flop 2022 are arranged to produce p2q.sub.-- flush in this way.
In the upstream bridge chip (i.e., when the upstream.sub.-- chip.sub.-- i signal is asserted), p2q.sub.-- slot�2:0! always has a value of "001" since the CPU is the only master on the primary PCI bus. In the downstream chip, the value of p2q.sub.-- slot depends upon whether the cycle leading to a flush condition is a cycle from the secondary bus 32 to the queue block 127 (i.e., if p2q.sub.-- qcyc is asserted). If the p2q.sub.-- qcyc signal is asserted, p2q.sub.-- slot�2:0! takes on the value of the req.sub.-- slot�2:0! signal produced by the PCI slave 121. The req.sub.-- slot�2:0! signal indicates which of the seven devices on the secondary PCI bus 32 has been granted control of the bus 32. The PCI slave 121 generates the req.sub.-- slot�2:0! signal by latching the value of the GNT# line for each of the seven slots on the bus 32 to form a seven bit latched grant signal (latched.sub.-- gnt.sub.-- �7:1!; the eighth grant line, which belongs to the queue block, is ignored) and encoding latched.sub.-- gnt�7:1! according to look-up table 2006, as follows.
______________________________________Creation of req.sub.-- slot�2:0!latched.sub.-- gnt.sub.-- �7:1! req.sub.-- slot�2:0!______________________________________1111111 0001111110 0011111101 0101111011 0111110111 1001101111 1011011111 1100111111 111______________________________________
If the cycle leading to the flush is not a secondary-PCI-to-queue-block cycle, it must be an I/O read or config read to the target memory range of one of the slots on the secondary bus 32. When the cycle is an I/O read or config read (i.e., |iowr AND |wr.sub.-- cfg), p2q.sub.-- slot�2:0! takes on the value of the PCI slot whose memory range has been hit (mrange.sub.-- slot�2:0!). Otherwise, the cycle is an I/O write or a config write, and p2q.sub.-- slot�2:0! is set equal to "000" so that all completion buffers are flushed. Gates 2008 and 2010 and multiplexers 2002 and 2004 are arranged to generate p2q.sub.-- flush�2:0! in this way.
CABLE DECODER
Referring to FIG. 58, the cable decoder 146 receives transactions from the cable interface and selects the appropriate queue to receive each transaction. When the cable decoder is in the data phase (i.e., when data.sub.-- phase or next.sub.-- data.sub.-- phase, an asynchronous signal that sets the value of data.sub.-- phase at the next CLK cycle, is asserted), the cable decoder 146 looks at the command code (cd.sub.-- cmd�3:0!) sent across the cable to determine which queue should receive the transaction. As shown in the table below, when cd.sub.-- cmd�3:0! has a value of "1001", the transaction is a delayed completion, so the cable decoder asserts a cd.sub.-- dcq.sub.-- select signal that tells the DCQ to claim the transaction. When the three LSB of the command code signal (cd.sub.-- cmd�2:0!)) are "111", the transaction is a posted memory write, so the cable decoder generates a cd.sub.-- pmwq.sub.-- select signal to alert the PMWQ of the incoming transaction. When the transaction is neither a posted memory write nor a delayed completion and the command code does not represent a streaming signal, the cable decoder asserts a cd.sub.-- drq.sub.-- select signal that tells the DRQ to claim the transaction. Gates 2024, 2026, 2028, and 2030 are configured to generate the cd.sub.-- dcq.sub.-- select, cd.sub.-- pmwq.sub.-- select, and cd.sub.-- drq.sub.-- select signals in this way.
The following table shows the four bit command codes associated with each type of transaction.
______________________________________Transaction Command CodesTransaction Type Command Code______________________________________I/O Read 0010I/O Write 0011Config read 1010Config write 1011Memory read 0110MRL 1110MRM 1100Memory write 0111MWI 1111Delayed completion 1001Stream established 1000______________________________________
When the downstream bridge chip has established a data stream between the primary bus and a secondary bus master, the upstream cable decoder receives a command code of "1000". This code represents a streaming signal generated by the downstream chip to inform the upstream chip that a stream has been established. When the cable decoder receives this command code, it asserts a cd.sub.-- stream signal that tells the QPIF in the upstream device to continue the transaction. The cable decoder also generates a cd.sub.-- stream.sub.-- next.sub.-- data signal that instructs the upstream chip to provide another piece of data to the secondary bus. The cd.sub.-- stream.sub.-- next.sub.-- data signal is asserted when cd.sub.-- stream signal is asserted, the transaction is in the data phase (i.e., data.sub.-- phase is asserted), and a next.sub.-- data signal has been received from the downstream chip through the cable interface (the next.sub.-- data signal appears on one of the lines of the c2q.sub.-- buff�3:0! signal, which, when no stream is occurring, tells the queue block which downstream DCQ buffer is associated with the current transaction). The cd.sub.-- stream.sub.-- next.sub.-- data signal is deasserted when either the cd.sub.-- stream signal is deasserted or when a new request is received from the cable interface (i.e., c2q.sub.-- new.sub.-- req is asserted). Gates 2032 and 2034 are configured to generate the cd.sub.-- stream and cd.sub.-- stream.sub.-- next.sub.-- data signals in this way.
POSTED MEMORY WRITE QUEUE
Referring to FIG. 59, the posted memory write queue (PMWQ) 140 is a storage element that contains all of the command information needed to execute posted write transactions on the target bus. The PMWQ includes a tag memory portion 2036 that holds information identifying each transaction, a data RAM 2038 that holds the write data associated with each transaction in the PMWQ, and various control blocks to manage the flow of transactions into and out of the PMWQ. For each transaction in the PMWQ, the tag memory 2036 maintains information such as the address to be written to, the PCI command code (MW or MWI), an address parity bit, and "locked cycle" and "dual address cycle" indication bits, as shown in the following table. The tag memory 2036 also stores a pointer to the data RAM location of the data corresponding to each of the transactions in the PMWQ.
______________________________________Contents of PMWGField Bits Comments______________________________________Address 64 Upstream Transactions support Dual Address CyclesPCI Command 1 Memory Write 0111 Memory Write and Invalidate 1111 (only necessary to store cbe�3!)Byte Enables 0 Store BEs on every valid transfer clock in the data RAM.Parity 1/address Must store PAR with each transfer along with 32-bit addr/data. 0 Must store data parity bits on every valid data transfer in data RAM.Data 0 Stored in data RAM up to 8 cache linesLock 1DAC Indication 1 Indicates whether address is 32 or 64 bits______________________________________
Because the PCI Spec 2.1 requires posted memory write transactions to be executed in the order in which they are received, the tag memory 2036 is a circular FIFO device. The PMWQ, and therefore the tag memory 2036, can handle up to four posted memory write transactions simultaneously.
The data RAM 2038 includes four data buffers 2042, 2044, 2046, and 2048, one for each transaction in the PMWQ. Each buffer can store up to eight cache lines, or 256 bytes, of data (eight words per cache line). For each cache line in a buffer, the buffer stores eight data parity bits 2040 (one per dword) and thirty-two enable bits 2050 (one per byte).
A cable interface block 2060 receives each transaction and the corresponding data from the cable decoder and places the transaction in the tag memory 2036. A queue interface block 2053 receives the data from the cable interface block 2060 and places it in the appropriate location in the data RAM 2038. The queue interface 2053 also retrieves data from the data RAM 2038 and provides it to the QPIF when the QPIF is running the corresponding transaction on the PCI bus. An input pointer logic block 2054 generates four input pointers, one for each buffer, that tell the queue interface 2053 where to place the next word of data. A valid (output) pointer block 2056 generates four output pointers, one for each buffer, that indicate the position of the next word to be taken.
Referring also to FIG. 60, a valid flag logic block 2052 maintains an eight bit valid line register 2062 for each of the four buffers in the data RAM 2038. The valid line register 2062 indicates which of the eight cache lines in each buffer contain valid data. When the last word in a cache line has been filled with data (i.e., valid.sub.-- pointer�2:0! equals "111" and cd.sub.-- next.sub.-- data is asserted, indicating that the word has been filled), the corresponding bit in an eight bit cable valid signal (i.e., q0.sub.-- cable.sub.-- valid�7:0!, q1.sub.-- cable.sub.-- valid�7:0!, etc.) is set. The bit to be set is determined by the three most significant bits of the valid pointer (valid.sub.-- pointer�5:3!), which indicate the cache line being filled. The corresponding bit in the cable valid signal also is set when a slot validation signal (validate.sub.-- slot) is received from the cable decoder at the end of a transaction. The cable valid signal is latched into the valid line register 2062 corresponding to the selected data buffer at the rising edge of the first PCI clock cycle (CLK) after the last word is filled or the validate.sub.-- slot signal is received. Otherwise, the valid line register maintains its current value. The bits in the valid line registers 2062 are cleared when the corresponding bits of an eight bit invalidate signal (i.e., q0.sub.-- invalid�7:0!, q1.sub.-- invalid�7:0!, etc.) is asserted.
The valid flag logic block 2052 generates a pmwq.sub.-- valid�3:0! signal that indicates which, if any, of the four data buffers contains at least one valid line of data. The valid block 2052 also generates a pmwq.sub.-- valid.sub.-- lines�7:0! signal that indicates which of the eight cache lines of a selected data buffer are valid. A queue select signal from the QPIF (q2pif.sub.-- queue.sub.-- select�1:0!) is used to select which data buffer's valid line register 2062 is used to generate the pmwq.sub.-- valid.sub.-- lines�7:0! signal. When the queue block gains control of the bus to run a posted memory write cycle from a selected data buffer, the queue block transfers all data in each line whose corresponding bit is set in the pmwq.sub.-- valid.sub.-- lines�7:0! signal. Gates 2064, 2066, 2068, 2070, and 2072, and flip-flop 2074 are arranged to set the values in the valid line register 2062 for the first data buffer (q0.sub.-- valid�7:0!). Similar circuitry determines the contents of the valid registers for the other three data buffers. Multiplexer 2076 selects the value of the pmwq.sub.-- valid.sub.-- lines�7:0! signal.
Referring now to FIG. 61, a full line logic block 2058 maintains an eight bit full line register 2078 for each of the four data buffers. The contents of each full line register 2078 indicate which of the eight cache lines in the corresponding data buffer are full. The bits in each full line register 2078 are set by an asynchronous next.sub.-- full.sub.-- line.sub.-- bit signal generated by full line state machine 2080, described below. When a queue selection signal from the QPIF (select.sub.-- next.sub.-- queue�3:0!) selects one of the data buffers and the next.sub.-- full.sub.-- line.sub.-- bit signal is asserted, the bit in the full line register 2078 corresponding to the cache line indicated by the three most significant bits of the valid pointer (valid.sub.-- pointer�5:3!) is set. A 3.times.8 decoder 2082 converts the three bit valid pointer into an eight bit signal that determines which bit to set. An eight bit full line signal (q0.sub.-- full.sub.-- line) is generated for each data buffer from the contents of the corresponding full line register 2078. The full line signal indicates which lines in the corresponding data buffer are full. The full line logic block 2058 also generates a pmwq.sub.-- full.sub.-- line�7:0! signal that indicates which cache lines of a selected data buffer are full. Multiplexer 2084 and the q2pif.sub.-- queue.sub.-- select�1:0! signal are used to generate the pmwq.sub.-- full.sub.-- line�7:0! signal.
Referring also to FIG. 62, the full line state machine 2080 is placed in an IDLE state 2086 at reset. In the IDLE state 2086, the next.sub.-- full.sub.-- line.sub.-- bit is set to zero. When a transaction is placed in the PMWQ, the transaction occurs in two phases, an address phase and a data phase. When the data phase begins (i.e., a clock.sub.-- second.sub.-- phase signal is asserted) and the valid pointer points to the first word in a cache line (valid.sub.-- pointer�2:0!="000"), the state machine 2080 transitions to a DATA state 2088. In the data state, the next.sub.-- full.sub.-- line.sub.-- bit signal is asserted only if the valid pointer points to the last word in the cache line (valid.sub.-- pointer�2:0!="111"), the cd.sub.-- next.sub.-- data signal is asserted by the cable decoder (indicating that the last word was filled with data), and the byte enable signal from the cable decoder (cd.sub.-- byte.sub.-- en�3:0!) equals "0000". The state machine also transitions back to the IDLE state 2086 when these conditions occur. If these conditions do not occur before the transaction terminates (i.e., cd.sub.-- complete is asserted), the next.sub.-- full.sub.-- line.sub.-- bit signal remains deasserted and the state machine 2080 transitions back to the IDLE state 2086. The state machine 2080 also transitions to the IDLE state 2086 without asserting the next.sub.-- full.sub.-- line.sub.-- bit signal when the cd.sub.-- byte.sub.-- en�3:0! signal takes on a value other than "0000".
Referring again to FIG. 59 and also to FIG. 63, the PMWQ normally must terminate a transaction from the cable decoder when the data buffer receiving the corresponding data is full. However, when the cable decoder continues to send data after the buffer is full, an overflow logic block 2090 allows the data to overflow into the next empty buffer. The overflow logic block 2090 maintains an overflow register 2092 that indicates which, if any, of the four data buffers are being used as overflow buffers. The contents of the overflow register 2092 are used to produce a four bit overflow signal (pmwq.sub.-- overflow�3:0!). When the transaction is in the data phase (i.e., data.sub.-- phase is asserted), the valid pointer reaches the last word of a data buffer (i.e., valid.sub.-- pointer�5:0!="111111"), the cable decoder indicates that more data is coming (i.e., cd.sub.-- next.sub.-- data is asserted), and the cable decoder has not indicated that the transaction is complete (i.e., cd.sub.-- complete is not asserted), the select.sub.-- next.sub.-- queue�3:0! signal, which points to the recently filled data buffer, is used to set the overflow register bit corresponding to the next data buffer. If the conditions are not met, the overflow bit is cleared. Gates 2094 and 2095 are used in conjunction with the select.sub.-- next.sub.-- queue�3:0! signal to set and clear the appropriate overflow register bits when these conditions are met.
A single transaction may continue to overflow into additional buffers until the last unused buffer is full. If more than one buffer is used as an overflow buffer, multiple overflow register bits will be set. Consecutive set bits in the overflow register indicate that a single transaction has overflowed into more than one buffer. The overflow bits are either set or cleared when the posted write transaction is placed into the PMWQ. Also, if the QPIF begins to run the PMW transaction on the target bus and empty the original buffer while the data is still entering the PMWQ, the original buffer may be reused to continue the overflow transaction. The overflow can continue until all of the available buffers are full.
DELAYED REQUEST QUEUE
Referring to FIG. 64, the DRQ 142 stores all of the information needed to complete delayed read request (DRR) and delayed write request (DWR) transactions on the target bus. The DRQ includes a queue memory 2100 that holds information such as the address to be read from or written to, the PCI command code, byte enables, address and data parity bits, "locked cycle" and "dual address cycle" indication bits, and the buffer number of the delayed completion buffer reserved in the initiating bridge chip for the completion information. The queue memory 2100 also holds up to thirty-two bits (one word) of data to be written to the target bus in a delayed write cycle. Because delayed write cycles never involve more than one word of data, no data RAM is needed in the DRQ. The DRQ, and therefore the queue memory 2100, is capable of holding up to three delayed request transactions at once. A cable interface block 2102 claims delayed request transactions from the cable decoder and places them into the queue memory 2100. The following table shows the information maintained in the DRQ queue memory.
______________________________________Contents of DRQField Bits Comments______________________________________Address 64 Upstream Transactions support Dual Address CyclesPCI Command 4 I/O Read I/O Write Config Read Config Write Memory Read Memory Read Line Memory Read MultipleByte Enables 4 Byte Enables not necessary on MRL, MRMParity 1/address 1/data transfer Send data par with delayed write transactionsData 32 Data queued on delayed write transactions.Lock 1DAC 1 Indicates whether address is 32 orIndication 64 bitsBuff Num 3 Indicates DCQ buffer allocated for completion data______________________________________
Referring also to FIG. 65, a valid flag logic block 2104 determines when the DRQ has received all of the information necessary to run the transactions in the queue memory 2100. When one of the DRQ slots is selected by a corresponding slot select signal (i.e., select.sub.-- zero for the first slot, select.sub.-- one for the second slot, and select.sub.-- two for the third slot) and the slot is validated by a validate.sub.-- slot signal, indicating that the cable decoder has finished delivering the transaction to the DRQ, a valid signal corresponding to the slot (i.e., q0.sub.-- valid, q1.sub.-- valid, or q2.sub.-- valid) is asserted at the rising edge of the next PCI clock (CLK) cycle. If a slot is not selected and validated by the validate.sub.-- slot signal, the slot's valid signal is deasserted if the QPIF has selected the slot by asserting a DRQ select signal (q2pif.sub.-- drq.sub.-- select) and identifying the slot (q2pif.sub.-- queue.sub.-- select=slot number) but has aborted the transaction by asserting a cycle abort signal (q2pif.sub.-- abort.sub.-- cycle). The valid signal also is deasserted if the DRQ ends the transaction by asserting a cycle complete signal (e.g., q0.sub.-- cycle.sub.-- complete) while the QPIF is waiting for more data (i.e., q2pif.sub.-- next.sub.-- data is asserted). However, the cycle complete signal is ignored if the QPIF is currently streaming data to the other bridge chip (i.e., q2pif.sub.-- streaming is asserted). Otherwise, if the slot's valid signal is not specifically asserted or deasserted on a clock cycle, it retains its current value. The valid flag logic block 2104 also generates a DRQ valid signal (drq.sub.-- valid�3:0!) that indicates which, if any, of the three DRQ slots contains a valid transaction, by combining the valid signals for each individual slot (i.e., drq.sub.-- valid={0, q2.sub.-- valid, q1.sub.-- valid, q0.sub.-- valid}). Gates 2106, 2108, 2110, 2112, and 2114, multiplexers 2116 and 2118, and flip-flop 2120 are arranged to generate the slot valid signals and the DRQ valid signals in this manner.
The DRQ also includes pointer logic blocks that maintain pointers to the memory locations from which data is to be read during a delayed read request transactions. When the address at which the delayed read transaction will begin is loaded into the queue memory 2100, a valid pointer logic block 2122 generates a six bit valid pointer that indicates where the transaction will end. If the transaction involves a single word (e.g., a memory read), the valid pointer logic 2122 sets the valid pointer equal to the address loaded into the queue memory 2100. For a memory read line transaction, the valid pointer logic 2122 gives the valid pointer a value of "000111", which indicates that the last valid piece of data is eight dwords (i.e., one cache line) beyond the starting point. For a memory read multiple transaction, the valid pointer is set to "111111", which indicates that the last valid piece of data is sixty-four dwords (i.e., eight cache lines) beyond the starting point. The valid pointer logic 2122 maintains one valid pointer for each slot in the DRQ (valid.sub.-- pointer.sub.-- 0�5:0!, valid.sub.-- pointer.sub.-- 1�5:0!, and valid.sub.-- pointer.sub.-- 2�5:0!). The location of the valid pointer is ignored by the DRQ when it receives a streaming signal from the QPIF (q2pif.sub.-- streaming), as described in more detail below.
An output pointer logic block 2124 maintains three output pointers (output.sub.-- pointer.sub.-- 0�5:0!, output.sub.-- pointer.sub.-- 1�5:0!, and output pointer.sub.-- 2�5:0!), one for each slot in the DRQ, that indicate the next word of data to be read from memory and delivered to the other bridge chip. The pointer is incremented when the QPIF indicates that it is ready to read the next piece of data (i.e., it asserts the q2pif.sub.-- next.sub.-- data signal), once for every word read. Except in streaming situations, a transaction is terminated (completed) when the output pointer reaches the valid pointer. If a transaction terminates before all of the data is read (i.e., before the output pointer reaches the input pointer), the QPIF will pick up at the location indicated by the output pointer when the transaction resumes. If the output pointer is incremented but the output pointer logic 2124 receives a stepback signal (q2pif.sub.-- step.sub.-- back), indicating that the transaction was terminated on the PCI bus before the QPIF was able to read the last piece of data, the output pointer logic 2124 decrements the counter once so that the last unread piece of data can be read when the transaction resumes. A queue interface block 2126 provides transaction information and the valid and output pointers to the QPIF.
DELAYED COMPLETION QUEUE
Referring to FIG. 66, the DCQ 144 stores delayed completion messages containing the response of the target bus to each delayed request issued on the initiating bus. Delayed completion messages corresponding to delayed read requests include the requested data, while delayed completion messages corresponding to delayed write requests include no data. A cable interface block 2130 claims delayed completion messages from the cable decoder and provides the delayed completion information to a tag memory 2132. The DCQ, and therefore the tag memory 2132, is capable of storing up to eight delayed completion messages at once. The tag memory 2132 stores information such as the PCI command and the address contained in the original request leading to the delayed completion message, byte enable bits, address and data parity bits, and "locked cycle" and "dual address cycle" bits. For delayed write transactions, which always involve only in a single word of data, the tag memory 2132 stores a copy of the written data. Each of the eight slots in the tag memory 2132 includes an implied pointer to one of eight corresponding data buffers in a DCQ data RAM 2134. For delayed read transactions, the returned data is stored in a corresponding data buffer 2135a-h in the data RAM 2134. The following table shows the information stored in the tag memory 2132 for each transaction held in the DCQ.
______________________________________Contents of DCQField Bits Comments______________________________________Address 64 Upstream Transactions support Dual Address CyclesPCI Command 4 I/O Read I/O Write Config Read Config Write Memory Read Memory Read Line Memory Read MultipleByte Enables 4 Byte Enables not necessary on MRL, MRMParity 1/data transfer Send data par with delayed write transactionsData 32 Data queued on delayed write transactions.Lock 1DAC 1 Indicates whether address is 32 orIndication 64 bits______________________________________
Each of the eight data buffers in the DCQ data RAM 2134 may store up to eight cache lines (256 bytes) of delayed completion data. Therefore, the buffers are large enough to store all completion data for even the largest delayed request transactions (memory read multiple transactions). However, the capacity of each data buffer may be reduced to four cache lines by setting a configuration bit (cfg2q.sub.-- eight line.sub.--) in the bridge chip's configuration registers. Each data buffer may be filled by data provided in a single delayed completion transaction, or if not all requested data is returned in a single delayed completion transaction, by multiple delayed completion transactions. However, each data buffer may contain data corresponding to only one original delayed request, regardless of how many delayed completion transactions it takes to provide the requested data.
A queue interface block 2136 controls the flow of completion data from the DCQ cable interface 2130 into the data RAM 2134 and out of the data RAM 2134 to the QPIF. Three logic blocks generate pointers that govern the input and output of data stored in the eight data buffers. The first block, an input pointer logic block 2138, maintains a six bit input pointer for each of the eight data buffers (in pointer.sub.-- 0�5:0!, in.sub.-- pointer.sub.-- 1�5:0!, etc.). Each input pointer points to the location in the corresponding data buffer to place the next word of data. The second block, an output pointer logic block 2140, maintains a six bit output pointer for each of the eight buffers (out.sub.-- pointer.sub.-- 0�5:0!, out pointer.sub.-- 1�5:0!, etc.). Each output pointer points to the location of the word of data immediately following the word last removed by the QPIF. The output pointer for a selected data buffer is incremented when the QPIF indicates that it is ready for the next piece of data (i.e, when q2pif.sub.-- next.sub.-- data is asserted). If the output pointer is incremented but the last piece of data does not reach the requesting device because the transaction was terminated by a device other than the QPIF, the QPIF asserts a stepback signal (q2pif.sub.-- step.sub.-- back) that causes the output pointer logic block 2140 to decrement the output pointer by one word.
The third pointer block, a valid pointer logic block 2142, maintains for each of the eight data buffers a six bit valid pointer (valid.sub.-- pointer.sub.-- 0�5:0!, valid.sub.-- pointer.sub.-- 1�5:0!, etc.) that indicates the next word of data in the corresponding data buffer that is available to the QPIF. Because the PCI Spec 2.1 requires that read completion data not be returned before an earlier-initiated posted memory write transaction, delayed completion data placed into the DCQ while a posted memory write is pending in the PMWQ cannot be made available to the requesting device until the posted memory write is completed on the PCI bus and removed from the PMWQ. Therefore, as long as any earlier-enqueued posted memory write transactions remain in the PMWQ, the valid pointer must remain at its current position. Then, when all earlier-enqueued posted memory writes have been removed from the PMWQ, the valid pointer may be moved to the same position as the in pointer. When the PMWQ is empty, all delayed completion data is valid (i.e., available to the requesting device) as soon as it is stored in the DCQ.
Referring also to FIGS. 67A and 67B, the valid pointer logic block 2142 must ask the master cycle arbiter (MCA) to validate all delayed completion transactions that enter the delayed completion queue while a posted memory write is pending in the PMWQ. But because the MCA can enqueue no more than four delayed completion transactions at once, as discussed below, the valid pointer logic block 2142 may request validation of no more than four delayed completion data buffers at once. The valid pointer logic block 2142 also must keep track of which four delayed completions transactions are enqueued in the MCA at any given time. To do so, the valid pointer logic block 2142 maintains two four-slot registers: a DCQ buffer number register 2144 and a validation request register 2146. The buffer number register 2144 maintains the three-bit DCQ buffer number, as determined by the DCQ buffer number signal (cd.sub.-- dcq.sub.-- buff.sub.-- num�2:0!) provided by the cable decoder, of each delayed completion transaction enqueued in the MCA. The validation request register 2146 maintains one transaction validation request bit for each of the DCQ buffers whose numbers are stored in the four slots 2148a-d of the buffer number register 2144. The request bit in each slot 2150a-d of the validation request register 2146 is asserted if a corresponding delayed completion transaction is enqueued in the MCA. The values of the bits in the four validation request slots 2150a-d are provided together to the MCA as a four bit validation request signal (dcq.sub.-- valid�3:0!).
When a delayed completion transaction is to be enqueued in the MCA, its corresponding DCQ buffer number is loaded into one of the buffer number slots 2148a-d by the cd.sub.-- dcq.sub.-- buff.sub.-- num�2:0! signal. The slot 2148a-d to be loaded is selected by a two bit selection signal (next.sub.-- valid.sub.-- select�1:0!). The value of the selection signal depends upon the value of the dcq.sub.-- valid�3:0! signal generated by the validation request register 2146 and look-up table 2152, the contents of which are shown in the table below. The slot is loaded when it is selected by next.sub.-- valid.sub.-- select�1:0!, when the cable decoder has selected the DCQ and has completed the transaction (i.e., cd.sub.-- dcq.sub.-- select and cd.sub.-- complete are asserted), and when at least one posted memory write transaction is pending in the PMWQ (i.e., pmwq.sub.-- no.sub.-- pmw is not asserted). Gates 2154, 2156, 2158, 2160, and 2162 and 2.times.4 decoder 2164 are arranged to load the buffer number register 2144 in this manner. Likewise, the corresponding bit in the validation request register 2146 is set by the output of gates 2154, 2156, 2158, 2160, and 2162 and 2.times.4 decoder 2164.
______________________________________Buffer number register slot selectiondcq.sub.-- valid�3:0! next.sub.-- valid.sub.-- select�1:0! slot #______________________________________xxx0 00 0xx01 01 1x011 10 20111 11 3______________________________________
In response to the dcq.sub.-- valid�3:0! signal, the MCA outputs a four bit DCQ run signal (mca.sub.-- run.sub.-- dcq�3:0!)) that indicates which of the DCQ buffers pointed to by the buffer number register may have its valid pointer updated. The mca.sub.-- run.sub.-- dcq�3:0! signal is provided to a valid pointer update logic block 2166, along with the pmwq.sub.-- no.sub.-- pmw signal and the in pointers for each of the eight data buffers. If a posted memory write transaction remains in the PMWQ after the MCA asserts one of the mca.sub.-- run.sub.-- dcq�3:0! bits (which will happen when a posted memory write transaction was enqueued after the delayed completion transaction was enqueued but before the MCA asserted the corresponding mca.sub.-- run.sub.-- dcq bit), the corresponding valid pointer is updated as long as no other delayed completion transactions corresponding to the same DCQ buffer are still enqueued in the MCA. If a delayed completion transaction for the same DCQ buffer is still enqueued in the MCA, the valid pointer may be updated only when the mca.sub.-- run.sub.-- dcq bit corresponding this transaction is asserted. On the other hand, as soon as the pmwq.sub.-- no.sub.-- pmw signal is deasserted, all valid pointers are updated to match the corresponding in pointers regardless of whether delayed completions are still enqueued in the MCA. When a mca.sub.-- run.sub.-- dcq bit is asserted, the corresponding bit in the validation request register 2146 is cleared. Gates 2168, 2170, 2172, 2174, and 2176 are arranged to clear the validation request register bits in this manner.
Referring again to FIG. 66, a hit logic block 2180 determines when a delayed request transaction from a requesting device on the PCI bus has "hit" one of the delayed completion messages in the DCQ. According to the PCI Spec 2.1, the following attributes must be identical for a delayed completion to be matched with a request: address, PCI command, byte enables, address and data parity, data (if a write request), REQ64# (if a 64-bit data transaction), and LOCK# (if supported). When a request is latched by the PCI slave, the QPIF retrieves the request information, sends it to the DCQ, and asserts a check cycle signal (q2pif.sub.-- check.sub.-- cyc) that instructs the DCQ hit logic 2180 to compare the request information to the delayed completion messages stored in the DCQ tag memory 2132. The hit logic 2180 receives the sixty-four bit address signal (q2pif.sub.-- addr�63:2!), the four bit PCI command signal (q2pif.sub.-- cmd�3:0!), the four enable bits (q2pif.sub.-- byte.sub.-- en�3:0!), the dual address cycle bit (q2pif.sub.-- dac) (which corresponds to the PCI REQ64# signal), the lock bit (q2pif.sub.-- lock) from the QPIF, and, if the request is a write request, the data to be written (q2pif.sub.-- data�31:0!). Though not required by the PCI Spec 2.1, the QPIF also provides the slot number (q2pif.sub.-- slot�2:0!) of the requesting device to enhance the queue block's buffer flushing routine, described below. The hit logic 2180 then compares each of these signals to the delayed completion information stored in the eight DCQ buffers. If all of the signals match the information of any of the delayed completion messages, the hit logic 2180 identifies the buffer containing the matching completion message by asserting a corresponding bit in an eight bit hit signal (dcq.sub.-- hit�7:0!). When a hit occurs, the QPIF retrieves the completion message and provides it to the requesting device and, if the request is a read request, begins removing the returned data from the corresponding data buffer in the data RAM 2134. If the request information does not match the completion information of any of the delayed completion messages in the DCQ, the request has "missed" the DCQ and is stored in the next available DCQ buffer and forwarded through the cable to the other bridge chip by the QPIF. A PCI device which initiates a request that misses the DCQ may have its REQ# line masked until its completion message is returned, as described in more detail below.
The hit logic 2180 also interfaces with a multi-threaded master detection block 2182 to detect which PCI slots, if any, contain multi-threaded devices. Multi-threaded devices are capable of maintaining more than one delayed transaction at once and therefore must be treated specially. When a multi-threaded master is detected, a corresponding bit in the configuration registers is set to indicate that the device is able to sustain multiple outstanding delayed transactions and therefore that its REQ# line should not be masked. Multi-threaded master detection is discussed in more detail below.
Another function of the DCQ is to determine when an opportunity to create a stream of read data between the primary and secondary PCI buses exists. A streaming opportunity exists when delayed completion data is being placed into the DCQ by the cable decoder while it is still being placed onto the target bus by the target device. If the PCI device that initiated the transaction resubmits its request while the target device is still placing data on the PCI bus, a read stream is established. Because read streaming is an efficient way to transfer data between the primary and secondary PCI buses, the PCI bridge chip not only gives higher priority in the bus arbitration process to a device whose completion data is arriving, it also will attempt to terminate a non-streaming transaction to improve the possibility that a stream will be established. However, while in theory streaming can occur during any read cycle, in practice it is likely to occur only during transactions that involve a large amount of data (i.e., memory read multiple transactions). Therefore, the queue block will attempt to terminate transactions in favor of potential streaming opportunities only when the potential streaming transaction is a memory read multiple transaction.
Referring also to FIG. 68, a stream logic block 2184 in the DCQ determines whether a streaming opportunity exists and, if so, generates the signals required to support the stream. The stream logic block 2184 generates the signals required to disconnect a current transaction in favor of a potential stream. When the cable decoder is placing a delayed completion transaction in the DCQ, the stream logic 2184 uses the DCQ buffer number signal provided by the cable decoder (cd.sub.-- dcq.sub.-- buff.sub.-- num) to retrieve the PCI command code stored in the corresponding DCQ buffer (q0.sub.-- cmd�3:0!), q1.sub.-- cmd�3:1!, etc.). If the command code represents a memory read multiple request (i.e., "1100"), the stream logic 2184 asserts a disconnect-for-stream signal (dcq.sub.-- disconnect.sub.-- for.sub.-- stream) that instructs the QPIF and the PCI interface to terminate the current transaction due to a potential streaming opportunity. Multiplexer 2186 and comparator 2188 are arranged to generate the dcq.sub.-- disconnect.sub.-- for.sub.-- stream signal. Then, as long as the cable decoder continues to provide the completion data to the DCQ (i.e., the cd.sub.-- dcq.sub.-- select signal remains asserted) and no posted memory writes appear in the PMWQ (i.e., pmwq.sub.-- no.sub.-- pmw remains asserted), the stream logic 2184 provides a streaming request signal (q2a.sub.-- stream) directly to the PCI arbiter. The stream logic 2184 also provides the slot number of the potential streaming device (q2a.sub.-- stream.sub.-- master�2:0!) to the PCI arbiter by using the cd.sub.-- dcq.sub.-- buff.sub.-- num�2:0! signal to select the PCI slot number stored in the selected DCQ buffer (q0.sub.-- master�2:0! for DCQ buffer zero 2135a, q1.sub.-- master�2:0! for DCQ buffer one 2135b, etc.). The PCI arbiter then elevates the bus arbitration priority of the potential streaming device, as discussed in more detail below. If the potential streaming master is not granted the bus before the streaming opportunity disappears, its priority is returned to normal. Because the upstream bus has only one master device (the CPU), this feature is disabled in the upstream chip. Gate 2190 and multiplexer 2192 are arranged to generate the q2a.sub.-- stream and q2a.sub.-- stream.sub.-- master signals.
When a requesting device hits a delayed completion message stored in the DCQ, the corresponding bit of an eight bit hit signal (hit�7:0!) is asserted. The hit�7:0! signal indicates which of the eight DCQ buffers was hit by the current request. When this happens, if the corresponding DCQ buffer contains data (i.e., dcq.sub.-- no.sub.-- data is not asserted), the stream logic 2180 latches the value of the hit signal for the duration of the transaction (i.e., as long as q2pif.sub.-- cyc.sub.-- complete is asserted). The latched version of the hit signal forms a "delayed" hit signal (dly.sub.-- hit�7:0!). When either the hit signal or the delayed hit signal indicates that a DCQ buffer has been hit, a three bit DCQ stream buffer signal (dcq.sub.-- stream.sub.-- buff�2:0!) provides the buffer number of the hit DCQ buffer. Then, if the cable decoder places delayed completion data into the buffer while the cycle that hit the buffer is in progress (i.e., cd.sub.-- dcq.sub.-- select is asserted and cd.sub.-- dcq.sub.-- buff.sub.-- num�2:0! equals dcq.sub.-- stream.sub.-- buff�2:0!), the stream logic block 2180 asserts a stream connect signal (dcq.sub.-- stream.sub.-- connect) that tells the QPIF that a stream has been established. The QPIF then informs the bridge chip on the target bus that a stream has been established. If certain conditions are met, the target QPIF will continue to stream until it is told to stop by the initiating QPIF, as discussed in more detail below. Gates 2194 and 2196, multiplexers 2198 and 2200, and flip-flop 2202 are arranged to generate the delayed hit signal. Gates 2204, 2206, and 2208 and encoder 2210 are arranged as shown to generate the dcq.sub.-- stream.sub.-- connect and dcq.sub.-- stream.sub.-- buff�2:0! signals.
Referring again to FIG. 66, the DCQ will, under certain circumstances, automatically prefetch data from the target bus on behalf of a PCI master in anticipation that the master will come back and request the data. A prefetch logic block 2212 in the DCQ prefetches data when the reading master consumes all of the data in its DCQ buffer and the prefetch logic 2212 anticipates that the requesting device will return with a sequential read request (i.e., a request that picks up with data located at the next sequential location in memory). Because some devices, such as multi-threaded masters, routinely read all of the data requested in one transaction and then return with a different, non-sequential request, the prefetch logic 2212 includes prediction circuitry that disables the prefetch capabilities for each device on the PCI bus until the device has shown a tendency to issue sequential read requests. As soon as a device that has been receiving prefetched data returns with a non-sequential read request, the prediction circuitry will disable the prefetching function for that master.
Referring also to FIGS. 69A and 69B, the prefetch logic block 2212 includes a prefetch prediction register 2214, the output of which is an eight bit prefetch enable signal (prefetch.sub.-- set�7:0!) that governs whether the prefetch function is available for each of the devices on the PCI bus. All bits in the prefetch enable signal are cleared at reset (RST) and when the QPIF orders a general flush of all of the DCQ registers (i.e., general.sub.-- flush is asserted and q2pif slot�2:0! equals "000"). The general.sub.-- flush signal is discussed in more detail below. Gates 2216 and 2218 generate the signal that resets the prefetch.sub.-- set bits.
An individual bit in the prefetch enable signal is set when the corresponding PCI slot is selected by the q2pif.sub.-- slot signal and the following conditions occur: the requesting device hits a delayed completion buffer in the DCQ (i.e., one of the bits in the cycle.sub.-- hit�7:0! signal is asserted), the current transaction is a memory read line or memory read multiple cycle (i.e., q2pif.sub.-- cmd�3:0! equals "1100" or "11110"), the QPIF has indicated that the cycle is complete (i.e., q2pif.sub.-- cyc.sub.-- complete is asserted), and the last word of data was taken from the DCQ buffer (i.e., last.sub.-- word is asserted). Gates 2220, 2222, 2224 and 2228a-h and decoder 2226 are arranged to set the prediction bits in this manner. The last.sub.-- word signal is asserted by the prefetch logic 2212 when the requesting device tries to read past the end of the DCQ buffer. This occurs when the out pointer and in pointer are equal, indicating that the end of the DCQ buffer has been reached (i.e., for a four cache line buffer, out pointer.sub.-- x�4:0! equals valid.sub.-- pointer.sub.-- x�4:0! or, for an eight cache line buffer, out.sub.-- pointer.sub.-- x�5:0! equals valid.sub.-- pointer.sub.-- x�5:0!) and when the requesting device tries to read another piece of data (i.e., q2pif.sub.-- next.sub.-- data is asserted). Gates 2230, 2232, and 2234 are arranged to generate the last.sub.-- word signal.
An individual bit in the prefetch enable signal is cleared when the corresponding PCI slot is selected and either a PCI flush condition occurs (p2q.sub.-- flush is asserted), the QPIF tells the DCQ to step back the buffer's valid pointer (q2p.sub.-- step.sub.-- back is asserted), or the requesting device initiates a transaction that misses all of the DCQ buffers (q2pif.sub.-- check.sub.-- cyc is asserted and dcq.sub.-- hit is deasserted). Gates 2236, 2238, and 2240a-h and decoder 2226 are arranged to clear the prediction enable bits in this manner.
When the prefetching function is enabled for a device on the PCI bus, the prefetch logic 2212 can generate two types of prefetch signals for the device: a prefetch line signal (dcq.sub.-- prefetch.sub.-- line) and a prefetch multiple signal (dcq.sub.-- prefetch.sub.-- mul). The prefetch line signal is generated when the current PCI command from the requesting device is a memory read line signal, and the prefetch multiple signal is generated when the current PCI command is a memory read multiple signal. In either case, the corresponding prefetch signal is generated when the following conditions occur: the prefetch.sub.-- set bit for the requesting PCI slot is set; a corresponding prefetch enable bit in the configuration registers is set (cfg2q.sub.-- auto.sub.-- prefetch.sub.-- enable); the DRQ in the upstream chip is not full (|tc.sub.-- dc.sub.-- full); the DCQ buffer has room for the corresponding amount of prefetch data (|dcq.sub.-- no.sub.-- prefetch.sub.-- room); the current cycle hit the DCQ buffer; and the requesting master has tried to read past the end of the DCQ buffer (last.sub.-- word and q2pif.sub.-- cyc.sub.-- complete). Gates 2242, 2244, 2246, 2248, 2250, and 2252, decoder 2254, and multiplexers 2256 and 2258 are arranged to generate the prefetch signals in this manner.
When the prefetch logic 2212 generates a prefetch signal, it generates a corresponding prefetch address signal (dcq.sub.-- refetch.sub.-- addr�63:2!) by concatenating the upper fifty-seven bits of the address stored in the corresponding DCQ buffer (q0.sub.-- addr�63:7! for buffer zero, q1.sub.-- addr�63:7! for buffer one, etc.) with the lower-five bits of the buffer's output pointer (out.sub.-- pointer.sub.-- 0�4:0!, etc.). A dual address cycle signal (dcq.sub.-- prefetch.sub.-- dac) indicates whether the prefetch transaction is a dual or single address cycle. The dcq.sub.-- prefetch.sub.-- cycle signal takes on the value of the dual address bit stored in the DCQ buffer (q0.sub.-- dac, q1.sub.-- dac, etc.). For both the prefetch address and dual address cycle signals, the appropriate value is output from a multiplexer 2260 or 2262 and selected by the three bit DCQ buffer number signal indicating which DCQ buffer was hit by the current request.
Referring again to FIG. 66, each DCQ data buffer has several possible states, each of which is determined by a buffer state logic block 2264 in the DCQ. The following are the possible buffer states.
1. Empty. Available for allocation. A buffer is Empty after power up and after it is flushed.
2. Complete. The buffer contains completion information for a delayed completion from a real delayed request from a device on the PCI bus (i.e., not a prefetch request). The PCI device has not yet reconnected and taken data from the buffer. The delayed completion transaction is complete.
3. Prefetch. The buffer contains completion data for a prefetch request or requested data that was left in the buffer after the requesting master disconnected from the buffer. All of the completion data has arrived from the target.
4. PartComplete. The buffer is reserved for and may contain completion information for a real delayed request (i.e., not a prefetch request). The master has not yet reconnected and taken data from the buffer, and not all of the completion information has arrived from the target.
5. PartPrefetch. The buffer is reserved for or contains completion information for a prefetch request, or the buffer contains requested data that was left in the buffer after the requesting master disconnected from the buffer. Not all of the completion information has arrived from the target.
6. Discard. The buffer was flushed while in the PartPrefetch state, but the last completion data has not yet arrived from the target. The buffer is placed in the Discard state to prevent it from being used until the transaction completes on the target bus and the last data arrives.
When the QPIF requests a DCQ buffer for a delayed request transaction, the buffer state logic 2264 allocates the buffers in the following order. If no buffer is in the Empty state or Prefetch state, the requesting master must be retried.
______________________________________DCQ Buffer AllocationBuffer Number Buffer State______________________________________Q0 EmptyQ1 EmptyQ2 EmptyQ3 EmptyQ4 EmptyQ5 EmptyQ6 EmptyQ7 EmptyQ0 PrefetchQ1 PrefetchQ2 PrefetchQ3 PrefetchQ4 PrefetchQ5 PrefetchQ6 PrefetchQ7 Prefetch______________________________________
When a device on the PCI bus initiates a delayed read request and a DCQ completion buffer is set aside, the buffer state logic 2264 changes the buffer's state to PartComplete. If the DCQ initiates a prefetch read, the buffer state is changed to PartPrefetch. When the last piece of completion data arrives, the buffer's state is changed from PartComplete or PartPrefetch to Complete or Prefetch, respectively. When the requesting device resubmits a retried read request and hits the buffer, any valid completion data is given to the master if the buffer is in the Complete, Prefetch, PartComplete, or PartPrefetch state. If the master does not take all of the data before disconnecting, the buffer's state is changed to Prefetch or PartPrefetch to indicate that the unclaimed data is considered to be prefetch data. If the master takes the last piece of data when the buffer is in the Complete or Prefetch state, the buffer's state is changed to Empty.
If a flush signal is received while a buffer is in the Prefetch state, the prefetch data in the buffer is discarded and the buffer state is changed to Empty. If a flush event occurs while the buffer is in the PartPrefetch state and completion data is still arriving, the buffer is changed to the Discard state until all of the prefetch data arrives. When the transaction is complete, the prefetch data is discarded and the buffer state is changed to Empty. If the buffer is in the Complete or PartComplete state when a flush signal is received, the completion data is left in the buffer and the buffer state remains unchanged. If the flush signal occurs because the corresponding PCI device has issued a new request (i.e., a request that is not currently enqueued and that "misses" all of the completion buffers), as discussed below, the DCQ allocates a new buffer for the transaction, as discussed above. Therefore, a PCI device may have more than one completion buffer allocated. Multiple buffers may be allocated to a PCI device when the device has a buffer containing or awaiting completion data (i.e., the buffer is in the Complete or PartComplete state) and the device issues a new request. Because multi-threaded devices are the only devices that can maintain multiple transactions at once, only multi-threaded devices can have multiple completion buffers reserved simultaneously.
MASTER CYCLE ARBITER
The Master Cycle Arbiter (MCA) determines the execution order of posted memory write and delayed request transactions while maintaining the ordering constraints between posted memory write, delayed request, and delayed completion cycles set forth in the PCI Spec 2.1. According to the PCI Spec 2.1, the MCA must guarantee that executed cycles maintain strong write ordering and that no deadlocks occur. To ensure that no deadlocks will occur, posted memory write cycles must be allowed to pass earlier enqueued delayed request cycles, and to maintain the required ordering constraints, delayed request cycles and delayed completion cycles must never be allowed to pass earlier-enqueued posted memory write cycles.
Referring to FIG. 70, the MCA uses two transaction queues, a transaction run queue (TRQ) (or transaction execution queue) 2270 and a transaction order queue (TOQ) 2272, to manage cycles enqueued in the PMWQ, DRQ, and DCQ. An MCA control block 2274 receives transactions from the PMWQ, DRQ, and DCQ in the form of four bit validation request signals (pmwq.sub.-- valid�3:0!, drq.sub.-- valid�3:0!, and dcq.sub.-- valid�3:0!) and outputs run commands in the form of four bit run signals (mca.sub.-- run.sub.-- pmwq�3:0!, mca.sub.-- run.sub.-- drq�3:0!, and mca.sub.-- run.sub.-- dcq�3:0!). The transactions are moved into and out of the TRQ 2270 and TOQ 2272 by a TRQ control block 2276 and a TOQ control block 2278, respectively.
Referring also to FIG. 71, the TRQ 2270 is the queue from which the MCA determines the transaction execution order. Transactions in the TRQ 2270 can be executed in any order without violating the transaction ordering rules, but once a posted memory write cycle is placed in the TRQ 2270, no other cycle can be placed in the TRQ 2270 until the posted memory write is removed. Transactions in the TRQ 270 are tried in circular order and generally are completed in the order they were received. However, if a transaction in the TRQ 2270 is retried on the PCI bus, the MCA may select the next transaction in the TRQ 2270 to be tried on the PCI bus. Because delayed completion transactions are slave cycles rather than master cycles, they are never placed in the TRQ 2270. Furthermore, because delayed completion information may be made available to the requesting device as soon as it enters the DCQ if no posted memory write cycles are pending in the PMWQ, delayed completion transactions are placed in the TOQ 2272 only when a posted memory write cycle is pending in the TRQ 2270, as discussed in more detail below.
The TRQ 2270 is a circular queue that holds up to four transactions at once. Because the MCA must always be able to run at least one posted memory write transaction to preserve the required ordering constraints, the TRQ 2270 can never hold more than three delayed request transactions at once. Furthermore the TRQ can hold only one posted write transaction at a time because posted writes cannot be passed by any later-initiated transaction, including other posted writes. Each slot 2280a-d in the TRQ 2270 contains three bits of information: a one bit cycle type indicator 2282 (which equals "1" for posted memory write transactions and "0" for delayed request transactions), and a two bit valid pointer 2284, the four possible values of which identify which of the buffers in the PMWQ or the DRQ the enqueued transactions occupy. The TRQ 2270 also includes an input/output enable block 2286 that determines when a transaction may be moved into or out of the TRQ 2270, an input logic block 2288 that controls the placement of a transaction into the TRQ 2270, and an output logic block 2290 that controls removal of a transaction from the TRQ 2270. These logic blocks contain standard queue management circuitry.
A circular input pointer 2292 selects the next available slot for placement of an incoming transaction. The input pointer is circular to maintain, as much as possible, historical order of the incoming transactions.
A circular output pointer 2294 arbitrates between the transactions in the TRQ 2270 and determines their order of execution. The output pointer 2294 always begins with the top slot 2286a in the TRQ 2270 at startup and progresses circularly through the TRQ 2270. The output pointer 2294 may be configured to operate in either infinite retry or zero retry mode by setting or clearing, respectively, an infinite retry bit in the configuration registers (cfg2q.sub.-- infretry). In infinite retry mode, the output pointer 2294 remains on a transaction until the transaction is run successfully on the PCI bus. In zero retry mode, the output pointer 2294 is incremented each time a transaction is tried on the bus (i.e., q2pif.sub.-- cyc.sub.-- complete was asserted on the previous PCI clock cycle), regardless of whether the transaction completes successfully or is retried. Because the PCI Spec 2.1 mandates that posted memory write transactions be allowed to bypass delayed request transactions, the output pointer 2294 in at least one of the bridge chips must be configured to operate in zero retry mode. Here, the downstream chip always is configured to operate in zero retry mode. Alternatively, the output pointer may be configured to operate in finite retry mode, in which each transaction may be attempted on the PCI bus a predetermined number (e.g., three) of times before the output pointer increments. Both the upstream and downstream chips can be configured to operate in finite retry mode with violating the ordering constraints of the PCI Spec 2.1. In any case, the output pointer tries to maintain the historical order of transactions stored in the TRQ 2270, incrementing only when a transaction cannot be completed successfully on the target PCI bus.
When a posted memory write or delayed request cycle is popped out of the TOQ 2272 (new.sub.-- toq.sub.-- cycle is asserted), as discussed below, or when the TOQ 2272 is not enabled (|toq.sub.-- enabled) and a new cycle is received by the MCA (new.sub.-- valid.sub.-- set), the cycle type bit and valid bits for the new cycle are loaded into the next empty slot in the TRQ. If the cycle is coming from the TOQ 2272, the valid bits and cycle type bit are provided by TOQ valid and cycle type signals (toq.sub.-- valid�1:0! and toq.sub.-- cyctype�0!), respectively. Otherwise, the new cycle information is provided by MCA valid and cycle type signals (d.sub.-- valido�1:0! and d.sub.-- cyctype�0!). Gates 2296 and 2298 and multiplexers 2300 and 2302 are arranged to control the selection of cycles to be loaded into the TRQ 2270. When a cycle is successfully run on the PCI bus, the cycle is removed from the transaction order queue and its cycle type bit and valid bits are provided to the MCA control block 2274 as TRQ cycle type and valid signals (trq.sub.-- cyctype�0! and trq.sub.-- valido�1:0!), respectively.
The TRQ control block 2276 generates a trq.sub.-- pmw signal that indicates when a posted memory write transaction is enqueued in the TRQ 2270. When this signal is asserted, subsequently issued delayed request and delayed completion transactions must be enqueued in the TOQ 2272, as discussed below. The trq.sub.-- pmw signal is asserted when the MCA control block 2274 has instructed the TRQ 2270 to enqueue a new posted memory write cycle (trq.sub.-- slot.sub.-- valid.sub.-- set does not equal "0000" and d.sub.-- trq.sub.-- cyctype equals "1"), or, alternatively, when any of the TRQ slots 2280a-d contains a cycle (trq.sub.-- slot.sub.-- valid�3:0! does not equal "0000"), at least one of the cycles is a posted memory write cycle (trq.sub.-- cyctype equals "1"), and the posted memory write cycle has not been cleared from the corresponding slot 2280a-d (|trq.sub.-- slot.sub.-- valid.sub.-- rst�3:0!). Gates 2304, 2306, 2308, 2310, and 2312 are arranged to generate the trq.sub.-- pmw signal in this manner.
Referring now to FIG. 72, the TOQ 2272 is a first-in-first-out (FIFO) queue that retains the historical order of transactions received by the bridge after a posted memory write transaction is placed in the TRQ 2270. Because all transactions must wait for earlier-issued posted memory writes to run, all transactions including posted memory write, delayed request, and delayed completion transactions, are placed in the TOQ 2270 when a posted memory write is enqueued in the TRQ 2270. Transactions in the TOQ 2272 must remain in the TOQ 2272 until the posted memory write transaction is removed from the TRQ 2270.
The TOQ 2270, which has eight slots 2314a-h, can hold up to three posted memory write transactions (the fourth will be stored in the TRQ 2270), three delayed request transactions, and four delayed completion transactions. Each of the slots 2314a-h in the TOQ 2272 contains two cycle type bits 2316 that identify the corresponding transaction ("01" is a posted memory write, "00" is a delayed request, and "1x" is a delayed completion) and two valid bits 2318 that identify which of the buffers in the PMWQ, DRQ, and DCQ the corresponding transaction occupies. The TOQ 2272 also includes standard input and output logic blocks 2320 and 2322, which control the movement of transactions into and out of the TOQ 2272.
The positions at which transactions are placed into and removed from the TOQ 2272 are determined by a three bit input counter 2326 (inputr�2:0!) and a three bit output counter 2324 (outputr�2:0!), respectively. Both counters begin at the first slot 2314a in the TOQ 2272 and increment through the queue as transactions are entered into and removed from the queue. The input counter 2326 increments on the rising edge of every PCI clock cycle at which the TOQ 2272 is enabled (toq.sub.-- enabled is asserted) and the MCA control block 2274 provides a new cycle to the TOQ 2272 (new.sub.-- valid.sub.-- set is asserted). The valid bits and cycle type bits for each new cycle are provided by the MCA valid and cycle type signals (d.sub.-- valido�1:0! and d.sub.-- cyctype�1:0!). The output counter 2324 increments on the rising edge of each PCI clock cycle at which the MCA control block 2274 instructs the TOQ 2272 to move to the next cycle (next.sub.-- toq.sub.-- cycle is asserted) and the TOQ 2272 is not empty (i.e., inputr�2:0! does not equal outputr�2:0!). Cycles exiting the TOQ 2272 are represented by TOQ valid and cycletype signals (toq.sub.-- valido�1:0! and toq.sub.-- cyctypeo�1:0!). Gates 2328 and 2330 and comparator 2332 are arranged to properly clock the input pointer 2326 and output pointer 2324.
When a delayed request transaction or posted memory write transaction is popped out of the TOQ 2272, the transaction is placed in the TRQ 2270 to await arbitration. But because delayed completion transactions are target transactions and not master transactions, delayed completions are not placed in the TRQ 2270. Instead, delayed completions are simply popped out of the TOQ 2272 and used to validate the corresponding data in the DCQ data buffers. However, as long as a posted memory write transaction is enqueued in the TRQ 2270, all delayed completions must be placed in the TOQ 2272, even when two or more delayed completions correspond to the same delayed request and therefore the same delayed completion buffer, as described above.
Referring to FIGS. 73A through 73D, the MCA control block 2274 controls the flow of transactions through the MCA. As discussed above, the PMWQ, DRQ, and DCQ request validation of transactions held in the queues by providing four bit validation signals pmwq.sub.-- valid�3:0!, drq.sub.-- valid�3:0!, and dcq.sub.-- valid�3:0!, respectively, to the MCA. Among these signals, only one bit can change during each clock pulse since only a single new transaction can be placed into the queue block on each clock pulse. Therefore, the MCA control block identifies new validation requests by watching for the changing bits in the pmwq.sub.-- valid, drq.sub.-- valid, and dcq.sub.-- valid signals. To do so, the MCA control block latches and inverts each signal at the rising edge of every PCI clock to create a delayed, inverted signal and compares the delayed, inverted signal to the current signal (i.e., the signal at the next clock pulse). Since only a newly changed bit will have the same value as its delayed and inverted counterpart, the MCA control block is able to detect which bit changed. Using flip-flops 2340, 2342, and 2344 and gates 2346, 2348, and 2350, the MCA controller generates new.sub.-- pmwq.sub.-- valid�3:0!, new.sub.-- drq.sub.-- valid�3:0!, and new.sub.-- dcq.sub.-- valid�3:0! signals which, at each clock pulse, together identify whether the PMWQ, DRQ, or DCQ, if any, submitted a new transaction for validation and which buffer in the corresponding queue contains the new transaction. Referring also to FIG. 74, the MCA control block uses a look-up table 2352 to convert the twelve bits of the new.sub.-- pmwq.sub.-- valid, new.sub.-- drq.sub.-- valid, and new.sub.-- dcq.sub.-- valid signals into the two bit d.sub.-- valid�1:0!) and d.sub.-- cyctype�1:0! signals provided to the TRQ and TOQ, as discussed above.
The MCA controller enables the TOQ by latching the toq.sub.-- enabled signal to a value of "1" when either the trq.sub.-- pmw is asserted, indicating that a posted memory write cycle is enqueued in the TRQ, or when the toq.sub.-- enable signal already is asserted and the TOQ is not empty (|toq.sub.-- empty). Gates 2354 and 2356 and flip-flop 2358 are arranged to generate toq.sub.-- enabled in this manner.
The MCA control block asserts the new.sub.-- toq.sub.-- cycle signal, which instructs the TRQ to enqueue the cycle being popped out of the TOQ, when there was not a posted memory write cycle in the TRQ during the previous clock cycle (|s1.sub.-- trq.sub.-- pmw), when the TOQ is not empty (|toq.sub.-- empty), and when the cycle being popped out of the TOQ is not a delayed completion transaction (|(toq.sub.-- cyctypeo�1!="DC")). The MCA controller uses gate 2360 to generate the new.sub.-- toq.sub.-- cycle signal.
The next.sub.-- toq.sub.-- cycle signal, which is used to increment the TOQ output counter to the next cycle in the TOQ, is asserted when the TOQ is not empty (|toq.sub.-- empty) and either when no posted memory write cycles currently are enqueued in the TRQ (|trq.sub.-- pmw) and the next cycle in the TOQ is a delayed completion (toq.sub.-- cyctype�1!="DC") or when the next TOQ cycle is a posted memory write or delayed request transaction (|(toq.sub.-- cyctype�1!="DC")) and there were no posted memory write transactions during the previous clock cycle (|s1.sub.-- trq.sub.-- pmw). The control block uses gates 2362, 2364, 2366, and 2368 to generate the next.sub.-- toq.sub.-- cycle signal.
The MCA controller generates the mca.sub.-- run.sub.-- dcq�3:0! signal to indicate that a delayed completion transaction has been popped out of the TOQ. When the TRQ contains no posted memory write cycles (|trq.sub.-- pmw), the TOQ is not empty (|toq.sub.-- empty), and the TOQ cycle is a delayed completion (toq.sub.-- cyctype�1!="DC"), the mca.sub.-- run.sub.-- dcq�3:0! signal takes on the value of the decoded toq.sub.-- valido�1:0! signal, discussed above. Otherwise, the mca.sub.-- run.sub.-- dcq�3:0! signal equals "0000". Gate 2370, decoder 2372, and multiplexer 2374 are arranged to generate mca.sub.-- run.sub.-- dcq�3:0! in this manner.
The MCA control block generates new.sub.-- mca.sub.-- run.sub.-- dr�3:0!) and new.sub.-- mca.sub.-- run.sub.-- pmw�3:0! signals to indicate that it has a new delayed request transaction and a posted memory write transaction, respectively, to be enqueued. The new.sub.-- mca.sub.-- run.sub.-- dr�3:0! signal takes on the value of the 2.times.4 decoded d.sub.-- valido�1:0! signal, discussed above, when the new cycle is a delayed request cycle (d.sub.-- cyctype�0!="DR"). Otherwise, all bits of the new.sub.-- mca.sub.-- run.sub.-- dr signal are set to zero. Likewise, the new.sub.-- mca.sub.-- run.sub.-- pmw�3:0! signal takes on the value of the 2.times.4 decoded d.sub.-- valido�1:0! signal when the new cycle is a posted memory write transaction and is set to "0000" otherwise. Decoders 2376 and 2380 and multiplexers 2378 and 2382 are arranged to generate the new.sub.-- mca.sub.-- run.sub.-- dr and new.sub.-- mca.sub.-- run.sub.-- pmw signals in this manner.
The MCA controller generates toq.sub.-- mca.sub.-- run.sub.-- dr�3:0! and toq.sub.-- mca.sub.-- run.sub.-- pmw�3:0! signals to indicate when a new delayed request transaction or posted memory write transaction, respectively, has popped out of the TOQ. The toq.sub.-- mca.sub.-- run.sub.-- dr�3:0! signal takes on the value of the 2.times.4 decoded toq.sub.-- valido�1:0! signal when a delayed request cycle is popped out of the TOQ and a value of "0000" otherwise. Likewise, the toq.sub.-- mca.sub.-- run.sub.-- pmw�3:0! signal takes on the value of the 2.times.4 decoded toq.sub.-- valido�1:0! signal when a posted memory write cycle pops out of the TOQ and a value of "0000" otherwise. Decoders 2384 and 2388 and multiplexers 2386 and 2390 are used to generate the toq.sub.-- mca.sub.-- run.sub.-- dr and toq mca.sub.-- run.sub.-- pmw signals in this manner.
The MCA controller generates trq.sub.-- mca.sub.-- run.sub.-- dr�3:0! and trq.sub.-- mca.sub.-- run.sub.-- pmw�3:0! signals to indicate when a new delayed request transaction or posted memory write transaction, respectively, has won the arbitration in the TRQ and is ready to be run on the PCI bus. The trq.sub.-- mca.sub.-- run.sub.-- dr�3:0! signal takes on the value of the 2.times.4 decoded trq.sub.-- valido�1:0! signal when a delayed request cycle has won the arbitration and the TRQ is not empty. The trq.sub.-- mca.sub.-- run.sub.-- dr�3:0! takes on a value of "0000" otherwise. Likewise, the trq.sub.-- mca.sub.-- run.sub.-- pmw�3:0! signal takes on the value of the 2.times.4 decoded trq.sub.-- valido�1:0! signal when a posted memory write cycle has won the arbitration and the TRQ is not empty. The trq.sub.-- mca.sub.-- run.sub.-- pmw�3:0! signal is set to a value of "0000" otherwise. Gates 2392 and 2398, decoders 2394 and 2400, and multiplexers 2396 and 2402 are used to generate the trq.sub.-- mca.sub.-- run.sub.-- dr and trq.sub.-- mca.sub.-- run.sub.-- pmw signals in this manner.
When the TRQ is empty, the MCA may issue a request to run the next transaction in the TOQ while the transaction is being placed in the TRQ. When both the TRQ and the TOQ are empty, transactions may begin to run even before they have been enqueued into TRQ. Therefore, the MCA control block includes logic that determines when the new.sub.-- mca.sub.-- run or toq.sub.-- mca.sub.-- run signals may be used asynchronously to indicate that a transaction may be tried on the PCI bus. By converting the new.sub.-- mca.sub.-- run and toq.sub.-- mca.sub.-- run signals into asynchronous run signals, the MCA controller saves a PCI clock wait state. When the new.sub.-- valid.sub.-- set signal is asserted by the MCA control block and the TOQ is not enabled (|toq.sub.-- enabled), the async.sub.-- mca.sub.-- run.sub.-- dr�3:0! and async.sub.-- mca.sub.-- run.sub.-- pmw�3:0! signals take on the values of the new.sub.-- mca.sub.-- run.sub.-- dr�3:0! and new.sub.-- mca.sub.-- run.sub.-- pmw�3:0! signals, respectively. Otherwise, the asynchronous run signals take on the values of the toq.sub.-- mca.sub.-- run.sub.-- dr�3:0! and toq.sub.-- mca.sub.-- run.sub.-- pmw�3:0! signals. The MCA controller uses gate 2404 and multiplexers 2406 and 2408 to generate the asychronous run signals.
When a PCI bus master has completed a transaction (s1.sub.-- q2pif.sub.-- cyc.sub.-- complete is asserted), the TRQ is not empty (|trq.sub.-- empty) and is configured for operation in the zero retry mode (|cfg2q.sub.-- infretry), and either a new transaction has popped out of the TOQ (new.sub.-- toq.sub.-- cycle) or the TOQ is not enabled (|toq.sub.-- enabled) and the MCA has received a new cycle to be validated (new.sub.-- valid.sub.-- set), the MCA cannot select a cycle to run on the PCI bus, so both the mca.sub.-- run.sub.-- dr�3:0! and mca.sub.-- run.sub.-- pmw�3:0! signals are set to "0000". Otherwise, if the TRQ is empty (trq.sub.-- empty) and either a new transaction has popped out of the TOQ (new.sub.-- toq.sub.-- cycle) or the TOQ is not enabled (|toq.sub.-- enabled) and the MCA has received a new cycle to be validated (new.sub.-- valid.sub.-- set), then the mca.sub.-- run.sub.-- dr�3:0! and mca.sub.-- run.sub.-- pmw�3:0! signals take on the value of the asynchronous run signals, async.sub.-- mca.sub.-- run.sub.-- dr�3:0! and async.sub.-- mca.sub.-- run.sub.-- pmw�3:0!, respectively. Otherwise, the mca.sub.-- run.sub.-- dr�3:0! signal takes on the value of the trq.sub.-- mca.sub.-- run.sub.-- dr�3:0! signal and the mca.sub.-- run.sub.-- pmw�3:0! signal takes on the value of the trq.sub.-- run.sub.-- pmw�3:0! signal ANDed with validation request signal from the PMWQ (pmwq.sub.-- valid�3:0!). Gates 2410, 2412, 2414, 2416, and 2418 and multiplexers 2420, 2422, 2424, and 2426 are arranged to generate the MCA run signals in this manner.
THE QUEUE-BLOCK-TO-PCI-INTERFACE (QPIF)
Referring again to FIG. 4 and to FIG. 75, the QPIF 148 governs the flow of transactions between the queue block 127 and the PCI bus 32. The QPIF 148 also delivers transactions initiated on the PCI bus 32 to the cable interface 130. The QPIF 148 operates in two modes: master mode and slave mode. In the master mode, the QPIF 148 has control of the PCI bus and therefore executes transactions intended for target devices on the bus. A master state machine 2500 in the QPIF 148 retrieves transactions from the PMWQ and DRQ and executes them on the PCI bus when the QPIF is in the master mode. In the slave mode, the QPIF 148 receives transactions initiated by a device on the PCI bus and either provides the requested information to the initiating device (if the information is available) or retries the initiating device (if the transaction is a delayed request) and forwards the transaction to the upstream chip. The transaction also is retried if the corresponding one of the transaction counters 159 indicates that the other bridge chip is full, as discussed above. A slave state machine 2502 receives an incoming transaction from the PCI bus and then checks the DCQ for a corresponding completion message and/or forwards the transaction to a cable message generator 2504, which in turn forwards the transaction through the cable to the upstream bridge chip.
Referring also to FIGS. 76A and 76B, the QPIF includes address and data latching logic 2506 that latches the incoming address phase and data phase information associated with each transaction initiated by a device on the PCI bus. The QPIF slave state machine 2502 controls operation of the address and data latching logic 2506. When a new transaction initiated on the PCI bus is intended for the QPIF, the slave state machine 2502 asserts an address phase latching signal (reg.sub.-- latch.sub.-- first.sub.-- request) indicating that the address phase information should be latched from the PCI bus. At the next falling edge of the PCI clock signal, the assertion of the reg.sub.-- latch.sub.-- first.sub.-- request signal causes a delayed address phase latching signal (dly.sub.-- reg.sub.-- latch.sub.-- first.sub.-- request) to be asserted. When both the original and the delayed address phase latching signals are asserted, the latching logic 2506 generates a first latching signal (latch1). Flip-flop 2508 and gate 2510 are arranged to generate the first latching signal in this manner.
The latching logic 2506 loads the address phase information from the PCI bus (via the PCI interface) into three address phase registers when the first latching signal is asserted. The first register is a thirty-bit address register 2512 that indicates the starting address of the current transaction. When the first latching signal is asserted, the address signal from the PCI interface (p2q.sub.-- ad�31:2!) is loaded into the address register 2512. The address register 2512 outputs the address signal used by the QPIF (q2pif.sub.-- addr�31:2!). The second register is a four bit command register 2514 that receives the PCI command code from the PCI bus (p2q.sub.-- cmd�3:0!) and outputs the QPIF command signal (q2pif.sub.-- cmd�3:0!). The third register is a three bit slot selection register 2516 that receives the p2q.sub.-- slot�2:0! signal indicating which PCI device is the current bus master and outputs the QPIF slot selection signal (q2pif.sub.-- slot�2:0!).
When the address phase of the PCI transaction ends, the slave state machine 2502 asserts a data phase latching signal (reg.sub.-- latch.sub.-- second.sub.-- request) indicating that the data phase information should be latched from the PCI bus. At the next falling edge of the PCI clock signal, the asserted reg.sub.-- latch.sub.-- first.sub.-- request signal causes a delayed data phase latching signal (dly.sub.-- reg.sub.-- latch.sub.-- second.sub.-- request) to be asserted. When both the original and the delayed data phase latching signals are asserted, the latching logic 2506 generates a second latching signal (latch2). Flip-flop 2518 and gate 2520 are arranged to generate the second latching signal in this manner.
The latching logic 2506 then loads the data phase information from the PCI bus (via the PCI interface) into three data phase registers when the second latching signal is asserted. The first data phase register is a thirty-two bit data register 2522 that receives the data associated with the current transaction on the PCI address/data lines (p2q.sub.-- ad�31:0!) and outputs the QPIF data signal (q2pif.sub.-- data�31:0!). The second data phase register is a four bit enable register 2524 that receives enable bits from the PCI bus (p2q.sub.-- cbe�3:0!) and outputs the QPIF byte enable signal (q2pif.sub.-- byte.sub.-- en�3:0!). The third register is a three bit lock register 2526 that receives the PCI lock signal (p2q.sub.-- lock) indicating that the current transaction should be run as a locked transaction and outputs the QPIF lock signal (q2pif.sub.-- lock).
Referring again to FIG. 75 and also to FIG. 77, the QPIF includes a "lock" logic block 2528 that controls the "lock" state of the QPIF. The QPIF has three lock states: an unlocked state 2530 (lock.sub.-- state�1:0!="00") that indicates that no locked transactions are pending in the DCQ; a locked state 2532 (lock.sub.-- state�1:0!="01) indicating that a locked transaction has been received in the DCQ or is completing on the PCI bus; and an unlocked-but-retry state 2534 (lock.sub.-- state�1:0!="10") that indicates that the lock has been removed but that a posted memory write transaction pending in the other bridge chip must be run before the next transaction can be accepted.
At power-up and reset, the lock logic 2528 enters the unlocked state 2530 and waits for a locked transaction to enter the DCQ (indicated by the assertion of the dcq.sub.-- locked signal). At the first clock pulse after the dcq.sub.-- locked signal is asserted, the lock logic enters the locked state 2532, which forces the QPIF slave state machine 2502 to retry all transaction requests from the PCI bus. The PCI interface also asserts a lock signal (p2q.sub.-- lock) that indicates it has locked the PCI bus for the transaction. After the locked transaction has completed and the requesting device has retrieved the locked completion data from the DCQ, the dcq.sub.-- locked signal is deasserted. At the first clock pulse after the dcq.sub.-- locked is deasserted, while the p2q.sub.-- lock signal is still asserted, if no posted memory writes are pending in the other bridge chip (i.e., the pmw.sub.-- empty signal is asserted by the cable decoder), the lock logic 2528 returns to the unlocked state 2530 and the slave state machine 2502 again is able to accept transaction requests. However, if the pwm.sub.-- empty signal is not asserted at the first clock pulse after the dcq.sub.-- lock signal is deasserted, the lock logic 2528 enters the unlocked-but-retry state 2534, which forces the slave state machine 2502 to retry all transactions until the posted memory write cycle is completed on the other PCI bus. After the posted memory write cycle is complete, the pwm.sub.-- empty signal is asserted, and the lock logic 2528 returns to the unlocked state 2530.
Referring again to FIG. 75 and also to FIG. 78, the QPIF includes buffer flush logic 2536 that determines when the DCQ should flush data from one or all of its data buffers. As discussed above, the PCI interface in the downstream chip generates a p2q.sub.-- f lush signal when the upstream chip issues an I/O or config write or a memory write that hits the target memory range register (TMRR) of a downstream device. The QPIF buffer flush logic 2536 asserts a QPIF flush signal (general.sub.-- flush) that flushes the corresponding data buffer or all data buffers (depending upon the value of the p2q.sub.-- slot signal, as discussed above) when the p2q.sub.-- f lush signal is received. Otherwise, the buffer flush logic 2536 asserts the general flush signal only when a device on the secondary bus issues a delayed request that misses all of the DCQ buffers when checked by the DCQ control logic (i.e., |dcq.sub.-- hit and q2pif.sub.-- check.sub.-- cyc are asserted). In either case, the general.sub.-- flush signal is used to flush only buffers that are in the "prefetch" state, as discussed above. Therefore, prefetch data is held in the DCQ until the PCI interface orders a flush or until the corresponding PCI device issues a non-sequential request (i.e., misses the DCQ). Gates 2538 and 2540 are arranged to generate the general.sub.-- flush signal in this manner.
When a multi-threaded device has more than one completion buffer allocated, at least one of which contains prefetch data, the prefetch data remains in-the corresponding buffer as long as the device does not issue a request that misses all of the DCQ buffers. As soon as the device issues a new request, all of its prefetch buffers are flushed. Alternatively, a prefetch buffer associated with a multi-threaded device could be flushed as soon as the device issues a request that hits another DCQ buffer.
Referring again to FIG. 75, the QPIF includes a read command logic block 2542 that receives read commands from the PCI interface and prefetch commands from the DCQ and provides an outgoing message command signal (message.sub.-- cmd) to the cable. In non-streaming situations, the outgoing message command may be same as the command received from the PCI bus or the DCQ, or the read command logic 2542 may convert the command into one involving a greater amount of data. Because transactions executed dword-by-dword take longer to complete on the host bus than transactions involving an entire cache line of data, and because single cache line transactions take longer to complete on the host bus than multiple cache line transactions, the read command logic often promotes "smaller" commands into "larger" ones to reduce the number of clock cycles consumed by the transaction ("read promotion"). For example, when a device on the secondary PCI bus issues a memory read command and then asks for every dword of data in a cache line, the read command logic 2542 is able to reduce the host latency by promoting the PCI command to a memory read line, which allows the upstream chip to read the entire cache line of data at once instead of reading each dword individually.
Referring also to FIG. 79, when the DCQ indicates that a read stream has been established (i.e., dcq.sub.-- stream.sub.-- connect is asserted), as discussed above, the read command logic 2542 generates a message command of "1000", which informs the upstream chip that a stream is occurring. When no stream has been established, the read command logic 2542 must decide whether to send a memory read, memory read line, or memory read multiple command. If the command received from the PCI bus is a memory read (MR) command (q2p.sub.-- cmd�2:0! equals "0110") and the corresponding memory-read-to-memory-read-line promotion bit (cfg2q.sub.-- mr2mr1) in the configuration registers is set, the read command logic 2542 generates a memory read line command ("1110"). On the other hand, if the PCI command is a memory read command and the corresponding memory-read-to-memory-read-multiple bit (cfg2q.sub.-- mr2mrm) is set, or if the command is a memory read line command (q2pif.sub.-- cmd�3:0! equals "1110") from the PCI bus or a prefetch line command (dcq.sub.-- prefetch.sub.-- line is asserted) from the DCQ and the corresponding memory-read-line-to-memory-read-multiple bit (cfg2q.sub.-- mrl2mrm) is set, or if the command is a prefetch multiple command (dcq.sub.-- prefetch.sub.-- mul) from the DCQ, the read command logic 2542 generates a memory read multiple command (i.e., message.sub.-- cmd equals "1100"). If the command is a prefetch line command and the corresponding memory-read-line-to-memory-read-multiple bit is not set, the read command logic 2542 generates a MRL command ("1110"). Otherwise, the read command logic 2542 outputs the received PCI command (q2pif.sub.-- cmd�2:0!) as the message command signal. Gates 2544, 2546, 2548, 2550, 2552, 2554, 2556, and 2558 and multiplexers 2560, 2562, and 2564 are arranged to generate the message.sub.-- cmd signal in this manner.
Referring again to FIG. 75, when the QPIF is operating in the master mode and has received control of the bus to run a transaction stored in the PMWQ, a write command logic block 2566 generates the command code that is executed on the PCI bus. To reduce transaction time as discussed above, the write command logic can convert memory write (MW) commands, which involve data transfers one dword at a time into memory write and invalidate commands (MWI), which involve transfers of at least one entire cache line of data. The write command logic block 2566 can convert a command midstream when, e.g., the transaction begins as a memory write in the middle of a cache line and contains data crossing the next cache line boundary and including all eight dwords of data in the next cache line. In this situation, the write command logic 2566 terminates the memory write transaction when it reaches the first cache line boundary and initiates a memory write and invalidate transaction to transfer the next full cache line of data. The write command logic 2566 also may terminate a MWI transaction midstream in favor of a MW transaction if less than a cache line of data is to be written to the target bus after a cache line boundary is crossed.
Referring again to FIG. 75 and also to FIG. 80, the slave state machine 2502 also maintains two counters that indicate when a posted write transaction initiated on the PCI bus should be terminated. A 4K page boundary counter 2594 generates a page count signal (page.sub.-- count.sub.-- reg�11:2!) that indicates when data transferred from the PCI bus reaches a 4K page boundary. Because a single memory access is not allowed to cross a 4K page boundary, the posted write transaction must be terminated on the initiating bus when a boundary is reached. The 4K page boundary counter 2594 is loaded with the third through twelfth bits of the transaction address (q2pif.sub.-- addr�11:2!) when the state machine asserts a load.sub.-- write.sub.-- counter signal (the circumstances surrounding assertion of this signal are discussed in more detail below). The counter 2594 then increments by one at the rising edge of each clock pulse after the load.sub.-- write.sub.-- counter signal is deasserted. The counter 2594 is not incremented on clock pulses during which the initiating device has inserted an initiator wait state (i.e., p2q.sub.-- irdy asserted). The output of gate 2592 determines when the counter is allowed to increment. When all bits in the page.sub.-- count.sub.-- reg�11:2! signal are high, a 4K page boundary has been reached and the slave state machine must terminate the posted write transaction and retry the initiating device.
A dword counter 2598 generates a pmw.sub.-- counter�5:0! signal that indicates the number of dwords written from the initiating bus during a posted write transaction. The pmw.sub.-- counter�5:0! signal then is used to indicate when an overflow has occurred or when the last line of the transaction has been reached, as discussed below. When the slave state machine 2503 asserts the load.sub.-- write.sub.-- counter signal, the third through fifth bits of the address signal (q2pif.sub.-- addr�4:2!) are loaded into the lower three bits of the counter 2598, while the upper three bits are set to zero. This address offset indicates at which dword in a cache line the posted write transaction has started. The counter 2598 then increments by one at the rising edge of each clock pulse after the load.sub.-- write.sub.-- counter signal is deasserted. The counter 2598 is not incremented on clock pulses during which the initiating device has inserted an initiator wait state (i.e., p2q.sub.-- irdy asserted). The output of gate 2596 determines when the counter is allowed to increment. When all bits in the pmw.sub.-- counter�5:0! signal are high, the posted write has reached the end of the eighth cache line.
Referring to FIGS. 81A through 81C, the write command logic block 2566 generates a four bit write command signal (write.sub.-- cmd�3:0!) indicating the command code of the posted write transaction to be executed on the PCI bus. If the command code stored in the PMWQ represents a memory write and invalidate command (pmwq.sub.-- cmd�3!="1"), the write command logic 2566 generates a write command code of "1111". If the PMWQ command code represents a memory write command, the write command logic 2566 looks at the memory-write-to-memory-write-and-invalidate configuration bit (cfg2q.sub.-- mw2mwi) corresponding to the target PCI slot. If the cfg2q.sub.-- mw2mwi bit is not set, the write command logic 2566 produces a memory write command ("0111"). If the configuration bit is set, the write command logic 2566 generates a MWI command if the next line in the PMWQ data buffer is full (pmw.sub.-- full.sub.-- line is asserted) and generates a MW command otherwise. Multiplexers 2568 and 2570 are arranged to generate the write.sub.-- cmd signal in this manner.
When the QPIF is executing a transaction on the PCI bus and has reached a cache line boundary, the write command logic 2566 may assert a new.sub.-- write.sub.-- cmd signal indicating that the current transaction must be terminated in favor of a new write command. If the transaction has reached the last cache line in the PMWQ data buffer (i.e., pmwq.sub.-- pointer�5:3! equals "111"), the new.sub.-- write command signal is asserted to indicate that the transaction should be terminated if the next PMWQ buffer is not an overflow buffer containing valid data, if the corresponding cfg2q.sub.-- mw2mwi bit is not set, or if the full.sub.-- line bits corresponding to the current cache line and the next cache line are different (i.e., pmwq.sub.-- full.sub.-- line�7! does not equal pmwq.sub.-- next.sub.-- full.sub.-- line). If the transaction has not reached the end of the PMWQ buffer, the new.sub.-- write.sub.-- cmd signal is asserted either if the next line in the PMWQ buffer does not contain valid data (|pmwq.sub.-- valid.sub.-- lines�x+1!) or if the cfg2q.sub.-- mw2mwi bit is set and the full line bits for the current line and the next line are different (i.e., pmwq.sub.-- full.sub.-- line�x! does not equal pmwq.sub.-- full line�x+1!). Gates 2572, 2574, 2576, 2578, and 2580 and multiplexer 2582 are arranged to generate the new.sub.-- write command signal in this manner.
After the new.sub.-- write.sub.-- cmd signal is asserted, the transaction is not terminated until the write command logic block 2566 asserts a synchronous new write command signal (held.sub.-- new.sub.-- write.sub.-- cmd). The held.sub.-- new.sub.-- write.sub.-- cmd signal is asserted at the first clock pulse after the new.sub.-- write.sub.-- cmd signal is asserted and the end.sub.-- of.sub.-- line signal is asserted indicating that the end of the cache line has been reached, as long as the PCI interface has not terminated the transaction (i.e., p2q.sub.-- start.sub.-- pulse is asserted). The held.sub.-- new.sub.-- write command is deasserted at reset and at the first clock pulse after the new.sub.-- write.sub.-- cmd, end.sub.-- of.sub.-- line, and p2q.sub.-- start.sub.-- pulse signals are deasserted and the QPIF terminates the transaction (i.e., the asynchronous early.sub.-- cyc.sub.-- complete signal is asserted). Otherwise, the held.sub.-- new.sub.-- write.sub.-- cmd signal retains its current value. Gates 2584 and 2586, inverter 2588, and flip-flop 2590 are arranged to generate the held.sub.-- new.sub.-- write.sub.-- cmd signal in this manner.
Referring again to FIG. 75 and also to FIG. 82A, the QPIF includes an overflow logic block 2600 that allows the master state machine 2500 to manage overflow data, if any, when executing a posted write transaction on the target bus. When the QPIF receives a transaction run signal (mca.sub.-- run.sub.-- pmw or mca.sub.-- run.sub.-- dr, discussed above) from the MCA, the overflow logic 2600 generates a two bit initial queue selection signal (start.sub.-- queue.sub.-- select�2:0!) indicating which of the buffers in the PMWQ or DRQ should be selected to run the current transaction. The following table shows how the start.sub.-- queue.sub.-- select signal is generated.
______________________________________Creation of start.sub.-- queue.sub.-- select signalMCA Run Code{mca.sub.-- run.sub.-- pmw, mca.sub.-- run.sub.-- dr} start.sub.-- queue.sub.-- select______________________________________00000001 0000000010 0100000100 1000001000 1100010000 0000100000 0101000000 1010000000 11______________________________________
When the QPIF is executing a posted write transaction on the target bus, a two bit QPIF queue selection signal (q2pif.sub.-- queue.sub.-- select�1:0!) is used-to select the appropriate buffer in the PMWQ. When the transaction is initiated, the master state machine 2500 asserts a queue selection signal (initial.sub.-- queue.sub.-- select) that causes the q2pif.sub.-- queue.sub.-- select signal to take on the value of the initial queue selection signal (start.sub.-- queue.sub.-- select). At the same time, a queue selection counter 2602 is loaded with the value of the start.sub.-- queue.sub.-- select signal. After the initial.sub.-- queue.sub.-- select signal is deasserted, the q2pif.sub.-- queue.sub.-- select signal takes on the value of the count.sub.-- queue.sub.-- select signal generated by the counter 2602. When the posted memory write transaction overflows into the next PMWQ buffer, the master state machine 2500 asserts an increment queue selection signal (inc.sub.-- queue.sub.-- select) that causes the counter 2602 to increment by one. As a result, the q2pif.sub.-- select.sub.-- signal is incremented and the next buffer in the PMWQ is selected to continue the transaction. Multiplexer 2604 determines the value of the q2pif.sub.-- queue.sub.-- select signal.
Referring also to FIG. 82B, the overflow logic 2600 assets an overflow.sub.-- next.sub.-- queue signal when the master state machine 2500 should continue pulling information from the next PMWQ buffer during a posted memory write transaction. Using the q2pif.sub.-- queue.sub.-- select�1:0! signal to determine which PMWQ is currently selected, the overflow logic 2600 asserts the overflow.sub.-- next.sub.-- queue signal when the valid bit (pmwq.sub.-- valid) and the overflow bit (pmwq.sub.-- overflow) corresponding to the next PMWQ buffer are set. The pmwq.sub.-- valid and pmwq.sub.-- overflow flags are discussed above. Gates 2606, 2608, 2610, and 2612 and mulitplexer 2614 are arranged to generate the overflow.sub.-- next.sub.-- queue signal in this manner.
Referring again to FIG. 75; the QPIF includes a read align logic block 2616 that allows the QPIF to correct misaligned memory read line and memory read multiple transactions. Read line correction occurs when the QPIF, while operating in the master mode, receives a MRL or MRM transaction that begins in the middle of a cache line. To reduce transaction time, the QPIF begins the read transaction on the cache line boundary and ignores the unrequested dwords instead of individually reading only the requested dwords of data.
Referring also to FIG. 83, the read align logic 2616 activates the read alignment feature by asserting an align.sub.-- read signal. This signal is asserted when the command stored in the corresponding DRQ buffer is a memory read line or memory read multiple command (i.e., drq.sub.-- cmd�3:0! equals "1110" or "1100", respectively), and when the read alignment configuration bit (cfg2q.sub.-- read.sub.-- align) corresponding to the target PCI device is set. Gates 2618 and 2620 are arranged to produce the align.sub.-- read signal in this manner.
Referring also to FIGS. 84A through 84C, the read align logic 2616 includes a read alignment down counter 2622 that counts the dwords from the cache line boundary and indicates when the master state machine 2500 reaches the first requested dword. The counter 2622 includes a state machine 2624 that controls the operation of the counter 2622.
At reset, the counter 2622 enters an IDLE.sub.-- CNT state 2626 in which no counting occurs. When the MCA instructs the QPIF to run a delayed request transaction on the PCI bus (i.e., when any bits in the mca.sub.-- run.sub.-- dr�3:0! are asserted), the QPIF asserts a delayed request run signal (any.sub.-- drq.sub.-- run) indicating that it is attempting to run a delayed request transaction. While the counter is in the IDLE.sub.-- CNT state 2622, its three bit output signal (throw.sub.-- cnt�2:0!) is loaded with the dword offset of the transaction address (drq.sub.-- addr�4:2!) when the any.sub.-- run.sub.-- drq signal is asserted and the QPIF gains control of the PCI bus (i.e., p2q.sub.-- ack is asserted). Gate 2623 generates the load enable signal. Then, at the rising edge of the next PCI clock cycle, the counter 2622 enters the COUNT state 2628. If the transaction begins at a cache line boundary, the dword offset equals "000" and no count is needed. When read alignment is activated, the master state machine 2500 begins each MRL and MRM transaction at the cache line boundary, regardless of the actual starting address.
While in the COUNT state 2628, the counter 2622 decrements by one on every clock pulse as long as the p2q.sub.-- ack signal is asserted, throw.sub.-- cnt has not reached zero, the transaction is in the data phase (i.e., the asynchronous signal eary.sub.-- data.sub.-- phase is asserted), and the target device has not issued a target ready wait state (|p2q.sub.-- trdy). Gate 2625 determines when the counter is decremented. If the PCI interface takes the bus away from the QPIF (p2q.sub.-- ack is deasserted) or if the data phase ends (early.sub.-- data phase is deasserted), the counter 2622 stops decrementing and reenters the IDLE.sub.-- CNT state 2626. If the throw.sub.-- cnt signal reaches "000" while the p2q.sub.-- ack signal is still asserted, the counter 2622 stops counting and enters the DONE state 2630. Otherwise, the counter remains in the COUNT state 2628.
When the counter reaches "000", the read align logic 2616 asserts a read.sub.-- data.sub.-- start signal that instructs the master state machine 2500 to begin reading data from the target device. Comparator 2632 generates the read.sub.-- data.sub.-- start signal. After the read.sub.-- data.sub.-- start signal is asserted, the counter 2622 remains in the DONE state 2630 until the data phase ends (early.sub.-- data.sub.-- phase is deasserted).
Referring to FIG. 85, the master state machine controls the operation of the QPIF when the QPIF is operating in the master mode. In the master mode, the QPIF executes posted write transactions and delayed request transactions on the PCI bus. The following table shows the events causing state transitions in the master state machine.
__________________________________________________________________________MASTER STATE MACHINECurrentState Event Next State__________________________________________________________________________IDLE A=(any.sub.-- run&&|cable.sub.-- busy&&|p2q.sub.-- master.sub.-- dphase) IDLE .parallel.(any.sub.-- run.sub.-- drg && tc.sub.-- dc.sub.-- full)IDLE B: p2q.sub.-- ack && q2p.sub.-- dac.sub.-- flag MASTER.sub.-- DACIDLE C: p2q.sub.-- ack && any.sub.-- drg.sub.-- run RDATA1IDLE D: p2q.sub.-- ack && |(q2p.sub.-- dac.sub.-- flag .parallel. any.sub.-- drq.sub.-- run) WDATA1MASTER.sub.-- DAC E: p2q.sub.-- ack && any.sub.-- drq.sub.-- run && p2q.sub.-- start.sub.-- pulse RDATA1 F: p2q.sub.-- ack && p2q.sub.-- start pulse &&|any.sub.-- drq.sub.-- run WDATA1 G: |p2q.sub.-- ack IDLERDATA1 H: |p2q.sub.-- ack IDLE I: p2q-ack && p2q.sub.-- start.sub.-- pulse RBURST J: p2q.sub.-- ack && |p2q.sub.-- start-pulse RDATA1RBURST K: |p2q.sub.-- ack .parallel. p2q.sub.-- retry .parallel. p2q.sub.-- target.sub.-- abort .parallel. IDLE (queue.sub.-- cyc.sub.-- complete&& |(|p2q.sub.-- last.sub.-- dphase&& p2q.sub.-- master.sub.-- dphase && cd.sub.-- stream && stream.sub.-- match && |cfg2q.sub.-- stream.sub.-- disable) && |p2q.sub.-- trdy) .parallel. (read.sub.-- page.sub.-- disconnect && |p2q.sub.-- trdy) L: p2q.sub.-- ack && |p2q.sub.-- retry && |p2q.sub.-- target.sub. -- abort && RBURST ((read.sub.-- page.sub.-- disconnect && p2q.sub.-- trdy) .parallel. (queue.sub.-- cyc.sub.-- complete && ((|p2q.sub.-- last.sub.-- dphase && p2q.sub.-- master.sub.-- dphase && cd.sub.-- stream && stream.sub.-- match && |cfa2q.sub.-- stream.sub.-- disable) .parallel. p2q.sub.-- trdy)) .parallel. |p2q.sub.-- trdy .parallel. otherwise)WDATA1 M: |p2q.sub.-- ack .parallel. p2q.sub.-- retry .parallel. p2q.sub.-- target.sub.-- abort .parallel. IDLE ((queue.sub.-- cyc.sub.-- complete .parallel. held.sub.-- new.sub.-- wire.sub.-- cmd .parallel. end.sub.-- of.sub.-- line && new.sub.-- write.sub.-- cmd .parallel. p2q.sub.-- last.sub.-- dphase .parallel. sl.sub.-- p2q.sub.-- last.sub.-- dphase) && |p2q.sub.-- trdy) N: p2q.sub.-- ack && |p2q.sub.-- retry && |p2q.sub.-- targe.sub.- - abort WDATA1 && (queue.sub.-- cyc.sub.-- complete .parallel. held.sub.-- new.sub.-- write.sub.-- cmd .parallel. end.sub.-- of.sub.-- line && new.sub.-- write.sub.-- cmd .parallel. p2q.sub.-- last.sub.-- dphase .parallel. sl.sub.-- p2q.sub.-- last.sub.-- dphase) && p2q.sub.-- trdy O: otherwise WDATA2WDATA2 P: |p2q.sub.-- ack .parallel. (p2q.sub.-- retry&&|p2q.sub.-- trdy) .parallel. p2q.sub.-- target.sub.-- abort IDLE Q: p2q.sub.-- ack && p2q.sub.-- retry && p2q.sub.-- trdy WRETRY R: p2q.sub.-- ack && |p2q.sub.-- retry && |p2q.sub.-- target.sub. -- abort && WSHORT.sub.-- BURST (queue.sub.-- cyc.sub.-- complete .parallel. end.sub.-- of.sub.-- line && new.sub.-- write.sub.-- cmd) && (|p2q.sub.-- trdy .parallel. p2q.sub.-- start.sub.-- pulse) S: otherwise WDATA2WRETRY T: Always IDLEWSHORT.sub.-- BURST U: |p2q.sub.-- ack .parallel. p2q.sub.-- retry .parallel. p2q.sub.-- target.sub.-- abort IDLE V: p2q.sub.-- ack && |p2q.sub.-- retry && |p2q.sub.-- target.sub. -- abort WCOMPLETE &&((overflow.sub.-- next.sub.-- queue&& |new.sub.-- write.sub.-- cmd && |p2q.sub.-- trdy) .parallel. |p2q.sub.-- trdy) W: otherwise WSHORT.sub.-- BURST__________________________________________________________________________
__________________________________________________________________________Master state transitionsMASTER STATE MACHINECurrentState Event Next State__________________________________________________________________________WCOMPLETE X: p2q.sub.-- retry .parallel. p2q.sub.-- target.sub.-- abort .parallel. (|(overflow.sub.-- next.sub.-- IDLE queue && |new.sub.-- write.sub.-- cmd && |p2q.sub.-- last.sub.-- dphase)&& |p2q.sub.-- trdy) Y: |p2q.sub.-- retry &&|p2q.sub.-- target.sub.-- abort && ((overflow.sub.-- WDATA1 next.sub.-- queue &&|new.sub.-- write.sub.-- cmd && |p2q.sub.-- last.sub.-- dphase) &&|p2q.sub.-- trdy) Z: otherwise WCOMPLETE__________________________________________________________________________
At reset, the master state machine enters an IDLE state 2700 in which the QPIF awaits instructions to run a transaction on the PCI bus. When the QPIF receives a run signal from the MCA (any.sub.-- run is asserted when any bit in the mca.sub.-- run.sub.-- pmw signal or mca.sub.-- run.sub.-- dr signal is asserted), the cable is not busy delivering a message (|cable.sub.-- busy), and the PCI interface is not trying to finish the previous transaction (|p2q.sub.-- master.sub.-- dphase), the master state machine attempts to run the transaction on the PCI bus. If the transaction is a delayed request transaction (any.sub.-- run.sub.-- drq is asserted) and the other chip does not have room for a delayed completion (tc.sub.-- dc.sub.-- full is asserted), the master state machine is not able to run the request and steps the MCA to the next transaction. Otherwise, if the PCI interface has given the QPIF control of the bus (p2q.sub.-- ack is asserted), the master state machine begins to execute the transaction on the PCI bus. In the IDLE state 2700, the master provides the address phase information, discussed above, to the PCI bus. If the transaction to be run is a dual address cycle (q2pif.sub.-- dac.sub.-- flag is asserted), the master state machine enters a MASTER.sub.-- DAC state 2702 in which the second half of the address information is provided. If the transaction is not a dual address cycle and is a delayed request transaction (any.sub.-- run.sub.-- drq is asserted), the master state machine then enters an RDATA1 read state 2704, in which the master state machine begins the data phase of the delayed request transaction. If the transaction is not a dual address cycle and is not a delayed request, it is a posted memory write transaction, so the master state machine enters a WDATA1 write state 2706, in which the master state machine enters the data phase of the posted memory write transaction.
In the MASTER.sub.-- DAC state 2704=2, the master state machine provides the second half of the address phase information. Then, if the p2q.sub.-- ack signal is still asserted and the transaction is a delayed request, the master state machine enters the RDATA 1 state 2704 when it receives the start signal (p2q.sub.-- start.sub.-- pulse) from the PCI interface. If the transaction is not a delayed request, the master state machine enters the WDATA1 state 2706 when it receives the PCI start pulse. The master state machine also initiates a delayed completion message on the cable when the PCI start pulse is received by asserting an asynchronous completion message signal (early.sub.-- master.sub.-- send.sub.-- message). If the p2q.sub.-- ack signal has been deasserted by the PCI interface, the master state machine returns to the IDLE state 2700 and waits to retry the transaction.
The RDATA1 state 2704 is the initial state for delayed read and delayed write requests. In this state, the master state machine waits for the PCI start pulse before entering an RBURST burst data phase 2708. When the state machine first enters the RDATA1 state 2704, it initiates a completion message on the cable (if not already done in the MASTER.sub.-- DAC state 2702). Then, if the p2q.sub.-- ack is deasserted by the PCI interface, the master state machine terminates the transaction, steps the MCA to the next transaction, and reenters the IDLE state 2700. Otherwise, when the PCI start pulse appears, the master state machine prepares to enter the RBURST state 2708. If the QPIF indicates the end of the transaction (queue cyc.sub.-- complete) or if the transaction has reached a 4K page boundary (read page.sub.-- disconnect is asserted because all bits in the drq.sub.-- addr�11:2! signal are high), the master state machine deasserts the QPIF's frame.sub.-- signal and indicates that the next piece of data is the last piece (asynchronous signal early.sub.-- last.sub.-- master.sub.-- data is asserted) before entering the RBURST state 2708. The master state machine also asserts an asynchronous early.sub.-- master.sub.-- lastline signal, indicating that the last line of data has been reached, if the read page.sub.-- disconnect.sub.-- lastline signal is asserted or if the DRQ last line signal (drq.sub.-- lastline) is asserted and the QPIF has not received a streaming signal from the other bridge chip (cd.sub.-- stream or stream.sub.-- match are not asserted or cfq2q.sub.-- stream.sub.-- disable is not set). If the PCI start pulse is not asserted, the master state machine remains in the RDATA1 state 2704 until the QPIF terminates the transaction or a 4K page boundary is reached, which will return the state machine to the IDLE state 2700, or until the PCI start pulse appears, which forces the state machine to enter the RBURST state 2708.
In the RBURST state 2708, the master state machine bursts data to the PCI bus. If a completion message has not yet been initiated, the master state machine initiates a completion message upon entering the RBURST state 2708. Then, if the p2q.sub.-- ack signal is deasserted, or if the QPIF transaction is retried by the PCI interface (p2q.sub.-- retry is asserted), or if the PCI interface aborts the transaction (p2q.sub.-- target.sub.-- abort is asserted), the master state machine terminates the transaction on the PCI bus, aborts the completion message on the cable, and returns to the IDLE state. When the p2q.sub.-- ack signal is taken away, the master cycle arbiter continues to select the current transaction. But when the transaction is retried or aborted, the master state machine steps the MCA to the next transaction.
While the p2q.sub.-- ack signal is still asserted and the QPIF transaction is not retried or aborted, the master state machine nevertheless terminates the transaction and returns to the IDLE state 2700 if a 4K page boundary is reached and the PCI interface indicates that the target device has stopped taking data (p2q.sub.-- trdy is no longer asserted). If the target device took the last piece of data, the master state machine remains in the RBURST state 2708.
If the QPIF asserts the queue.sub.-- cyc.sub.-- complete signal indicating that the transaction has completed, the master in general will terminate the transaction and return to the IDLE state 2700 if the p2q.sub.-- trdy signal is deasserted or remain in the RBURST state 2708 until the last dword of data is transferred if the p2q.sub.-- trdy signal remains asserted. However, if the transaction is in the data phase and is not in the last data phase (p2q.sub.-- master.sub.-- dphase and |p2q.sub.-- last.sub.-- dphase) and a stream has been established with the other bridge chip (cd.sub.-- stream and stream.sub.-- match and |cfg2q.sub.-- stream.sub.-- disable), the master state machine will remain in the RBURST phase indefinitely. When the QPIF is streaming, the master state machine asserts a streaming signal (q2pif.sub.-- streaming) that forces the QPIF to continue to provide data to the requesting device on the other PCI bus until that device terminates the transaction.
If the p2q.sub.-- ack signal remains asserted and neither the p2q.sub.-- retry, p2q.sub.-- target.sub.-- abort, or queue.sub.-- cyc.sub.-- complete signals are asserted, the master state machine looks at the p2q.sub.-- trdy signal. If the signal is not asserted, indicating that the target device has taken or provided the last piece of data, the master state machine asserts its next data signal (early.sub.-- next.sub.-- data), which indicates that the QPIF is ready to transfer another piece of data. The next data signal is asserted only if the transaction is not a corrected read (align.sub.-- read is not asserted) or if the transaction is a corrected read and the read.sub.-- data.sub.-- start signal has been asserted. If the p2q.sub.-- trdy signal is asserted, indicating that the target has not performed the last data transfer, the state machine remains in the RBURST state 2708.
In the WDATA1 state 2706, the master state machine begins the data phase of a posted memory write transaction. If the p2q.sub.-- ack signal is deasserted or the p2q.sub.-- retry or p2q.sub.-- target.sub.-- abort signals are asserted while the master state machine is in this state, the transaction is terminated on the PCI bus and the state machine returns to the IDLE state 2700. When the p2q.sub.-- ack signal is deasserted, the MCA remains on the current cycle; otherwise, the master state machine steps the MCA to the next transaction.
If the p2q.sub.-- ack signal remains asserted and the transaction is neither retried nor aborted, the master state machine must determine whether the write involves a single dword or more than one dword. If in the WDATA1 state the queue.sub.-- cyc.sub.-- complete signal is asserted, the held new write command signal is asserted, the end.sub.-- of.sub.-- line and new.sub.-- write.sub.-- cmd signals are asserted, or the transaction has reached the last dword of data, the transaction involves a single dword. In this situation, the transaction -terminates and the state machine returns to the IDLE state 2700 only when the target took the last piece of data (|p2q.sub.-- trdy). Otherwise, the state machine remains in the WDATA2 state 2710. If the transaction involves more than one dword of data, the master state machine enters a WDATA2 burst data phase state 2710. Just before entering the WDATA2 state, the master state machine inserts a q2p.sub.-- irdy wait state if the overflow.sub.-- next.sub.-- queue signal has been asserted.
In the WDATA2 state 2710, the master state machine bursts data to the PCI bus. If the p2q.sub.-- ack signal is deasserted or the transaction is aborted by the PCI interface, the transaction is terminated in the QPIF and the master state machine reenters the IDLE state 2710. If the transaction is retried by the PCI interface but the PCI interface took the data provided (|p2q.sub.-- trdy), the master state machine reenters the IDLE state 2700. Otherwise, the state machine enters a WRETRY stepback state 2712 that steps the PMWQ out pointer back to the previous piece of data by generating the stepback signal discussed above. From the WRETRY state 2712, the state machine always reenters the IDLE state 2700.
If the p2q.sub.-- ack signal remains asserted and the transaction is neither retried nor aborted, the master state machine determines whether the transaction is complete. If the QPIF indicates the end of the transaction (queue.sub.-- cyc.sub.-- complete is asserted) or the end of a cache line is reached and a new write command is needed (end.sub.-- of.sub.-- line and new.sub.-- write.sub.-- command are asserted), the state machine enters a WSHORT.sub.-- BURST state 2714 when either the last piece of data was taken (|p2q.sub.-- trdy) or the PCI start pulse is received. In either case, only two dwords of data must be written to the PCI bus. Otherwise, the state machine remains in the WDATA2 state 2710. When the state machine enters the WSHORT.sub.-- BURST state 2714, the QPIF frame.sub.-- signal remains asserted if the transaction can overflow into the next queue and a new write command is not needed.
In the WSHORT.sub.-- BURST state 2714, the master state machine prepares to write the final two dwords of data to the PCI bus. If the p2q.sub.-- ack signal is deasserted or the cycle is retried or aborted by the PCI interface, the state machine terminates the transaction and returns to the IDLE state 2700. When the PCI acknowledge signal disappears or the cycle is aborted, the master state machine asserts the stepback signal to indicate that the PMWQ out pointer should be stepped back to the previous dword. When the transaction is retried by the PCI interface, the out pointer is stepped back only if the target device did not take the last piece of data (p2q.sub.-- trdy is asserted). When the transaction is not terminated and it can overflow into the next PMWQ buffer (overflow.sub.-- next.sub.-- queue is asserted) and a new write command is not needed, the master state machine keeps the QPIF frame signal asserted and then enters a WCOMPLETE state 2716 if the target device has taken the last piece of data or stays in the WSHORT.sub.-- BURST state 2714 otherwise. If the transaction cannot overflow into the next queue or a new write command is needed, the state machine deasserts the frame signal to indicate the end of the QPIF transaction and then enters the WCOMPLETE state 2716 if the last piece of data was taken by the target device or remains in the WSHORT.sub.-- BURST state 2714 otherwise.
In the WCOMPLETE state 2716, the master state machine terminates the posted memory write transaction. The state machine enters the IDLE state 2700 if the transaction is retried or aborted by the PCI interface. If the transaction is retried, the PMWQ out pointer is incremented only if the target device took the last piece of data. If the transaction can overflow into the next queue, a new write command is not needed, and the transaction is not in the last data phase, the master state machine increments the queue selection counter and returns to the WDATA1 state 2706 to continue the transaction from the overflow queue, as long as the target device took the last piece of data. If the target device did not take the last piece of data, the master state machine remains in the WCOMPLETE state 2716.
If the transaction will not overflow into the next PMWQ buffer, the master state machine terminates the transaction and returns to the IDLE state 2700 if the target took the last piece of data. Otherwise, the state machine remains in the WCOMPLETE state 2716 until one of the terminating events discussed above occurs.
Referring to FIG. 86, the slave state machine controls the operation of the QPIF when the QPIF is operating in the slave mode. In the slave mode, the QPIF receives posted write transactions and delayed request transactions from devices on the PCI bus and forwards the transactions to the target bus through the cable. The following table shows the events causing state transitions in the slave state machine.
__________________________________________________________________________Slave state transitionsSLAVE STATE MACHINECURRENTSTATE EVENT NEXT STATE__________________________________________________________________________SLAVE.sub.-- IDLE A: p2q.sub.-- qcyc && p2q.sub.-- dac.sub.-- flag && |p2q.sub.-- perr SLAVE.sub.-- DAC B: p2q.sub.-- qcyc && |p2q.sub.-- dac.sub.-- flag && pmw.sub.-- request && PMW1 |p2q.sub.-- perr &&(|tc.sub.-- pmw.sub.-- full && |dcq.sub.-- locked && |lock.sub.-- state�1!) C: p2q.sub.-- qcyc && |p2q.sub.-- dac.sub.-- flag &&|pmw.sub.-- request STEP.sub.-- AHEAD && |p2q.sub.-- perr &&(mem.sub.-- read.sub.-- line .parallel. mem.sub.-- read.sub.-- mul) && (dcq.sub.-- hit &&|dcq.sub.-- no.sub.-- data &&|lock.sub.-- state�1!) D: p2q.sub.-- qcyc &&|p2a.sub.-- dac.sub.-- flag &&|pmw.sub.-- request SECOND.sub.-- CHECK && |p2q.sub.-- perr &&|(mem.sub.-- read.sub.-- line .parallel. mem.sub.-- read.sub.-- mul) E: �p2q.sub.-- qcyc &&|p2q.sub.-- dac.sub.-- flag && pmw.sub.-- request && SLAVE.sub.-- IDLE |p2q.sub.-- perr &&|(|tc.sub.-- pmw.sub.-- full&&|dcq.sub.-- locked&&|lock.sub.-- state�1!)! .parallel. �p2q.sub.-- qcyc&&p2q.sub.-- dac.sub.-- flag&&p2q.sub.-- perr! .parallel. �p2c.sub.-- qcyc &&|p2q.sub.-- dac.sub.-- flag&&|pmw.s ub.-- request&& (p2q.sub.-- perr) .parallel. ((mem.sub.-- read.sub.-- line .parallel. mem.sub.-- read.sub.-- mul)&& |(dcq.sub.-- hit&&|dcq.sub.-- no.sub.-- data &&|lock.sub.-- state�1!))! .parallel. otherwiseSLAVE.sub.-- DAC F: p2q.sub.-- qcyc&&pmw.sub.-- request && |p2q.sub.-- perr PMW1 (|tc.sub.-- pmw.sub.-- full &&|dcq.sub.-- locked &&|lock.sub.-- state�1!) G: p2q.sub.-- qcyc &&|pmw.sub.-- request && |p2q.sub.-- perr STEP.sub.-- AHEAD (mem.sub.-- read.sub.-- line .parallel. mem.sub.-- read.sub.-- mul)&& (dcq.sub.-- hit && |dcq.sub.-- no.sub.-- data && | lock.sub.-- state�1!) H: p2q.sub.-- qcyc&&|pmw.sub.-- request && |p2q.sub.-- perr SECOND.sub.-- CHECK |(mem.sub.-- read.sub.-- line .parallel. mem.sub.-- read.sub.-- mul) I: otherwise SLAVE.sub.-- IDLESECOND.sub.-- CHECK J: |io.sub.-- write && |config.sub.-- write && |p2q.sub.-- perr && STEP.sub.-- AHEAD (dcq.sub.-- hit && |dcq.sub.-- no.sub.-- data && |lock.sub.-- state�1! && dwr.sub.-- check.sub.-- ok).sub.-- K: otherwise SLAVE.sub.-- IDLESTEP.sub.-- AHEAD L: dcq.sub.-- no.sub.-- data HIT.sub.-- DCQ.sub.-- FINAL M: otherwise HIT.sub.-- DCQHIT.sub.-- DCQ N: |p2q.sub.-- qcyc SLAVE.sub.-- IDLE O: p2q.sub.-- qcyc&&(dcq.sub.-- no.sub.-- data&& |p2q.sub.-- irdy .parallel. (pmw.sub.-- counter�2! HIT.sub.-- DCQ.sub.-- FINAL &&pmw.sub.-- counter�1! && pmw.sub.-- counter�0! && read.sub.-- disconnect.sub.-- for.sub.-- stream) P: otherwise HIT.sub.-- DCQHIT.sub.-- DCQ.sub.-- FINAL Q: |p2q.sub.-- qcyc .parallel. |p2q.sub.-- irdy SLAVE.sub.-- IDLE R: otherwise HIT.sub.-- DCQ.sub.-- FINALPMW1 S: |p2q.sub.-- qcyc SLAVE.sub.-- IDLE T: otherwise PMW1__________________________________________________________________________
At reset, the slave state machine enters an IDLE state 2720, in which the QPIF waits for a transaction be initiated by a device on the PCI bus. If a transaction initiated on the bus does not target the QPIF (q2p.sub.-- qcyc is not asserted), the slave state machine continues in the IDLE state 2720. When a transaction on the PCI bus does target the QPIF, the slave state machine enters a SLAVE.sub.-- DAC dual address cycle state 2722 if the p2q.sub.-- dac.sub.-- flag is asserted and an address parity error has not occurred (p2q.sub.-- perr.sub.-- is low). If the transaction is not a dual address cycle and is a posted memory write request, and if a parity error has not occurred in the address phase, the slave state machine loads the write counters (i.e., asserts load.sub.-- write.sub.-- counter) and determines whether it can accept the transaction. If the PMWQ in the other bridge chip is full (tc.sub.-- dc.sub.-- full is asserted by the DC transaction counter) or the DCQ is locked (dcq.sub.-- locked is asserted) or the QPIF lock logic is in the unlocked-but-retry-state (lock.sub.-- state�1! equals "1"), the slave state machine terminates the transaction by asserting an asynchronous retry signal (early.sub.-- retry) that is passed to PCI interface as q2pif.sub.-- retry and remains in the IDLE state 2720. If the QPIF can accept the transaction, the slave state machine initiates the posted memory write message on the cable and enters a PMW1 state 2724, in which the transaction is forwarded up the cable.
If the transaction is not a dual address cycle or a posted memory write request, the slave state machine loads the dword counter (asserts load.sub.-- write.sub.-- counter) and, if no parity error has occurred, analyzes the delayed request transaction. If the transaction is a MRL or a MRM transaction and the QPIF lock logic is not in the unlocked-but-retry state, the slave state machine asserts the QPIF check cycle signal (q2pif.sub.-- check.sub.-- cyc), which instructs the DCQ to compare the latched request to the delayed completion messages in the DCQ buffers. If the request hits a DCQ buffer that is not empty (dcq.sub.-- hit and |dcq.sub.-- no.sub.-- data), the slave state machine enters a STEP.sub.-- AHEAD state 2726 in which the QPIF begins delivering the requested information to the PCI bus. If the MRL or MRM request misses all of the DCQ data buffers (|dcq.sub.-- hit), the DCQ is not full (|dcq.sub.-- full), the delayed request queue in the other bridge chip is not full (|tc.sub.-- dr.sub.-- full), and the DCQ and QPIF are not locked (|dcq.sub.-- locked and |lock.sub.-- state�1!), the slave state machine asserts the q2pif.sub.-- retry signal, forwards the request down the cable, and remains in the IDLE state 2720. If the request misses the DCQ and the request cannot the sent down the cable, the QPIF simply retries the requesting device and remains in the IDLE state 2720.
If the delayed request is not a MRL or MRM transaction, a second clock cycle is needed to check the request because the data or byte enables must be compared to the contents of the DCQ buffers, so the slave state machine enters a SECOND.sub.-- CHECK state 2728. If a parity error occurs or if the lock logic is in the unlocked-but-retry state, the state machine retries the requesting device and remains in the IDLE state 2720.
In the SLAVE.sub.-- DAC state 2722, the slave state machine receives the second half of the address phase information. If the requesting device has not targeted the QPIF, the slave state machine ignores the transaction and remains in the IDLE state 2720. When the QPIF is the target device, the state transition events are the same as those in the IDLE state 2720. Specifically, if the transaction is a posted memory write request and a parity error has not occurred, the slave state machine loads the write counters and determines whether it can accept the transaction. If the PMWQ in the other bridge chip is full (tc.sub.-- pmw.sub.-- full is asserted), the DCQ is locked, or the QPIF lock logic is in the unlocked-but-retry state, the slave state machine retries the requesting device and returns to the IDLE state 2720. If the QPIF can accept the transaction, the slave state machine initiates the posted memory write message on the cable and enters the PMW1 state 2724.
If the transaction is not a posted memory write request, the slave state machine loads the dword counter and, if no parity error has occurred, analyzes the delayed request transaction. If the transaction is a MRL or a MRM transaction and the QPIF lock logic is not in the unlocked-but-retry state, the slave state machine asserts the QPIF check cycle signal. If the request hits a DCQ buffer that is not empty, the slave state machine enters the STEP.sub.-- AHEAD state 2726. If the MRL or MRM request misses all of the DCQ data buffers, the DCQ is not full, the delayed request queue in the other bridge chip is not full (tc.sub.-- dr.sub.-- full is not asserted), and the DCQ and QPIF are not locked, the slave state machine asserts the q2pif.sub.-- retry signal, forwards the request down the cable, and returns to the IDLE state 2720. If the request misses the DCQ and the request cannot be sent down the cable, the QPIF simply retries the requesting device and returns to the IDLE state 2720.
If the delayed request is not a MRL or MRM transaction, a second clock cycle is needed to check the request because the data or byte enables must be compared to the contents of the DCQ buffers, so the slave state machine enters the SECOND.sub.-- CHECK state 2728. If a parity error occurs or if the lock logic is in the unlocked-but-retry state, the state machine retries the requesting device and returns to the IDLE state 2720.
In the PMW1 state 2724, the slave state machine forwards a posted memory write transaction through the cable to the target device. When the state machine first enters the PMW1 state 2724, it deasserts the load.sub.-- write.sub.-- counter signal. If the dword counter indicates that the posted memory write transition is in the last cache line (pmw.sub.-- counter�5:3! equals "111") and the PMWQ in the other bridge is full (tc.sub.-- pmw.sub.-- full) and the write overflow feature is disabled (|cfg2q.sub.-- write.sub.-- overflow), or if the write.sub.-- page.sub.-- disconnect signal is asserted because the transaction has reached a 4K page boundary, or if the DCQ has asserted the dcq.sub.-- disconnect.sub.-- for.sub.-- stream signal and the write disconnect feature is not disabled (|cfg2q.sub.-- wr.sub.-- discnt.sub.-- disable), the slave state machine asserts the slave.sub.-- lastline signal indicating that the current cache line will be the last to be transferred. The slave state machine then remains in the PMW1 state 2724 until the p2q.sub.-- qcyc signal is deasserted, indicating that the transaction has completed on the PCI bus. After leaving the PMW1 state 2724, the slave state machine reenters the IDLE state 2720.
In the SECOND.sub.-- CHECK state 2728, the slave state machine has the DCQ compare the second phase of request information to the delayed completion information in the DCQ buffers. If the transaction is not a delayed write request (|io.sub.-- write and |config.sub.-- write) or there is no parity error (|p2q.sub.-- perr), and if the DCQ is not locked and the dwr.sub.-- check.sub.-- ok signal is asserted, the slave state machine asserts the q2pif.sub.-- check.sub.-- cyc. The dwr.sub.-- check.sub.-- ok signal is asserted either when the transaction is not a delayed write request or when it is a delayed write request and a p2q.sub.-- irdy wait state has not been inserted. If the request hits one of the DCQ buffers and the buffer is not empty, the slave state machine enters the STEP.sub.-- AHEAD state 2726. If the request misses all of the DCQ buffers but the QPIF can send the message down the cable, the slave state machine retries the requesting device, forwards the transaction down the cable, and reenters the IDLE state 2720. Otherwise, if the request missed all of the DCQ buffers and the QPIF could not send the transaction down the cable, or if a parity error occurred on a delayed write request, the state machine will retry the requesting device and reenter the IDLE state 2720.
In the STEP.sub.-- AHEAD state 2726, the slave state machine increments the DCQ output pointer to the next dword. This state is necessary immediately after a DCQ buffer is hit because the PCI interface latches the first dword of data without asserting the |p2q.sub.-- trdy signal. From the STEP.sub.-- AHEAD state 2726, the state machine enters a HIT.sub.-- DCQ state 2730, in which data is provided from the appropriate DCQ buffer to the requesting device, if the last dword of data has not been taken. Otherwise, the state machine enters a HIT.sub.-- DCQ.sub.-- FINAL state 2732, in which the requesting device is retried because the DCQ buffer contains no more data.
From the HIT.sub.-- DCQ state 2730, when the delayed request transaction terminates on the PCI bus before it terminates in the QPIF (i.e., p2q.sub.-- qcyc is deasserted), the state machine terminates the transaction in the QPIF and asserts the stepback signal, which indicates that the DCQ out pointer should be decremented because the last piece of data was not taken by the requesting device. The state machine then reenters the IDLE state 2720. If the DCQ buffer runs out of data while the requesting device continues to request it (dcq.sub.-- no.sub.-- data and |p2q.sub.-- irdy), or if the pmw.sub.-- counter indicates that the last dword has been reached and the read.sub.-- disconnect.sub.-- for.sub.-- stream signal has been asserted, the slave state machine retries the requesting device and enters the HIT.sub.-- DCQ.sub.-- FINAL state 2732. If the transaction terminates to establish a stream, the step back signal is asserted and the output pointer of the appropriate DCQ buffer is decremented. In any other situation, the slave state machine continues to provide data in the HIT.sub.-- DCQ state 2730.
In the HIT.sub.-- DCQ.sub.-- FINAL state 2732, the slave state machine has one dword of data left to transfer. If the PCI bus terminates the transaction before the requesting device takes the last piece of data (i.e., p2q.sub.-- qcyc is deasserted), the slave state machine asserts the stepback signal and returns to the IDLE state 2720. If the p2q.sub.-- qcyc signal remains asserted and the requesting device has not asserted an initiator wait state (|p2q.sub.-- irdy), the requesting device is retried because the last piece of data has been taken. The state machine then reenters the IDLE state 2720. Otherwise, the slave state machine remains in the HIT.sub.-- DCQ.sub.-- FINAL state 2732.
Referring to FIG. 87, the cable message generator is a state machine that creates cable messages from transaction information obtained from the master and slave state machines. In addition to an IDLE state 2740, the cable message generator also includes a dual address cycle (CABLE.sub.-- DAC) state 2742, a master data phase (MASTER.sub.-- DPHASE) state 2744, and a slave data phase (SLAVE.sub.-- DPHASE) state 2746. The following table shows the events causing state transitions in the cable message generator.
__________________________________________________________________________Cable Message Generator State TransitionsCABLE MESSAGE GENERATORCURRENTSTATE EVENT NEXT STATE__________________________________________________________________________CABLE.sub.-- IDLE A: (send.sub.-- message&&q2pif.sub.-- dac) .parallel. ((dcq.sub.- - prefetch.sub.-- mul .parallel. CABLE.sub.-- DAC dcq.sub.-- prefetch.sub.-- line)&&dcq.sub.-- prefetch.sub.-- dac) B: (send.sub.-- message&&|q2pif.sub.-- dac) .parallel. ((dcq.sub. -- prefetch.sub.-- mul .parallel. SLAVE.sub.-- DPHASE dcq.sub.-- prefetch.sub.-- line)&&|dcq.sub.-- prefetch.sub.-- dac) .parallel. (dcq.sub.-- stream.sub.-- connect&&|(.vertline.drq.sub.-- valid�3:0!))&&(dcq.sub.-- stream.sub.-- connect .parallel. |p2q.sub.-- ack .parallel. dcq.sub.-- prefetch.sub.-- line .parallel. dcq.sub.-- prefetch.sub.-- mul) C: (send.sub.-- message&&|q2pif.sub.-- dac) .parallel. ((dcq.sub. -- prefetch.sub.-- mul .parallel. MASTER.sub.-- DPHASE dcq.sub.-- prefetch.sub.-- line)&&|dcq.sub.-- prefetch.sub.-- dac) .parallel. (dcq.sub.-- stream.sub.-- connect &&|(.vertline.drq.sub.-- valid�3:0!))&&|dcq.sub.-- stream.sub. -- connect&& |(|p2q.sub.-- ack.parallel.dcq.sub.-- prefetch.sub.-- mul.parallel.dcq.sub.-- prefetch.sub.-- line) D: otherwise CABLE.sub.-- IDLECABLE.sub.-- DAC E: |p2q.sub.-- ack .parallel. dcq.sub.-- dcq.sub.-- prefetch.sub. -- mul .parallel. dcq.sub.-- prefetch.sub.-- line SLAVE.sub.-- DPHASE F: otherwise MASTER.sub.-- DPHASEMASTER.sub.-- DPHASE G: send.sub.-- message&&q2pif.sub.-- dac CABLE.sub.-- DAC H: send.sub.-- message&&|q2pif.sub.-- dac SLAVE.sub.-- DPHASE I: |send.sub.-- message&&(early.sub.-- last.sub.-- master.sub.-- data&&|p2q.sub.-- trdy .parallel. CABLE.sub.-- IDLE master.sub.-- abort.sub.-- cable) J: otherwise MASTER.sub.-- DPHASESLAVE.sub.-- DPHASE K: �|(drq.sub.-- stream.sub.-- connect&&|(.vertline.drq.sub.-- valid�3:0!)&&p2.sub.-- qcyc)! CABLE.sub.-- IDLE &&�(dly.sub.-- read.sub.-- request.parallel. dly.sub.-- single.sub.-- write.sub.-- request.parallel. dcq.sub.-- prefetch.sub.-- mul .parallel. dcq.sub.-- prefetch. sub.-- line)! .parallel. L: early.sub.-- last.sub.-- slave.sub.-- data .parallel. dcq.sub.-- stream.sub.-- connect&&|(.vertline.drq.sub.-- valid�3:0!)&&p2q.sub.-- qcyc and SLAVE.sub.-- DPHASE otherwise__________________________________________________________________________
At reset, the cable message generator enters the IDLE state 2740, in which it waits for transaction information to arrive from the master or slave state machines. From the IDLE state 2740, if the cable message generator receives a prefetch multiple signal (dcq.sub.-- prefetch.sub.-- mul) or a prefetch line signal (dcq.sub.-- prefetch.sub.-- line), the cable address signal (early.sub.-- cad�31:2!) equals the prefetch address signal (dcq.sub.-- prefetch.sub.-- addr�31:2!). Otherwise the early.sub.-- cad�31:2! signal takes on the value of the QPIF address signal (q2pif.sub.-- addr�31:2!). When the cable message is initiated by the master state machine, the message is a delayed completion message, so the command code (early.sub.-- ccbe�3:0!) equals "1001". When the cable message is initiated by the slave state machine, the command code takes on the value of the message.sub.-- cmd�3:0! signal, discussed above.
If the send.sub.-- message signal is asserted, indicating that either the master state machine or the slave state machine has initiated a message, and the corresponding transaction is not a dual address cycle, or if the cable message generator receives a prefetch request that is not a dual address cycle, or if the cable message generator receives a stream connect signal and no delayed requests from the CPU are pending in the downstream DRQ, the cable message generator asserts a sent.sub.-- pmw signal that indicates that a posted memory write request from the PCI bus will be sent down the cable. The sent.sub.-- pmw signal is not asserted if a stream has been established by the DCQ. The cable message generator asserts a sent.sub.-- dr signal when a read request or delayed write request is received from the slave state machine or a prefetch signal is received and when a stream has not been established by the DCQ.
If the DCQ has established a stream (dcq.sub.-- stream.sub.-- connect is asserted), the buffer number for the cable signal (early.sub.-- cbuff�2:0!) takes on the value of the DCQ stream buffer (dcq.sub.-- stream.sub.-- buff�2:0!), the cable command code (early.sub.-- ccbe�3:0!) is set equal to "1000", and the cable message generator enters the SLAVE.sub.-- DPHASE state 2746. Otherwise, if the QPIF is in the slave mode and the cable message generator receives either a prefetch multiple or a prefetch line signal, the cable buffer signal takes on the value of the DCQ buffer number (dcq.sub.-- buff�2:0!) and the cable message generator enters the SLAVE.sub.-- DPHASE state 2746. Otherwise, the QPIF is operating in the master mode and the cable message generator enters the MASTER.sub.-- DPHASE state 2744.
When the cable message generator receives the send.sub.-- message signal and a transaction that is a dual address cycle, or when it receives a prefetch request that is a dual address cycle, the message generator enters the CABLE.sub.-- DAC state 2742. For a prefetch signal, the cable address signal is set equal to the upper thirty two bits of the dcq.sub.-- prefetch.sub.-- addr�63:0! signal; otherwise, the cable address equals the upper thirty-two bits of the q2pif.sub.-- addr�63:0! signal. Also, if the cable message generator receives the transaction from the slave state machine, the cable buffer number equals the DCQ buffer number; otherwise, the cable buffer number equals the DRQ buffer number (no completion messages are generated for posted memory write transactions).
In the CABLE.sub.-- DAC state 2742, the cable message decoder generates the second half of the address phase information. As in the IDLE state 2740, the cable address signal takes on the value of the prefetch address when the received transaction is a prefetch line or prefetch multiple request and takes on the value of the q2pif.sub.-- addr�31:2! otherwise. The sent.sub.-- pmw signal is asserted when the message generator receives a posted memory write transaction from the slave state machine, and the sent.sub.-- dr signal is asserted when it receives a prefetch request or a delayed request from the slave state machine. If a prefetch request or a request from the slave state machine is received, the cable message generator enters the SLAVE.sub.-- DPHASE state 2746. Otherwise, the message generator enters the MASTER.sub.-- DPHASE state 2744.
In the MASTER.sub.-- DPHASE state 2744, the cable message generator attempts to send a delayed completion message down the cable. However, if the PCI interface grants the bus to a device on the PCI bus before the QPIF gets control of the bus, the cable message generator must leave the MASTER.sub.-- DPHASE state 2744 to send the newly received message. Therefore, if the send.sub.-- message signal is asserted while the message generator is in the MASTER.sub.-- DPHASE state 2744, the q2c.sub.-- new.sub.-- req signal is asserted to indicate the start of a new message. If the q2pif.sub.-- dac.sub.-- flag is asserted, the new transaction is a dual address cycle and the cable message generator enters the CABLE.sub.-- DAC state 2742. Otherwise, message generator enters the SLAVE.sub.-- DPHASE state 2746.
If the send.sub.-- message signal is not asserted, then the cable message generator is sending a delayed completion message from the master state machine. When the master state machine has completed the last data transfer with the PCI bus and the target device has acknowledged the transfer (|p2q.sub.-- trdy), or when the master has aborted the transaction on the cable, the cable message generator asserts a sent.sub.-- dc signal indicating that the delayed completion message was sent down the cable and reenters the IDLE state 2740. Otherwise, the message generator remains in the MASTER.sub.-- DPHASE state 2744 and continues generating the delayed completion message.
From the SLAVE.sub.-- DPHASE state 2746, as long as a stream is established with the upstream chip, no delayed requests from the CPU are pending in the downstream DRQ, and the requesting device continues to send data to the QPIF (q2p.sub.-- qcyc is asserted), the cable message generator remains in the SLAVE.sub.-- DPHASE state 2746 and continues to forward the transaction from the requesting device. Otherwise, if the cable message generator receives a delayed request or a prefetch request, the cable message generator forwards the request and, in the case of a delayed write request, the one dword of data to the upstream device and then enters the IDLE state 2740. Otherwise, the cable message generator has received a posted memory write request. In this situation, the cable message generator stays in the SLAVE.sub.-- DPHASE state 2746 and continues to forward the posted memory write information down the cable until the early.sub.-- last.sub.-- slave.sub.-- data signal is asserted, indicating the last piece of data has been sent by the slave state machine. The message generator then terminates the cable transaction and reenters the IDLE state 2740.
CABLE INTERFACE
To ensure the valid transfer of data between the two bridge chips, data sent through the cable 28 must be synchronized properly to the clocks from the clock generators 102 and 122. The downstream clock generator 122 bases its clocks on an upstream clock (which in turn is based on the PCI bus clock PCICLK1) transmitted down the cable 28 with the data. As a result, upstream data transmitted downstream is synchronized to the clocks generated in the downstream bridge chip 48. However, the phase delay associated with the cable 28 between the main clocks generated in the upstream chip 26 and the data transferred back upstream from the downstream chip 48 is unknown. The length of the cable 28 range from 10 to as large as 100 feet (if appropriate interface technology is used). The receiving logic in the upstream cable interface 104 is effectively an asynchronous boundary with respect to the upstream clock. Consequently, the receiving logic needs to re-synchronize the downstream-to-upstream data to the clock from the upstream clock generator 102.
Referring to FIG. 5, the clock distribution scheme in the 2-chip PCI-PCI bridge is shown. Transactions which are forwarded between the bridge chips 26 and 48 are encoded into multiple time-multiplexed messages. The format of the messages is similar to the PCI transaction format (except for time multiplexing) and includes an address and one or more data phases and modified handshake signals in addition to signals which are added to indicate buffer number and special bridge function commands. Each cable interface 104 or 130 includes a master cable interface (192 or 194) and a slave cable interface (196 or 198). The master cable interface 192 or 194 transmits messages out onto the cable 28, and the slave cable interface 196 or 198 receives messages from the cable 28.
The clock generator 102 or 122 in each bridge chip includes two on-chip PLLs for clock generation. A PLL 184 in the upstream bridge chip 26 locks on the primary PCI bus input clock PCICLK1. In the downstream bridge chip 48, the PLL 180 locks to an incoming clock PCICLK2 from a clock buffer 181.
In the ensuing description, a "1X clock" refers to a clock having the same frequency as the clock PCICLK1, while a "3X clock" refers to a clock having three times the frequency of the clock PCICLK1. A 1X clock PCLK generated by the PLL 184 or 180 (in the bridge chip 26 or 48, respectively) is used for the corresponding bridge chip's PCI bus interface logic 188 or 190, and the 3X clock PCLK3 is used to run the cable message generation logic in the master cable interface 192 or 194. The other PLL 186 or 182 is used to lock to a cable input clock CABLE.sub.-- CLK1 (from upstream) or CABLE.sub.-- CLK2 (from downstream) and to generate a 1X clock CCLK and a 3X clock CCLK3 to capture incoming cable data. The clock outputs of the PLL 186 or 182 are routed to the slave cable interface 196 or 198, respectively.
The PLLs are arranged in the layout to balance the 1X and 3X clocks as closely as possible to minimize the skew between them.
The PLL 184 or 180 generates a phase indicator signal PCLKPHI1, which indicates to the master cable interface 192 or 194 when the first phase of data should be presented to the cable 28. On the upstream side, the signal PCLKPHI1 is based on the PCI clock PCICLK1; on the downstream side, the signal PCLKPHI1 is based on the PCI clock PCICLK2. The PLL 186 or 182 generates a phase indicator signal CCLKPHI1, based on the clock CABLE.sub.-- CLK1 or CABLE.sub.-- CLK2, to indicate to the slave cable interface 196 or 198 when the first phase of data has come down the cable 28.
The PCI clock PCICLK2 for the secondary PCI bus 32 is generated off a 1X clock BUFCLK of the PLL 182 in the downstream bridge chip 48. The clock BUFCLK drives the clock buffer 181 through a driver 179. The buffer 181 outputs a separate clock signal for each of the six slots on the secondary PCI bus 32 as well as the clock PCICLK2, which is routed back as the bus input clock to the downstream bridge chip 48. By basing the clock PCLK on the clock PCICLK2 from the clock buffer 181, the clock schemes of the upstream and downstream chips are made to appear more similar since both are based on an external bus clock.
The cable clock CABLE.sub.-- CLK1 is a 33% duty cycle clock. The PLL 182 first converts the 33% duty cycle clock to a 50% duty cycle clock for output as BUFCLK.
The PCI Specification, Version 2.1, requires that the PCI bus clock must meet the following requirements: clock cycle time greater than or equal to 30 ns; clock high time greater than 11 ns; clock low time greater than or equal to 11 ns; and clock slew rate between 1 and 4 ns.
When the computer system is powered up, the upstream chip 26 is powered on last, the upstream PLL 184 sends the clock CABLE.sub.-- CLK1 (through the master interface 192) down the cable 28, which is then locked to by the downstream PLL 182 and PLL 180. The downstream PLL 180 then sends the clock CABLE.sub.-- CLK2 back upstream to be locked to by the PLL 186. The system is not completely operational until all four PLLs have acquired lock.
If the upstream bridge chip 26 powers up and the downstream bridge chip 48 is not yet turned on, the upstream bridge chip 26 behaves as a PCI-PCI bridge with nothing connected to its downstream bus (the cable 28). As a result, the upstream bridge chip 26 does not accept any cycles until the downstream bridge chip 48 is powered on and the upstream PLL 186 has acquired "lock" from the cable clock CABLE.sub.-- CLK2.
The upstream bridge chip 26 floats all of its PCI output buffers and state machines asynchronously with assertion of the PCI reset signal PCIRST1.sub.-- on the primary bus 24. During reset, the PLL 184 may be attempting to acquire lock on the PCI bus clock PCICLK1. Since the PCI Specification guarantees that the signal PCIRST1.sub.-- will remain active for at least 100 .mu.s after the PCI bus clock becomes stable, the PLL 184 has about 100 .mu.s to acquire a lock.
The downstream bridge chip 48 resets all internal state machines upon detection of the primary bus PCIRST1.sub.-- signal. In response, the downstream bridge chip 48 also asserts a slot-specific reset to each slot on the secondary PCI bus 32, as well as a secondary PCI bus reset signal PCIRST.sub.2.sub.--.
Referring to FIG. 6, each PLL includes a voltage-controlled oscillator (VCO) 200 generating an output 201 (the 3X clock) between 75 Mhz (for a 25-Mhz PCI bus) and 100 Mhz (for a 33-Mhz PCI bus). The VCO 200 receives a reference clock 197, which is the PCI bus clock. Each PLL has a lock detection circuit 205 which indicates by a lock indication bit that the PLL phase is locked to its reference accurately enough to perform its intended function.
The lock indication bits are written to a status register in the configuration space 105 or 125 of each bridge chip. On the downstream side, a power-good/lock status bit is transmitted to the upstream bridge chip 26 to indicate that the main elements of the downstream bridge chip 48 are stable (power is stable) and the downstream PLLs are locked (lock indication bits of the two PLLs are active). The lock indication bit is also gated with the EDC status bits such that EDC errors are not reported as such until the PLLs are locked. Thus, the bridge chip pair can come up to an error-free communication state without software intervention. The lock indication bit also provides some diagnostic information which can distinguish between a PLL lock failure and other data errors. The clock generation circuitry includes a four-state machine 202 to generate a divide-by-3 clock (1X clock) of the VCO output 201. The 1X clock is fed back to the PLL at input 203.
Data is moved down the cable 28 at a 3X clock (PCLK3) rate in three time-multiplexed phases to produce a 1X clock message transfer rate. Referring to FIG. 7, the circuitry in the master cable interface 192 or 194 for disassembling and transmitting the cable message includes a register 204, which samples the out-going message at the local PCLK boundary. The flip-flop 208 provides extra margin for hold time on the third phase of the transmitted message by holding this phase for an extra half of a PCLK. Since the output register 212 is clocked with the 3X clock PCLK3, this reduces the need for tight control on the skew between the 1X and 3X clocks. From the phase indication signal PCLKPHI1, a set of three flip-flops 210 generates successive PHI1, PHI2, and PHI3 signals, representing phases 1, 2 and 3, respectively, which in turn control a 60:20 multiplexer 206. The three phases of data (LMUXMSG�19:0!, LMUXMSG�9:20!, {LMUXXMSG�51:40!, EDC�7:0!}) are successively multiplexed into the register 212 and driven through the cable 28. The third phase of data includes error correction bits EDC�7:0! generated by an ECC generator 206 (FIG. 17) from the register 204 output bits LMUXMSG�51:0!. The flip-flop 214, clocked by PCLK3, receives the PHI1 signal and clocks it out as the cable clock CABLE.sub.-- CLK1 or CABLE.sub.-- CLK2.
Since the master cable interface 192 or 194 is a 1X-to-3X communication interface, a one 3X-clock latency is incurred, resulting in a single 3X clock phase shift of the transmitted cable message from the PCI bus clock as shown in FIG. 8. In period T0, message A is presented to the input of the register 204 and the first phase clock indicator PCLKPHI1 is asserted high. The signal PHI1 is asserted high from a previous cycle. In period T1, the cable clock CABLE.sub.-- CLK1 or CABLE.sub.-- CLK2 is driven high in response to the signal PHI1 being high. The PCLKPHI1 pulse causes the signal PHI2 to be pulsed high in period T1. Next, in period T2, the signal PHI3 is pulsed in response to the signal PHI2. In period T3, the signal PHI1 is pulsed high in response to the signal PHI3 being high. Message A is also loaded into the register 204 on the rising edge of the clock PCLK in period T3. Next, in period T4, the signal PHI1 causes the multiplexer 206 to select the first phase data A1 for loading into the register 212. Next, in period T5, the second phase data A2 is selected and loaded into the register 212. Then, in period T6, the third phase data A3 is loaded into the register 212. This process is repeated for messages B, C, D and E in the subsequent clock periods.
As shown in FIG. 8, the cable clock CABLE.sub.-- CLK has a 33% duty cycle. Alternatively, the cable clock CABLE.sub.-- CLK can be designed to have an average duty cycle of 50%, which can be accomplished, for example, by sending out the cable clock as 33% high-66% low-66% high-33% low. Having an average 50% duty cycle could result in better pass characteristics in the cable 28.
Referring to FIG. 9, a slave cable interface first-in-first-out buffer (FIFO) 216 assembles incoming data from the cable 28 and transmits the assembled data to the queues and PCI state machines in the receiving bridge chip. The FIFO 216 is 4 entries deep, with each entry capable of holding one complete cable message. The depth of the FIFO 216 allows for the cable data to be synchronized to the local bridge chip clock without losing any effective bandwidth in the cable interface. In addition, on the upstream side, the FIFO 216 is an asynchronous boundary for the cable data coming from the downstream bridge chip 48. The FIFO 216 ensures that the cable data is properly synchronized with respect to PCLK before it is outputed to the rest of the chip.
The entries of the FIFO 216 are selected by an input pointer INPTR�1:0! from an input pointer counter 226, which is clocked by the signal CCLK3, cleared when a signal EN.sub.-- INCNT is low, and enabled by the phase indicator CCLKPHI1. The negative edge of the 3X clock CCLK3 from the PLL 186 or 182 is used to latch incoming data from the cable 28, first into a 20-bit register 218, and then into a register 220 if a phase one indication signal PHI1.sub.-- DLY is asserted, or into a register 222 if a phase two indication signal PHI2.sub.-- DLY is asserted. The phase 1 data, phase 2 data and phase 3 data from the registers 220, 222 and 218, respectively, are loaded into the selected entry of the FIFO 216 on the negative edge of CCLK3 when the phase 3 indication signal PHI3.sub.-- DLY is asserted. The four sets of outputs from the FIFO 216 are received by a 240:60 multiplexer 228, which is selected by an output pointer OUTPTR�1:0! from an output pointer counter 224 clocked by PCLK and cleared when a signal EN.sub.-- OUTCNT is low.
Referring to FIG. 10, the input pointer and output pointer counters 226 and 224 continuously traverse through the FIFO 216 filling and emptying data. The counters 226 and 224 are offset in such a way as to guarantee valid data in a location before it is read out. The initialization of the pointers is different for an upstream bridge chip 26 than for a downstream bridge chip 48 due to synchronization uncertainties.
Flip-flops 236 and 238 synchronize the reset signal C.sub.-- CRESET, which is asynchronous to the clocks in the bridge chip, to the CCLK clock boundary. The signal EN.sub.-- INCNT is generated by the flip-flop 238. The input pointer is incremented on the rising edge of the clock CCLK3 if the first phase indication signal CCLKPHI1 and the signal EN.sub.-- INCNT. The output pointer is then started at a later local PCLK clock boundary PCLK when it can be guaranteed that the data will be valid in the FIFO 216. The upstream and downstream bridge chips must handle the starting of the output pointer differently since the phase relationship of the cable clock to the local clock is not known for the upstream bridge chip 26 but is known for the downstream bridge chip 48.
In the downstream bridge chip 48, the phase relationship between the incoming cable clock CABLE.sub.-- CLK1 and the secondary PCI bus clock PCICLK2 is known since the PCI clock PCICLK2 is generated from the cable clock. As a result, no synchronization penalty exists for the output pointer OUTPTR�1:0! in the downstream bridge chip 48, and the output pointer can track the input pointer INPTR�1:0! as closely as possible. A flip-flop 230, which is clocked on the negative edge of the clock PCLK, is used to avoid any clock skew problems between the clock CCLK generated by the PLL 182 and the clock PCLK generated by the PLL 180. Though these two clocks have identical frequencies and should be in phase with each other, there is an unknown skew between the two clocks since they are generated from two different PLLs. On the downstream side, the signal EN.sub.-- OUTCNT is the signal EN.sub.-- INCNT latched on the negative edge of the signal PCLK by the flip-flop 230. A multiplexer 234 selects the output of the flip-flop 230 since the signal UPSTREAM.sub.-- CHIP is low.
In the upstream bridge chip 26, the cable interface is treated as completely asynchronous. The phase uncertainty is due to the unknown phase shift of the cable 28 itself. Designing for this uncertainty gives complete freedom on the length of cable 28. What is known is that the clocks in the upstream and downstream bridge chips have the same frequency, since they both have their origin in the upstream PCI bus clock PCICLK1. In the upstream bridge chip 26, the signal EN.sub.-- OUTCNT is the signal EN.sub.-- INCNT latched on the positive edge of the clock PCLK by a flip-flop 232. The multiplexer 234 selects the output of the flip-flop 232 since the signal UPSTREAM.sub.-- CHIP is high. The flip-flop 232 guarantees that even for the worst-case lineup of the cable clock CABLE.sub.-- CLK2 and the local PCI clock PCLK (one complete PCLK period phase shift), there is valid data in the FIFO 216 before the data is transmitted to the rest of the chip.
Referring to FIG. 11, the cable data is received by the slave cable interface 196 or 198 as three phase time-multiplexed signals A1, A2 and A3; B1, B2 and B3; C1, C2 and C3; and so forth. A previous transaction is completed in periods T0, T1 and T2. Beginning in period T3, the first phase data A1 is presented to the register 218 and the first phase indicator CCLKPHI1 is pulsed high. On the falling edge of CCLK3 in period T3, the data A1 is loaded into the register 218, and the local phase 1 indication signal PHI.sub.-- DLY is pulsed high. In period T4, on the falling edge of clock, the phase 1 data A1 is loaded into the register 220, the phase 2 data A2 is loaded into the register 218, and the phase 2 indication signal PHI2.sub.-- DLY is pulsed high. In period T5, on the falling edge of CCLK3, the phase 2 data is loaded into the register 222, the phase 3 data A3 is loaded into the register 218, and the phase 3 indication signal PHI3.sub.-- DLY is pulsed high. In period T6, the contents of the registers 220, 222, and 218 are loaded into the selected entry of the FIFO 216 on the following edge of CCLK3. Also in period T6, the data B1 is presented to the register 218 along with the indication signal CCLKPHI1. Messages B and C are loaded into the FIFO 216 in the same manner as message A in subsequent periods.
Referring to FIG. 12, the input pointer INPTR�1:0! starts at the value 0 in period T0 on the rising edge of the clock CCLK3. Also in period T0, message A is loaded into FIFO 0 on the falling edge of the clock CCLK3. In the downstream bridge chip 48, the output pointer OUTPTR�1:0! is incremented to the value 0 on the next rising edge of the clock PCLK in period T3. Also in period T3, the input pointer INPTR�1:0! is incremented to the value 1 on the rising edge of the clock CCLK3, and message B is loaded into FIFO 1 on the falling edge of CCLK3. Cable data is thus loaded into FIFO0, FIFO1, FIFO2, and FIFO3 in a circular fashion.
On the upstream side, if the input pointer INPTR�1:0! is 0 in period t0, the output pointer OUTPTR�1:0! is incremented to the value 0 in period T6, two PCLK periods after the input pointer INPTR�1:0!. The two PCLK period lag in the upstream bridge chip 26 allows the phase delay in the cable 28 to be of any value, which has the advantage that the cable length need not be of a specific fixed value.
Referring to FIG. 13, the input and output flip flops on the cable interface are custom-placed by the manufacturer of the chips to minimize the skew between the cable data and the clock passed with it. The amount of wire between each flip-flop and the I/O are maintained as consistent as possible between all cable interface signals.
CABLE MESSAGE
Sixty bits of cable data constitute one message. The 60 bits are multiplexed onto 20 cable lines and are transmitted each 10 ns over the cable 28. The table in FIG. 14 shows the bits and the phase each bit is assigned to. The first three columns show the upstream-to-downstream data transfer format, and the last three columns show the downstream-to-upstream data transfer format. The following is a description of the signals.
EDC�7:0!: The signals are the eight syndrome bits used to detect and correct errors encountered in transmitting data over the cable 28.
CAD�31:0!: The signals are the 32 address or data bits.
CFRAME.sub.-- : The signal is used to signal the start and end of a cable transaction, similar to the PCI FRAME.sub.-- signal.
CCBE�3:0!.sub.-- : The four bits form byte enables in some PCI clock phases and either a PCI command or a message code in other PCI clock phases.
CBUFF�3:0!: In the address phase, the signals indicate a buffer number for initializing the bridge chip delayed completion queue (DCQ) 148 to tie upstream and downstream delayed read completion (DRC) and delayed read request (DRR) transactions. After the address phase, the signals contain the parity bit, parity error indication and the data ready signal.
COMPLETION REMOVED: The bit is used to signal that a delayed completion has been removed from the transaction ordering queue (TOQ) on the other side of the cable 28.
PMW ACKNOWLEDGE: The bit is used to signal that a posted memory write (PMW) has been completed on the other side and has been removed from the transaction run queue (TRQ).
LOCK.sub.-- : The bit is transmitted downstream (but not upstream) to identify locked cycles.
SERR.sub.-- : The bit is used to transmit an SERR.sub.-- indication upstream, but is not transmitted downstream.
INTSYNC and INTDATA: The bits carry the eight interrupts from downstream to upstream in a serially multiplexed format. The signal INTSYNC is the synchronization signal indicating the start of the interrupt sequence and the signal INTDATA is the serial data bit. The signals INTSYNC and INIDATA are routed on separate lines over the cable 28.
RESET SECONDARY BUS: The bit is asserted when the CPU 14 writes to the secondary reset bit in a bridge control register in the upstream bridge chip 26. It causes the downstream bridge chip 48 to reset to a power up state. The reset signals for the slots are also asserted. The signal RESET secondary bus is routed on a separate line over the cable 28.
Because the address and data in each PCI transaction is multiplexed over the same lines, each PCI transaction includes an address phase and at least one data phase (more than one for burst transactions). The PCI specification also supports single address transactions (32-bit addressing) and dual-address transactions (64-bit addressing).
Referring to FIG. 15A, a table shows what information appears on each portion of the bus during address and data phases of the single-address transactions. For a single address transaction, the first phase is the address phase and the second and subsequent phases are data phases. In the address phase of a delayed read/write request transaction, the signals CBUFF�3:0! indicate the DCQ buffer number for initializing the bridge chip DCQ 148 to tie upstream and downstream DRC and DRR transactions. After the address phase, the signal CBUFF�0! contains the parity bit. The signals CCBE�3:0!.sub.-- contain the PCI command in the address phase and the byte enable bits in the data phases.
For posted memory write transactions, the signals CBUFF�3:0! are "don't care" in the address phase and contain the data-ready indication, parity error indication, and parity bit in the data phases.
In a delayed read/write completion transaction, the signals CBUFF�3:0! contain the DCQ buffer numbers in the address phase and the end-of-completion indication, data-ready indication, parity error indication, and parity bit in the data phases. The signals CCBE�3:0!.sub.-- contain a code representing a DRC transaction in the address phase and the status bits of the DRC transaction in the data phases. Delayed completion transactions return the status of the destination bus for each data phase. The data parity bit is transmitted on CCBE�3!.sub.--. Other status conditions are encoded on the CCBE�2:0!.sub.-- bus, with a binary value 000 indicating normal completion and a binary value 001 indicating a target abort condition. The address/data bits CAD�31:0! are "don't care" in the address phase and contain data during the data phases.
In a stream connect transaction, the signals CBUFF�3:0! contain a buffer number in the address phase and the signal CBUFF�2! contains the data-ready indication in the data phases. The signals CCBE�3:0! contain a code representing a stream connect transaction in the address phase and are "don't care" in the data phases. The address/data bits CAD�31:0! are not used during a stream connect transaction.
The table in FIG. 15B shows the encoding of the signals for dual-address transactions. In delayed read/write request transactions, the signals CBUFF�3:0! contain a buffer number in the first and second address phases and the signal CBUFF�0! contains the parity bit in the data phase. The signals CCBE�3:0!.sub.-- contain a code representing a dual-address cycle in the first address phase, the PCI command in the second address phase, and the byte enable bits in the data phase. The signals CAD�31:0! contain the most significant address bits in the first address phase, the least significant address bits in the second address phase, and the data bits in the data phase.
In a dual-address posted memory write transaction, the signals CBUFF�3:0! are "don't care" in the first two address phases, but the signals CBUFF�1:0! contain the parity error indication bit and the parity bit in the data phases. The signals CCBE�3:0!.sub.-- contain a code representing a dual-address cycle in the first address phase, the PCI command bits in the second address phase, and the byte enable bits in the data phases. The signals CAD�31:0! contain the most significant address bits in the first address phase, the remaining address bits in the second address phase, and the data bits in the data phases.
There are three possible states for the data transfer: not-last, last-of-cable-transfer, and last-of- request. The not-last state is indicated by asserting the bit CBUFF�2! while FRAME.sub.-- is active, which indicates that another word of data is being presented. The last-of-cable- transfer state is indicated by asserting the bit CBUFF�2! while the signal CFRAME.sub.-- is inactive. The last-of-request state is indicated by asserting the bits CBUFF�3! and CBUFF�2! while the signal CFRAME.sub.-- is inactive.
The following four IEEE 1149.1 Boundary-Scan (JTAG) signals are included in the cable 28 to effect a JTAG test chain: TCK (the test clock), TDI (test data input), TDO (test data output) and TMS (test mode select). The optional TRST.sub.-- is not transmitted down the cable, but TRST.sub.-- can be generated from power-good.
The JTAG signals are routed from the system PCI connector through the upstream bridge chip 26, including JTAG master 110, down the cable 28 to the downstream bridge chip 48 to the JTAG master 128, which distributes the JTAG signals to each of the six PCI slots on the secondary PCI bus 32. The return path is from the JTAG master 128, up the cable 28 back to the upstream bridge chip 26 and then to the PCI slot on the primary PCI bus 24. The signals TDO, TCK, and TMS are downstream bound signals. The signal TDI is an upstream bound signal.
One type of cable 28 that can be used is a cylindrical 50-pair shielded cable designed to support the High Performance Parallel Interface (HIPPI) standard. A second type of cable is a shielded 50-pair ribbon cable. The advantages of the first are standardization, ruggedness and reliable uniform manufacture. The advantages of the second are greater mechanical flexibility, automatic termination to the connector in assembly and possibly lower cost.
The table of FIG. 16 shows some of the HIPPI cable specifications. The ground shield consists of a braid over aluminum tape and carries only minimum DC currents due to the differential nature of the buffers to be used. The method of signaling is true differential which provides several advantages, with differential buffers used to send and receive signals over the cable 28. First the true differential method is less expensive than fiber optics for this short distance and less complex to interface than other serial methods. Differential signaling provides significant common mode noise immunity and common mode operating range, is available in ASICs and is faster than TTL. When using twisted pair and shielding, it minimizes electromagnetic radiation. When using low voltage swings, it minimizes power dissipation.
The signaling levels chosen as a target are described in the IEEE Draft Standard for Low-Voltage Differential Signals (LVDS) for Scaleable Coherent Interface (SCI), Draft 1.10 (May 5, 1995).
The cable connector is an AMP metallic shell 100-pin connector with two rows of pins. The rows are 100 mils apart and the pins are on 50-mil centers. The metal shell provides EMI shielding and the connection of the ground path from the cable shield to the board connector. The mating right angle board connector just fits a PCI bracket. The connector is to have a bar running between the rows of pins to divert electrostatic discharges from the signal pins when the connector is disconnected. A pair of thumb screws attached to the cable connector will secure the mated connectors.
ERROR DETECTION AND CORRECTION
An error detection and correction (EDC) method is implemented on each bridge chip to protect communication over the cable 28. Since the data is time-multiplexed into three 20-bit groups to be sent over 20 pairs of wires, each triplet of "adjacent" bits (i.e., bits associated with the same wire in the cable 28) is arranged so as to be transmitted on a single wire pair. The EDC method can correct single-bit failures and multi-bit failures occurring in the same bit position in each of the three time-multiplexed phases. The multi-bit failures are typically associated with a hardware failure, e.g., a broken or defective wire or a faulty pin on bridge chips 26, 48.
Twenty wire pairs of the cable 28 are used for downstream communication and 20 more for upstream communication. For the remaining ten pairs in the 50-pair HIPPI cable 28 (which pass such information as the clock signals CABLE.sub.-- CLK1 and CABLE.sub.-- CLK2, reset signals, and the power good/PLL-lock signal), error detection and correction is not implemented.
The following are the underlying assumptions for the EDC algorithm. Most errors are single bit errors. The probability of having random multiple-bit errors in the same transaction is extremely remote because the cable 28 is not susceptible to interference from internal or external sources. Errors caused by a defective wire may affect a single bit or a group of bits transmitted on that wire. When a hardware failure occurs, the logic state of the corresponding differential buffer is in a single valid logic state.
Referring to FIG. 17, the output signals FIFOOUT�59:0! from the multiplexer 228 in the slave cable interface 196 or 198 are provided to the input of a check bit generator 350, which produces check bits CHKBIT�7:0!. The check bits are generated according to the parity-check matrix shown in FIG. 18, in which the first row corresponds to CHKBIT�0!, the second row corresponds to CHKBIT�1!, and so forth. The bits across a row correspond to data bits FIFOOUT�0:59!.
The check bits are generated by an exclusive-OR of all the data bits FIFOOUT�X! (X is equal to 0-59), which have a 11111 value in the parity-check matrix. Thus, the check bit CHKBIT�0! is an exclusive-OR of data bits FIFOOUT�7!, FIFOOUT�8!, FIFOOUT�9!, FIFOOUT�12!, FIFOOUT�13!, FIFOUT�16!, FIFOOUT�22!, FIFOOUT�23!, FIFOOUT�24!, FIFOOUT�26!, FIFOOUT�32!, FIFOOUT�33!, FIFOOUT�34!, FIFOOUT�35!, FIFOOUT�38!, FIFOOUT�39!, FIFOOUT�45!, FIFOOUT�46!, FIFOOUT�48!, FIFOOUT�49!, FIFOOUT�51!, and FIFOOUT�52!. Similarly, the check bit CHKBIT�1! is an exclusive-OR of bits 0, 1, 4, 5, 9, 10, 12, 14, 15, 16, 23, 27, 35, 37, 38, 40, 43, 46, 47, 48, 50, and 53. Check bits CHKBIT�2:7! are generated in similar fashion according to the parity-check matrix of FIG. 18. The parity check matrix is based upon the 20 sub-channels or wires per time-multiplexed phase and a probability that multiple errors in the accumulated data are attributable to a faulty sub-channel or wire that affects the same data position in each time-multiplexed phase.
In the master cable interface 192 or 194, the check bits CHKBIT�7:0! are provided as error detection and correction bits EDC�7:0! along with other cable data to allow error correction logic in the slave cable interface 196 or 198 to detect and correct data errors.
The check bits CHKBIT�7:0! are provided to a fix bit generator 352, which generates fix bits FIXBIT�59:0! according to the syndrome table shown in FIG. 19. The check bits CHKBIT�7:0! have 256 (2.sup.8) possible values. The syndrome table in FIG. 19 contains 256 possible positions. Each of the 256 positions in the syndrome table contains 2 entries, the first entry being the hexadecimal value of the check bits CHKBIT�7:0!, and the second entry indicating the cable data status associated with that position. Thus, for example, a hexadecimal value 00 indicates a no-error condition, a hexadecimal value 01 indicates an error in data bit 52, a hexadecimal value 02 indicates an error in data bit 53, a hexadecimal value 03 indicates an uncorrectable error (UNCER), and so forth.
The EDC logic is capable of detecting up to 3 erroneous bits, as long as those data bits are adjacent, i.e., associated with the same wire. Thus, for example, if the check bits CHKBIT�7:0! contain a hexadecimal value 3D, then data bits 3, 23, and 43 are erroneous. The cable 28 carries cable data CABLE.sub.-- DATA�19:0!. Thus, data bits FIFOOUT�3!, FIFOOUT�23!, and FIFOOUT�43! are associated with the fourth position of the cable data, i.e., CABLE.sub.-- DATA�3!. The EDC method can also correct two-bit errors associated with the same cable wire. Thus, for example, a hexadecimal check bit value of 0F indicates errors in data bits FIFOOUT�4! and FIFOOUT�24!, both associated with CABLE.sub.-- DATA�4!.
The fix bit generator 352 also produces signals NCERR (uncorrectable error) and CRERR (correctable error). If no error is indicated by the check bits, then the signals CRERR (correctable error) and NCERR (non-correctable error) are both deasserted low. In those positions in the syndrome table containing the uncorrectable state UNCER, the signal NCERR is asserted high and the signal CRERR is deasserted low. Otherwise, where a correctable data error is indicated, the signal NCERR is deasserted low and the signals CRERR is asserted high.
The lower 52 bits of the fix bits FIXBIT�51:0! are provided to one input of 52 exclusive-OR gates 354, whose other input receives one of each the lower 52 bits of the FIFO data FIFOOUT�51:0!. The upper 8 FIFO bits FIFOOUT�59:52!, allocated to the error detection and correction bits EDC�7:0!, are used to generate the check bits and the syndrome bits, but are not subject to error correction. The exclusive-OR gates 354 perform a bit-wise exclusive-OR operation of the fix bits FIXBIT�51:0! and the data bits FIFOOUT�51:0!. If the data signals FIFOOUT�51:0! contain correctable, erroneous data bits, those data bits are flipped by the exclusive-OR operation. The exclusive-OR gates 354 provide the corrected data CORRMSG�51:0! to the 1 input of a multiplexer 360. The 0 input of the multiplexer 360 receives the data bits FIFOOUT�51:0!, and the multiplexer 360 is selected by a configuration signal CFG2C.sub.-- ENABLE.sub.-- ECC. The output of the multiplexer 360 produces signals MUXMSGI�51:0!. If the system software enables error detection and correction by setting the signal CFG2C.sub.-- ENABLE.sub.-- ECC high, then the multiplexer 360 selects the corrected data CORRMSG�51:0! for output. Otherwise, if error detection and correction is disabled, the data bits FIFOOUT�51:0! are used.
The non-correctable and correctable error indicators NCERR and CRERR are provided to inputs of AND gates 356 and 358, respectively. The AND gates 356 and 358 are enabled by the signal CFG2C.sub.-- ENABLE.sub.-- ECC. The outputs of the AND gates 356 and 358 produce signals C.sub.-- NLERR and C.sub.-- CRERR, respectively. The signals C.sub.-- NLERR and C.sub.-- CRERR can be asserted only if error detection and correction is enabled. When an error is detected, the fix bits are latched and used for diagnostic purposes.
If a correctable error is indicated (the signal C.sub.-- CRERR is high), then an interrupt is generated to the interrupt receiving block 132, forwarded up to the interrupt output block 114, and then transmitted to the system interrupt controller and then to the CPU 14 to invoke an interrupt handler. Non-correctable errors indicated by the signal C.sub.-- NCERR will cause the system error SERR.sub.-- to be asserted, which in turn causes the system interrupt controller (not shown) to assert the non-maskable interrupt (NMI) to the CPU 14. In the downstream bridge chip 48, non-correctable errors will also cause the power-good/PLL lock indication bit sent up the cable 28 to be negated so that the upstream bridge chip 26 does not send cycles downstream.
To prevent spurious interrupts during and just after power-up, error detection and correction on both the upstream and downstream bridge chips is disabled during power-up until the upstream PLL 186 and downstream PLL 182 have locked to the clock CABLE.sub.-- CLK1 or CABLE.sub.-- CLK2.
System management software responding to the correctable-error interrupt determines the cause by reading the latched fix bits. If a hardware failure is determined (e.g., multiple data error bits associated with the same cable wire), then the system management software can notify the user of the condition to fix the hardware failure. The system management software responds to SERR.sub.-- caused by an uncorrectable error by shutting down the system or performing other functions programmed by the user.
SECONDARY BUS ARBITER
Referring to FIG. 3, each bridge chip includes a PCI arbiter 116 or 124. Since the upstream bridge chip 26 is normally installed in a slot, the PCI arbiter 116 is disabled. The PCI arbiter 124 supports 8 masters: 7 generic PCI masters (REQ�7:1!.sub.--, GNT�7:1!.sub.--) including the six PCI slots and the hot plug controller in the SIO 50, and the bridge chip itself (BLREQ.sub.--, BLGNT.sub.--). The signals BLREQ.sub.-- and BLGNT.sub.-- are routed from and to the PCI master block 123. The bridge chip asserts the signal BLREQ.sub.-- if a transaction from the CPU 14 targeted for the secondary PCI bus 32 is received by the upstream and downstream bridge chips 26 and 48. The request and grant lines REQ�1!.sub.-- and GNT�1!.sub.-- for the SIO 50 are routed internally in the downstream bridge chip 48. The PCI arbiter 124 inserts a PCICLK2 delay between negation of a GNT.sub.-- signal for one master and the assertion of a GNT.sub.-- signal for another master.
In the downstream bridge chip 48, the PCI arbiter 124 is enabled or disabled based on the sampled value of REQ�7!.sub.-- at the rising edge of the signal PCIRST.sub.2.sub.--. If the bridge chip 48 samples REQ�7!.sub.-- low on PCIRST2.sub.--, it will disable the PCI arbiter 124. If the PCI arbiter 124 is disabled, then an external arbiter (not shown) is used and the hot plug request is driven out on the REQ�1!.sub.-- pin and hot plug grant is input on the GNT�1!.sub.-- pin. The bridge PCI bus request is driven out on the REQ�2!.sub.-- pin and its grant is input on the GNT�2!.sub.-- pin. If the bridge chip 48 samples REQ�7!.sub.-- high on PCIRST.sub.2.sub.--, it will enable the PCI arbiter 124.
The PCI arbiter 124 negates a master's GNT.sub.-- signal either to service a higher priority initiator, or in response to the master's REQ.sub.-- signal being negated. Once its GNT.sub.-- signal is negated, the current bus master maintains ownership of the bus until the bus returns to idle.
If no PCI agents are currently using or requesting the bus, the PCI arbiter 124 does one of two things depending on the value of a PARKMSTRSEL configuration register in the configuration space 125. If the register contains the value 0, the PCI arbiter 124 uses the last active master to park on the bus 32; if it contains the value 1, then the bus is parked at the bridge chip 48.
The PCI arbiter 124 includes a PCI minimum grant timer 304 (FIG. 21) which controls the minimum active time of all the GNT.sub.-- signals. The default value for the timer 304 is the hexadecimal value 0000 which indicates that there is no minimum grant time requirement. The timer 304 can be programmed with a value from 1 to 255, to indicate the number of PCICLK2 clock periods the GNT.sub.-- line is active. Alternatively, an individual minimum grant timer can be assigned to each PCI master on the secondary bus 32 to provide more flexibility. The minimum grant time is applicable only when the current master is asserting its REQ.sub.-- signal. Once the REQ.sub.-- signal is deasserted, the GNT signal can be removed regardless of the minimum grant time value.
Referring to FIG. 20A, in normal operation, the PCI arbiter 124 implements a round-robin priority scheme (second level arbitration scheme). The eight masters in the round-robin scheme include devices connected to the six slots of the expansion box 30, the SIO 50, and a posted memory write (PMW) request from the upstream bridge chip 26. All masters on the PCI bus 32 in this scheme have the same priority as the bridge chip 48. After a master has been granted the secondary PCI bus 32 and the master has asserted the FRAME.sub.-- signal, the bus is re-arbitrated and the current master is put on the bottom of the round-robin stack. If the master negates its request or the minimum grant timer 304 expires, the PCI bus 32 is granted to the next highest priority master. Locked cycles are not treated any differently by the PCI arbiter 124.
In response to certain events, the arbitration scheme is modified to optimize system performance. The events include: 1) an upstream-to-downstream delayed read or delayed write request is pending, 2) a downstream-to-upstream delayed read request is pending with no read completion indication provided, and 3) a streaming possibility exists while the bridge chip 26 is the current master on the upstream bus 24.
When a delayed request is detected, the bridge chip 48 becomes the next master to be granted the secondary PCI bus 32. Once the bridge chip 48 is granted the bus 32, it maintains ownership of the bus 32 until it completes all outstanding delayed requests or one of its cycles is retried. If the bridge chip 48 is retried, then a two-level arbitration scheme is implemented by the arbiter 124. One primary cause of the bridge chip read cycle being retried is that the target device is a bridge with a posted write buffer that needs to be flushed. In this case, the optimum operation is to grant the bus 32 to the retrying target to allow it to empty its posted write buffer so it can accept the bridge chip read request.
Referring to FIG. 20B, the two-level arbitration protocol includes a first level arbitration scheme which is a round-robin scheme among three possible masters: the delayed request from the CPU 14, a request from the retrying master, and a master selected by the second-level arbitration scheme. Each of the three masters in the first-level arbitration scheme is guaranteed every third arbitration slot. For memory cycles, the slot associated with the retrying target can be determined from target memory range configuration registers in the configuration space 125 of the bridge chip 48, which store the memory range associated with each PCI device. If the retrying master cannot be determined (as in the case of an I/O read), or if the retrying master is not requesting the secondary bus 32, then the first level arbitration scheme would be between the bridge chip 48 and a level-two master.
The retrying master is not masked from the level-two arbitration. Thus, it is possible for it to have two back-to-back arbitration wins if it is the next master in the level-two arbitration scheme.
For example, if an upstream-to-downstream read is retried and Master C (the retrying master) is requesting the bus 32 as well as Master B and Master E, the order of the bus grants would be as follows in descending order: the bridge chip 48, the retrying master (Master C), Master C, the bridge chip 48, the retrying master C, Master E, the bridge chip 48, and so forth, until the bridge chip 48 is able to complete its transaction and the PCI arbiter 124 reverts back to its level-two arbitration scheme for normal operation.
If, as another example, the bridge chip read is retried and the only other requesting masters are Master A and Master D (i.e., the retrying master is not requesting the bus or it could not be identified because it is accessing I/O space), the order of the bus grants is as follows: the bridge chip 48, Master A, the bridge chip 48, Master D, and so forth.
The two-level arbitration scheme gives delayed requests from the CPU 14 the highest priority. Although this arbitration method favors heavily the CPU 14, every requesting device on the bus 32 is eventually granted the PCI bus 32. By so doing, there is less chance that the other secondary bus masters would be starved when a PCI bridge chip request is retried.
Referring to FIG. 21, the PCI arbiter 124 includes an L2 state machine 302 to implement the level-two round-robin arbitration scheme. The L2 state machine 302 receives signals RR.sub.-- MAST�2:0!, which indicate the current round-robin master. The L2 state machine 302 also receives request signals RR.sub.-- REQ�7:0!, corresponding to the 8 possible masters of the secondary PCI bus 32. Based on the current master and the state of the request signals, the L2 state machine 302 generates a value representing the next round-robin master. The output of the L2 state machine 302 is provided to the 0 input of a 6:3 multiplexer 306, whose 1 input receives signals Q2A.sub.-- STRMAST�2:0!. The select input of the multiplexer 306 receives a signal STREAM.sub.-- REQ, which is asserted high by an AND gate 308 when a streaming opportunity exists (Q2A.sub.-- STREAM is high), the streaming master on the secondary PCI bus 32 is asserting its request line (MY.sub.-- REQ�Q2A.sub.-- STRMAST�2:0!! is high), and a delayed request is not pending (BAL.sub.-- DEL.sub.-- REQ is low).
The output of the multiplexer 306 drives signals N.sub.-- RR.sub.-- MAST�2:0! which represent the next round-robin master in the level-two arbitration scheme. The signals N.sub.-- RR.sub.-- MAST�2:0! are received by an L1 state machine 300, which also receives the following signals: a signal RTRYMAST.sub.-- REQ (which represents the request of the retrying bus master); a signal MIN.sub.-- GRANT (which is asserted when the minimum grant timer 304 times out); the delayed request signal BAL.sub.-- DEL.sub.-- REQ; the stream request signal STREAM.sub.-- REQ; a signal CURMAST.sub.-- REQ (indicating that the current master is maintaining assertion of its request signal); a signal ANY.sub.-- SLOT.sub.-- REQ (which is asserted high if any of the request signals REQ�7:1!.sub.--, but not including the bridge chip request BLREQ.sub.--, is asserted); and signals L1STATE�1:0! (which represent the current state of the L1 state machine 300). The L1 state machine 300 selects one of the three possible L1 masters, including the retrying master (RTRYMAST.sub.-- REQ), the delayed request from the bridge chip 48 (BAL.sub.-- DEL.sub.-- REQ), and the level-two master (ANY.sub.-- SLOT.sub.-- REQ).
The retrying master request signal RTRYMAST.sub.-- REQ is generated by an AND gate 312, which receives the signal BAL.sub.-- DEL.sub.-- REQ, the signal MY.sub.-- REQ�RTRY.sub.-- MAT�2:0!! (which indicates if the retrying master is asserting its request), and the output of an OR gate 310. The inputs of the OR gate 310 receive the signals RTRY.sub.-- MAST�2:0!. Thus, if a retrying master has been identified (RTRY.sub.-- MAST�2:0! is non-zero), a delayed request is present (BAL.sub.-- DEL.sub.-- REQ is high), and the retrying master has asserted its request, then the signal RTRYMAST.sub.-- REQ is asserted.
The L1 state machine 300 generates signals N.sub.-- L1STATE�1:0! (representing the next state of the L1 state machine 300), as well as signals N.sub.-- CURMAST�2:0! (representing the next master according to the level-two arbitration scheme). The L1 state machine 300 also generates a signal OPEN.sub.-- WINDOW, which indicates when a re-arbitration window exists for a grant state machine 306 to change masters on the secondary PCI bus 32. A signal ADV.sub.-- RR.sub.-- MAST provided by the L1 state machine 300 indicates to the grant state machine 306 when to load the value of the signals N.sub.-- RR.sub.-- MAST�2:0! into the signals RR.sub.-- MAST�2:0! to advance the next level-two round-robin master.
The grant state machine 306 outputs grant signals GNT�7:0! as well as a signal CHANGING.sub.-- GNT to indicate that ownership of the bus 32 is changing. The grant signals GNT�7:1!.sub.-- are inverted from the GNT�7:1! signals, and the grant signal BLGNT.sub.-- is inverted from the GNT�0! signal. The grant state machine 306 also generates signals L1STATE�1:0! and signals RR.sub.-- MAST�2:0!.
The minimum grant timer 304 is clocked by the signal PCLK and generates the signal MIN.sub.-- GRANT. The minimum grant timer 304 also receives the signal CHANGING.sub.-- GNT and NEW.sub.-- FRAME (indicating a new FRAME.sub.-- signal has been asserted). The initial value of the minimum grant timer 304 is loaded as a value {CFG2A.sub.-- MINGNT�3:0!, 0000}, with the signals CFG2A.sub.-- MINGNT�3:0! being stored configuration bits in the configuration space 125 which define the initial value of the minimum grant timer 304. The minimum grant timer 304 is reloaded after it has counted down to zero and the signal CHANGING.sub.-- GNT is asserted high. After the minimum grant timer 304 is loaded with a new value, it begins decrementing when the signal NEW.sub.-- FRAME is asserted high and the signal CHANGING.sub.-- GNT is deasserted low by the grant state machine 306, which indicates that a new transaction has started on the PCI bus 32.
Signals MY.sub.-- REQ�7:1! are generated by a NOR gate 314, whose inputs receive the request signals REQ�7:1!.sub.-- and mask signals Q2AMASKREQ�7:1!. Assertion of the mask bit Q2AMASKREQ�X!, X=1-7, masks the request REQ�X!.sub.-- of the corresponding master, which prevents the PCI arbiter 124 from responding to the request signal. A signal MY.sub.-- REQ�0! is driven by an inverter 316, which receives the bridge request BLREQ.sub.--.
Referring to FIG. 22 the grant state machine 306 includes four states: PARK, GNT, IDLE4GNT, and IDLE4PARK. On assertion of a reset signal RESET (generated from the PCI reset signal PCIRST.sub.2.sub.--), the grant state machine 306 enters state PARK, where it remains while a signal ANY.sub.-- REQ is deasserted. The signal ANY.sub.-- REQ is asserted high if any of the request lines to the PCI arbiter 124 is asserted. In the PARK state, the PCI-PCI bridge 48 is parked as the owner of the PCI bus 32 when another request is not present.
If the signal ANY.sub.-- REQ is asserted, the grant state machine 306 transitions from state PARK to state IDLE4GNT, and the signal CHANGING.sub.-- GNT is asserted high to indicate that the PCI arbiter 124 is changing masters. The grant signals GNT�7:0! are cleared to all zeros, and the signals CURMAST�2:0! are updated with the value of the next master N.sub.-- CURMAST�2:0!. In addition, the round-robin master signals RR.sub.-- MAST�2:0! are updated with the next round-robin master value N.sub.-- RR.sub.-- MAST�2:0! if the signal ADV.sub.-- RR.sub.-- MAST is asserted by the L1 300. The signal ADV.sub.-- RR.sub.-- MAST when high indicates that the next L1 master is one of the L2 masters.
From state IDLE4GNT, the grant state machine 306 next transitions to the GNT state, and the signals GNT�7:0! are set to the state of new grant signals NEWGNT�7:0! and the signal CHANGING.sub.-- GNT is negated low. The signals NEWGNT�7:0! are based on the state of the current master signals CURMAST�2:0!, as shown in FIG. 24.
From state GNT, three transitions are possible. The grant state machine 306 returns to the PARK state if an arbitration window is open (OPEN.sub.-- WINDOW is high), no request is pending (ANY.sub.-- REQ is low), the PCI bus 32 is idle (BUS.sub.-- IDLE is high), and the next master is the current master (i.e., the current master is the parking master). In the transition back from the GNT state to the PARK state, the signals L1STATE�1:0! are updated with the signals N.sub.-- L1STATE�1:0!. However, if no requests are pending and the bus is idle, but the current master is not the parking master (i.e., the signals N.sub.-- CURMAST�2:0! are not equal to the value of the signals CURMAST�2:0!), an idle state is needed and the grant state machine 306 transitions from the GNT state to the IDLE4PARK state. The L1 state values L1STATE�1:0! are updated. From the IDLE4PARK state, the grant state machine 306 transitions to the PARK state, setting the grant signals GNT�7:0! equal to the new grant signals NEWGNT�7:0! to grant the PCI bus 32 to the new master. The signal CHANGING.sub.-- GNT is also negated low.
If the arbitration window opens up (OPEN.sub.-- WINDOW is high), and the next master is not the current master (the signals N.sub.-- CURMAST�2:0! are not equal to the signals CURMAST�2:0!), then the grant state machine 306 transitions to the idle state IDLE4GNT to change bus master grants. In the transition, the signal CHANGING.sub.-- GNT is asserted high, the signals GNT�7:0! are cleared to all zeros, the signals CURMAST�2:0! are updated with the next master value N.sub.-- CURMAST�2:0!, and the L1 state signals L1STATE�1:0! are updated with the next state value N.sub.-- L1STATE�1:0!. In addition, the round-robin master signals RR.sub.-- MAST�2:0! are updated with the next round-robin master N.sub.-- RR.sub.-- MAST�2:0! if the signal ADV.sub.-- RR.sub.-- MAST is asserted high. The grant signals GNT�7:0! are then assigned to the value NEWGNT�7:0! in the transition from the IDLE4GNT state to the GNT state.
Referring to FIG. 23, the L1 state machine 300 (FIG. 21) starts in state RR upon assertion of the RESET signal, where the state machine 300 remains while a delayed request signal BAL.sub.-- DEL.sub.-- REQ is negated low (indicating there is no delayed request pending). While in the RR state, the signal ADV.sub.-- RR.sub.-- MAST is asserted high to allow the grant state machine 306 to update the round-robin master (i.e., setting signals RR.sub.-- MAST�2:0! equal to the value N.sub.-- RR.sub.-- MAST�2:0!. The RR state is the round-robin state in which the level-two arbitration scheme is used. While in the RR state, the next master signals N.sub.-- CURMAST�2:0! are set equal to the next round-robin master N.sub.-- RR.sub.-- MAST�2:0!, and the signal OPEN.sub.-- WINDOW is set high if a stream request opportunity exists (STREAM.sub.-- REQ is high), or the minimum grant timer 304 has expired (MIN.sub.-- GRANT is high), or the current master has negated its request (CURMAST.sub.-- REQ goes low). When asserted high, the signal OPEN.sub.-- WINDOW allows a new arbitration to take place.
If a delayed request is detected (BAL.sub.-- DEL.sub.-- REQ goes high), the L1 state machine 300 transitions from the RR state to the BAL state, setting the next master state N.sub.-- CURMAST�2:0! as the bridge chip 48 and deasserting the signal ADV.sub.-- RR.sub.-- MAST to disable the level-two round-robin arbitration. In the BAL state, the signal OPEN.sub.-- WINDOW is asserted high if the delayed request is deasserted (BAL.sub.-- DEL.sub.-- REQ goes low) or the delayed request has been retried (BAL.sub.-- RETRIED goes high). If the signal BAL.sub.-- DEL.sub.-- REQ is negated low, or if the delayed request BAL.sub.-- DEL.sub.-- REQ is asserted high but the retrying master request is negated low (RTRYMAST.sub.-- REQ is low) and the slot request ANY.sub.-- SLOT.sub.-- REQ is asserted high, then the L1 state machine 300 transitions back to the RR state. In the transition, the signal ADV.sub.-- RR.sub.-- MAST is asserted high and the next master signals N.sub.-- CURMAST�2:0! are set equal to the next round-robin master N.sub.-- RR.sub.-- MAST�2:0!. If the signal BAL.sub.-- DEL.sub.-- REQ is deasserted, that indicates that the arbiter 124 should revert back to the level-two round-robin scheme. If the delayed request signal is asserted but the retrying master request is negated, then the level-one arbitration scheme is between the slots on the PCI bus 32 and the bridge chip 48.
If both the delayed request BAL.sub.-- DEL.sub.-- REQ and the retrying master request RTRYMAST.sub.-- REQ are asserted, then the L1 state machine 300 transitions from state BAL to state RETRY.sub.-- MAST, and the retrying master is set as the next master (N.sub.-- CURMAST�2:0! is set equal to RTRY.sub.-- MAST�2:0!). The signal ADV.sub.-- RR.sub.-- MAST is maintained low. In the RETRY.sub.-- MAST state, if none of the PCI slot masters are asserting a request (ANY.sub.-- SLOT.sub.-- REQ is low), then the level-one arbitration scheme is between the retrying master and the bridge chip 48, and the L1 state machine 300 transitions back to the BAL state. The bridge chip 48 is set as the next master (N.sub.-- CURMAST�2:0! is equal to the state BALBOA), and the signal ADV.sub.-- RR.sub.-- MAST is maintained low. However, the L1 state machine 300 transitions from the RETRY.sub.-- MAST state to the RR state if any one of the slot masters is asserting a request (ANY.sub.-- SLOT.sub.-- REQ is high). In the transition, the signal ADV.sub.-- RR.sub.-- MAST is asserted high, and the next round-robin master is set as the next master (N.sub.-- CURMAST�2:0! is set equal N.sub.-- RR.sub.-- MAST�2:0!).
To take advantage of the streaming capabilities of the bridge chip, when data for a DRC starts arriving from the cable 28, the master associated with that DRC becomes the highest priority device (assuming its REQ.sub.-- is asserted). This allows the master to receive the data stream coming down the cable 28 while the window of opportunity is there for streaming. If the bridge chip 48 cannot connect the master before the DRC queue fills up, then the upstream bridge chip 24 will disconnect and only a portion of the data would be passed to the requesting master, necessitating the master to issue another read request on the upstream bus 24. The streaming master retains the highest priority as long as DRC data continues to arrive from the cable 28. If the master repeats a different cycle/address, it will be retried, but it will maintain ownership of the secondary PCI bus 32 until its request goes away or the opportunity for streaming passes.
RETRYING REQUESTS AND MULTI-THREADED MASTERS
Since each bridge chip is a delayed transaction device, if a device on the downstream bus 32 issues a read request destined for an upstream target, the downstream bridge chip 48 will issue a retry transaction (described in the PCI specification) on the secondary bus 32 and forward the request up the cable 28. The retry transaction causes the requesting master to give up control of the PCI bus 32 and negate its REQ.sub.-- line. After negating its REQ.sub.-- line, the retried master will re-assert a request for the same cycle at a later time, which may result in its GNT.sub.-- being asserted (if its REQ.sub.-- line is not masked) and the bus master being retried again until the read completion indication is asserted in the downstream bridge chip 48.
Referring to FIG. 25, to avoid the unnecessary servicing of retry requests, the REQ.sub.-- line of a secondary bus master which issues a retried delayed read or write request is masked by asserting the appropriate one of signals Q2A.sub.-- MASK.sub.-- REQ�7:1! (requests from the bridge chip 48 which are retried are not masked) until the delayed completion returns. In this fashion, other requesting masters are given priority to get their requests in. As soon as the first information associated with the delayed completion is returned, the REQ.sub.-- line of the corresponding master is unmasked and the retried master is able to enter arbitration again.
However, a special case exists for multi-threaded (or multi-headed) masters on the downstream bus 32 (FIG. 26B), which are able to assert a first request, get retried, and come back with a different request. One such multi-threaded bus device is a PCI-PCI bridge 323 connecting the secondary PCI bus 32 and a subordinate PCI bus 325. The bus 325 is connected to network interface cards (NICs) 327A and 327B which are connected to two different networks. Thus, if the request from the NIC 327A for the primary PCI bus 32 is retried by the bridge chip 48, the NIC 327B can generate a different request. In this case, the REQ.sub.-- lines of the multi-threaded masters are not masked, as indicated by the signal CFG2Q.sub.-- MULTI.sub.-- MASTER�X! being set high.
A status register 326 determines if a slot is single- or multi-threaded. On reset, the register 326 is cleared to assume that each secondary bus device is single-threaded. Each slot is then monitored to determine if it requests a different cycle while another cycle from the same master is pending. If multi-threaded behavior is observed in a master, then that master is marked as such by setting the corresponding bit CFG2Q.sub.-- MULTI.sub.-- MASTER�X! high.
The input of the status register 326 is connected to the output of a 14:7 multiplexer 328, whose 0 input is connected to the output of a 14:7 multiplexer 330 and whose 1 input is connected to address bits P2Q.sub.-- AD�22:16!. A select signal CFGWR.sub.-- MM selects the 0 and 1 inputs of the multiplexer 328. When asserted high, the signal CFGWR.sub.-- MM causes a configuration write of the status register 326 from the data bits P2Q.sub.-- AD�22:16!, allowing software control of the bits in the register 326. The 1 input of the multiplexer 330 receives multi-master signals MULTI.sub.-- MASTER�7:1!, the 0 input receives the output of the register 326, and the multiplexer 330 is selected by a signal MULTI.sub.-- SEL. The signal MULTI.sub.-- SEL is generated by an AND gate 338, whose first input receives a signal Q2PIF.sub.-- CHECK.sub.-- CYC (asserted high to indicate that the current transaction information should be checked with information stored in the queue block 127 for a match, such as during a delayed memory read or write request from a bus device on the secondary PCI bus 32), and the other input receives the inverted state of a signal DCQ.sub.-- HIT (indicating that the current address information does not match the address information associated with a pending request of the requesting master in the DCQ 148). Thus, if a failed comparison occurred, the value of signals CFG2Q.sub.-- MULTI.sub.-- MASTER�7:1! is updated.
A bit MULTI.sub.-- MASTER�X! is asserted high if master X has a pending request that has been retried, and master X subsequently comes back with a different request. This is checked by comparing the transaction information (e.g., address, byte enables, data for a write) of the pending request with the address of the new request. A failed comparison indicates that the master is multi-threaded. Once a multi-master configuration bit CFG2Q.sub.-- MULTI.sub.-- MASTER�X! (X=1-7) is set high, the bit is maintained high.
The signals MULTI.sub.-- MASTER�7:1! are generated by a decoder 336. The decoder 336 receives signals Q2PIF.sub.-- SLOT�2:0! (slot number for the current delayed request from a master), Q�7:0!.sub.-- MASTER�2:0! (the master associated with each of the eight buffers in the DCQ 148), Q�7:0!.sub.-- COMPLETE (the completion status of each of the eight queues), and Q�7:0!.sub.-- PART.sub.-- COMPLETE (the partial completion status of each of the buffers in the delayed completion queue). For example, if the signal Q0.sub.-- MASTER�2:0! contains the value 4, then that indicates DCQ buffer 0 stores the transaction information of a delayed request from the bus device in slot 4. The signal QY.sub.-- COMPLETE, Y=0-7, if asserted high indicates if DCQ buffer Y has received all the data associated with delayed request transaction. The signal QY.sub.-- PART.sub.-- COMPLETE, Y=0-7, if asserted high indicates that DCQ buffer Y has been allocated as the DCQ buffer for a delayed transaction of one of the masters but all the data associated with the delayed transaction has not been received.
If the current slot number Q2PIF.sub.-- SLOT�2:0! is equal to the value of any one of the eight queue master indication signals Q�7:0!.sub.-- MASTER�2:0!, and the corresponding DCQ buffer is in the complete or part complete state, then the corresponding one of the bits MULTI.sub.-- MASTER�7:1! is set high if the signal DCQ.sub.-- HIT is low and the signal Q2PIF.sub.-- CHECK.sub.-- CYC is high. Thus, for example, if the signal Q2PIF.sub.-- SLOT�2:0! contains the value 2, indicating that the device in slot 2 is the current master of the delayed request, and DCQ buffer 5 is storing a pending request for the slot 2 master (Q5.sub.-- MASTER�2:0!=5), and either of signals Q5.sub.-- COMPLETE or Q5.sub.-- PART.sub.-- COMPLETE is high, and if the signal Q2PIF.sub.-- CHECK.sub.-- CYC is high and the signal DCQ.sub.-- HIT is low, then the bit MULTI.sub.-- MASTER�2! is set high to indicate that the slot 2 device is a multi-threaded master.
A mask request generation block 332 produces signals Q2A.sub.-- MASK.sub.-- REQ�X! (X=1-7) in response to signals Q�7:0!.sub.-- MASTER�2:0!, Q�7:0!.sub.-- STATE�3:0! (which indicates the state of delayed completion queues 0-7), SLOT.sub.-- WITH.sub.-- DATA�7:0! (which indicate if delayed completion Qs 0-7 contain valid data), CFG2Q.sub.-- MULTI.sub.-- MASTER�X! (X=1-7), CFG2Q.sub.-- ALWAYS.sub.-- MASK, and CFG2Q.sub.-- NEVER.sub.-- MASK.
Referring to FIG. 26A, the mask request generation block 332 includes a 2:1 multiplexer 320 for producing the signal Q2A.sub.-- MASK.sub.-- REQ�X! (X=1-7). The 1 input of the multiplexer 320 is connected to the output of an OR gate 322 and the 0 input is tied low. The select input of the multiplexer 320 is driven by a signal MASK.sub.-- MUXSEL. One input of the OR gate 322 is connected to the output of a NOR gate 324, which receives a signal CFG2Q.sub.-- MULTI.sub.-- MASTER�X! (indicating a multi-threaded master), and the other input receives a signal CFG2Q.sub.-- NEVER.sub.-- MASK (a configuration bit indicating that the request line should not be masked if a multi-threaded master is detected). The other input of the OR gate 322 receives a signal CFG2Q.sub.-- ALWAYS.sub.-- MASK, which is a configuration bit indicating that the corresponding mask bit Q2A.sub.-- MASK.sub.-- REQ�X! should always be masked if the signal MUXSEL is asserted high. The signal MASK.sub.-- MUXSEL is asserted high if the request from the secondary bus master is not to data already existing in the queue block 127, i.e., the request must be transmitted to the primary PCI bus 24. Thus each time a request is transmitted from a device on the secondary PCI bus 32 upstream to the primary PCI bus 24, a check is performed on bits CFG2Q.sub.-- MULTI.sub.-- MASTER�7:1! to determine if a multi-threaded master has been detected.
The masking of requests can be overridden by setting the appropriate bits in the configuration registers 125. The available modes include: 1) normal mode in which request masking is enabled except if multi-threaded master (CFG2Q.sub.-- NEVER.sub.-- MASK=0, CFG2Q.sub.-- ALWAYS.sub.-- MASK=0), 2) always mask mode in which requests from retried masters are masked even if multi-threaded (CFG2Q.sub.-- ALWAYS.sub.-- MASK=1), and 3) never mask mode in which the requests are never masked (CFG2Q.sub.-- NEVER.sub.-- MASK=1, CFG2Q.sub.-- ALWAYS.sub.-- MASKED=0).
EXPANSION CARD INSERTION AND REMOVAL CONNECTING EXPANSION CARDS
As shown in FIGS. 1 and 27A, the two expansion boxes 30a and 30b, of common design 30, each have the six hot-plug slots 36 (36a-f) in which the conventional expansion cards 807 can be inserted and removed (hot-plugged) while the computer system 10 remains powered up. The six mechanical levers 802 are used to selectively secure (when closed, or latched) the expansion cards 807 that are inserted into corresponding hot-plug slots 36. For purposes of removing or inserting the expansion card 807 into one of the slots 36, the corresponding lever 802 must be opened, or unlatched, and as long as the lever 802 is opened, the corresponding slot 36 remains powered down.
When the lever 802 that secures the expansion card 807 to its slot 36 is opened, the computer system 10 senses this occurrence and powers down the card 807 (and corresponding slot 36) before the card 807 can be removed from its slot 36. Slots 36 that are powered down, like other slots 36 not holding cards 807, remain powered down until software of the computer system 10 selectively powers up the slots 36.
The card 46 inserted into the card slot 34 has the bridge chip 48 that monitors the securement status (open or closed) of the levers 802 and powers down any card 807 (and corresponding slot 36) that is not secured by its lever 802. Software of the computer system 10 can also selectively power down any one of the slots 36.
The cards 807 are powered up through a power up sequence and powered down through a power down sequence. In the power up sequence, power is first supplied to the card 807 being powered up, and thereafter, a PCI clock signal (from the PCI bus 32) is furnished to the card 807 being powered up. Remaining PCI bus signal lines of the card 807 are then coupled to corresponding lines of the PCI bus 32. Lastly, the reset signal for the card 807 being powered up is negated which brings the card 807 out of reset.
The power up sequence allows the circuitry of the card 807 being powered up to become fully functional with the PCI clock signal before the remaining PCI bus signals are provided. When the clock signal and remaining PCI bus signals are connected to the card 807 and before the card 807 is reset, the bridge chip 48 has control of the PCI bus 32. Because the bridge chip 48 has control of the PCI bus 32 during these times, potential glitches on the PCI bus 32 from the power up sequence do not disturb operations of the cards 807 that are powered up.
In the power down sequence, the card 807 being powered down is first reset. Next, the PCI bus signals, excluding the PCI clock signal, are removed from the card 807. The bridge chip 48 subsequently disconnects the PCI clock signal from the card 807 before power from the card 807 is removed. The power down sequence minimizes the propagation of false signals from the card 807 being powered down to the bus 32 because circuitry on the card 807 remains fully functional until the PCI bus signal lines are removed.
When the PCI clock signal and remaining PCI bus signals are disconnected, and when the card 807 is reset, the bridge chip 48 has control of the PCI bus 32. Because the bridge chip 48 has control of the PCI bus 32 during these times, potential glitches on the PCI bus 32 from the power down sequence do not disturb operations of the cards 807 that are powered up.
The bridge chip 48 includes the Serial Input/Output (SIO) circuit 50 which controls the power up and power down sequences of the slots 36 through twenty-four control signals POUT�39:16!. The control signals POUT�39:16! are a subset of forty output control signals POUT�39:0! generated by the SIO circuit 50. The control signals POUT�39:16! are latched versions of slot bus enable signals BUSEN#�5:0!, slot power enable signals PWREN�5:0!, slot clock enable signals CLKEN#�5:0! and slot reset signals RST#�5:0!, all internal signals of the SIO circuit 50, further described below. The control signals POUT�39:0! and their relationship to the signals BUSEN#�5:0!, PWREN�5:0!, CLKEN#�5:0! and RST#�5:0! are described in the following table:
__________________________________________________________________________PARALLEL OUTPUT CONTROL SIGNALS (POUT�39:0!)SIGNAL ASSOCIATED CONTROL WHEN SIGNALPOSITION DESCRIPTION SIGNALS IS ACTIVE__________________________________________________________________________ 0-11 Control signals for LEDs 5412-15 General purpose output signals GPOA�3:0!16 Reset signal for slot 36a (RST# �0!) Low17 Reset signal for slot 36b (RST# �1!) Low18 Reset signal for slot 36c (RST# �2!) Low19 Reset signal for slot 36d (RST# �3!) Low20 Reset signal for slot 36e (RST# �4!) Low21 Reset signal for slot 36f (RST# �5!) Low22 Clock enable signal for slot 36a (CLKEN# �0!) Low23 Clock enable signal for slot 36b (CLKEN# �1!) Low24 Clock enable signal for slot 36c (CLKEN# �2!) Low25 Clock enable signal for slot 36d (CLKEN# �3!) Low26 Clock enable signal for slot 36e (CLKEN# �4!) Low27 Clock enable signal for slot 36f (CLKEN# �5!) Low28 Bus enable signal for slot 36a (BUSEN# �0!) Low29 Bus enable signal for slot 36b (BUSEN# �1!) Low30 Bus enable signal for slot 36c (BUSEN# �2!) Low31 Bus enable signal for slot 36d (BUSEN# �3!) Low32 Bus enable signal for slot 36e (BUSEN# �4!) Low33 Bus enable signal for slot 36f (BUSEN# �5!) Low34 Power enable signal for slot 36a (PWREN �0!) High35 Power enable signal for slot 36b (PWREN �1!) High36 Power enable signal for slot 36c (PWREN �2!) High37 Power enable signal for slot 36d (PWREN �3!) High38 Power enable signal for slot 36e (PWREN �4!) High39 Power enable signal for slot 36f (PWREN �5!) High__________________________________________________________________________
As shown in FIGS. 2 and 28, each hot-plug slot 36 has the associated switch circuitry 41 for connecting and disconnecting the slot 36 to and from the PCI bus 32. The switch circuitry 41 for each slot 36 receives four of the control signals POUT�39:16!. As an example, for the slot 36a, when the control signal POUT�28! is asserted, or low, the slot 36a is connected to the bus signal lines of the PCI bus 32 by a switch circuit 47. When the control signal POUT�28! is deasserted, or high, the slot 36a is disconnected from the bus signal lines of the PCI bus 32.
When the control signal POUT�22! is asserted, or low, the slot 36a is connected to a PCI clock signal CLK through a switch circuit 43. When the control signal POUT�22! is deasserted, or high, the slot 36a is disconnected from the clock signal CLK.
When the control signal POUT�34! is asserted, or high, the slot 36a is connected to a card voltage supply level V.sub.SS through a switch circuit 45. When the control signal POUT�34! is deasserted, or low, the slot 36a is disconnected from the card voltage supply level V.sub.SS.
When the control signal POUT�16! is asserted, or low, the slot 36a is reset and when the control signal POUT�16! is deasserted, or high, the slot 36a comes out of the reset state.
As seen in FIG. 2, the SIO circuit 50 may selectively monitor up to one hundred twenty-eight (sixteen bytes) of latched status signals STATUS�127:0! furnished by the expansion box 30. The status signals STATUS�127:0! form a "snapshot" of selected conditions of the expansion box 30. The status signals STATUS�127:0! include six status signals STATUS�5:0! which indicate the securement status (opened or closed) of each of the levers 802. The SIO circuit 50 monitors the status signals STATUS�31:0! for changes in their logical voltage levels. The SIO circuit 50 serially shifts the status signals STATUS�127:32! into the SIO circuit 50 when instructed to do so by the CPU 14.
The SIO circuit 50 serially receives the status signals STATUS�127:0!, least significant signal first, via a serial data signal NEW.sub.-- CSID. The data signal NEW.sub.-- CSID is furnished by the serial output of the thirty-two bit, parallel input shift register 82 located on board the expansion box 30 along with the slots 36.
The register 82, through its parallel inputs, receives twenty-four parallel status signals PIN�23:0!, four associated with each of the hot-plug slots 36, that are included in the thirty-two least significant status signals STATUS�31:0!. When the status indicated by one or more of the status signals STATUS�31:0! changes (the logical voltage level changes), the bridge chip 48 generates an interrupt request to the CPU 14 by asserting, or driving low, a serial interrupt request signal SI.sub.-- INTR# which is received by the interrupt receiving block 132. The status signals PIN�23:0! include two PCI card presence signals (PRSNT1# and PRSNT2#) associated with each slot 36.
Six status signals PIN�5:0!, corresponding to their latched versions, status signals STATUS�5:0!, indicate the securement, or engagement, status (open or closed) of each the levers 802. Six sliding switches 805 (FIGS. 27A-27C) are actuated by the movement of their corresponding levers 802 and are used to electrically indicate the securement status of the corresponding lever 802. Each switch 805 has a first terminal coupled to ground and a second terminal furnishing the corresponding one of the status signals PIN�5:0!. The second terminal is coupled to a supply voltage level V.sub.DD through one of six resistors 801.
If one of the levers 802 opens and the card 807 secured by the lever 802 becomes unsecured, the corresponding one of the status signals PIN�5:0! is asserted, or driven high. As an example, for the slot 36a, the status signal PIN�0! is deasserted, or driven low, when the corresponding lever 802 is closed. When the lever 802 for the slot 36a is opened, the status signal PIN�0! is asserted, or driven high.
The register 82 also receives a serial stream of latched status signals STATUS�127:32! that do not cause interrupts when the logical voltage level of one of the signals STATUS�127:32! changes. The status signals STATUS�127:32! are formed by the sixteen bit shift register 52 located on board the expansion box 30 with the slots 36. The shift register 52 receives status signals at its parallel inputs and latches the status signals STATUS�127:32! when instructed to do so by the SIO circuit 50. The shift register 52 serializes the status signals STATUS�127:32! and furnishes the signals STATUS�127:32! to the serial input of the register 82 via a serial data signal CSID.sub.-- I.
When instructed by the SIO circuit 50, the register 82 latches status signals PIN�23:0!, forms the status signals STATUS�31:0!, furnishes the status signals STATUS�31:0! and furnishes a byte or more of the status signals STATUS�127:32! (when requested by the CPU 14), in a least significant signal first fashion, to the SIO circuit 50 via the serial data signal NEW.sub.-- CSID. The status signals STATUS�127:0! are described by the following table:
______________________________________STATUS �127:0!BIT DESCRIPTION______________________________________0 Lever 802 status signal for slot 36a (PIN �0!)1 Lever 802 status signal for slot 36b (PIN �1!)2 Lever 802 status signal for slot 36c (PIN �2!)3 Lever 802 status signal for slot 36d (PIN �3!)4 Lever 802 status signal for slot 36e (PIN �4!)5 Lever 802 status signal for slot 36f (PIN �5!)6 Reserved for lever 802 status signal for additional hot-plug slot7 Reserved for lever 802 status signal for additional hot-plug slot8 PRSNT2# signal for slot 36a (PIN �6!)9 PRSNT2# signal for slot 36b (PIN �7!)10 PRSNT2# signal for slot 36c (PIN �8!)11 PRSNT2# signal for slot 36d (PIN �9!)12 PRSNT2# signal for slot 36e (PIN �10!)13 PRSNT2# signal for slot 36f (PIN �11!)14 Reserved for PRSNT#2 signal for additional hot-plug slot 3615 Reserved for PRSNT#2 signal for additional hot-plug slot 3616 PRSNT1# signal for slot 36a (PIN �12!)17 PRSNT1# signal for slot 36b (PIN �13!)18 PRSNT1# signal for slot 36c (PIN �14!)19 PRSNT1# signal for slot 36d (PIN �15!)20 PRSNT1# signal for slot 36e (PIN �16!)21 PRSNT1# signal for slot 36f (PIN �17!)22 Reserved for PRSNT1# signal for additional hot-plug slot 3623 Reserved for PRSNT1# signal for additional hot-plug slot 3624 Power fault status for slot 36a (PIN �18!)25 Power fault status for slot 36b (PIN �19!)26 Power fault status for slot 36c (PIN �20!)27 Power fault status for slot 36d (PIN �21!)28 Power fault status for slot 36e (PIN �22!)29 Power fault status for slot 36f (PIN �23!)30 Reserved for power fault status for additional hot-plug slot 3631 Reserved for power fault status for additional hot-plug slot 3632-127 Status signals that do not cause interrupt requests when their status changes______________________________________
As shown in FIGS. 2 and 30, when the SIO circuit 50 asserts, or drives low, a register load signal CSIL.sub.-- O.sub.--, the shift register 52 latches the status signals STATUS�127:32! and the shift register 82 latches the status signals STATUS�31:0!. When the SIO circuit 50 negates, or drives high, the signal CSIL.sub.-- O.sub.--, both the registers 52 and 82 serially shift their data to the SIO circuit 50 on the positive edge of a clock signal CSIC.sub.-- O furnished by the SIO circuit 50. The clock signal CSIC.sub.-- O is synchronized to and one fourth the frequency of the PCI clock signal CLK.
As shown in FIG. 29, for purposes of monitoring, or scanning, the status signals STATUS�31:0!, the SIO circuit 50 uses a thirty-two bit interrupt register 800 whose bit positions correspond to the signals STATUS�31:0!. The SIO circuit 50 updates the bits of the interrupt register 800 to equal the corresponding status signals STATUS�31:0! that have been debounced, as further described below. Two status signals STATUS�7:6! are reserved for additional hot-plug slots 36, and the seventh and eighth most significant bits of the interrupt register 800 are also reserved for the additional slots 36. The interrupt register 800 is part of a register logic block 808 of the SIO circuit 50 which is coupled to the PCI bus 32.
Serial scan input logic 804 of the SIO circuit 50 sequentially scans, or monitors, the status signals STATUS�31:0!, least significant signal first, for changes, as indicated by transitions in their logical voltage levels. If the status of one or more of the status signals STATUS�5:0! associated with the levers 802 changes, the serial scan input logic 804 enters a slow scan mode such that the status signals STATUS�5:0! are scanned thirty-two times within a predetermined debounce time interval. If one or more of the status signals STATUS�5:0! changes, the serial scan input logic 804 updates the interrupt register 800 (and asserts the serial interrupt signal SI.sub.-- INTR#) if the changed status signal STATUS�5:0! remains at the same logical voltage level for at least a predetermined debounce time interval. The serial scan input logic 804 is coupled to programmable timers 806 which generate and indicate the end of the debounce delay interval initiated by the serial scan logic 804. Requiring the status to remain stable for the debounce time interval minimizes the inadvertent powering down of one of the hot-plug slots 36 due to a false value (i.e., a "glitch") indicated by one of the status signals STATUS�5:0!. When all of the status signals STATUS�5:0! remain at the same logical voltage level for at least the debounce time interval, the serial scan input logic 804 then proceeds to once again scan all thirty-two status signals STATUS�31:0! in the faster scan mode.
If the serial scan input logic 804 detects a change in one of the status signals STATUS�31:6!, the serial scan input logic 804 instructs the timers 806 to measure another debounce delay interval, subsequently asserts the serial interrupt signal SI.sub.-- INTR#, updates the interrupt register 800 with the signals STATUS�31:6! that have changed, and ignores further changes in the status signals STATUS�31:6! until the debounce time interval expires. After expiration of the debounce time interval, the serial scan input logic 804 proceeds to recognize changes in the thirty-two status signals STATUS�31:0!.
When the serial interrupt signal SI.sub.-- INTR# is asserted, the CPU 14 subsequently reads the interrupt register 800, determines which (may be more than one) status signals STATUS�31:0! caused the interrupt, and deasserts the serial interrupt signal SI.sub.-- INTR# by writing a "1" to the bit or bits of the interrupt register 800 that have changed.
The CPU 14 may selectively mask interrupt requests caused by the status signals STATUS�31:0! by writing a "1" to a corresponding bit of a thirty-two bit interrupt mask register 810. The CPU 14 can also selectively read any byte of the status signals STATUS�47:0! by writing a byte number of the selected byte to a serial input byte register 812. The SIO circuit 50 then transfers the desired byte into a serial data register 815.
For example, to read the third byte (byte number two) of the status signals STATUS�23:16!, the CPU 14 writes a "2" to the serial input byte register 812. The serial scan input logic 804 then serially shifts byte two of the status signals STATUS�23:16! into the serial data register 815. A busy status bit BS of the serial input byte register 812 is equal to "1" when the CPU 14 initially writes the desired byte number to the serial input byte register 812. The bit BS is cleared by the SIO circuit 50 after the requested byte has been shifted into the serial data register 815.
The CPU 14 can power up one of the slots 36 by writing a "1" to a corresponding bit of a slot enable register 817 and disable the slot 36 by writing a "0" to this bit. Furthermore, the CPU 14 can reset one of the slots 36 by writing a "1" to a corresponding bit of a slot reset register 819. The contents of the slot enable 817 and slot reset 819 registers are represented by signals SLOT.sub.-- EN�5:0! and SLOT.sub.-- RST.sub.-- �5:0!, respectively.
To initiate the request indicated by the slot enable 817 and reset 819 registers, the CPU 14 writes a "1" to an SO bit of control register 814. After the SO bit is asserted (which asserts, or drives high, a GO.sub.-- UPDATE signal), the SIO circuit 50 initiates and controls the required power down and/or power up sequences.
The serial scan input logic 304 is coupled to ON/OFF control logic 820 which controls the power up and power down sequences. The ON/OFF control logic 820 furnishes the signals BUSEN#�5:0!, CLKEN#�5:0!, RST#�5:0! and PWREN�5:0! to serial output logic 824.
Each power up or power down sequence involves four shift phases during which another step of the power down or power up sequence is performed. During each shift phase, the ON/OFF control logic 820 instructs the serial output logic 824 to combine the control signals BUSEN#�5:0!, CLKEN#�5:0!, RST#�5:0! and PWREN�5:0!; latch these signals; and serially furnish these signals (via a serial data signal CSOD.sub.-- O) to the serial input of an output shift register 80. At end of each shift phase, the ON/OFF control logic 820 instructs the shift register 80 to update the control signals POUT�35:12!.
The ON/OFF control logic 820 is also interfaced to the register logic 808 and Light Emitting Diode (LED) control logic 822. The LED control logic 122 controls the on/off status of the six LEDs 54, which visually indicate whether the corresponding levers 802 are latched or unlatched. The LEDs 54 can be programmed to blink when turned on through LED control registers (not shown) of the register logic 808.
As shown in FIG. 31A, the serial scan input logic 804 includes a scan state machine 840 which controls the scanning of the status signals STATUS�31:0! for changes and controls the shifting of a selected byte of the status signals STATUS�47:0! into the serial input byte register 815.
The scan state machine 840 is clocked on the negative edge of a clock signal DIV2CLK, which is synchronized to a PCI clock signal CLK and one half of the frequency of the PCI clock signal CLK. The load and click signals, CSIL.sub.-- O.sub.-- and CSIC.sub.-- O, respectively, are furnished by the scan state machine 840. The clock signal, when enabled, is synchronized to the clock signal CSIC.sub.-- O.
A bit/byte counter 841, through a thirty-two bit signal BIT.sub.-- ACTIVE�31:0!, indicates which bit of the status signals STATUS�31:0! is currently represented by the serial data signal NEW.sub.-- CSID. The asserted bit of the signal BIT.sub.-- ACTIVE�31:0! has the same bit position as the status signal STATUS�31:0! represented by the data signal NEW.sub.-- CSID.
The counter 841 also furnishes a three bit signal BIT�2:0! which represents which bit of the current byte of the status signals STATUS�31:0! is currently being scanned by the scan state machine 840. The counter 841 is clocked on the negative edge of a signal SHIFT.sub.-- ENABLE. The outputs of the counter 841 are reset, or cleared, when the output of an AND gate 842, connected to the clear input of the counter 841, is negated.
The scan state machine 840 furnishes a signal SCAN.sub.-- IN.sub.-- IDLE which when asserted, or high, indicates that the scan state machine 840 is in an IDLE state and not currently scanning any of the status signals STATUS�127:0!. The signal SCAN.sub.-- IN.sub.-- IDLE is deasserted otherwise.
The signal SCAN.sub.-- IN.sub.-- IDLE is furnished to one input of the AND gate 842. The other input of the AND gate 842 is connected to the output of an OR gate 843. One input of the OR gate 843 receives an inverted HOLD.sub.-- OFF signal, and the other input of the OR gate 843 receives a signal GETTING.sub.-- BYTE.
The signal HOLD.sub.-- OFF, when asserted, or driven high, indicates that a change in one of the status signals STATUS�5:0! has been detected, and the serial scan logic 804 has entered the slow scan mode. In the slow scan mode, the serial scan input logic 804 waits for a predetermined slow scan interval before traversing the status signals STATUS�31:0! again. The serial scan input logic 804 counts the number of times the serial scan signals STATUS�5:0! are scanned during the slow scan mode and uses this count to determine when one of the status signal STATUS�5:0! has remain unchanged for the debounce delay interval, as further described below.
Therefore, when the scan state machine 840 is in the IDLE state and the either the HOLD.sub.-- OFF signal is deasserted or the scan state machine 840 is reading in selected byte (selected by the CPU 14) of the status signals STATUS�47:0!, all outputs of the counter 841 are cleared, or set equal to zero.
The signal SHIFT.sub.-- ENABLE is furnished by the output of an AND gate 844. One input of the AND gate 844 receives the clock signal CSIC.sub.-- O. Another input of the AND gate 844 receives a signal DIV2CLK#. The signal DIV2CLK# is asserted, or driven low, on the negative edge of the signal CLKDIV4. The third input of the AND gate 844 receives a signal SCAN.sub.-- IN.sub.-- PROGRESS, which when asserted, or driven high, indicates that the scan state machine 840 is currently scanning the status signals STATUS�127:0!, and the signal SCAN.sub.-- IN.sub.-- PROGRESS is deasserted otherwise.
Therefore, when the scan state machine 840 is not shifting in the status signals STATUS�127:0!, the counter 841 is disabled. Furthermore, when enabled, the counter 841 is clocked on the negative edge of the clock signal DIV2CLK.
The interrupt register 800 receives input signals D.sub.-- INTR.sub.-- REG�31:0! at its corresponding thirty-two inputs. The load enable inputs of the inter t register 800 receive corresponding load enable signals UPDATE.sub.-- IRQ�31:0!. The interrupt register 800 is clocked on the positive edge of the PCI clock signal CLK.
For purposes of keeping track of the status signals STATUS�5:0! after each scan, a multi-bit, D-type flip-flop 836 furnishes status signals SCAN.sub.-- SW�5:0!. The clear input of the flip-flop 836 receives the reset signal RST, and the flip-flop 836 is clocked on the positive edge of the clock signal CLK. The input of the flip-flop 836 is connected to the output of a multi-bit OR gate 850 which has one input connected to the output of a multi-bit AND gate 846 and one input connected to the output of a multi-bit AND gate 847. One input of the AND gate 846 receives six bit enable signals BIT.sub.-- ENABLE�5:0! (described below) and the other input of the AND gate 846 receives the serial data signal NEW.sub.-- CSID. One input of the AND gate 847 receives inverted bit enable signals BIT.sub.-- ENABLE�5:0!, and the other input of the AND gate 847 receives the signals SCAN.sub.-- SW�5:0!.
Only one of the bit enable signals BIT.sub.-- ENABLE�5:0! is asserted at one time (when the scan state machine 840 is scanning), and the asserted bit indicates which one of the corresponding status signals STATUS�31:0! is represented by the signal NEW.sub.-- CSID. Thus, when the scan state machine 840 is scanning, on every positive edge of the clock signal CLK, the signals SCAN.sub.-- SW�5:0! are updated.
The bit enable signals BIT.sub.-- ENABLE�31:0! are furnished by the output of a multi-bit multiplier 832 that receives the bits BIT.sub.-- ACTIVE�31:0! at its one input. The zero input of the multiplexer 832 receives a thirty-two bit signal indicative of logic zero. The select input of the multiplexer 832 receives the signal SHIFT.sub.-- ENABLE.
For purposes of detecting a change in the status signals STATUS�5:0!, a multi-bit, Exclusive Or (XOR) gate 848 furnishes switch change signals SW.sub.-- CHG�5:0!. When one of the signals SW.sub.-- CHG�5:0! is asserted, or high, the logical voltage of the corresponding status signal STATUS�5:0! changed during successive scans. One input of the XOR gate 848 is connected to the input of the flip-flop 836, and the other input of the XOR gate 848 receives the signals SCAN.sub.-- SW�5:0!.
As shown in FIG. 31D, for purposes of indicating when the logical voltage level of a selected status signal STATUS�5:0! has remained at the logical voltage level for at least the duration of the debounce delay interval, the scan input logic 804 has six signals SWITCH�5:0!. The non-inverting input of a D-type flip-flop 900 furnishes the signal LSWITCH�5! at its non-inverting output. The signal LSWITCH�5! is asserted, or driven high, to indicate the above-described condition and deasserted otherwise. The flip-flop 900 is clocked on the positive edge of the clock signal CLK, and the clear input of the flip-flop 900 receives the RST signal.
The input of the flip-flop 900 is connected to the output of a multiplexer 902 which furnishes a D.sub.-- LSWITCH�5! signal. The select input of the multiplexer 902 is connected to the output of an AND gate 903 that receives a MAX5 signal and a SCAN.sub.-- END signal. The SCAN.sub.-- END signal, when asserted, indicates the scan state machine 840 has completed the current scan. Five signals (MAX5, MAX4, MAX3, MAX2, MAX1 AND MAX0) indicate whether the corresponding Status signal STATUS�5!, STATUS�4!, STATUS�3!, STATUS�2!, STATUS�1!, or STATUS�0!, respectively, has remained at the same logical voltage level for a least the duration of the debounce time interval. The zero input of the multiplexer 902 receives the signal LSWITCH�5!, and the one input of the multiplexer 902 receives the signal SCAN.sub.-- SW�5!. The signal SCAN.sub.-- END is furnished by the output of an AND gate 851 (FIG. 31B). The AND gate 851 receives a signal STOP.sub.-- SCAN and a signal SCAN.sub.-- DONE. The signal STOP.sub.-- SCAN is asserted, or driven high, when conditions for ending the scanning by the scan state machine 840 are present, as further described below. The signal SCAN.sub.-- END is a pulsed (for one cycle of the CLK signal) version of the STOP.sub.-- SCAN signal. The signals LSWITCH�4!-LSWITCH�0! and D.sub.-- LSWITCH�4!-D.sub.-- LSWITCH�0! are generated in a similar fashion from the respective SCAN.sub.-- SW�4!-SCAN.sub.-- SW�0! signals and the respective signals MAX4-MAX0.
For purposes of updating the logical voltage level of the status signals STATUS�31:6! as these signals are scanned in, a multi-bit D-type flip-flop 905 (FIG. 31D) furnishes twenty-six signals SCAN.sub.-- NSW�31:6!. One of the signals SCAN.sub.-- NSW�31:6! is asserted, or driven high, to indicate this condition and deasserted otherwise. The flip-flop 905 is clocked on the positive edge of the clock signal CLK, and the clear input of the flip-flop 905 receives the RST signal.
The input of the flip-flop 905 is connected to the output of a multi-bit multiplexer 906. The select input of the multiplexer 906 receives an inverted CHECK.sub.-- SWITCH.sub.-- ONLY signal. The CHECK.sub.-- SWITCH.sub.-- ONLY signal is asserted, or driven high, when the scan state machine 840 is only scanning the status signals STATUS�5:0! or status signals STATUS�127:32! (i.e., ignoring changes in the signals STATUS�31:6!) and deasserted otherwise. The zero input of the multiplexer 906 receives the signals SCAN.sub.-- NSW�31:6!, and the one input of the multiplexer 906 is connected to the output of a multi-bit OR gate 907. One input of the OR gate 907 is connected to the output of a multi-bit AND gate 908, and the other input of the OR gate 907 is connected to the output of a multi-bit AND gate 872.
One input of the AND gate 908 receives the signals BIT.sub.-- ENABLE�31:6!. The other input of the AND gate 908 is connected to the output of a multi-bit multiplexer 909. If the NEW.sub.-- CSID signal is asserted, or high, the multiplexer 909 furnishes a twenty-six bit signal equal to "h3FFFFFF." Otherwise, the multiplexer furnishes a twenty-six bit signal equal to "0." One input of the AND gate 872 is connected to the inverted output of the AND gate 908, and the other input of the AND gate 872 receives the signals SCAN.sub.-- NSW�31:6!.
For purposes of storing the logical voltage level of the status signals STATUS�31:6! after every scan, a multi-bit, D-type flip-flop 871 furnishes twenty-six signals LNON.sub.-- SW�31:6!. One of the signals LNON.sub.-- SW�31:6! is asserted, or driven high, to indicate this condition and deasserted otherwise. The flip-flop 871 is clocked on the positive edge of the clock signal CLK, and the clear input of the flip-flop 871 receives the RST signal.
The input of the flip-flop 871 is connected to the output of a multi-bit multiplexer 870 which furnishes the signals D.sub.-- LNON.sub.-- SW�31:6!. The select input of the multiplexer 870 receives the signal SCAN.sub.-- END. The zero input of the multiplexer 870 receives the signals LNON.sub.-- SW�31:6!, and the one input of the multiplexer 807 receives the signals SCAN.sub.-- NSW�31:6!.
As shown in FIG. 31B, for purposes of generating the MAX0, MAX1, MAX2, MAX3, MAX4, and MAX5 signals, the serial input logic 804 includes six counters 831a-f, respectively, of common design 831. Each counter 831 is initialized (to a predetermined count value) when an AND gate 892 asserts, or drives high, its output. For the counter 831a, the AND gate 892 receives the signal BIT.sub.-- ENABLE�0!, the signal SW.sub.-- CHG�0! and an inverted signal QUICK.sub.-- FILTER. The signal QUICK.sub.-- FILTER, when asserted, or high, can be used to circumvent the debounce time interval. The QUICK.sub.-- FILTER signal is normally deasserted, or low. The clock input of the counter 831 is connected to the output of an AND gate 893. For the counter 831a, the AND gate 893 receives the BIT.sub.-- ENABLE�0! signal, the inverted SW.sub.-- CHG�0! signal, the inverted GETTING.sub.-- BYTE signal, and the inverted MAX0 signal. Therefore, for the counter 831a, once the logical voltage of the status signal STATUS�0! changes, each time the serial scan-logic 804 scans the status signal STATUS�0!, the counter 831a is incremented. When the counter 831a reaches its maximum value, the signal MAX0 is asserted which indicates the debounce time interval has elapsed. If the logical voltage of the status signal STATUS�0! changes during the count, the counter 831a is reinitialized and the count begins again. The other counters 831b-f function in a similar fashion for their corresponding status signals STATUS�5:1!.
The HOLD.sub.-- OFF signal, when asserted, instructs one of the timers 806 to measure a predetermined slow scan interval which puts the serial scan state machine 840 in the slow scan mode. When the timer 806 completes measuring this delay interval, the timer 806 asserts, or drives high, a FTR.sub.-- TIMEOUT signal which is otherwise deasserted, or negated. The product of this slow scan interval and the number of counts for the counter 831 to reach its maximum value is equal to the debounce time interval (8 ms).
The HOLD.sub.-- OFF signal is furnished by the output of a JK flip-flop 885. The flip-flop 885 is clocked on the positive edge of the CLK signal, and the clear input of the flip-flop 885 receives the RST signal. The J input is connected to the output of an AND gate 883, and the K input is connected to the output of an AND gate 884. One input of the AND gate 884 is connected to the output of a JK-type flip-flop 896, and the other input of the AND gate 883 receives the SCAN.sub.-- END signal. One input of the AND gate 884 is connected to the inverted output of the AND gate 883, one input of the AND gate 884 receives the FTR.sub.-- TIMEOUT signal, and another input of the AND gate 884 receives a SCAN.sub.-- IN.sub.-- IDLE signal, which is asserted when the scan state machine 840 is in its IDLE state, as further described below.
The flip-flop 895 is clocked on the positive edge of the CLK signal, and the clear input of the flip-flop 895 receives the RST signal. The J input is connected to the output of a NAND gate 894 which receives the MAX0, MAX1, MAX2, MAX3, MAX4 and MAX5 signals. The K input is connected to the output of an AND gate 826 which is connected to the inverted J input of the flip-flop 895 and receives an inverted SCAN.sub.-- IN.sub.-- PROGRESS signal which is asserted when the scan state machine 840 is scanning the status signals STATUS�31:0!.
For purposes of generating the CHECK.sub.-- SWITCH.sub.-- ONLY signal, the serial scan input logic 804 includes a JK-type flip-flop 864 which furnishes the CHECK.sub.-- SWITCH.sub.-- ONLY signal at its non-inverting output and is clocked on the positive edge of the CLK signal. The clear input of the flip-flip 864 receives the RST signal, and the J input of the flip-flop 864 receives a DEBOUNCE signal, which when asserted, or driven high, indicates that one of the logical voltage level of one or more of the status signals STATUS�31:6! has changed. The K input of the flip-flop 864 is connected to the output of a AND gate 865. One input of the AND gate 865 receives the inverted DEBOUNCE signal, and one input of the AND gate 865 receives the SCAN.sub.-- IN.sub.-- IDLE signal.
As shown in FIG. 31C, the debounce signal DEBOUNCE is furnished by the non-inverting output of a JK-type flip-flop 860. The flip-flop 860 is clocked by the positive edge of the clock signal CLK, and the clear input of the flip-flop 860 receives the reset signal RST. The J input of the flip-flop 860 receives a signal CHANGE.sub.-- ON.sub.-- INPUT signal. The CHANGE.sub.-- ON.sub.-- INPUT signal is asserted, or driven high, when a change in one of the status signals STATUS�31:6! is detected at the end of a scan by the serial input logic 804 and deasserted otherwise. The K input is connected to the output of an AND gate 861 which receives a DB.sub.-- TIMEOUT signal at one of its inputs. The other input of the AND gate 861 receives the inverted CHANGE.sub.-- ON.sub.-- INPUT signal. The DB.sub.-- TIMEOUT signal is asserted by the timers 106 for one cycle of the CLK signal when the debounce time delay (initiated by the assertion of the DEBOUNCE signal) has expired. The assertion of the DB.sub.-- TIMEOUT signal negates the DEBOUNCE signal on the next positive edge of the CLK signal.
The CHANGE.sub.-- ON.sub.-- INPUT signal is furnished by the non-inverting output of a JK-type flip-flop 866 which is clocked on the positive edge of the CLK signal. The clear input of the flip-flop receives the RST signal. The J input of the flip-flop 866 is connected to the output of an AND gate 869 which receives the SCAN.sub.-- END signal, and another input of the AND gate 869 is connected to the output of an OR gate 867. The OR gate 867 logically ORs all of a set of NSW.sub.-- CHG�31:6! signals. The bit positions of the signals NSW.sub.-- CHG�31:6! correspond to the bit positions of the status signals STATUS�31:6! and indicate, by their assertion, whether the corresponding status signal STATUS�31:6! has changed after the last scan. The AND gate 869 further receives the SCAN.sub.-- END signal. The K input of the flip-flop 866 is connected to the output of an AND gate 868 which receives the inverted SCAN.sub.-- IN.sub.-- PROGRESS signal and the inverted output of the AND gate 869. The signals NSW.sub.-- CHG�31:6! are furnished by the output of a multi-bit, XOR gate 862 which receives the signals D.sub.-- LNON.sub.-- SW�31:6! and LNON.sub.-- SW�31:6!.
The non-inverting output of a multi-bit D-type flip-flop 912 furnishes bits SI.sub.-- DATA�7:0! for the serial data register 815. The clear input of the flip-flop 912 receives the signal RST, and the flip-flop 912 is clocked on the positive edge of the CLK signal. The signal input of the flip-flop 912 is connected to the output of a multi-bit multiplexer 916. The select input of the multiplexer 916 is connected to the output of an AND gate 914, and the zero input of the multiplexer 916 receives the bits SI.sub.-- DATA�7:0!. The AND gate 914 receives the signals GETTING.sub.-- BYTE and SHIFT.sub.-- ENABLE. Thus, when the serial scan logic 804 is not shifting in a requested byte of the status signals STATUS�47:0!, the values of the bits SI.sub.-- DATA�7:0! are preserved.
The one input of the multiplexer 916 is connected to the output of a multi-bit multiplexer 910. The one input of the multiplexer 910 is connected to the output of a multi-bit OR gate 911, and the zero input of the multiplexer is connected to the output of a multi-bit AND gate 915. The select input of the multiplexer 910 receives the signal NEW.sub.-- CSID.
One input of the AND gate 915 receives the bits SI.sub.-- DATA�7:0!, and an inverting input of the AND gate 915 is connected to the output of a 3.times.8 decoder 913. The decoder 913 receives the signal BIT�2:0!. One input of the OR gate 911 receives the bits SI.sub.-- DATA�7:0!, and the other input of the OR gate 911 receives the output of the decoder 913.
The serial input logic 804 furnishes five signals RST.sub.-- SWITCH�5:0! (corresponding to the bit positions of the status signals STATUS�5:0!) to the ON/OFF control logic 820 which indicate, by their assertion, whether the corresponding slot 36a-f should be powered down. The ON/OFF control logic 820 indicates when the slot 36 (indicated by the RST.sub.-- SWITCH�5:0! signals) has subsequently been powered down by the subsequent assertion of one of five signals CLR.sub.-- SWITCH.sub.-- �5:0! signals whose bit positions correspond to the signals RST.sub.-- SWITCH�5:0!. After receiving the indication that the slot 36 has been powered down, the serial logic 804 then deasserts the corresponding RST.sub.-- SWITCH�5:0! signal.
The signals RST.sub.-- SWITCH�5:0! are furnished by the non-inverting output of a multi-bit, D-type flip-flop 891 (FIG. 31B). The clear input of the flip-flop 891 receives the reset signal RST, and the flip-flop 891 is clocked on the positive edge of the clock signal CLK. The input of the flip-flop 891 is connected to the output of a multi-bit OR gate 857 which has one input connected to the output of a multi-bit AND gate 859 and one input connected to the output of a multi-bit AND gate 855. One input of the AND gate 859 is connected to the output of a multiplexer 853, and the other input of the AND gate 859 receives latched slot enable signals LSLOT.sub.-- EN�5:0! which indicate, by their assertion, whether the corresponding slot 36a-f is powered up. One input of the AND gate 855 receives the signals CLR.sub.-- SWITCH.sub.-- �5:0! signals. Another input of the AND gate 855 receives the signals RST.sub.-- SWITCH�5:0!. Another input of the AND gate 855 is connected to the inverted output of the multiplexer 853.
The zero input of the multiplexer 853 receives a six bit signal indicative of zero. The one input of the multiplexer 853 is connected to the output of a multi-bit AND gate 849. One input of the AND gate 849 receives the signals D.sub.-- LSWITCH�5:0!, and the other input of the AND gate 849 receives the inverted signals L.sub.-- SWITCH�5:0!. The select input of the multiplexer 853 receives the SCAN.sub.-- END signal.
For purposes of generating the SI.sub.-- INTR# signal, the serial scan logic 804 includes a D-type flip-flop 882 which furnishes the serial interrupt signal SI.sub.-- INTR# at its inverting output. The flip-flop 882 is clocked on the positive edge of the CLK signal, and the clear input of the flip-flip 882 receives the RST signal. The input of the flip-flop 882 is connected to the output of an OR gate 881 which receives thirty two pending interrupt signals PENDING.sub.-- IRQ�31:0!, which indicate, by their assertion, or driving high, whether an interrupt is pending for the corresponding one of the status signals STATUS�31:0!. The signals PENDING.sub.-- IRQ�31:0! are otherwise deasserted.
As shown in FIG. 31E, a multi-bit, D-type flip-flop 979 furnishes the signals PENDING.sub.-- IRQ�31:0! at its non-inverting output. The flip-flop 979 is clocked on the positive edge of the signal CLK signal and receives the signal RST at its clear input. The input of the flip-flop 979 is connected to the output of a multi-bit AND gate 981 which receives inverted interrupt mask signals INTR.sub.-- MASK�31:0! at one input. The signals INTR.sub.-- MASK�31:0! are indicative of corresponding bit of the interrupt mask register 810. The other input of the AND gate 981 is connected to the output of a multi-bit OR gate 835. One input of the OR gate 835 is connected to the output of a multi-bit AND gate 862, and the other input of the OR gate 835 is connected to the output of a multi-bit AND gate 834.
The AND gate 862 receives inverted PENDING.sub.-- IRQ�31:0! signals and signals SET.sub.-- PIRQ�31:0!. The signals SET.sub.-- PIRQ�31:0! are asserted to indicate an interrupt request should be generated for the corresponding one of the status signals STATUS�31:0!. Therefore, the signals PENDING.sub.-- IRQ�31:0! are updated with the signals SET.sub.-- PIRQ�31:0! if not masked by the signals INTR.sub.-- MASK�31:0!.
The AND gate 834 receives the signals PENDING.sub.-- IRQ�31:0!, inverted signals SET.sub.-- PIRQ�31:0! and inverted WR.sub.-- INTR.sub.-- REG�31:0! signals. The signals WR.sub.-- INTR.sub.-- REG�31:0! indicate the write data furnished by the CPU 14 to the interrupt register 800. The CPU clears an interrupt by writing a "1" to the corresponding bit of the interrupt register 800. Therefore, if this occurs, and no new interrupt requests are indicated for the corresponding one of the status signals STATUS�31:0!, the corresponding one of the signals PENDING.sub.-- IRQ�31:0! is cleared.
The signals SET.sub.-- PIRQ�31:0! are furnished by the output of a multi-bit AND gate 839. One input of the AND gate 839 receives the signals UPDATE.sub.-- IRQ�31:0!. The other input of the AND gate 839 is connected to the output of a multi-bit XOR gate 837. One input of the XOR gate 837 receives the signals D.sub.-- INTR.sub.-- REG�31:0!, the other input of the XOR gate 837 receives the signals INTR.sub.-- REG�31:0!. Therefore, when the bits of the interrupt register 800 transition from one logical state to another, an interrupt request is generated.
For purposes of updating the bits of the interrupt register 800, the signals UPDATE.sub.-- IRQ�31:0! are furnished to the corresponding load inputs of the register 800. When one of the signals UPDATE.sub.-- IRQ�31:0! is asserted, or driven high, the corresponding bit is loaded with the corresponding one of the signals D.sub.-- INTR.sub.-- REG�31:0!.
The signals UPDATE.sub.-- IRQ�31:0! are furnished by the output of a multi-bit OR gate 971. One input of the OR gate 971 is connected to the output of a multi-bit AND gate 973. One input of the AND gate 973 is connected to the output of a multi-bit multiplexer 977, and the other input of the AND gate 973 receives inverted PENDING.sub.-- IRQ�31:0! signals. The select input of the multiplexer 977 receives the signal SCAN.sub.-- END, the one input of the multiplexer 977 receives a thirty-two bit signal indicative of "hFFFFFFFF," and the zero input of the multiplexer 977 receives a thirty-two bit signal indicative of "0." Therefore, at the end of a scan, the signals UPDATE.sub.-- IRQ�31:0! allow the bits of the interrupt register 800 to be updated that correspond to the asserted PENDING.sub.-- IRQ�31:0! signals.
Another input of the OR gate 971 is connected to the output of a multi-bit AND gate 975. One input of the AND gate 975 receives the inverted INTR.sub.-- MASK�31:0! signals, another input of the AND gate 975 receives the signals PENDING.sub.-- IRQ�31:0!, and another input of the AND gate 975 receives the signals WR.sub.-- INTR.sub.-- REG�31:0!. Therefore, the CPU 14 can selectively clear bits of the signals PENDING.sub.-- IRQ�31:0!.
The signals D.sub.-- INTR.sub.-- REG�5:0! are furnished by the output of a multi-bit multiplexer 830. When the SCAN.sub.-- END signal is asserted, the signals D.sub.-- INTR.sub.-- REG�5:0! are equal to the signals D.sub.-- LSWITCH�5:0!. When the SCAN.sub.-- END signal is deasserted, the signals D.sub.-- INTR.sub.-- REG�5:0! are equal to the signals LSWITCH�5:0!.
The signals D.sub.-- INTR.sub.-- REG�31:6! are furnished by the output of a multi-bit multiplexer 845. When the SCAN.sub.-- END signal is asserted, the signals D.sub.-- INTR.sub.-- REG�31:6! are equal to the signals D.sub.-- LNON.sub.-- SW�31:6!. When the SCAN.sub.-- END signal is deasserted, the signals D.sub.-- INTR.sub.-- REG�5:0! are equal to the signals LNON.sub.-- SW�31:6!. The interrupt register 800 takes on new values only when the signal SCAN.sub.-- END is asserted.
As shown in FIGS. 32A-B, the scan state machine 840 enters an IDLE state after the assertion of the reset signal RST. When not in the IDLE state, the scan state machine 840 toggles the states of the serial input clock signal CSIC.sub.-- O in order to clock the shift register 82. Furthermore, when not in a first load state LD1, the scan state machine 840 asserts, or drives high, the load signal CSIL.sub.-- O.sub.-- in order to enable the registers 82 and 52 to serially shift the status signals STATUS�127:0! to the SIO circuit 50. In the IDLE state, the scan state machine 840 sets the signal SCAN.sub.-- DONE equal to zero.
The scan state machine 840 transitions from the IDLE state to the state LD1 when either the signal GETTING.sub.-- BYTE is asserted or the signal HOLD.sub.-- OFF is deasserted. Otherwise, the scan state machine 840 remains in the IDLE state. In the LD1 state, the scan state machine 840 asserts, or drives low, the load signal CSIL.sub.-- O.sub.-- which enables the registers 82 and 52 to latch and start receiving the status signals STATUS�127:0!.
The scan state machine 840 transitions from the LD1 state, to a load two state LD2. In the LD2 state, the load signal CSIL.sub.-- O.sub.-- is kept asserted which enables the registers 82 and 52 to serially shift the status signals STATUS�127:0!.
The scan state machine 840 subsequently transitions to a scan state SCAN. In the SCAN state, the serial scan input logic 804 scans in one of the status signals STATUS�127:0! on each negative edge of the clock signal DIV2CLK. When the signal STOP.sub.-- SCAN is asserted, the scan state machine 840 transitions back to the IDLE state. The STOP.sub.-- SCAN signal is asserted when either the desired byte of the status signals STATUS�127:0! has been shifted into the serial data register 815; the lever status signals STATUS�5:0! have been scanned in and the serial interrupt signal SI.sub.-- INTR# has been asserted; or all of the status signals STATUS�31:0! have been shifted in. In the SCAN state, the SCAN.sub.-- DONE signal is set equal to the STOP.sub.-- SCAN signal.
As shown in FIG. 33A, the ON/OFF control logic 820 includes an ON/OFF state machine 998 which receives the signals RST.sub.-- SWITCH�5:0!, SLOT.sub.-- EN�5:0! and SLOT.sub.-- RST.sub.-- �5:0!. Based on the conditions indicated by these signals, the ON/OFF state machine 998 indicates and controls the appropriate power up or power down sequences. The ON/OFF state machine 998 furnishes control signals to control logic 999.
The ON/OFF state machine 998 furnishes a serial output update signal SO.sub.-- UPDATE to the serial output logic 824. When the signal SO.sub.-- UPDATE is asserted, or driven high, the serial output logic 824 begins the shifting phase and serially shifts control data, via the signal CSOD.sub.-- O, to the register 80. The serial output logic 824 indicates completion of the shifting phase by asserting a signal SO.sub.-- UPDATE.sub.-- DONE which is received by the ON/OFF state machine 998. The ON/OFF state machine 998 subsequently updates the control signals POUT�39:0! by negating, or clocking, the latch signal CSOLC.sub.-- O which is received by the register 80.
The control logic 999 furnishes the signals PWREN�5:0!, CLKEN#�5:0!, BUSEN#�5:0! and RST#�5:0! to the serial output logic 824. The control logic 999 also furnishes a PCI bus request signal CAYREQ# to and receives a PCI bus grant signal CAYGNT# from the arbiter 124. The ON/OFF control logic 820 asserts, or drives low, the signal CAYREQ# to request the PCI bus 32, and when the arbiter 124 asserts, or drives low, the signal CAYGNT#, the arbiter 124 has granted control of the PCI bus 32 to the ON/OFF control logic 820.
As shown in FIGS. 33B-G, the ON/OFF state machine 998 enters an idle state IDLE upon assertion of the reset signal RST. If not idle, the ON/OFF state machine 998 controls one of three sequences: the power down sequence, the power on sequence, or the one pass sequence used to update the control signals POUT�39:0! as indicated by the slot enable 817 and LED control (not shown) registers. The ON/OFF state machine 998 asserts, or drives high, the load signal CSOLC.sub.-- O for one cycle of the clock signal CLK of the register 80 until the ON/OFF state machine 998 determines the control signals POUT�39:0! are to be updated. When the control signals POUT�39:0! are updated, the ON/OFF state machine 998 negates the signal CSOLC.sub.-- O which updates the control signals POUT�39:0!.
The ON/OFF state machine 998 begins the power down sequence when either the software requests a power down of at least one of the slots 36, as indicated by the deassertion of the signals SLOT.sub.-- EN�5:0!; or the serial scan input logic 804 determines at least one of the slots 36a-f should undergo the power down sequence, as indicated by the assertion of the signals RST.sub.-- SWITCH�5:0!. To begin the power down sequence, the ON/OFF state machine 998 asserts the SO.sub.-- UPDATE signal to begin a shifting phase and transitions from the IDLE state to a RSTON state.
During the RSTON state, the control logic 999 negates the reset signals RST#�5:0! for the slots 36 that are to be powered down, and the serial output logic 824 serially shifts the reset signals RST#�5:0! to the output register 80. The ON/OFF state machine 998 also negates the signal SO.sub.-- UPDATE. Once all forty-control signals are shifted by the serial output logic 824 to the register 80, as indicated by the assertion of the signal SO.sub.-- UPDATE.sub.-- DONE, the ON/OFF state machine 998 transitions from the RSTON state to an OFF.sub.-- ARB1 state.
In the OFF.sub.-- ARB1 state, the ON/OFF state machine 998 requests control of the secondary PCI bus 32 by asserting the request signal CAYREQ#. The ON/OFF state machine 998 then transitions to an OFF.sub.-- WGNT1 state where it waits for the grant of the secondary PCI bus 32. When the arbiter 124 grants control of the bus 32, as indicated by the assertion of the CAYGNT# signal, the ON/OFF state machine 998 negates the signal CSOLC.sub.-- O for one cycle of the signal CLK to update the control signals POUT�39:0! and transitions to an OFF.sub.-- LCLK1 state.
In the OFF.sub.-- LCLK1 state, the ON/OFF state machine 998 asserts the signal SO.sub.-- UPDATE to begin another shift phase. The ON/OFF state machine 998 transitions from the OFF.sub.-- LCLK1 state to a bus off state BUSOFF. During the BUSOFF state, the control logic 999 deasserts, or drives high, the bus enable signals BUSEN#�5:0! for the slots 36 that are to be powered down, and the serial output logic 824 serially shifts the bus enable signals BUSEN#�5:0! to the output register 80. The ON/OFF state machine 998 also negates the signal SO.sub.-- UPDATE. Once all forty-control signals are shifted by the serial output logic 824, as indicated by the assertion of the signal SO.sub.-- UPDATE.sub.-- DONE, the ON/OFF state machine 998 transitions from the BUSOFF state to an OFF.sub.-- ARB2 state where the state machine 998 once again requests control of the secondary PCI bus 32. The state machine 998 then transitions to an OFF.sub.-- WGNT2 state where it waits for the grant of -the PCI bus 32. Once the grant is received, the state machine 998 transitions to an OFF.sub.-- LCLK2 state where the control signals POUT�39:0! are updated by negating the signal CSOLC.sub.-- O for one cycle of the signal CLK. The state machine 998 then transitions to a clock off state CLKOFF.
During the CLKOFF state, the control logic 999 deasserts, or drives high, the clock enable signals CLKEN#�5:0! for the slots 36 that are to be powered down. The bus enable signals BUSEN#�5:0! do not change, and the serial output logic 824 serially shifts the clock enable signals CLKEN#�5:0! to the output register 80. The ON/OFF state machine 998 also negates the signal SO.sub.-- UPDATE. Once all forty control signals are shifted by the serial output logic 824, as indicated by the assertion of the signal SO.sub.-- UPDATE.sub.-- DONE, the ON/OFF state machine 998 transitions from the CLKOFF state to an OFF.sub.-- ARB3 state, where the state machine 998 once again requests control of the PCI bus 32. The state machine 998 then transitions to an OFF.sub.-- WGNT3 state where it waits for the grant of the PCI bus 32. Once the grant is received, the state machine 998 transitions to an OFF.sub.-- LCLK3 state where the control signals POUT�39:0! are updated by negating the signal CSOLC.sub.-- O for one cycle of the signal CLK. The state machine 998 then transitions to a power off state PWROFF.
During the PWROFF state, the control logic 999 deasserts, or dries low, the power enable signals PWREN�5:0! for the slots 36 that are to be powered down. The signals RST#�5:0!, BUSEN#�5:0!, and CLKEN#�5:0! do not change, and the serial output logic 824 serially shifts the power enable signals PWREN�5:0! to the output register 80. The ON/OFF state machine 998 also negates the signal SO.sub.-- UPDATE. Once all forty control signals are shifted by the serial output logic 824, as indicated by the assertion of the signal SO.sub.-- UPDATE.sub.-- DONE, the ON/OFF state machine 998 transitions from the PWROFF state to an OFF.sub.-- LCLK4 state where the signals POUT�39:0! are updated by negating the signal CSOLC.sub.-- O for one cycle of the signal CLK. The state machine 998 then transitions to the IDLE state which completes the power down sequence.
If a power down sequence is not required, the ON/OFF state machine 998 then determines if the power up sequence is required. If either the software has requested at least one of the slots 36 to powered up or a power up of the expansion box 30 is pending, then the ON/OFF state machine 998 transitions from the IDLE state to a power on PWRON state to begin the power on sequence. To begin the power on sequence, the ON/OFF state machine 998 asserts the SO.sub.-- UPDATE signal to begin a shift phase and transitions from the IDLE state to a power on state PWRON.
During the PWRON state, the control logic 999 asserts the power enable signals PWREN�5:0! for the slots 36 that are to be powered up, and the serial output logic 824 serially shifts the power enable signals PWREN�5:0! to the output register 80. The ON/OFF state machine 998 also negates the signal SO.sub.-- UPDATE. Once all forty control signals are shifted by the serial output logic 824, as indicated by the assertion of the signal SO.sub.-- UPDATE.sub.-- DONE, the ON/OFF state machine 998 transitions from the PWRON state to a timer 806 initialization state LDCNT1 and negates the load signal CSOLC.sub.-- O to update the control signals POUT�39:0!.
In the LDCNT1 state, the ON/OFF state machine 998 initializes the timers 806 so that the timers 806 provide an indication when a predetermined stabilization delay interval has expired. The stabilization delay interval allows sufficient time for the card 807 that is being powered up to stabilize once the voltage level V.sub.SS is furnished to the card 807. In the LDCNT1 state, the ON/OFF state machine 998 also asserts the signal CSOLC.sub.-- O. The ON/OFF state machine 820 transitions from the LDCNT1 state to a CLKON state.
During the CLKON state, the control logic 999 asserts, or drives low, the clock enable signals CLKEN#�5:0! for the slots 36 that are to be powered up. The PWREN�5:0! signals remain unchanged, and the serial output logic 824 serially shifts the clock enable signals CLKEN#�5:0! to the output register 80. The ON/OFF state machine 998 also negates the signal SO.sub.-- UPDATE. Once the stabilization delay interval has expired, the ON/OFF state machine 998 transitions from the CLKOFF state to an ON.sub.-- ARB1 state.
In the ON.sub.-- ARB1 state, the ON/OFF state machine 998 requests control of the secondary PCI bus 32 by asserting the request signal CAYREQ#. The ON/OFF state machine 998 then transitions to an ON.sub.-- WGNT1 state where it waits for the grant of the secondary PCI bus 32. Once control of the bus 32 is granted, as indicated by the assertion of the CAYGNT# signal, the ON/OFF state machine 998 negates the signal CSOLC.sub.-- O to update the control signals POUT�39:0! and transitions to an ON.sub.-- LCLK1 state where the signals POUT�39:0! are updated.
The ON/OFF state machine 998 transitions from the ON.sub.-- LCLK1 state to a LDCNT2 state where the timers 806 are initialized so that the timers 806 provide an indication when another predetermined stabilization delay interval has expired. This delay interval is used to allow the clock signal on the card 807 being powered up to stabilize before power up sequence continues. The ON/OFF state machine 998 transitions from the LDCNT2 state to a bus on state BUSON.
During the BUSON state, the control logic 999 asserts, or drives low, the bus enable signals BUSEN#�5:0! for the slots 36 that are to be powered down. The signals CLKEN#�5:0! and PWREN�5:0! remain unchanged, and the serial output logic 824 serially shifts the bus enable signals BUSEN#�5:0! to the output register 80. The ON/OFF state machine 998 also negates the signal SO.sub.-- UPDATE. Once the stabilization delay interval has expired, the ON/OFF state machine 998 transitions from the BUSON state to an ON.sub.-- ARB2 state where the state machine 998 once again requests control of the PCI bus 32. The state machine 998 then transitions to an ON.sub.-- WGNT2 state where it waits for the grant of the bus 32. Once the grant is received, the state machine 998 transitions to an ON.sub.-- LCLK2 state where the signals POUT�39:0! are updated by negating the signal CSOLC.sub.-- O for one cycle of the signal CLK. The state machine 998 then transitions to a reset off state RSTOFF.
During the RSTOFF state, the control logic 999 asserts, or negates, the reset signals RST#�5:0! for the slots 36 that are to be powered up, depending on their respective SLOT.sub.-- RST.sub.-- �5:0! signals. The signals CLKEN#�5:0!, PWREN�5:0! and BUSEN#�5:0! remain unchanged, and the serial output logic 824 serially shifts the reset signals RST#�5:0! to the output register 80. The ON/OFF state machine 998 also negates the signal SO.sub.-- UPDATE. Once all forty control signals are shifted by the serial output logic 824, as indicated by the assertion of the signal SO.sub.-- UPDATE.sub.-- DONE, the ON/OFF state machine 998 transitions from the RSTON state to an ON.sub.-- ARB3 state where the state machine 998 once again requests control of the bus 32. The state machine 998 then transitions to an ON.sub.-- WGNT3 state where it waits for the grant of the bus 32. Once the grant is received, the state machine 998 transitions to an ON.sub.-- LCLK3 state where the signals POUT�39:0! are updated by negating the signal CSOLC.sub.-- O for one cycle of the signal CLK. The state machine 998 then transitions back to the IDLE state.
If neither the power up sequence nor the power down sequence is required, the ON/OFF state machine 998 then determines if a one pass sequence is needed to update selected ones of the signals POUT�39:0!. If the GO.sub.-- UPDATE signal is asserted, and if any bits of the slot enable register 817 or slot reset register 819 changes, then the ON/OFF state machine 998 transitions to a ONEPASS state and asserts the SO.sub.-- UPDATE signal.
The ON/OFF state machine 998 remains in the ONEPASS state until the forty control signals have been shifted to the register 80. The ON/OFF state machine 998 then transitions to an OP.sub.-- ARB state where the state machine 998 requests control of the PCI bus 32 by asserting the signal CAYREQ#. The state machine 998 then transitions to an OP.sub.-- WGNT state where it waits for the grant of the bus 32. Once the grant is received, the state machine 998 transitions to an OP.sub.-- LCLK state where the signals POUT�39:0! are updated by negating the signal CSOLC.sub.-- O for one cycle of the signal CLK. The state machine 998 then transitions back to the IDLE state.
As shown in FIG. 34, the serial output logic 824 includes a shift output bit counter 921 that provides a six bit counter output signal BIT.sub.-- CNTR�5:0! which tracks the control signal shifted out of the serial output logic 824 via the signal CSOD.sub.-- O. When the signal BIT.sub.-- CNTR�5:0! is equal to a six digit number equivalent to "39" then a signal MAX.sub.-- CNT is asserted. The signal MAX.sub.-- CNT is provided to the input of an AND gate 922. The AND gate 922 further receives a signal SHIFT4 which is asserted when the output shift state machine 920 enters its SHIFT4 state, further described below. The output of the AND gate 922 provides the signal SO.sub.-- UPDATE.sub.-- DONE.
The output shift state machine 920 furnishes an increment counter signal INC.sub.-- CNTR to the bit counter 921. When the INC.sub.-- CNTR signal is asserted, the bit counter 921 increments the value represented by the signal BIT.sub.-- CNTR�5:0!. When a load counter signal LOAD.sub.-- CNTR is asserted or when the RST signal is asserted, then the output of an OR gate 925, connected to a clear input of the bit counter 921, clears the signal BIT.sub.-- CNTR�5:0!.
The signal BIT.sub.-- CNTR�5:0! is furnished to the select input of a multi-bit multiplexer 924 that furnishes the signal CSOD.sub.-- O. The zero through eleven inputs of the multiplexer 924 receive the LED control signals LEDS�11:0!. The twelve through fifteen inputs of the multiplexer 924 receive general purpose output signals GPOA�3:0!. The sixteen through twenty-one inputs receive the reset signals RST#�5:0!. The twenty-two through twenty-seven inputs receive the clock enable signals CLKEN#�5:0!. The twenty-eight through thirty-three inputs receive the bus enable signals BUSEN#�5:0!. The thirty-four through thirty-nine inputs receive the power enable signals PWREN�5:0!.
As shown in FIGS. 35A-B, the output shift state machine 920 enters an IDLE state when the signal RST is asserted. If the signal SO.sub.-- UPDATE is asserted, then the output shift state machine 920 transitions from the IDLE state to a SHIFT1 state.
Because the output shift state machine 920 is clocked on the positive edge of the PCI clock signal CLK, the output shift state machine 920 transitions through a SHIFT1 state, a SHIFT2 state, a SHIFT3 state and a SHIFT4 state to generate the clock signal CSOSC.sub.-- O that is one fourth of the frequency of the clock signal CLK. During the SHIFT1 and SHIFT2 states the clock signal CSOSC.sub.-- O is negated, or low, and during the SHIFT3 and SHIFT4 states, the clock signal CSOSC.sub.-- O is asserted, or high. When the current shift phase is completed, as indicated by the assertion of the signal MAXCNT, the shift state machine 920 returns to the IDLE state and the clock signal CSOSC.sub.-- O is asserted until the beginning of the next shifting phase.
As shown in FIG. 36, a HANG.sub.-- PEND signal is received by the clear input of the register 80. The assertion, or driving high, or the HANG.sub.-- PEND signal asynchronously clears the appropriate output control signals POUT�39:0! to power down all slots 36 when the PCI bus 32 is in a locked up condition, as further described below.
FAULT ISOLATION
The bus watcher 129 can detect for a hang condition on the secondary PCI bus 32. If a hang condition is detected, the bus watcher 129 sets a bus hang pending bit, which causes the SIO 50 to power down the slots on the secondary PCI bus 32 and a non-maskable interrupt (NMI) to be transmitted to the CPU 14. The CPU 14 responds to the NMI by invoking an NMI routine to isolate the slot(s) causing the hang condition. Once identified, the defective slot (s) are disabled or powered off.
For software diagnostic purposes, the bus watcher 129 in the downstream bridge chip 48 includes a bus history FIFO and a bus vector FIFO. When the secondary PCI bus 32 is functioning properly, the bus history information, which includes an address group (including the PCI address, PCI command signals, PCI master number, and the address parity bit) and a data group (including the PCI data, byte enable signals C/BE�3:0!.sub.--, parity error signal PERR.sub.--, the data parity bit, a burst cycle indication bit, and a data valid flag), are recorded by the bus watcher 129 in each transaction. When the PCI signal FRAME.sub.-- is asserted on the secondary PCI bus 32 to start a bus transaction, the address group and each subsequent data group are stored in the bus history FIFO. If the transaction is a burst transaction, then the burst cycle indication bit is set active on the second data phase. After the first data phase, the address field in the address group associated with the subsequent data groups in the burst transaction is incremented by 4 and the new address group and data group are stored in the next location of the bus history FIFO. If data is not transferred because of a retry condition or a disconnect-without-data condition, the valid data indication bit is set low.
Both the address group and the data group flow through a 2-stage pipeline to allow time for the data group to collect the data parity bit and data parity error bit, and stop the recording process when a data parity error occurs before the next address group is stored. If the bus hangs in the middle of a write data phase, the data is stored, and a bus-hang status bit is set in a bus-hang indication register 482 (FIG. 42) accessible via configuration space. If the bus hangs in the middle of a read data phase, the data is marked as not valid, and the bus-hang bit is set.
Bus state vectors are assembled and stored in the bus vector FIFO, including the following PCI control signals: slot request signals REQ�7:0!.sub.-- ; slot grant signals GNT�7:0!.sub.-- ; the FRAME.sub.-- signal; the PCI device select signal DEVSEL.sub.-- ; the PCI initiator ready signal IRDY.sub.-- ; the PCI target ready signal TRDY.sub.-- ; the STOP.sub.-- signal; the PCI parity error signal PERR.sub.-- ; the PCI system error signal SERR.sub.-- ; and the LOCK.sub.-- signal. On each PCI clock in which the bus state vector changes, i.e., any one of the listed signals changes state, the new vector is stored into the bus vector FIFO.
The bus watcher 129 includes a watch-dog timer 454 (FIG. 40) to determine whether the secondary bus 32 has locked up. If the watch-dog timer 454 expires, then the bus 32 has hung. The following are examples of bus.sub.-- hang conditions that can be detected by the watch-dog timer 454: The FRAME.sub.-- signal is stuck high or low; the signal TRDY.sub.-- is not asserted in response to IRDY.sub.-- ; the PCI arbiter 124 does not grant the bus to any master; and a master requesting the bus 32 keeps getting retried.
When the watch-dog timer 454 expires, the bus hang pending bit is set active in the bus-hang indication register 482. When set active, the bus hang pending bit disables the bus watcher 129. Next, the slot enable bits in the SIO 50 are cleared, causing the slots to be powered off. The SIO 50 then asserts the system error signal SERR.sub.--.
To isolate the cause of a bus-hang condition, the system error signal SERR.sub.-- causes the interrupt logic in the system to issue the NMI to the CPU 14. Referring to FIG. 37, the NMI handler first determines 400 if the bus hang pending bit is set by reading the bus hang indication register 482. If so, the NMI handler calls 401 a BIOS isolation handler for isolating the defective slot or slots. Otherwise, other NMI procedures are called 402.
As a fail-safe mechanism, the computer system also includes the automatic server recovery (ASR) timer 72 which is cleared when certain software routines are executed by the operating system. If the ASR timer expires (e.g., after 10 minutes), that indicates that the operating system has locked up. The secondary PCI bus 32 hanging may be the cause of the system lock up, in which case the NMI may never get to the CPU 14. If the ASR timer expires, then an ASR-generated reboot occurs. The ASR timer also ensures that if the BIOS isolation handler is in the middle of isolating a faulty slot on the PCI bus 32, and the computer system hangs to cause the ASR reboot, the isolate routine can pick up where it left off just before the ASR time-out event.
Referring to FIG. 38, a BIOS ASR handler is invoked in response to an ASR reboot condition. The ASR handler first checks 444 to determine if an isolation-in-progress event variable (EV) contains active information indicating that the isolation process was in progress prior to the ASR time-out event. The isolation-in-progress EV is stored in non-volatile memory (NVRAM) 70 and includes header information which is set active to indicate that the isolation process has started. The isolation-in-progress EV is also updated with the current state of the isolation process, including the slots which have been checked, the slots which are defective, and the slots which have been enabled.
If the isolation process was in progress, the BIOS ASR handler re-enables 448 all slots except the ones that were enabled immediately prior to the ASR event, which is determined from the isolation-in-progress EV. The enabled slots prior to the ASR reboot were probably the cause of the ASR lock-up. As a result, those slots are disabled (i.e., powered off). Next, the disabled slot numbers are logged 450 as fail status information stored in the NVRAM, and the isolation-in-progress EV is cleared. The BIOS ASR handler then checks 452 to determine if the bus-hang pending bit is set. If so, the bus-hang pending bit is cleared (by performing an I/O cycle on the secondary PCI bus 32) to re-enable the bus watcher 129.
If the isolation-in-progress EV is not set 444 to the active state, indicating that the isolation process was not running when the ASR event occurred, the routine checks 446 to determine if the bus-hang pending bit is set. If not, then the BIOS ASR handler is done. If the bus-hang pending bit is set 446, indicating that a bus-hang condition occurred before the ASR event, the BIOS ASR handler calls the BIOS isolation handler to isolate the faulty slot or slots.
Referring to FIG. 39, the BIOS isolation handler first logs 408 to the fail status information portion of the NVRAM the bus history and bus state vector information stored in the history and vector FIFOs in the bus monitor 127. The bus history and bus state vector FIFOs are read and their contents transferred to the NVRAM. Next, the header information of the isolation-in-progress event variable is set 410 to indicate that the isolation process is in progress. The bus-hang pending bit is cleared (by writing to a predetermined configuration address) to re-enable the bus watcher 129. Next, the isolation routine re-enables 412 (i.e., powers up) the first populated slot (i.e., slot with a PCI device connected), and reads and writes from the PCI configuration space of the device. A slot is re-enabled by writing to the slot enable register 817 (FIG. 29). Next, the routine determines 414 if the bus-hang pending bit is set active, indicating that the device connected to the slot caused the bus to hang while reading from it. If not, the routine determines 416 if all populated slots have been checked. If not, the first populated slot is disabled 418 and the isolation-in-progress EV is updated 420 to indicate that the first populated slot has been tried by the BIOS isolation handler. If the routine determines 414 that the bus-hang pending bit is set active, the slot is indicated as being failed (e.g., by setting active a fail flag for that slot) in the fail status information portion of the NVRAM. Next, the loop consisting of steps 412, 414, 416, 418 and 420 is performed until all populated slots have been checked.
If all populated slots have been checked 416, the routine checks 424 to determine if any slot is indicated as failed in the fail status information portion of the NVRAM. If so, the routine 398 re-enables 426 only the non-failing slots. Then, the isolation-in-progress EV is cleared 428, and the BIOS isolation routine is complete.
If none of the slots are indicated 424 as failed, then that indicates that the bus-hang condition is not caused by a single slot, but may be caused by more than one device being active at the same time. To confirm that, the BIOS isolation handler first disables (i.e., powers down) 430 all the slots, and updates the isolation-in-progress EV with this information. Next, the BIOS isolation handler clears 431 a count variable N to zero and sets a count variable I to the value of N. The count variable N represents the count of the populated slots.
The BIOS isolation handler re-enables (i.e., powers up) 432 the populated slot I (which is initially slot N) and reads and writes to its PCI configuration space. The handler then checks 438 to determine if the bus-hang pending bit is set. If not, the handler decrements 433 the variable I and checks 434 if the variable I is greater than or equal to zero. If so, the handler updates 435 the isolation-in-progress EV and re-enables 432 and reads and writes the next populated slot I. The handler then checks 438 if the bus hang pending bit is set for this next slot. In this manner, for each slot N that is to be enabled, the previously enabled slots are also powered on one at a time to determine if a combination of slots is causing the failure.
If the variable I is determined 434 to be less than zero, then the handler checks 436 to determine if all populated slots have been enabled. If not, the variable N is incremented 437, the isolation-in-progress EV is updated 439, and the variable I is again set 441 equal to the value of N.
If the bus hang pending bit is set 438 active, then potentially two slots are disabled 440: slot N (which is the slot currently being enabled) and slot I (which is the slot currently being read from and written to). If the value of I and N are the same, then only slot N is disabled. If the handler determines 436 that all populated slots have been enabled (and a failure could not be identified), then the handler logs 442 in the NVRAM its inability to isolate the failure. Next, the handler clears 428 the isolation-in-progress EV.
Referring to FIG. 40, the watch-dog timer 454, provides output signals WD.sub.-- TMR.sub.-- OUT�17:0! (timer count value), HANG.sub.-- PEND (bus hang condition present), EN.sub.-- CAP (the software has enable capture of the bus and vector history information), TIME.sub.-- OUT (the watch-dog timer 454 has timed out), a signal HANG.sub.-- RCOVR.sub.-- EN (set high by software to enable the hang recovery logic in the bus watcher 129 and in the SIO 50) and a signal CAP.sub.-- ILLEG.sub.-- PROT (to indicate an illegal cycle on the PCI bus 32).
The signal HANG.sub.-- PEND is provided to the SIO 50 to shut down the secondary bus slots. The input signals to the watch-dog timer 454 include some of the PCI bus signals, a signal WRT.sub.-- EN.sub.-- CAP.sub.-- 1 (pulsed high by software to re-enable the capture of the bus history and bus vector information by the fault isolation block 129), and a power-good indicator signal SYNC.sub.-- POWEROK (indicating that power in the computer system is stable).
A bus hang recovery state machine 456 receives the signals HANG.sub.-- PEND, TIME.sub.-- OUT, and HANG.sub.-- RCOVR.sub.-- EN from the watch-dog timer 454. The recovery state machine 456 also receives some of the PCI signals. The output signals from the bus hang recovery state machine 456 includes a device select signal DEVSEL.sub.-- O for driving the PCI signal DEVSEL.sub.--, a signal STOP.sub.-- O for driving the PCI signal STOP.sub.--, a signal SERR.sub.-- EN which enables assertion of the system error signal SERR.sub.--, a signal BR.sub.-- M.sub.-- ABORT (indicating that the bus watcher 129 has recovered with a master abort), a signal BR.sub.-- T.sub.-- ABORT (indicating that the bus watcher 129 has recovered with a target abort), and a signal RCOVR.sub.-- ACTIVE (for indicating when the bus hang recovery state machine 456 is active). The bus hang recovery state machine 456 ensures that the secondary PCI bus 32 is brought back to the idle state to allow the software to isolate the faulty slot. When the hang condition is detected, the SIO 50 powers down the secondary bus slots, which would automatically place the bus 32 into the idle state if one of the slot devices was the bus master when the hang condition occurred. However, if one of the slot devices was the target (and the bridge chip 48 was the master) when the bus hang occurred, then the bridge chip 48 would remain on the bus. To take the bridge chip off the bus, the recovery state machine 456 forces a retry cycle on the PCI bus 32 by asserting the signal STOP.sub.--.
A bus history capture block 458 monitors the PCI bus 32 for transactions, and presents the bus history information (including the address and data) on to output signals BUS.sub.-- HIST.sub.-- DATA3�31:0! (the bus history address), BUS.sub.-- HIST.sub.-- DATA2�31:0! (the bus history data), and BUS.sub.-- HIST.sub.-- DATA1�15:0! (parity error signal |PERR.sub.--, parity bit PAR, valid data bit VALID.sub.-- DAT, address parity bit ADDRPAR, burst indicator BURST, master number MASTER�2:0!, byte enable bits CBE�3:0!.sub.--, and command bits CMD�3:0!). The bus history capture block 458 asserts a signal HIST.sub.-- RDY when data is available on the BUS.sub.-- HIST.sub.-- DATA signals, which is true at the end of each data phase in a normal transaction, or if the transaction is terminated with a master abort, a retry, while the assertion of the time out signal TIME.sub.-- OUT.
A bus vector capture block 460 captures the states of certain PCI control signals when any of the those control signals changes state. The vector is captured and output as signals BUS.sub.-- VECT.sub.-- DATA�20:0!, which contain the request signals |REQ�7:0!.sub.--, grant signals |GNT�7:0!.sub.--, time out signal TIME.sub.-- OUT, lock signal LOCK.sub.--, system error signal SERR.sub.--, parity error signal PERR.sub.--, stop signal STOP.sub.--, target ready signal TRDY.sub.--, initiator ready signal IRDY.sub.--, device select signal DEVSEL.sub.--, and frame signal FRAME.sub.--. The bus vector capture block 460 asserts a signal VECT.sub.-- RDY if any of the bus vector BUS.sub.-- VECT.sub.-- DATA�24:0! has changed or the watch-dog timer 454 has expired (TIME.sub.-- OUT is high).
The bus history and bus vector signals are presented to the inputs of bus watcher FIFOs, which includes a 2-deep bus history FIFO and a 4-deep vector history FIFO. The outputs of the bus history FIFOs are presented as signals BUS.sub.-- HIST.sub.-- REG1�31:0!, BUS.sub.-- HIST.sub.-- REG2�31:0!, and BUS.sub.-- HIST.sub.-- REG3�31:0!. The outputs of the vector history FIFO are presented as signals BUS.sub.-- VECT.sub.-- REG�31:0!. The system software reads the outputs of the bus history FIFO by generating an I/O read cycle which causes a signal BUS.sub.-- HIST.sub.-- RD1 to be asserted, and reads the outputs of the vector FIFO by generating an I/O read cycle which causes a signal BUS.sub.-- VECT.sub.-- RD to be asserted.
Referring to FIG. 41, the recovery state machine 456 begins in state IDLE when the signal SYNC.sub.-- POWEROK is negated low, indicating that power is not yet stable. The state machine remains in state IDLE while the signal HANG.sub.-- PEND is low. In state IDLE, signals BR.sub.-- M.sub.-- ABORT, BR.sub.-- T.sub.-- ABORT and RCOVR.sub.-- ACTIVE are negated low. The signal RCOVR.sub.-- ACTIVE is active high in the other states WAIT, ABORT, and PEND.sub.-- OFF. If the signal SET.sub.-- HANG.sub.-- PEND is asserted high, the state machine transitions to state WAIT. In the transition, the signal DEVSEL.sub.-- O is set equal to the inverted state of the device select signal DEVSEL.sub.--. This insures that if the device select signal DEVSEL.sub.-- is asserted by a target before the bus hang condition, the recovery state machine 456 maintains the signal DEVSEL.sub.-- asserted. In state WAIT, the signal DEVSEL.sub.-- O is set equal to the state of the signal DEV.sub.-- SEL.sub.-- WAS, which is set high if the signal DEVSEL.sub.-- is asserted by a target before the state machine transition to the WAIT state.
From state WAIT, the bus hang recovery state machine 456 transitions to the PEND.sub.-- OFF state if a signal PCI.sub.-- IDLE is asserted, indicating that the PCI bus 32 has gone idle (i.e., signals FRAME.sub.-- and IRDY.sub.-- are both negated high). In the transition, the signal BR.sub.-- M.sub.-- ABORT is set high to indicate that one of the slot devices was the master before the hang condition and powering down the slot device caused the PCI bus to go idle. A signal SERR.sub.-- EN is also set high to enable assertion of the system error signal SERR.sub.-- or if INTA.sub.-- is enabled.
If a slot device was a target before the bus hang condition, then the bus master will remain on the PCI bus 32. To force the bus master off the PCI bus 32, the bus hang recovery state machine 456 issues a retry on the PCI bus 32. A counter 457 counts a predetermined number of PCLK periods (e.g., 15 PCLK period) after the signal HANG.sub.-- PEND is asserted high. The 15 PCLK periods insure sufficient rise time on FRAME.sub.-- and IRDY.sub.-- to give the signals time to go back to their idle states. When 15 PCLK periods have elapsed, the counter 457 asserts the signal TIME.sub.-- OUT15. If the signal TIME.sub.-- OUT15 is asserted high, and the signal PCI.sub.-- IDLE remains low, then the state machine transitions from state WAIT to state ABORT. In the transition, the signal STOP.sub.-- O is asserted high to drive the PCI STOP.sub.-- signal active to retry the bus master. The state machine remains in state ABORT while the bus master maintains the signal FRAME.sub.-- asserted low. In state ABORT, the signal STOP.sub.-- O is maintained high. Once the bus master deasserts the FRAME.sub.-- signal in response to the retry condition, the state machine transitions from state ABORT to state PEND.sub.-- OFF. In the transition, the signal BR.sub.-- T.sub.-- ABORT is asserted high to indicate that the target abort was necessary after the bus hang condition to place the bus 32 in the idle state. The signal SERR.sub.-- EN is also asserted high to enable assertion of the signal SERR.sub.-- or if INTA.sub.-- is enabled. The state machine remains in state PEND.sub.-- OFF until the signal WRT.sub.-- EN.sub.-- CAP.sub.-- 1 has been asserted high at which time it transitions back to state IDLE.
System software can read the value of the BR.sub.-- M.sub.-- ABORT and BR.sub.-- T.sub.-- ABORT signals to determine if the slot device involved in the bus hang was a master or a slave.
Referring to FIG. 42, the watch-dog timer 454 includes an 18-bit LSFR counter 464 which is clocked by the signal PCLK. The counter 464 is enabled when the output of an AND gate 467 is asserted high, which occurs when a new master issues a request (ANY.sub.-- REQ is high), the bus cycle has started (signals FRAME.sub.-- and IRDY.sub.-- are both asserted), the enable capture signal EN.sub.-- CAP is asserted, and the signal TIME.sub.-- OUT is low. An OR gate 466 receives the signal ANY.sub.-- REQ and the inverted states of signals FRAME.sub.-- and IRDY.sub.--. The AND gate 467 receives the output fo the OR gate 466, the signal EN.sub.-- CAP, and the inverted state of the signal TIME.sub.-- OUT. The output of the counter drives signals WD.sub.-- TMR.sub.-- OUT�17:0! and is cleared when a time out condition is detected (TIME.sub.-- OUT is high), a data transfer has taken place (both signals IRDY.sub.-- and TRDY.sub.-- are asserted low), or all output bits of the counter 464 are high (which is an illegal condition). The clear condition is indicated by an OR gate 470, which receives the signal TIME.sub.-- OUT, the bit-wise AND of the signals WD.sub.-- TMR.sub.-- OUT�17:0!, and the output of an AND gate 472. The inputs of the AND gate 472 receive the inverted state of the signal IRDY.sub.-- and the inverted state of the signal TRDY.sub.--.
The signal TIME.sub.-- OUT is asserted high by a time out detector 474 when the timer signals WD.sub.-- TMR.sub.-- OUT�17:0! count to the binary value 1000000000000000. The signal TIME.sub.-- OUT is provided to one input of an OR gate 476, whose output is connected to the input of an AND gate 478. The other input of the AND gate 478 receives the inverted state of a signal WRT.sub.-- EN.sub.-- CAP.sub.-- 1 (controlled by software to re-enable the bus history and bus vector capture), and its output is connected to the D input of a D-type flip-flop 488. The flip-flop 488 is clocked by the signal PCLK and drives an output signal WD.sub.-- TIME.sub.-- OUT, which is fed back to the other input of the OR gate 476. The flip-flop 488 is cleared when the power-good signal SYNC.sub.-- POWEROK is negated. Thus, an ASR reset does not clear the signal WD.sub.-- TIME.sub.-- OUT.
The HANG.sub.-- PEND signal is asserted high by a D-type flip-flop 482, whose D input is connected to the output of an AND gate 484 and which is clocked by the signal PCLK. One input of the AND gate 484 is connected to the output of an OR gate 486, and its other input receives the inverted state of the signal WRT.sub.-- EN.sub.-- CAP.sub.-- 1. One input of the OR gate 486 is connected to the signal HANG.sub.-- PEND, and the other input is connected to the output of an AND gate 488. The inputs of the AND gate 488 receive the signal TIME.sub.-- OUT and the enable signal HANG.sub.-- RCOVR.sub.-- EN. Thus, if system software enables bus hang recovery (HANG.sub.-- RCOVR.sub.-- EN is high), then a time-out condition will cause the signal HANG.sub.-- PEND to be set high. The signal HANG.sub.-- PEND is cleared when the system software causes the signal WRT.sub.-- EN.sub.-- CAP.sub.-- 1 to be asserted (by performing an I/O cycle on the bus 32) or when the signal SYNC.sub.-- POWEROK is negated. The bit HANG.sub.-- PEND is not negated by an ASR reboot.
The enable capture signal EN.sub.-- CAP is generated by a D-type flip-flop 490, whose D input receives the output of an AND gate 492. One input of the AND gate 492 is connected to the output of an OR gate 494, and its other input is connected to the inverted state of a signal CLR.sub.-- EN.sub.-- CAP. One input of the OR gate 494 is routed back to the signal EN.sub.-- CAP and the other input receives the signal WRT.sub.-- EN.sub.-- CAP.sub.-- 1. The flip-flop 490 is clocked by the signal PCLK and set high when the signal SYNC.sub.-- POWEROK is negated low. Once the signal EN.sub.-- CAP is set high by the software via the signal WRT.sub.-- EN.sub.-- CAP.sub.-- 1, it is maintained high. The signal CLR.sub.-- EN.sub.-- CAP is asserted to clear the signal EN.sub.-- CAP (disable capture of information), which occurs when a time-out has occurred (TIME.sub.-- OUT is high), a system error has occurred (SERR.sub.-- is low), a parity error has occurred (PERR.sub.-- is low), or an illegal bus protocol has been detected (CAP.sub.-- ILLEG.sub.-- PROT is high).
The signal CAP.sub.-- ILLEG.sub.-- PROT is generated by a D-type flip-flop 483, whose D input receives the output of an AND gate 485. One input of the AND gate receives the inverted state of the signal WRT.sub.-- EN.sub.-- CAP.sub.-- 1, and the other input receives the output of an OR gate 487. The OR gate 487 receives the signals CAP.sub.-- ILLEG.sub.-- PROT and SET.sub.-- ILLEG.sub.-- PROT. The signal SET.sub.-- ILLEG.sub.-- PROT is asserted when capture is enabled (EN.sub.-- CAP is high), the state machine 456 is not active (RCOVR.sub.-- ACTIVE is low), the bus is idle, and any of signals DEVSEL.sub.--, TRDY.sub.--, or IRDY.sub.-- is asserted low. This condition is an illegal condition, which triggers capture of the bus history and bus vector information.
Referring to FIG. 43, the bus history ready signal HIST.sub.-- RDY is generated by a D-type flip-flop 502, which is clocked by the signal PCLK and cleared by the signal RESET. The D input of the flip-flop 502 is connected to the output of an OR gate 504, whose inputs receive the signal TIME.sub.-- OUT, a signal M.sub.-- ABORT (master abort signal delayed by one PCLK), the output of an AND gate 506, and the output of an AND gate 508. The AND gate 506 asserts its output if a retry, disconnect C or target abort cycle is present on the secondary bus 32 (the signal FRAME.sub.--, the inverted state of the signal IRDY.sub.--, the inverted state of the signal STOP.sub.--, and the inverted state of the signal DSC.sub.-- A.sub.-- B are all true). The AND gate 508 asserts its output when a completed data transfer has occurred (the signals IRDY.sub.-- and TRDY.sub.-- are both low). Thus, the bus history information is loaded into the bus history FIFOs when the watch-dog timer 454 times out, a retry, disconnect C, or target abort condition is present, the master has aborted the cycle, or a cycle has successfully completed.
The valid data indication signal VALID.sub.-- DAT is generated by a D-type flip-flop 510, which is clocked by the signal PCLK and cleared by the signal RESET. The D input of the flip-flop 510 is connected to the output of a NOR gate 512, which receives the signal TIME.sub.-- OUT, master abort signal M.sub.-- ABORT, and the output of the AND gate 506. Thus, data is valid unless a time out is detected, a master abort cycle is issued, or a retry, disconnect C, or target abort cycle is present.
The signal VECT.sub.-- RDY is generated by a D type flip-flop 514, which is clocked by the signal PCLK and cleared by the signal RESET. The D input of the flip-flop 514 is connected to the output of an OR gate 516, which receives the time out signal TIME.sub.-- OUT and a signal CHANGE.sub.-- STATE indicating that one of the PCI control signals in the bus vector has changed state. Thus, the state vector information is loaded into the vector FIFOs whenever control signals on the PCI bus 32 change state or when a time-out occurred.
Referring to FIG. 44, the bus history data {BUS.sub.-- HIST.sub.-- DATA3�31:0!, BUS.sub.-- HIST.sub.-- DATA2�31:0!, BUS.sub.-- HIST.sub.-- DATA1�15:0! is provided to the input of bus history register 540, which is the first stage of the bus history FIFO. The bus history 501 provides output signals BUS.sub.-- HIST.sub.-- FIFO1�79:0!, to the register 542 (the second state of the pipeline), which provides output signals BUS.sub.-- HIST.sub.-- FIFO0�79:0!. Both bus history registers 540 and 542 are clocked by the signal PCLK and cleared when the power-good signal SYNC.sub.-- POWEROK is low.
The bus history registers 540 and 542 are loaded when the output of an AND gate 518 is driven high. The AND gate 518 receives the enable capture bit EN.sub.-- CAP and the OR of the bus history ready signal HIST.sub.-- RDY and the CAP.sub.-- ILLEG.sub.-- PROT signal (OR gate 519). The output signals BUS.sub.-- HIST.sub.-- FIFO0�79:0! and BUS.sub.-- HIST.sub.-- FIFO1�79:0! are provided to the 0 and 1 inputs, respectively, of multiplexers 520, 522, and 524. Each of the multiplexers 520, 522, and 524 is selected by a read address signal HIST.sub.-- FIFO.sub.-- RD.sub.-- ADDR (which starts out low to select the output of the bus register 502 and is toggled on each subsequent read). The multiplexers 520, 522, and 524 drive output signals BUS.sub.-- HIST.sub.-- REG3�31:0!, BUS.sub.-- HIST.sub.-- REG2�31:0!, and BUS.sub.-- HIST.sub.-- REG1�15:0!, respectively.
The bus vector data signals BUS.sub.-- VECT.sub.-- DATA�24:0! are provided to the inputs of a bus vector register 544, whose output is routed to the input of a bus vector register 546. The output of the bus vector register 546 is routed to the input of a bus vector register 548, whose output is in turn routed to the input of a bus vector register 550. Each of the bus vector registers 0-3 are clocked by the signal PCLK and cleared when the signals SYNC.sub.-- POWEROK is low. The bus vector registers are loaded when the output of the AND gate 521 is asserted high. The AND gate 521 receives the signal EN.sub.-- CAP and the OR of signals VECT.sub.-- RDY and CAP.sub.-- ILLEG.sub.-- PROT (OR gate 523). The bus vector registers 550, 548, 546 and 544 produce output signals BUS.sub.-- VECT.sub.-- FIFO0�24:0!, BUS.sub.-- VECT.sub.-- FIFO1�24:0!, BUS.sub.-- VECT.sub.-- FIFO2�24:0!, and BUS.sub.-- VECT.sub.-- FIFO3�24:0!, respectively, which are in turn provided to the 0, 1, 2, and 3 inputs of a multiplexer 526, respectively. The output of the multiplexer 526 provides signals BUS.sub.-- VECT.sub.-- REG�31:0!, with the multiplexer 526 selecting one of its inputs based on the state of address signals VECT.sub.-- FIFO.sub.-- RD.sub.-- ADDR�1:0! (which begin with a binary value 00 and is incremented on each successive read).
Thus, the bus history and bus state vector information is captured in response to assertion of signals HIST.sub.-- RDY or VECT.sub.-- RDY, respectively, or in response to assertion of the signal CAP.sub.-- ILLEG.sub.-- PROT if an illegal bus protocol condition is detected.
Expansion Card Space Reservation
Unlike conventional computer systems, in the initial configuration of the computer system 10 at power up, the CPU 14 reserves memory space and PCI bus numbers for the slots 36 that are empty (no card 807 inserted) or powered down.
As is typically done, the CPU 14 assigns bus numbers for PCI buses (e.g., PCI buses 24, 32a-b and PCI bus(es) of the cards 807 that are inserted into slots 36 and powered up) that are present when the computer system 10 is first powered up.
Each PCI-PCI bridge circuit (e.g., PCI-PCI bridge 26, 48), in its configuration register space 1252 (FIG. 49), has a subordinate bus number register 1218 and a secondary bus number register 1220. The subordinate bus number register 1218 contains a subordinate bus number which is the highest PCI bus number downstream of the PCI-PCI bridge circuit, and the secondary bus number register 1220 contains a secondary bus number which is the PCI bus number of the PCI bus immediately downstream of the PCI-PCI bridge circuit. Thus, the values stored in the subordinate 1218 and secondary 1220 bus number registers define the range of PCI bus numbers that are downstream of the PCI-PCI bridge circuit.
The configuration register space 1252 also has a primary bus number register 1222. The primary bus number register 1222 contains the number of the PCI bus located immediately upstream of the PCI-PCI bridge circuit.
The system controller/host bridge circuit 18 also has the subordinate 1218 and secondary 1220 bus number registers. After configuration, the subordinate bus number register 1218 of the circuit 18 contains the maximum PCI bus number present in the computer system. The secondary bus number register 1220 of the circuit 18 contains bus number zero, as the PCI bus immediately downstream of the circuit 18 (PCI bus 24) always is assigned bus number zero.
Unlike the known system, the CPU 14 recognizes that one of the slots 36 that is initially powered down or empty may introduce one or more additional PCI buses (present on the card 807 inserted into the slot 36 initially powered down) into the computer system 10 after the computer system 10 is already powered up and configured. Accordingly, during initial configuration, the CPU 14 reserves memory space, I/O space and a predetermined number (e.g., one or three) of PCI bus numbers for any slot 36 that is powered down or empty.
Thus, PCI-PCI bridge circuits of the computer system 10 do not have to be reconfigured to accommodate the card 807 that has recently been powered up. Only the PCI-PCI bridge circuit of the card 807 that was recently powered up needs to be configured. The remainder of the computer system 10 remains unchanged.
As part of the resource reservation process, a Basic Input/Output System (BIOS) stored in the ROM 23 and shadowed (and write-protected) in the memory 20, builds a table specifying resource ranges being reserved for the slots 36. This table includes bus number, memory, and I/O resource ranges for use in configuring a PCI device that has been newly added to the system 10. The operating system uses this table to determine what resources have been reserved and what resources are available for configuring the newly added PCI devices.
As shown in FIG. 45, in a recursive PCI configuration routine called BUS.sub.-- ASSIGN, the CPU 14 assigns PCI bus numbers and programs configuration registers 1252 of the PCI-PCI bridge circuits accordingly. The CPU 14 accomplishes this by scanning one PCI bus at a time for PCI devices. The BUS.sub.-- ASSIGN routine is part of the BIOS stored in the ROM 23 and is used to initially configure the computer system 10 after power up.
The CPU 14 first sets 1000 the value of a search parameter PCI.sub.-- BUS equal to the value of another search parameter CURRENT.sub.-- PCI.sub.-- BUS and initializes 1000 search parameters FCN and DEV. The parameter PCI.sub.-- BUS indicates the bus number of the PCI bus currently being scanned by the CPU 14, and when the BUS.sub.-- ASSIGN routine is first executed by the CPU 14, the parameter PCI.sub.-- BUS indicates bus number zero.
The parameter CURRENT.sub.-- PCI.sub.-- BUS indicates the next PCI bus number available for assignment by the CPU, and when the routine BUS.sub.-- ASSIGN is first executed by the CPU 14, the parameter CURRENT.sub.-- PCI.sub.-- BUS indicates bus number zero. The parameters FCN and DEV indicate the current PCI function and PCI device, respectively, currently being scanned by the CPU 14.
The CPU 14 determines 1001 whether the parameter PCI.sub.-- BUS indicates bus number zero, and if so, the CPU 14 sets 1002 the secondary bus number register 1220 of the system controller/host bridge circuit 18 equal to zero. The CPU 14 then finds 1004 the next PCI-PCI bridge circuit or the slot 36 that is powered down or empty on the PCI bus indicated by the parameter PCI.sub.-- BUS.
For purposes of determining if the next found PCI device is a PCI-PCI bridge circuit or does not exist (a powered down or empty slot) the CPU 14 attempts to read from a value from a one word vendor ID register located in the configuration space of every PCI device. A value of "hFFFF" (where the prefix "h" denotes hexadecimal representation) is reserved and not used by any vendor. If the attempted read from the vendor ID register returns a value of "HFFFF," then this indicates no PCI device is present.
If the CPU 14 determines 1006 there are no more unfound PCI-PCI bridge circuits or slots 36 that are powered down or empty on the PCI bus indicated by the parameter PCI.sub.-- BUS, a return is made from the last call made to the BUS.sub.-- ASSIGN routine. Otherwise, the CPU 14 determines 1008 whether another PCI-PCI bridge circuit was found, and if not, the CPU 14 increments 1010 the parameter CURRENT.sub.-- PCI.sub.-- BUS, as a slot 36 that is powered down or empty was found, and finds 1004 the next PCI-PCI bridge circuit or slot 36 that is powered down or empty. Thus, by incrementing 1010 the parameter CURRENT.sub.-- PCI.sub.-- BUS, the CPU 14 effectively reserves a bus number for the slot 36 that is powered down or empty. Alternatively, the CPU 14 may reserve more than one bus number for the slot 36 that is powered down or empty.
If the CPU 14 found a PCI-PCI bridge circuit, the CPU 14 then sets 1012 the primary bus number of the PCI-PCI bridge circuit equal to the parameter CURRENT.sub.-- PCI.sub.-- BUS. The CPU 14 then increments 1014 the parameter CURRENT.sub.-- PCI.sub.-- BUS and sets 1016 the secondary bus number of the PCI-PCI bridge equal to the new bus number indicated by the parameter CURRENT.sub.-- PCI.sub.-- BUS.
The CPU 14 then sets 1018 the subordinate bus number of the found PCI-PCI bridge circuit equal to the maximum possible number of PCI buses by writing to the subordinate bus number register 1218. This value for the subordinate bus number register 1218 is temporary and allows the CPU 14 to find and program additional downstream PCI-PCI bridge circuits or slots 36 that are powered down or empty.
The CPU 14 finds additional downstream PCI-PCI bridge circuits or slots 36 that are powered down or empty by preserving 1022 the parameters PCI.sub.-- BUS, DEV and FCN and recursively calling 1022 the BUS.sub.-- ASSIGN routine. The CPU 14 then restores 1024 the values for the parameters PCI.sub.-- BUS, DEV and FCN, and returns the latest call of the BUS.sub.-- ASSIGN routine to update the parameter CURRENT.sub.-- PCI.sub.-- BUS with the next PCI bus number to be assigned by the CPU 14.
The CPU 14 then updates 1026 the subordinate bus number of the found PCI-PCI bridge by setting 1026 the subordinate bus number equal to the parameter CURRENT.sub.-- PCI.sub.-- BUS. Thus, this completes the assignment of the PCI bus number to the found PCI-PCI bridge circuit and additional downstream PCI-PCI bridge circuits and slots 36 that are powered down or empty. The CPU 14 then finds 1004 the next PCI-PCI bridge circuit or slot 36 that is powered down or empty on the PCI bus indicated by the parameter PCI.sub.-- BUS.
As shown in FIG. 46, after the PCI bus numbers are assigned, the CPU 14 executes a memory space allocation routine called MEM.sub.-- ALLOC to allocate memory space for PCI functions and slots 36 that are powered down or empty. The CPU 14 first initializes 1028 search parameters used in aiding the CPU 14 in finding the located PCI functions and slots 36 that are powered down or empty.
The CPU 14 then finds 1030 the next PCI function or slot 36 that is powered down or empty. If the CPU 14 determines 1032 that all PCI functions and all slots 36 that are powered down or empty have been allocated memory space, the CPU 14 returns from the routine MEM.sub.-- ALLOC. Otherwise, the CPU 14 determines 1032 whether a PCI function was found.
If so, the CPU 14 allocates 1038 memory resources as specified by the PCI function. Otherwise, one of the slots 36 that is powered down or empty is found, and the CPU 14 allocates 1036 a default memory size and memory alignment for the slot 36. The default memory size can either be a predetermined size determined before power up of the computer system 10 or a size determined after a determination of the memory resources required by the computer system 10.
When allocating memory space, the CPU 14 programs memory base 1212 and memory limit 1214 registers of the PCI-PCI bridge circuits that are upstream of the found PCI function. The CPU 14 also programs base address registers of the corresponding PCI devices appropriately. The CPU 14 then finds 1030 the next PCI function or slot 36 that is powered down or empty.
As shown in FIG. 47, after the PCI bus numbers are assigned, the CPU 14 executes an I/O space allocation routine called I/O.sub.-- ALLOC to allocate I/O space for PCI functions and slots 36 that are empty. The CPU 14 first initializes 1040 search parameters used in aiding the CPU 14 in finding the located PCI functions and slots 36 that powered down or empty.
The CPU 14 finds 1042 the next PCI function or slot 36 that is powered down or empty. If the CPU 14 determines 1044 that all PCI functions and slots 36 that are powered down or empty have been allocated I/O space, the CPU 14 returns from the I/O.sub.-- ALLOC routine. Otherwise, the CPU 14 determines 1044 whether a PCI function was found. If so, the CPU 14 allocates 1050 I/O resources as specified by the PCI function. Otherwise, a slot 36 that is powered down or empty was found, and the CPU 14 allocates 1048 a default I/O size and I/O alignment for the slot 36. The default I/O size can either be a predetermined size determined before power up of the computer system 10 or a size determined after a determination of the I/O resources required by the computer system 10.
When allocating I/O space, the CPU 14 programs the I/O base 1208 and limit 1210 registers of the PCI-PCI bridge circuits upstream of the PCI function or slot 36. The CPU 14 also programs base address registers of the corresponding PCI devices appropriately. The CPU 14 then finds 1042 the next PCI function or slot 36 that is powered down or empty.
As shown in FIG. 48, after initial configuration, when an interrupt is generated that indicates one of the levers 802 has opened or closed, the CPU 14 executes an interrupt service routine called CARD.sub.-- INT. The CPU 14 reads 1052 the contents of the interrupt register 800 to determine 1053 whether the lever 802 has been opened or closed. If the CPU 14 determines 1053 that the lever 802 causing the interrupt was opened, the CPU 14 returns from the routine CARD.sub.-- INT.
Otherwise, the CPU 14 writes 1054 to the slot enable register 817 and sets 1054 the SO bit to initiate the power up of the slot 36 and the card 807 inserted into the slot 36. The CPU 14 then waits (not shown) for the card 807 to power up. The CPU 14 then accesses 1055 the PCI bus on the card, if any. The CPU 14 then determines 1056 whether the card 807 that was just powered up has a PCI bus (and PCI-PCI bridge circuit). If so, the CPU 14 determines 1057 the primary, secondary and subordinate bus numbers reserved for the slot 36 in which the card 807 was powered up. The CPU 14 subsequently configures 1058 the PCI-PCI bridge circuit on the card 807 that was powered up.
The CPU 14 then determines 1060 the location and size of I/O and memory spaces reserved for the slot 36. The CPU 14 subsequently writes 1062 to base address registers in the PCI configuration header space of the card 807 that was powered up. The CPU 14 then reads 1064 an interrupt pin register in the configuration space of the card 807 to determine 1066 whether the card 807 uses interrupt requests. If so, the CPU 14 writes 1068 an interrupt line register in the configuration space of the card 807 with an assigned IRQ number.
The CPU then enables 1070 command registers of the card 870 which are located in the configuration space of the card 807 and allow the card 807 to respond to memory and I/O accesses on the PCI bus 32. The CPU 14 subsequently writes 1072 to the interrupt register 800 to clear the interrupt request and loads 1074 a software device driver for the card 807. The CPU 14 then returns from the routine CARD.sub.-- INT.
Bridge Configuration
Functionally, bridge chips 26 and 48 form a PCI-PCI bridge between PCI buses 24 and 32. However, each bridge chip includes configuration space which must be independently configured. One solution is to treat the two bridges as independent devices forming one bridge, but that would require modification of the BIOS configuration routine. The other solution is to define the cable 28 as a bus so that the configuration routine can configure the upstream bridge chip 26 as a PCI-PCI bridge between the PCI bus 24 and the cable 28, and the downstream bridge chip 48 as a PCI-PCI bridge between the cable 28 and the PCI bus 32. One advantage of this second solution is that standard PCI configuration cycles can be run to configure the bridge chips 26 and 48 as if they were two PCI-PCI bridges, when in fact the two bridge chips actually form one PCI-PCI bridge.
There are two types of configuration transactions on a PCI bus: type 0 and type 1. A type 0 configuration cycle is intended for devices on the PCI bus on which the configuration cycle is generated while a type 1 configuration cycle is targeted for devices on a secondary PCI bus accessed via a bridge. FIG. 51 illustrates the address format of the type 0 and type 1 configuration cycles. A type 0 configuration command is specified by setting PCI address bits AD�1:0! to 00 during a configuration cycle. A type 0 configuration cycle is not forwarded across a PCI-PCI bridge, but stays local on the bus on which the type 0 configuration transaction was generated.
A type 1 configuration command is specified by setting address bits AD�1:0! to binary value 01. Type 1 configuration commands can be forwarded by a PCI-PCI bridge to any level in the PCI bus hierarchy. Ultimately, a PCI-PCI bridge converts a type 1 command to a type 0 command to configure devices connected to the secondary interface of the PCI-PCI bridge.
Configuration parameters stored in the configuration registers 105 or 125 of the bridge identify the bus numbers for its primary PCI interface (primary bus number) and secondary PCI interface (secondary bus number) and a subordinate bus number that indicates the highest numbered PCI bus subordinate to the bridge. The bus numbers are set by the PCI configuration routine BUS.sub.-- ASSIGN (FIG. 45). For example, in the upstream bridge chip 26, the primary bus number is the bus number of the bus 24, the secondary bus number is the number of the cable 28, and the subordinate bus number is the number of the secondary PCI bus 32 or the number of a deeper PCI bus if one exists. In the downstream bridge chip 48, the primary bus number is the number of the cable bus 28, the secondary bus number is the number of the PCI bus 32, and the subordinate bus number is the number of a PCI bus located deeper in the PCI bus hierarchy, if one exists.
Referring to FIG. 53A, detection of configuration cycles are handled by logic in the PCI target block 103 or 121 in the upstream bridge chip 26 or downstream bridge chip 48, respectively. A type 0 configuration cycle detected on the upstream bus 24 is indicated by asserting a signal TYP0.sub.-- CFG.sub.-- CYC.sub.-- US generated by an AND gate 276. The AND gate 276 receives signals UPSTREAM.sub.-- CHIP, IDSEL (chip select during configuration transactions), CFGCMD (configuration command cycle detected) and ADDR00 (bits 1 and 0 are both zeros). A type 0 configuration cycle detected by the downstream bridge chip 48 is indicated by a signal TYP0.sub.-- CFG.sub.-- CYC.sub.-- DS generated by an AND gate 278, which receives a signal S1.sub.-- BL.sub.-- IDSEL (IDSEL signal for the downstream bridge chip 48), the signal CFGCMD, the signal ADDR00, a signal MSTR.sub.-- ACTIVE (indicating that the bridge chip 48 is the master on a secondary PCI bus 32), and the inverted state of a signal UPSTREAM.sub.-- CHIP.
Detection of a type 1 configuration cycle by the PCI target 103 in the upstream bridge chip 26 is indicated by asserting a signal TYP1.sub.-- CFG.sub.-- CYC.sub.-- US from an AND gate 280, which receives signals CFGCMD, ADDR01 (bits 1 and 0 are low and high, respectively) and UPSTREAM.sub.-- CHIP. Detection of a type 1 configuration cycle on the downstream bus 32 is indicated by asserting a signal TYP1.sub.-- CFG.sub.-- CYC.sub.-- DS from an AND gate 282, which receives the signals CFGCMD, ADDR01, and the inverted state of the signal UPSTREAM.sub.-- CHIP.
The bridge chip receiving the type 0 transaction uses the register number field 250 in the configuration transaction address to access the appropriate configuration register. The function number field 252 specifies one of eight functions to be performed in a multi-functional device during the configuration transaction. A PCI device can be multi-functional and have such functions as a hard disk drive controller, a memory controller, a bridge, and so forth.
When the bridge chip 26 sees a type 1 configuration transaction on its upstream bus 26, it can forward the transaction either downstream, translate the transaction to a type 0 transaction, convert the transaction to a special cycle, or ignore the transaction (based on the bus number parameters stored in the configuration registers 105 or 125). If a transaction is forwarded, it is up to the PCI master of the destination bridge chip to convert the type 1 transaction to the corresponding appropriate transaction. If a bridge chip handles the transaction itself, then it responds by asserting the signal DEVSEL.sub.-- on the PCI bus and handles the transaction as a normal delayed transaction.
In a type 1 configuration transaction, the bus number field 260 selects a unique PCI bus in the PCI hierarchy. PCI target block 103 passes a type 1 configuration cycle from the upstream chip 26 down to the downstream bridge chip 48 if a signal PASS.sub.-- TYP1.sub.-- DS is asserted by an AND gate 284. The AND gate 284 receives the signal TYP1.sub.-- CFG.sub.-- CYC.sub.-- US and a signal IN.sub.-- RANGE (the bus number field 260 is greater than or equal to the stored secondary bus number and less than or equal to the stored subordinate bus number). The other input of the AND gate 284 is connected to the output of an OR gate 286, which has one input connected to the output of an AND gate 288 and the other input receiving the inverted state of a signal SEC.sub.-- BUS.sub.-- MATCH. Thus, if a type 1 cycle is detected, the signal IN.sub.-- RANGE is asserted and the bus number field 260 does not match the stored secondary bus number, the signal PASS.sub.-- TYP1.sub.-- DS is asserted. If the bus field 260 does not match the stored secondary bus number, then bus devices on or below the downstream bus 32 are addressed. The AND gate 288 asserts its output high if the signal SEC.sub.-- BUS.sub.-- MATCH is asserted high and the device number field 258 indicates that the target of the type 1 configuration cycle is the configuration space of the downstream bridge chip 48. If this is true, the type 1 configuration transaction is forwarded down the cable 28 to the downstream bridge chip 48 for translation to a type 0 configuration transaction. The PCI target 121 in the downstream bridge chip 48 responds to the transaction and reads and writes the downstream bridge configuration registers 125 according to the type 0 transaction. The control pins of the downstream chip are driven and read and write data appear on the downstream PCI bus 32 as if a type 0 transaction is running on the downstream bus (for debug purposes), although each IDSEL on the downstream bus 32 is blocked so that no device actually responds to the type 0 transaction.
If the PCI target block 103 in the upstream bridge chip 26 detects a type 1 configuration transaction on its upstream bus 24, having a bus number field equal to the stored secondary bus number (the cable bus 28) but not addressing device 0 (searching for other devices on the cable bus 28), then the target block 103 ignores the transaction on the primary bus 26.
If the PCI target 121 detects a type 1 configuration write transaction (WR.sub.-- high) on the secondary PCI bus 32, which has a bus number field 260 outside the range of the secondary bus number and subordinate bus number (IN.sub.-- RANGE low), and if the device number 258, the function number 256, and the register number 254 indicate a special cycle (SP.sub.-- MATCH high), then a signal PASS.sub.-- TYP1.sub.-- US is asserted by an AND gate 290. The AND gate 290 receives the signal TYP1.sub.-- CFG.sub.-- CYC.sub.-- DS, the signal SP.sub.-- MATCH, the write/read strobe WR.sub.--, and the inverted state of the signal IN.sub.-- RANGE. When the PCI master 101 in the upstream bridge chip 26 receives such a cycle, it runs a special cycle on the primary PCI bus 24.
Configuration transactions are ignored by a bridge chip under certain conditions. If the target block 103 in the upstream bridge chip 26 detects a type 1 configuration transaction on the PCI bus 24 (its upstream bus), and the bus number field 260 is less than the secondary bus number or greater than the subordinate bus number stored in the bridge chip's configuration space, then the target block 103 ignores the transaction.
If the target block 121 in the downstream bridge chip 48 detects a type 1 configuration transaction on the secondary PCI bus 32 (its downstream bus), and the bus number field 260 is greater than or equal to the secondary bus number and less than or equal to the subordinate bus number stored in the bridge chip's configuration space, then the target block 121 ignores the transaction. In addition, type 1 configuration commands going upstream are ignored if the type 1 command does not specify a conversion to a special cycle transaction regardless of the bus number specified in the type 1 command.
Referring to FIG. 53B, the PCI master 101 or 123 watches for a configuration cycle transferred over the cable 28. If the PCI master 123 in the downstream bridge chip 48 detects a type 1 configuration transaction from the upstream bridge chip 26, it compares the bus number field 260 with the primary bus number and secondary bus number stored in the configuration space of the bridge chip 48. If the bus number field 260 matches either the stored primary bus number (i.e., cable 28) or the stored secondary bus number (addressing a device directly connected to the downstream bus 32), the downstream bridge chip 48 translates the transaction to a type 0 transaction (by setting AD�1:0!=00) as it passes the configuration transaction onto the bus. The type 0 transaction is performed on the PCI bus 32 by the PCI master block 123.
The following are translations performed of fields in the type 1 configuration transaction. The device number field 258 in the type 1 configuration transaction is decoded by the PCI master 123 to generate a unique address in the translated type 0 transaction on the secondary bus 32, as defined in table of FIG. 52. The secondary address bits AD�31:16! decoded from the device number field 258 are used by the PCI master 123 to generate the appropriate chip select signals IDSEL for the devices on the secondary PCI bus 32. When the address bit AD�15! is equal to 1, then the bridge chip 48 maintains all of address bits AD�31:16! deasserted low (no IDSEL asserted). The register number field 254 and the function number field 256 of the type 1 configuration command are passed unmodified to the type 0 configuration command. The function number field 256 selects one of eight functions, and the register number field 254 selects a double word in the configuration register space of the selected function.
For a type 1 configuration transaction targeted to the downstream bridge chip 48, the bridge chip 48 converts the type 1 transaction to a type 0 transaction as if it were addressing a device on the downstream bus 32, but the AD�31:16! pins are set to zeros so that no secondary PCI bus device receives an IDSEL. The PCI master logic 123 detects this by asserting a signal TYP1.sub.-- TO.sub.-- INT0 driven by an AND gate 262. The AND gate 262 receives a signal CFG.sub.-- CMD (indicating a configuration command cycle), the output of an OR gate 264, and the inverted state of the signal UPSTREAM.sub.-- CHIP (type-1-to-type-0 translation is disabled in the upstream bridge chip 26). The OR gate 264 asserts its output high if a signal PRIM.sub.-- BUS.sub.-- MATCH is asserted (the bus number field 260 matches the stored primary bus number), or if the stored primary bus number CFG2P.sub.-- PRIM.sub.-- BUS.sub.-- NUM�7:0! is equal to zero (indicating that the primary bus number in the configuration space of the bridge chip 48 has not been configured by the system BIOS yet and the current type 1 configuration cycle is going to the internal configuration space to program the primary bus number of the bridge chip 48).
A signal TYP1.sub.-- TO.sub.-- EXT0 is asserted by an AND gate 266 and responds to a match to the stored secondary bus number. The inputs of the AND gate 266 receive the signal CFG.sub.-- CMD, the signal SEC.sub.-- BUS.sub.-- MATCH, the inverted state of the signal UPSTREAM.sub.-- CHIP, and the inverted state of a signal SP.sub.-- MATCH (not a special cycle). The signal TYP1.sub.-- TO.sub.-- EXT0 indicates that the converted type 0 configuration transaction is targeted to a device on the secondary PCI bus 32.
The signal TYP1.sub.-- TO.sub.-- INT0 is provided to the 1 input of a 4:1 multiplexer 274. The 2 input is tied low and the 0 and 3 inputs of the multiplexer 274 receive a signal LTYP1.sub.-- TO.sub.-- INT0 from a D type flip-flop 270. The select input S1 of the multiplexer 274 receives a signal CMD.sub.-- LATCH (FRAME.sub.-- asserted for a new cycle on the PCI bus 32), and the select input S0 receives a signal P2Q.sub.-- START.sub.-- PULSE (which indicates when high that an address has been sent to the PCI bus 32). The output of the multiplexer 274 is connected to the D input of a flip-flop 270, which is clocked by the signal PCLK and cleared by the signal RESET. The IDSEL signals to the secondary bus devices are blocked by asserting a signal BLOCK.sub.-- IDSEL from an OR gate 272, which receives at its inputs signals Q2P.sub.-- AD�15! (no conversion needed according to Table 1 of the FIG. 6), TYP1.sub.-- TO.sub.-- INT0 and LTYP1.sub.-- TO.sub.-- INT0. The signal LTYP1.sub.-- TO.sub.-- INT0 extends the assertion of the signal BLOCK.sub.-- IDSEL.
If the PCI master 123 in the downstream bridge chip 48 receives a type 1 configuration transaction from the upstream bridge chip 26 in which the bus number field 260 is greater than the stored secondary bus number and less than or equal to the stored subordinate bus number, then the PCI master block 123 forwards the type 1 transaction to the secondary PCI bus 32 unchanged. Some other device on the secondary PCI bus 32, e.g., another bridge device 323 (FIG. 26B), will receive the type 1 configuration transaction and forward to its secondary bus (PCI bus 325).
A type 1 configuration transaction to special cycle translation is performed if the PCI master 123 detects a type 1 configuration write transaction from the upstream bridge chip 26 and the bus number field 260 matches the stored secondary bus number and if the device number field 258, the function number field 256, and the register number field 254 indicates a special cycle (SP.sub.-- MATCH is high). This is indicated by an AND gate 268 asserting a signal TYPE1.sub.-- TO.sub.-- SPCYC high. The AND gate 268 receives SP.sub.-- MATCH, and Q2P.sub.-- CBE.sub.-- �0! (command bit for special cycle). The data from the type 1 configuration transaction becomes the data for the special cycle on the destination bus. The address during a special cycle is ignored.
Bus Performance Monitor
The bus monitor 127 (FIG. 3) includes circuitry for storing information to calculate certain bus performance parameters. The parameters include bus utilization, bus efficiency, and read data efficiency. Bus utilization is the ratio of the time that the bus is busy performing a transaction to a predetermined global period of time. Bus efficiency is the ratio of the number of PCI clock periods actually used for data transfer to the total number of clock periods during the bus busy period. Read data efficiency is the ratio of the number of the read data bytes accessed by a device on the secondary PCI bus 32 from the delayed completion queue (DCQ) 144 (FIG. 4) to the total number of data bytes fetched for that master by the bridge chip 48. The information stored in the bus monitor 127 is retrieved by system software to calculate the desired parameters.
Referring to FIG. 54A, a global period timer 1300 (which can be 32 bits wide) counts a total period of time during which the various parameters are to be calculated. The timer 1300 is programmed to the hexadecimal value FFFFFFFF. If the PCI clock PCICLK2 is running at 33 MHz, then the timer period is approximately 2 minutes. When the timer 1300 decrements to 0, it asserts a signal GL.sub.-- TIME.sub.-- EXPIRE.
The bus monitor 127 includes 7 slot-specific bus-busy counters 1302A-G, six of the counters corresponding, respectively, to the 6 slots on the secondary PCI bus 32 and one to the SIO 50. The bus-busy counters 1302A-G are cleared when the signal GL.sub.-- TIME.sub.-- EXPIRE is asserted. Depending on which bus device has control of the secondary bus 32, the bus-busy counter 1302 increments on every PCI clock in which the secondary PCI bus FRAME.sub.-- or IRDY.sub.-- signal is asserted. The appropriate one of the seven counters is selected by one of the grant signals GNT�7:1!.sub.--. Thus, for example, the bus-busy counter 1302A is selected when the signal GNT�1!.sub.-- is asserted low, indicating that the SIO is the current master on the secondary PCI bus 32.
Seven data-cycle counters 1306A-G, corresponding, respectively, to the 6 slots on the secondary PCI bus 32 and the SIO 50, keep track of the time during which a data transfer is actually occurring between a master and a target during a transaction on the PCI bus 32. The selected data-cycle counter 1306 is incremented on every PCI clock in which the secondary bus IRDY.sub.-- and TRDY.sub.-- signals are both asserted low. The data-cycle counters 1306A-G are cleared when the signal GL.sub.-- TIME.sub.-- EXPIRE is asserted.
Six DCQ data counters 1310A-F are included in the bus monitor 127 for keeping track of the amount of data loaded into the DCQ buffers. The six DCQ data counters 1310A-F correspond to the 6 slots on the secondary PCI bus 32. The selected DCQ data counter 1310 increments on every PCI clock in which delayed read completion (DRC) data is received from the cable 28 and loaded into the prefetch buffers.
Another set of counters, DCQ-data-used counters 1314A-F, are used to keep track of the amount of data loaded into the DCQ 144 actually used by the 6 slots on the secondary PCI bus 32. The selected DCQ-data-used counter 1314 increments on every PCI clock in which the secondary bus master reads data from the corresponding DCQ buffer. Both the DCQ-data counters 1310A-F and DCQ-data-used counters 1314A-F increment on each data cycle regardless of the number of bytes actually transferred. In most cases, the number of bytes transferred in each data cycle is 4.
When the global period timer 1300 times out and asserts the signal GL.sub.-- TIME.sub.-- EXPIRE, several events occur. First, the global period timer 1300 reloads its original count value, which is the hexadecimal value FFFFFFFF. The contents of all the other counters, including the bus-busy counters 1302A-G, data-cycle counters 1306A-G, DCQ data counters 1310A-F, and DCQ-data-used counters 1314A-F, are loaded into registers 1304, 1308, 1312, and 1316, respectively. The counters 1302, 1306, 1310, and 1314 are then cleared to 0. The global period timer 1300 then begins to count again after it is reloaded with its original value.
The signal GL.sub.-- TIME.sub.-- EXPIRE is provided to the interrupt receiving block 132, which forwards the interrupt over the cable 28 to the interrupt output block 114, which in turn generates an interrupt to the CPU 14. The CPU 14 responds to the interrupt by invoking an interrupt handler to perform the bus performance analysis. The interrupt handler accesses the contents of the registers 1304, 1308, 1312, and 1316, and calculates the several parameters, including the bus utilization, bus efficiency, and prefetch efficiency parameters associated with the 6 secondary bus slots and the SIO 50.
The bus utilization parameter is the value of the bus-busy counter 1302 divided by the initial value of the global period timer 1300, which is the hexadecimal value FFFFFFFF. Thus, bus utilization is the percentage of the total global time during which a bus master is performing a bus transaction.
A PCI transaction includes an address phase and at least one data transfer phase. A bus master asserts the signal FRAME.sub.-- to indicate the beginning and duration of an active bus transaction. When the signal FRAME.sub.-- is deasserted, that indicates the transaction is in the final data phase or the transaction has been completed. The signal IRDY.sub.-- indicates that the bus master is able to complete the current data phase of the bus transaction. During a write, the signal IRDY.sub.-- indicates that valid data is present on the bus. During a read, the signal IRDY.sub.-- indicates the master is prepared to accept read data. The addressed PCI target responds to the bus transaction by asserting the signal TRDY.sub.-- to indicate that the target is able to complete the current data phase of the transaction. During a read, the signal TRDY.sub.-- indicates that valid data is present on the bus; during a write, the signal TRDY.sub.-- indicates the target is prepared to accept data. Wait states can be inserted between the address and data phases and between consecutive data phases of the bus transaction. During the address phase or the wait states, no data transfer is actually occurring.
Actual data transfer is occurring only when both signals IRDY.sub.-- and TRDY.sub.-- are asserted low. To determine the data transfer bus efficiency, the interrupt handler divides the value of the data-cycle counter 1306 by the value of the bus-busy counter 1302. The bus efficiency represents the amount of time during which a data transfer actually occurs during a bus transaction. By calculating this value, the computer system can be made aware of target devices which require many wait states and therefore are inefficient.
The bridge chip 48 can fetch data from the primary PCI bus 26 and store the data in the DCQ 144. The DCQ 144 has eight buffers, each being assignable to a secondary bus master. For example, a memory read multiple transaction generated by a secondary bus master targeted at the primary bus will cause bridge 26, 48 to fetch 8 cache lines from the memory 20 and load into the DCQ 144. A memory read line transaction will cause the PCI-PCI bridge 26, 48 to fetch one line of data from the memory 20. In addition, as described in conjunctin with FIGS. 75 and 79, the PCI-PCI bridge 26, 48 can perform read promotion, which converts a read request from a secondary bus master to a read request for a larger block of data. In these instances, there exists a possibility that not all of the fetched data will be used by the bus master. In that case, the unread data is discarded, which reduces the read data efficiency. Measuring the read data efficiency allows system designers to understand how a bus master is utilizing read data fetched by the bridge chip 26, 48 from the primary bus 24.
Referring to FIG. 54B, the counter 1310 increments on the rising edge of the clock PCLK if the signal DCQ.sub.-- DATA.sub.-- RECEIVED�X!, X=2-7, is asserted, indicating that four bytes of data are being received by a DCQ buffer associated with master X from the cable 28. The counter 1310 outputs count value DCQ.sub.-- DATA�X!�20:0!, X=2-7, which is cleared to zero when the signal GL.sub.-- TIME.sub.-- EXPIRE is asserted.
The counter 1314 increments on the rising edge of the clock PCLK if a signal DCQ.sub.-- DATA.sub.-- TAKEN�X!, X=2-7, is asserted, indicating that four bytes of data are read from a DCQ buffer associated with master X. The counter 1314 is cleared when the signal GL.sub.-- TIME.sub.-- EXPIRE is high.
To determine the amount of the DCQ data that is actually used by the devices on the secondary PCI bus 32, the prefetch efficiency is calculated by the interrupt handler. This is determined by taking the ratio of the value in the DCQ-data-used counter 1314 to the value in the DCQ data counter 1310. Even though not all data transferred into or out of the prefetch buffers are 4 bytes wide, that ratio is closely approximated by assuming that every data phase transfers the same number of bytes.
In response to the calculated parameters, a user or the computer manufacturer can better understand computer system performance. For example, if bus efficiency is low, then the PCI device involved could be replaced with a different part by the computer manufacturer. Knowing the DCQ read data efficiency allows the computer manufacturer to change its DCQ fetch algorithm to better improve efficiency.
Using Subordinate Bus Devices
As shown in FIG. 88, six expansion cards inserted into the six expansion cards slots 36a-f introduce bus devices 1704-1708 that are subordinate to the CPU 14 and bus devices 1701-1702 that are subordinate to an I.sub.2 O processor 1700. Although all of the subordinate bus devices 1701-1708 are connected to the common PCI bus 32, the I.sub.2 O subordinate devices 1701-1702 appear to the CPU 14 to only be addressable through the I.sub.2 O processor 1700 and not directly addressable via the PCI bus 32. Therefore, the PCI bus 32 serves as both an I.sub.2 O subordinate device bus and a CPU 14 subordinate device bus.
For purposes of preventing the CPU 14 from recognizing the I.sub.2 O subordinate devices 1701-1702 as PCI bus 32 devices, the bridge chip 48 includes logic 1710 (FIG. 90) for preventing the I.sub.2 O subordinate devices 1701-1702 from responding to configuration cycles run by the CPU 14. The expansion box 30 also includes multiplexing circuitry 1712 which cooperates with the interrupt receiving block 132 of the bridge chip 48 to mask interrupt requests originating with the I.sub.2 O subordinate devices 1701-1702 from propagating to the CPU 14. Interrupt requests originating with I.sub.2 O subordinate bus devices 1701-1702 are redirected by the interrupt receiving block 132 to the I.sub.2 O processor 1700. The I.sub.2 O processor 1700 configures the I.sub.2 O subordinate devices 1701-1702; receives and processes interrupt requests originating from the I.sub.2 O subordinate devices 1701-1702; and controls operation of the I.sub.2 O subordinate devices as directed by the CPU 14.
After power up of the computer system 10 and when a card 807 is powered up (i.e., a new bus device is introduced on the PCI bus 32), the I.sub.2 O processor 1700 scans the PCI bus 32 to identify I.sub.2 O subordinate bus devices. For purposes of identifying the type of bus device (I.sub.2 O subordinate bus device or CPU 14 subordinate device), the I.sub.2 O processor 1700 runs configuration cycles on the PCI bus 32 to read the device identification word (Device ID) of each bus device. The Device ID is located in the configuration header space of all PCI devices. The I.sub.2 O processor 1700 stores the results of this scan in a six bit I.sub.2 O subordinate register 1729 (FIG. 93) inside the I.sub.2 O processor 1700 which is accessible by the CPU 14. Bits zero through five of the register 1729 are associated with slots 36a-f, respectively. A value of "1" for a bit indicates the associated slot 36 has a bus device subordinate to the CPU 14 and a value of "0" for a bit indicates the associated slot 36 has a bus device subordinate to the I.sub.2 O processor 1700.
The I.sub.2 O processor 1700 can be inserted into any of the slots 36a-f. For purposes of identifying which slot 36, if any, contains an I.sub.2 O processor, the CPU 14 scans the PCI bus 32 and reads the Device ID of the bus devices connected to the bus 32. The CPU 14 does not attempt to configure any devices 1704-1708 on the bus 32 until a host configuration enable bit 1726 (FIG. 94) inside the I.sub.2 O processor 1700 indicates to the CPU 14 that the I.sub.2 O processor 1700 has completed its identification of I.sub.2 O subordinate devices 1701-1702 on the bus 32. The host configuration enable bit 1726 has a value of "0" (value at power up) to disable configuration of the devices on the bus 32 by the CPU 14 and a value of "1" to enable configuration of the CPU 14 subordinate devices 1704-1708 on the bus 32. When the CPU 14 does configure bus devices on the bus 32, the CPU 14 does not "see" the I.sub.2 O subordinate device 1701-1702 because of the masking by the logic 1710, as described below.
After the host enable configuration bit 1726 is set, the CPU 14 reads the contents of the I.sub.2 O subordinate register 1729 and transfers the read contents to a six bit I.sub.2 O subordinate register 1728 (FIG. 91) of the bridge chip 48. The register 1728 indicates the subordinate status (I.sub.2 O processor 1700 subordinate or CPU 14 subordinate) of the bus devices in the same manner as the register 1729. Before the CPU 14 writes to the register 1728, the register 1728 contains all ones (value at power up) which allows the CPU 14 to scan the bus 32 for the I.sub.2 O processor 1700. The interrupt receiving block 132 uses the register 1728 to identify which interrupt requests received by the block 132 should be routed to the CPU 14 and which interrupt requests received by the block 132 should be routed to the I.sub.2 O processor 1700 for processing. Furthermore, the logic 1710 uses the contents of the register 1728 to block recognition by the CPU 14 of the I.sub.2 O subordinate devices 1701-1702 from the CPU 14.
For purposes of indicating to the interrupt receiving block 132, which bus device, if any, is an I.sub.2 O processor, the CPU 14 sets one bit of an I.sub.2 O slot register 1730 (FIG. 92) whose bits 0-5 correspond to the slots 36a-f, respectively. For this register 1730, located inside the bridge chip 48, a value of "0" for a bit indicates the associated slot 36 does not have an I.sub.2 O processor and a value of "1" for the bit indicates the associated slot 36 has an I.sub.2 O processor.
As shown in FIG. 90, the logic 1710 includes a multi-bit AND gate 1711 which furnishes signals AD.sub.-- IDSEL�5:0! to address/data lines of the bus 32 to select devices on the bus 32 during configuration cycles. The AND gate 1711 receives a six bit signal ENABLE�5:0! having bits indicative of and corresponding to bits of the I.sub.2 O subordinate register 1728. The AND gate 1711 also receives the typical identification select signals SLOT.sub.-- IDSEL�5:0! furnished by the bridge chip 48 for selecting devices on the bus 32 during configuration cycles. Therefore, the signals ENABLE�5:0! are used to selectively mask the signals SLOT.sub.-- IDSEL�5:0! from the PCI bus 32 when configuration cycles are run by the CPU 14.
For purposes of controlling the destination of interrupt requests from the slots 36a-d, the four standard PCI interrupt request signals (INTA#, INTB#, INTC# and INTD#) provided by each slot 36 are furnished to multiplexing circuitry 1712 (FIG. 88). The multiplexing circuitry 1712 serializes the PCI interrupt request signals received from the slots 36 and furnishes the signals to the interrupt receiving block 132 via four time multiplexed serial interrupt request signals: INTSDA#, INTDSB#, INTSDC#, and INTSDD#.
As shown in FIG. 89, the interrupt receiving block 132 furnishes interrupt request signals for the CPU 14 to the interrupt output block 114 via a time multiplexed serial interrupt request signal INTSDCABLE#. The interrupt receiving block 132 furnishes interrupt request signals for the I.sub.2 O processor 1700 via a time multiplexed serial interrupt request signal INTSDIIO# furnished via a PCI INTC# line 1709 of the bus 32 to the I.sub.2 O processor 1700
The interrupt output block 114 furnishes the interrupt requests destined for the CPU 14 to one or more of the standard PCI interrupt request lines (INTA#, INTB#, INTC#, and INTD#) of the PCI bus 24. An interrupt controller 1900, external to the bridge chip 26, receives the interrupt requests from the PCI interrupt request lines of the PCI bus 24. The interrupt controller 1900 prioritizes the interrupt requests (which may include interrupt requests from other devices on the PCI bus 24) and furnishes them to the CPU 14. The interrupt output block 114 may either asynchronously (when in an asynchronous mode) furnish the interrupt request signals to the interrupt request lines of the PCI bus 24 or serially (when in a serial mode) furnish the interrupt request signals to the INTA# line of the PCI bus 24, as further described below.
As shown in FIG. 95, all of the time multiplexed serial data signals represent their data via an interrupt cycle 1850 which comprises eight successive time slices (T0-T7). The duration of each time slice is one cycle of the PCI clock signal CLK. Each time slice represents a "snapshot" of the status of one or more interrupt request signals. As shown in FIG. 99, the signal INTSDA# represents the sampled INTA# interrupt request signals from the slots 36a-f. The signal INTSDB# represents the sampled INTB# interrupt request signals from the slots 36a-f. The signal INTSDC# represents the sampled INTC# interrupt request signals from the slots 36a-f. The signal INTSDD# represents the sampled INTD# interrupt request signals from the slots 36a-f.
For purposes of combining the interrupt signals INTSDA#-D# into the signal INTSDIIO#, the interrupt receiving block 132 logically ANDs the signals INTSDA#-D# together while simultaneously masking interrupt request signals destined for the CPU 14. Similarly, for purposes of combining the interrupt signals INTSDA#-D# into the signal INTSDCABLE#, the interrupt receiving block 132 logically ANDs the signals INTSDA#-D# together while simultaneously masking interrupt request signals destined for the CPU 14.
For the purpose of instructing the interrupt output block 114 when another interrupt cycle 1850 is beginning, the interrupt receiving block 132 furnishes a synchronization signal INTSYNCCABLE# to the interrupt output block 114. The falling, or negative, edge of the signal INTSYNCCABLE# indicates that time slice T0 of the interrupt cycle 1850 transmitted via the signal INTSDCABLE# is beginning on the next positive edge of the CLK signal. A signal INTSYNCIIO# is used in an analogous fashion to indicate an upcoming time slice T0 of the interrupt cycle 1850 transmitted via the signal INTSDIIO#. The signal INTSYNCIIO# is furnished by the interrupt receiving block 132 to the I.sub.2 O processor 1700 via a PCI INTD# line 1713 of the bus 32. For the purpose of instructing the multiplexing circuitry 1712 when to transmit another interrupt cycle 1850 via the interrupt signals INTSDA#-D#, the interrupt receiving block 132 furnishes a synchronization signal INTSYNC# to the multiplexing circuitry 1712. The falling, or negative, edge of the signal INTSYNC# indicates the muliplexing circuitry 1712 should being transmitting time slice T0 of the signals INTSDA#-D# on the next positive edge of the CLK signal.
As shown in FIG. 96, the multiplexing circuitry 1712 includes four multiplexers 1741-1744 which furnish the signals INTSDA#, INTSDB#, INTSDC# and INTSDD#, respectively. The select inputs of the multiplexers 1741-1744 receive a time slice signal SLICEIN�2:0! which is used to indicate the time slices T0-T7 of the signals INTSDA#-D#. The INTA-D# interrupt request signals from the slots 36 are furnished to the inputs of the multiplexers 1741-1744, respectively.
The signal SLICEIN�2:0! is furnished by the output of a three bit counter 1745 that is clocked on the positive edge of the PCI clock signal CLK. The interrupt synchronization signal INTSYNC# is received by a clocked enable input of the counter 1745. On the negative edge of the signal INTSYNC#, the counter 1745 resets to zero (SLICEIN�2:0! equals zero). The counter 1745 increments the value indicated by the SLICEIN�2:0! signal until the SLICEIN�2:0! signal is equal to "7" where it remains until the counter 1745 is once again reset by the INTSYNC# signal.
As shown in FIG. 97A, for purposes of tracking the time slices T0-T7, the interrupt receiving block 132 includes a three bit counter 1750 that is clocked on the positive edge of the CLK signal. The counter 1750 furnishes an output signal SL1�2:0! which is received by the select input of a 3.times.8 decoder 1752. The decoder 1752 furnishes an eight bit signal G.sub.-- CNTR�7:0! with the asserted bit of the signal G.sub.-- CNTR�7:0! indicating the time slice of the signals INTSDIIO# and INTSDCABLE#.
The INTSYNC# signal is furnished by the output of an inverter 1754 that receives the most significant bit of the G.sub.-- CNTR�7:0! signal, G.sub.-- CNTR�7!. Although the INTSYNC# signal is pulsed low during the time slice T7, the interrupt receiving block 132 could alternatively wait several cycles of the CLK signal after ending an interrupt cycle 1850 before pulsing the INTSYNC# signal low. The signals INTSYNCCABLE# and INTSYNCIIO# are both provided by the output of an inverter 1755 which receives the bit G.sub.-- CNTR�0!.
An additional interrupt request signal CAY.sub.-- INT# for the CPU 14 is provided by the SIO circuit 50. The CAY.sub.-- INT# signal is logically ANDed with the INTSDA#-D# signals during time slice T0. The CAY.sub.-- INT# signal is furnished by the output of an AND gate 1756 which receives a SIO.sub.-- CMPL# signal, the SI.sub.-- INTR# signal, and an I.sup.2 C.sub.-- INT# signal. The SIO.sub.-- CMPL# signal is asserted, or driven low, when the SIO circuit 50 has completed a serial output process. The I.sup.2 C.sub.-- INT# signal is asserted, or driven low, to indicate completion of a transaction over an I.sup.2 C bus (not shown) connected to the bridge chip 48. The I.sub.2 C.sub.-- INT# signal is deasserted, or driven high, otherwise.
For purposes of masking interrupt requests, the interrupt receiving block 132 generates four masking signals: MASKA, MASKB, MASKC and MASKD. When the MASKA signal is asserted, or driven high, during a particular time slice (T0-T7) of the signal INTSDA#, an interrupt request indicated by the serial interrupt signal INTSDA# during that particular time slice is masked from the CPU 14. If the MASKA signal is deasserted, or driven low, during the particular time slice, the interrupt request indicated by the serial interrupt signal INTSDA# is masked from the I.sub.2 O processor 1700. The MASKB-D signals function similarly to mask interrupt requests furnished by the signals INTSDB#-D#.
As shown in FIG. 97B, a multiplexer 1758 furnishes the MASKA signal. The select input of the multiplexer 1758 receives the SL1�2:0! signal. The eight inputs of the multiplexer 1758 receive inverted IIO.sub.-- SUB�5:0! signals which are indicative of corresponding bits of the I.sub.2 O subordinate register 1728. The signals IIO.sub.-- SUB�5:0! are connected to the appropriate inputs of the multiplexer 1758 so that when the INTSDA# signal indicates the interrupt status for a particular slot 36, the MASKA signal concurrently indicates the associated bit of the register 1728 for that slot 36. Three other multiplexers 1760, 1762, and 1764 furnish the signals MASKB, MASKC and MASKD, respectively. Similar to the generation of the MASKA signal, the signals IIO.sub.-- SUB�5:0! are connected to the appropriate inputs of multiplexers 1760, 1762, and 1764 so that the MASKB, MASKC and MASKD signals indicate the bit of the register 1728 associated with the slot represented by the signals INTSDB#, INTSDC#, and INTSDD#. The multiplexers 1760-1764 receive the signal SL1�2:0! at their select inputs.
As shown in FIG. 97C, the interrupt receiving block 132 also includes two multiplexers 1768 and 1770 which furnish two masking signals, IIOTS.sub.-- D and IIOTS.sub.-- C, used to mask the INTD# and INTC# signals furnished by the slot interrupt lines of the I.sub.2 O processor 1700 because the lines 1709 and 1713 are used to furnish the signals INTSDIIO# and INTSYNCIIO#, respectively, to the I.sub.2 O processor 1700. The select inputs of both multiplexers 1768 and 1770 receive the signal SL1�2:0!, and the signal inputs of the multiplexers 1768 and 1770 receive signals IIOSLOT�5:0! which are indicative of the corresponding bits of the I.sub.2 O slot register 1730. The signals IIOSLOT�5:0! are connected to the appropriate inputs of multiplexers 1768 and 1770 so that when the INTSDC#-D# signals indicate the interrupt status for a particular slot 36, the IIOSLOT�5:0! signal selected by the multiplexers 1768 and 1770 concurrently indicate the associated bit of the register 1730 for that slot 36.
As shown in FIG. 97D, six AND gates 1772-1782 are used to combine the signals INTSDA#-INTSDD# and mask selected interrupt request signals from the CPU 14. The AND gate 1772 receives an inverted ECC.sub.-- ERR.sub.-- DOWN# signal (asserted to indicate an error detected by the chip 48b in cable transmissions) and the bit G.sub.-- CNTRL�0!. The AND gate 1774 receives an inverted INTSDA# signal and the MASKA signal. The AND gate 1776 receives an inverted INTSDB# signal and the MASKB signal. The AND gate 1778 receives an inverted INTSDC# signal, the MASKC signal and the IIOTS.sub.-- C signal. The AND gate 1780 receives an inverted INTSDC# signal, the MASKD signal, and the IIOTS.sub.-- D signal. The AND gate 1782 receives an inverted CAY.sub.-- INT signal and the G.sub.-- CNTRL signal.
The outputs of the AND gates 1772-1782 are connected as inputs to an OR gate 1784 which has its output connected to the signal input of a D-type flip-flop 1786. The flip-flop 1786 is clocked on the positive edge of the CLK signal, and the set input of the flip-flop 1786 receives the RST signal. The inverting output of the flip-flop 1786 furnishes the INTSDCABLE# signal.
Four AND gates 1790-1796 are used to combine the INTSDA#-D# signals and mask selected interrupt request signals from the I.sub.2 O processor 1700. The AND gate 1790 receives an inverted INTSDA# signal and an inverted MASKA signal. Another input of the AND gate 1790 is connected to the output of a NOR gate 1802 which masks the INTSDA# signal during the time slices T0 and T7 because no card interrupt requests are include in these time slices. The NOR gate 1802 receives the bits G.sub.-- CNTRL�0! and G.sub.-- CNTRL�7!. The AND gate 1792 receives an inverted INTSDB# signal and an inverted MASKB signal. Another input of the AND gate 1792 is connected to the output of a NOR gate 1804 which masks the INTSDB# signal during the time slices T1 and T4 because no card interrupt requests are include in these time slices. The NOR gate 1802 receives the bits G.sub.-- CNTRL�1! and G.sub.-- CNTRL�4!.
The AND gate 1794 receives an inverted INTSDC# signal and an inverted MASKC signal. Another input of the AND gate 1794 is connected to the output of a NOR gate 1806 which masks the INTSDC# signal during the time slices T2 and T5 because no card interrupt requests are include in these time slices. The NOR gate 1806 receives the bits G.sub.-- CNTRL�2! and G.sub.-- CNTRL�5!. The AND gate 1796 receives an inverted INTSDD# signal and an inverted MASKD signal. Another input of the AND gate 1796 is connected to the output of a NOR gate 1808 which masks the INTSDD# signal during the time slices T3 and T6 because no card interrupt requests are include in these time slices. The NOR gate 1808 receives the bits G.sub.-- CNTRL�3! and G.sub.-- CNTRL�6!.
The outputs of the AND gates 1790-1796 are connected as inputs to an OR gate 1798 which has its output connected to the signal input of a D-type flip-flop 1800. The flip-flop 1800 is clocked on the positive edge of the CLK signal, and the set input of the flip-flop 1800 receives the RST signal. The inverting output of the flip-flop 1800 furnishes the INTSDIIO# signal.
As shown in FIG. 98, the interrupt output block 114 includes a three bit counter 1820 of common design with the counter 1745. The counter 1820 is clocked on the positive edge of the signal CLK, furnishes an output signal G.sub.-- CNTR2�2:0!, and begins counting from zero to seven after being reset by the INTSYNC# signal.
For purposes of furnishing the INTSYNCCPU# signal, the interrupt output block 114 includes a D-type flip-flop 1822 that is clocked on the positive edge of the CLK signal. The set input of the flip-flop 1822 receives the RST signal, and the signal input of the flip-flop 1822 receives the INTSYNCCABLE# signal. The non-inverting output of the flip-flop 1822 furnishes the INTSYNCCPU# signal.
For purposes of furnishing the INTSDCPU# signal, the interrupt output block 114 includes a D-type flip-flop 1824 that is clocked on the positive edge of the CLK signal. The set input of the flip-flop 1824 receives the RST signal, and the signal input of the flip-flop 1824 receives the INTSDCABLE# signal. The non-inverting output of the flip-flop 1824 furnishes the INTSDCPU# signal.
The interrupt requests received by the interrupt receiving block 114 are furnished to the interrupt controller 1900 either asynchronously or serially. In the asynchronous mode, the interrupt requests are mapped to the four PCI interrupt lines (commonly referred to as a "barber poling") on the PCI bus 24 as shown in FIG. 100.
For purposes of holding the interrupt information provided by the INTSDCABLE# signal, the interrupt output block 114 includes an eight bit register 1826. All signal inputs receive the INTSDCABLE# signal. The load enable inputs of bits 0-7 receive the bits G.sub.-- CNTR�0!-G.sub.-- CNTR�7!, respectively. Therefore, for example, during time slice T4, bit 3 is loaded with the value represented by the INTSDCABLE# signal. Bits 0 (represented by a INT.sub.-- A1 signal) and 4 (represented by a INT.sub.-- A2 signal) are mapped into a CPUINTA# signal. Bits 1 (represented by a INT.sub.-- B1 signal) and 5 (represented by a INT.sub.-- B2 signal) are mapped into a CPUINTB# signal. Bits 2 (represented by a INT.sub.-- C1 signal) and 6 (represented by a INT.sub.-- C2 signal) are mapped into a CPUINTC# signal. Bits 3 (represented by a INT.sub.-- D1 signal) and 7 (represented by a INT.sub.-- D2 signal) are mapped into a CPUINTD# signal.
Four OR gates 1828-1834 furnish the signals CPUINTA#, CPUINTB#, CPUINTC#, and CPUINTD#, which are provided to the PCI interrupt lines INTA#, INTB#, INTC# and INTD#, respectively, of the PCI bus 24. The OR gate 1828 has one input connected to the output of an AND gate 1836. The AND gate receives an inverted CM signal. The signal CM is furnished by a bit of a configuration register of the bridge chip 26 and is asserted, or driven high, to indicate the asynchronous mode and deasserted, or driven low, to indicate the synchronous mode. The AND gate 1836 also receives the signal INT.sub.-- A1, the signal INT.sub.-- A2, and a signal ECC.sub.-- ERR.sub.-- UP (used to indicate an error in cable transmissions).
The OR gate 1828 has an input connected to the output of an AND gate 1838. The AND gate 1838 receives the CM signal and the INTSDCPU# signal. Another input of the AND gate 1838 is connected to the output of an OR gate 1848. The OR gate 1848 receives the ECC.sub.-- ERR.sub.-- UP signal and the bit G.sub.-- CNTR2�0!.
The OR gate 1830 has one input connected to the output of an AND gate 1840 and one input connected to the output of an AND gate 1842. The AND gate 1840 receives an inverted CM signal, the signal INT.sub.-- B1, and the signal INT.sub.-- B2. The AND gate 1842 receives the signal CM and an inverted bit G.sub.-- CNTR2�0! (used to provide the "sync" signal to the interrupt controller 1900 during the serial mode).
The OR gate 1832 has one input connected to the output of an AND gate 1844 and one input receiving the CM signal. The AND gate 1844 receives an inverted CM signal, the INT.sub.-- C1 signal, and the INT.sub.-- C2 signal. The OR gate 1834 has one input connected to the output of an AND gate 1846 and one input receiving the CM signal. The AND gate 1846 receives an inverted CM signal, the INT.sub.-- D1 signal, and the INT.sub.-- D2 signal.
Host Switching
Referring to FIG. 102A, to improve fault tolerance in a network 5, two servers are used: a primary server 10A and a recovery server 10B, both connected to the network 5. The two servers can have identical hardware configurations, with the primary server 10A connected to an expansion card 46A (main active card) and the recovery server 10B connected to an expansion card 46B (standby card) for communication to the secondary PCI bus 32.
Referring to FIG. 102B, the secondary PCI bus 32 is further connected to a SCSI controller 1360, which is coupled to a mass storage system 1360 through a SCSI connector 1362. The SCSI controller 1360 controls communication between the secondary PCI bus 32 and the storage system 1364, which can include hard disk drives.
Referring to FIG. 103, a failover recovery block 1322 in the bridge chip 48 can switch the downstream PCI bus 32 from the failed server 10A to the standby server 10B. The PCI expansion box 30 is thus "hot-removed" from the failed server and "hot-added" to the surviving server. In normal operation, the primary server 10A is in control of the downstream PCI bus 32. The standby server 10B listens for a periodic "heartbeat" message from the primary server 10A via a serial cable 1320 (FIG. 102A) for indicating that the primary server is operating properly. When the standby server detects a loss of the heartbeat message from the primary server 10A, it will take over control of the downstream PCI bus 32 by setting a fail control bit in the standby bridge chip 48B, which causes the failover recovery block 1322B to assert the signal FAILOVER.sub.-- to activate the standby bridge chip 48B and disable the primary bridge chip 48A.
Each bridge chip 48 has two sub-modes: main active and standby. In the main active mode, the bridge chip 48 is functional and capable of driving all of its outputs. In the standby mode, the bridge chip 48 floats all of its outputs which are connected to the PCI bus 32. However, the standby bridge chip 48 does not float sideband signals such as I.sup.2 C interface signals, the power good/PLL lock indication signal, and JTAG signals, which allow the standby server 10B to check its communication with the standby bridge chip 48, to test the standby bridge chip 48, or to access devices on the I.sup.2 C bus (not shown).
The power-up mode of the bridge chip 48 is determined by the slot in which it is inserted. Slot 36A is the main slot (which has the STANDBY.sub.-- signal pulled up through a resistor 1326) and slot 36F is the standby slot (which has the STANDBY.sub.-- signal pulled low through a resistor 1324). The STANDBY.sub.-- signal is sampled by the failover recovery block 1322 on the falling edge of the RESET signal after system reset.
The signal FAILOVER.sub.-- is an output of a bridge chip 48 when the bridge chip 48 is in standby mode, and it is an input when the bridge chip 48 is in main active mode. If the standby bridge chip 48B needs to switch to main active mode in response to a failed primary server, the failover recovery block 1322B drives the FAILOVER.sub.-- signal active (low), drives the FAILOVER.sub.-- signal back high, and then floats it. The standby bridge chip 48B then switches to main active mode and enables its outputs.
When the main active bridge chip 48A detects the FAILOVER.sub.-- signal going active, the main active bridge chip 48A switches to standby mode and floats its outputs.
A miscellaneous feature control register 1323A or 1323B (in the configuration space 125 of the bridge chip 48) is used to control the mode of the PCI-PCI bridge chip. When the primary server 10A fails, the standby server 10B initiates the failover process by setting high a failover control bit FAIL.sub.-- CNTL in the miscellaneous feature control register 1323. This causes the standby bridge chip 48B to drive its FAILOVER.sub.-- output active (low). When the main active bridge chip 48A senses its FAILOVER.sub.-- input low, it switches to the standby mode and floats its outputs. Then one PCI clock period later, the standby bridge chip 48B switches to the main active mode and takes control of the downstream PCI bus 32 by driving its outputs.
Referring to FIG. 105, the failover recovery block 1322 (FIG. 103) of each bridge chip 48 includes a failover state machine 1330 for controlling the switch over if the primary server 10A fails. The signal FAILOVER.sub.-- is driven by a tri-state buffer 1332, whose input receives a signal FAILOVER.sub.-- from the failover state machine 1330. The signal FAILOVER.sub.-- is driven low by the standby bridge chip 48B to switch the main active bridge chip 48A to standby mode. The signal FAILOVER.sub.-- is a bi-directional signal, with the main active bridge chip 48 receiving the signal and the standby chip 48 outputting the signal. The tri-state buffer 1332 is controlled by a signal FAILOVER.sub.-- ENA.sub.--. The signal FAILOVERO.sub.-- is controlled by the failover state machine 1330 and responds to the configuration fail control bit FAIL.sub.-- CNTL in the miscellaneous feature control register 1323.
The bridge chip 48 samples the FAILOVER.sub.-- signal when it is in main active mode. The failover state machine 1330 generates a signal MASK for masking the FAILOVER.sub.-- signal if the bridge chip 48 is in standby mode. The signal MASK is provided to one input of an OR gate 1334, whose other input receives the signal FAILOVER.sub.--. The output of the OR gate 1334 is connected to the D input of a D-type flip flop 1336A clocked on the rising edge of the signal PCLK. The output of the flip flop 1336A is provided to the D input of a D-type flip flop 1336B, also clocked by PCLK, whose output is provided to one input of an AND gate 1338. The other inputs of the AND gate 1338 receive the signal FAILOVER.sub.-- and the output of the OR gate 1334. The output of the AND gate 1338 is connected to one input of an OR gate 1340, whose other input receives the signal MASK. The output of the OR gate 1340 drives a signal M.sub.-- F.sub.-- OVER.sub.--, which is the synchronized and masked version of the signal FAILOVER.sub.--. The signal M.sub.-- F.sub.-- OVER.sub.-- is provided back to an input of the failover state machine 1330.
The signal STANDBY.sub.-- is written to a status register in the miscellaneous feature control register 1323 for indicating to software if the bridge chip 48 is in a standby slot or a primary slot on the PCI bus 32. The failover state machine 1330 also drives a signal MODE for loading into a status bit of the miscellaneous feature control register 1323. If the signal MODE is high, that indicates the bridge chip 48 is in the active state. If the signal MODE is low, that indicates the bridge chip 48 is in standby state, and its outputs are all tri-stated. The failover state machine 1330 also provides the signal CLEAR.sub.-- CNTL to clear the FAIL.sub.-- CNTL bit in the register 1323.
Referring also to FIG. 106, the failover state machine 1330 begins in state INIT on assertion of the RESET signal. In the standby bridge chip 48B (STANDBY.sub.-- =0) the state machine 1330 transitions to state STBY1. In the primary bridge chip 48A (STANDBY.sub.-- =1), the state machine 1330 transitions from state INIT to state MAIN1.
In state INIT, signals FAILOVERO.sub.-- and FAILOVER.sub.-- ENA.sub.-- are deasserted high, and the MASK and CLR.sub.-- CNTL signals are asserted high. In the ensuing description, the signals retain their states unless otherwise indicated.
In the transition from state INIT to state MAIN1, the signals MASK and CLR.sub.-- CNTL are driven low, and the signal MODE is set high to indicate main active mode. In the transition from state INIT to state STBY1, the signal MODE is set low to indicate standby mode, and the signal CLR.sub.-- CNTL is driven low.
In state STBY1, the state machine 1300 drives the signal FAILOVER.sub.-- ENA.sub.-- low to drive the signal FAILOVER.sub.-- high. The standby bridge chip 48B remains in standby mode until software in the standby server 10B sets the signal FAIL.sub.-- CNTL in response to detection of a failed primary server 10A. Upon assertion of the signal FAIL.sub.-- CNTL, the state machine 1330 transitions to state STBY2, asserting the signals FAILOVERO.sub.-- and FAILOVER.sub.-- ENA.sub.-- to drive the signal FAILOVER.sub.-- low. Because the MASK signal is high in states STBY1 and STBY2, the standby failover recovery block 1322 does not detect its own assertion of the FAILOVER.sub.-- signal.
On the next PCLK clock, the state machine transitions from the state STBY2 to STBY3. In the transition, the signal FAILOVERO.sub.-- is driven back high, and the signal CLR.sub.-- CNTL is driven high to clear the FAIL.sub.-- CNTL bit in the miscellaneous feature control register 1323. The state machine next transitions to state MAIN1, asserting the signal MODE high to indicate main active mode. Further, in state MAIN1, the signals MASK and CLR.sub.-- CNTL are deasserted low and the signal FAILOVER.sub.-- ENA.sub.-- is deasserted high to disable the tri-state buffer 1332. In state MAIN1, the standby bridge chip has successfully transitioned to main active mode.
In the main active bridge chip, the failover state machine 1330 starts in state MAIN1, where it remains until it detects assertion of the signal M.sub.-- F.sub.-- OVER.sub.--. If the signal M.sub.-- F.sub.-- OVER.sub.-- is driven low in response to the standby bridge chip 48B asserting the signal FAILOVER.sub.--, then the state machine transitions to state MAIN2. The signal MODE is set low to indicate standby mode and the signals MASK and CLR.sub.-- CNTL are driven high. From state MAIN2, the state machine transitions to state STBY1, where the signal CLR.sub.-- CNTL is deasserted low and the signal FAILOVER.sub.-- ENA.sub.-- is asserted low to enable the tri-state buffer 1332.
Both the primary server 10A and the standby server 10B are connected to the network 5 using standard network interfaces for any of a wide variety of networks, such as Ethernet. The primary server 10A and the standby server 10B are further connected to each other by the serial link 1320, which can be a standard serial link for a personal computer and could be connected to COM ports on the primary server 10A and the standby server 10B. Although the serial link 1320 has been disclosed, a parallel link, fiber optic link, or any of a wide variety links could instead be used.
Because only one of the two servers 10A or 10B will be acting as a server on the network 5 at any one time, the expansion box 30 can switch between the two expansion cards 48A and 48B. During normal operation, the primary server 10A periodically sends a "heartbeat" message to the standby server 10B over the serial link 1320. The standby server 10B monitors for this heartbeat. If the standby server 10B does not periodically receive that heartbeat, it knows that the primary server 10A has failed. It then writes the fail control bit to the miscellaneous feature control register 1323B in the bridge chip 48B to switch the secondary PCI bus 32 from the primary server 10A to the secondary 10B. The standby server 10B then reboots the full NOS which is loaded onto the storage system 1364. The standby server 10B then acts in place of the primary server 10A on the network 5.
According to a further embodiment of the invention, once the failed primary server 10A is repaired and restarted, its Power On Self Test ("POST") code then passes a command over the serial link 1320 to the standby server 10B that forces the standby server 10B to shut down. Both the primary server 10A and standby server 10B include power-on self test, or "POST," code in their system read only memory. This code is preferably identical, as will be discussed below in conjunction with the discussions of FIGS. 107A-C. In the disclosed embodiment, the NOS is not on a local drive of the standby server 10B or the primary server 10A, but is instead located on the storage system 1364. Therefore, the standby server 10B and the primary server 10A will be executing the same code when they boot the NOS from the storage system 1364.
In an alternative embodiment, instead of sending a heartbeat over the serial link 1320, the primary server 10A sends its heartbeat to the standby server 10B over the network 5 itself. The standby server 10B in this case must be running an operating system sufficient to monitor network packages passed over the network 5, but otherwise acts the same as the system described in FIG. 102A.
Referring to FIG. 102C, another embodiment according to the invention is shown. This embodiment involves a single standby server 10B acting as a backup to primary servers 10C, 10D, and 10E. The three primary servers 10C-E are configured similarly to the primary server 10A of FIG. 102A. The first primary server 10C is connected via a first cable 28C to a first expansion box 30C, the second primary server 10D is connected via a second cable 28D to a second expansion box 30D, and the third primary server 10E is connected via a third cable 28E to an expansion box 30E. The three expansion boxes 30C-E are similar to the expansion box 30 of FIG. 102A. The first, second and third primary servers 10C-E are connected to the single standby servers via serial links 1320C-E to the single standby server 10B. The single standby server 10B differs from the standby server 10B of FIG. 102A in that it has three expansion cards 46C, 46D and 46E connected to the expansion boxes 30C, 30D and 30E over cables 28F, 28G and 28H, respectively. The three primary servers 10C-E and the single standby server 10B are all connected to the network 5 by connections not shown in FIG. 102C. (In an alternative embodiment, the system of FIG. 102C omits the serial links 1320C, 1320D and 1320E, and instead communicate "heartbeats" over the network 5).
The system of FIG. 102C provides the single standby server 10B as a backup to all three of the primary servers 10C-E. In operation, each of the primary servers 10C-E provides a heartbeat to the single standby server 10B over the serial links 1320C-E (or over the network in the alternatively described embodiment). The first expansion boxes 30C-E are connected to the primary servers 10C-E, respectively, during normal operation. Should any of the primary servers 10C-E fail, the single standby server 10B will cease receiving heartbeats from that particular server. It will then write a control bit to the command register of the corresponding expansion box 30C, 30D, or 30E. The single standby server 10B will then boot the NOS located on the storage system 1364 of the switched expansion box 30C, 30D, or 30E, and then act as a network server in place of the failed primary server 10C, 10D, or 10E. In alternative embodiment, the single standby server 200 is further connected to additional primary servers and expansion boxes.
Referring to FIG. 104, a block diagram of the software that controls the system of FIG. 102A is shown. The primary server 10A is preferably running a network operating system (NOS) such as Novell Netware or Windows NT by Microsoft Corporation, although a wide variety of NOSs could be used. One of the applications running in the primary server 10A is a NOS health driver 1372. This is a routine that is periodically called by the system software in the NOS of the primary server 10A. This software checks the "health" of the system, and logs errors and performs shutdowns when there are problems with the primary server 10A. Such software is further described in Assignee's U.S. Pat. No. 5,390,324, issued Feb. 14, 1995, and entitled "Computer Failure Recovery and Alert System," which is hereby incorporated by reference. The NOS health driver 300 software specific to the disclosed embodiment is further described below in conjunction with the discussions of FIGS. 108-110.
The standby server 10B includes Power On Self Test ("POST") code 1370. Code for the NOS health driver 1372 is initially found in the storage system 1364, while the POST code 1370 is included in non-volatile memory of both the primary server 10A and the standby server 10B. While the primary server 10A is operational, it is executing the NOS health driver code 1372, and while the standby server 10B is acting in its corresponding standby role, the standby server 10B is executing the POST code 1370. The POST code 1370, generally contained in the system Read Only Memory (ROM), is executed until a failure of the primary server 10A is detected.
Referring to FIGS. 107A-107D, a flow chart illustrating the POST code 1370 is shown. The POST code is stored in the flash EEPROM 23 ("Electrically Erasable Read Only Memory") in both the primary server 10A and the standby server 10B. Again, identical POST code is preferably executed by both the primary server 10A and the standby server 10B.
Certain "environmental variables," or EVs, are used by this code. An EV is preferably held in the non-volatile memory 70 that is preserved even when the power is shut down in the system. Certain of these EVs are initially set during system configuration, and four EVs are of primary interest.
The first is the global enable EV. The global enable EV determines whether the system as a whole is configured to run in a primary-standby mode in which host switching can be performed if the primary server 10A fails. The global enable EV should be identically set in both the primary server 10A and the standby server 10B.
The next EV is the primary EV. The primary EV, when set, indicates that the server on which the software is running is the primary server 10A. Similarly, if not set, this indicates that the software is running on the standby server 10B. In this way, the software illustrated in FIGS. 107A-107D, as well as FIGS. 108-110 discussed below, knows whether it is running on the primary server 10A or the standby server 10B.
The next EV of interest is the status EV. The status EV in general indicates whether the standby server 10B is currently operating in its standby mode, monitoring the operation of the primary server 10A. As discussed above, the primary server 10A periodically sends a heartbeat signal to the standby server 10B. If the standby server 10B does not receive such a signal within a predetermined length of time, it assumes that the primary server 10A has failed. If the status EV is reset, the standby server 10B ignores a failure of the primary server 10A to send a heartbeat signal. This could occur, for example, when the primary server 10A is performing system maintenance in which it cannot send the periodic heartbeat signal.
The status EV has a slightly different meaning in the primary server 10A as compared to the standby server 10B. On the primary server 10A, the status EV is set during system operation when the primary server 10A is sending heartbeat signals. The status EV has a further meaning to the primary server 10A on initialization, however. On a graceful power down, such as a user initiated shutdown, the primary server 10A resets the status EV. When the primary server 102 is rebooted, it examines the status EV. If the status EV is not reset, this indicates a non-graceful, or catastrophic, failure occurred, causing the previous restart of the primary server 10A. In such a case, appropriate action must be taken to ensure the primary server 10A is working correctly.
On the standby server 10B, the status EV is set when the standby server 10B is monitoring the primary server 10A. The primary server 10A can cause the standby server 10B to reset its status EV by a command to the standby server 10B. On system restart, if the status EV is set on the standby server 10B, this indicates that when the standby server 10B was previously shut down, it had taken over command from the primary server 10A. Unless the primary server 10A reinstitutes sending heartbeat messages, the standby server 10B will once again take over processing from the primary server 10A. Otherwise, the standby server 10B was not previously monitoring for heartbeats from the primary server 10A, so it will instead simply try to reestablish serial communications with the primary server 10A.
The final EV of interest is the ASR EV, or the automatic server recovery EV. Automatic server recovery is a recovery system for use in servers that is further described in U.S. Pat. No. 5,390,324, previously incorporated by reference. ASR employs an ASR timer 72. When a server NOS fails to reset that ASR timer 72 within a predetermined period of time, the ASR timer 72 times out, causing a system shutdown as well as the recordation of certain errors in a critical error log. This is further described in the incorporated patent. The ASR EV indicates whether the last shutdown was due to an ASR time out, indicating catastrophic failure of some sort. Of note, the ASR EV remains set if a system failure causes an ASR shutdown. The POST code can use the state of the ASR EV to determine if the standby server 10B experienced a non-graceful shutdown, usually caused by an ASR restart, or by a temporary power failure followed by a restart.
Of note, the ASR EV is only set by a NOS; the POST code does not modify the ASR EV. Thus, if the ASR EV is set on the standby server 10B, this indicates the standby server 10B was previously running the NOS and had experienced a non-graceful, ASR shutdown followed by a reboot. This would be true if the standby server 10B had taken over control from the primary server 10A when the standby server 10B was last running.
In FIG. 107A, the POST code 1370 begins at step 1400 when the power is turned on. Proceeding to step 1402, the POST code 1370 determines whether the global enable EV is set. If not, this indicates that standby server monitoring is currently not being used, so the routine proceeds to step 1404, where the system executes other, unrelated POST code and boots normally.
If at step 1402 the global enable EV is set, control proceeds to step 1406, where the POST code 1370 determines whether the primary EV is set. If so, this indicates that the POST code 1370 of FIGS. 107A-107D is running on the primary server 10A. Control then proceeds to step 1408, where the POST code 1370 determines whether the status EV is set. If not, this indicates the last shutdown of the primary server 10A was graceful, so there is no need to alert the user of a previous failure. Therefore, control proceeds to step 1410 where the POST code 1370 determines whether the expansion box 30 is connected. If so, control then proceeds to step 1412, where the primary server 10A normally boots the NOS. If at step 1410, the expansion box 30 was determined to be absent, control proceeds to step 1414, where the primary server 10A indicates a non-system disk or a POST error, so the user must hit a key before continuing. The user may, for example, have neglected to turn on the expansion box 30.
If at step 1408 it was determined that the status EV was set, this indicates the previous primary server 10A shutdown was non-graceful. Control then proceeds to step 1416, where the user is advised to run diagnostics and also requested to hit a keyboard character to continue. Proceeding to step 1418, if the user did not hit a keyboard response, control loops back to step 1416. Otherwise from step 1418 control proceeds to step 1420, where the status EV is cleared, and then to step 1412 where the primary server 10A boots. The status EV will subsequently be set by the software illustrated in FIG. 108, discussed below.
If at step 1406 it was determined that the primary EV was not set, control proceeds to step 1422. This would occur when this POST code 1370 is running on the standby server 10B. At step 1422, a failover timer for the standby server 10B is initialized. This failover timer is a countdown timer that unless periodically reset in response to a heartbeat from the primary server 10A will cause the standby server 10B to instruct the expansion box 30 to switch expansion cards on the PCI bus 32, to boot the NOS from the storage system 1364, and to assume the server operations of the primary server 10A. To initialize the failover timer, the timer is simply loaded with the current time. Then, if a predetermined period of time, such as one minute, passes without the primary server 10A sending a heartbeat message to the standby server 10B, this timer will lag the present time as indicated by a real time clock on the standby server 10B and will time out, causing the standby server 10B to take over control from the primary server 10A.
From step 1422, the POST code 1370 then proceeds to step 1424 in FIG. 107B. At step 1424, the POST code 1370 determines whether there is a cable fault on the serial link 1320, either at the standby server 10B end or the primary server 10A end. If there is a cable fault, control proceeds to step 1426 where a message is displayed indicating that cable fault, the timer is reset to prevent an inadvertent timeout, and control then loops to step 1424.
If at step 1424 it was determined that there was no cable fault, control then proceeds to step 1428, where the standby server 10B determines whether a serial ATN, or attention, sequence has been received from the primary server 10A over the serial link 1320. If so, this indicates the primary server 10A has sent a message, which is handled by the software of FIG. 107C discussed below. If not, control then proceeds to step 1430, where the standby server 10B determines whether its status EV is set. If the status EV is not set, then the standby server 10B is presently not timing heartbeats from the primary server 10A. Control then proceeds to step 1432, where a message is displayed indicating that the standby server 10B is attempting to establish serial communications with the primary server 10A, but that the user can cause the standby server 10B to assume control from the primary server 10A by pressing a key. Proceeding to step 1434, if the user did hit a special key, control proceeds to step 1462 in FIG. 107C discussed below, where the standby server 10B switches the expansion box 30 and boots the NOS. Otherwise control proceeds from step 1434 to step 1424, where the loop is repeated.
If the status EV was determined to be set at step 1430, the standby server 10B is presently timing heartbeats from the primary server 10A. In that case, control proceeds from step 1430 to step 1436, where it is determined whether the last reset of the standby server 10B was due to an ASR timeout, or automatic server recovery timeout. This is determined by examining the ASR EV. If this is true, then when the standby server 10B was last running, it must have been running the NOS rather than simply running in the POST code 1370. This could only be true if it had assumed control from the primary server 10A. Therefore, the standby server 10B should boot the NOS immediately, so control proceeds from step 1436 to step 1438, where the timer is reset so that it does not inadvertently time out, and then control proceeds to step 1480 in FIG. 107D, where control will be switched from the primary server 10A to the standby server 10B and the NOS will be booted.
If at step 1436 the last reset was not caused by an ASR timeout, control proceeds to step 1440, where a message is displayed indicating that the user can hit a key to switch to the secondary server 10B and boot the NOS. Proceeding to step 1442, if the timer count has expired, or if the user has hit a special key to switch and boot, control proceeds to step 1438, where the timer count is again reset, and control will proceed to booting. If the timer has not expired at step 1442, control proceeds to step 1424 to repeat the loop.
Referring to FIG. 107C, two portions of the POST code 1370 are shown. The first processes a serial command received from the primary server 10A at step 1428 of FIG. 107B, and the second is a switch now and boot command that is entered from step 1438 or 1434 in FIG. 107B, or from step 1460 of FIG. 107C. Communication packets can be provided over the serial link 1320 in the disclosed embodiment. These communication packets take the following form: ATN �Command! ET.
"ATN" is the attention portion of the communication packet, and "ET" is the end of transmission portion. The "�Command!" portion contains the command being communicated between the primary server 10A and the standby server 10B. In the disclosed embodiment, the following commands are used:
______________________________________Command Description______________________________________104 Positive acknowledgement of a transmission (i.e., "ten-four")NEG Negative acknowledgement of a transmissionDSS Disable standby server 10BAST Activate standby server 10B heartbeat timerTIK Heartbeat commandSWN Switch the expansion box 30 and boot______________________________________
These commands will be further described in conjunction with FIG. 107C.
From step 1428 (FIG. 107B), control proceeds to step 1450, a case statement based on the serial command received from the primary server 10A. Control branches from step 1450 to either step 1452, 1454, 1456, 1458 or 1460 depending on the command received.
Control proceeds to step 1452 if a "DSS", or disable standby server, command has been sent. At step 1452, the failover timer is disabled. This is done by both setting the failover timer to the current time and clearing the status EV. Clearing the status EV has the effect of disabling the failover timer. This is because at step 1430 in FIG. 107B, control will not proceed to steps 1436 and 1442, which check the failover timer and then switch and boot if the appropriate amount of time has passed. Instead, control will proceed from step 1430 to step 1432, where the user is asked if a switch to the standby server is desired. Thus, the "DSS" command prevents the standby server 10B from seizing control from the primary server 10A.
Control proceeds to step 1454 on an "AST", or activate standby timer, command. In this case, the status EV is set, indicating that heartbeat commands must be sent from the primary server 10A to avoid a timeout, and the failover timer is initialized with the current time to prevent an inadvertent timeout.
Control proceeds from step 1450 to step 1456 if the command from the primary server 10A was not recognized. At step 1456, the standby server 10B sends a "NEG", or negative acknowledge, command causing the primary server 10A to resend the previous command.
Control proceeds to step 1458 on receipt of a "TIK", or heartbeat. At step 1458, the failover timer is reset with the current time, causing the timeout period to restart. If the failover timer is periodically "tickled" by the heartbeat, the timer count at step 1442 will not have expired, and therefore the secondary server 10A will not switch the expansion box cards 46A and 46B in the expansion box 30 and then boot the NOS.
Control proceeds to step 1460 on an "SWN", or switch now, command. From step 1460 control proceeds to step 1480 in FIG. 107D to begin the switchover process.
From steps 1434 and 1438 in FIG. 107B, control proceeds to step 1464, where the POST code 1370 starts a 21-second timer and prompts the user to confirm the switchover. If 21-second elapses without confirmation, control proceeds back to step 1424 of FIG. 107B. If confirmation is entered by the user, the control proceeds to step 1480 in FIG. 107C.
From steps 1452, 1454, 1456, and 1458, control loops back to step 1424 in FIG. 107B. Although not shown, steps 1452, 1454, 1458, and 1460 further send a "104", or acknowledge, command to the primary server 10A, indicating a successful receipt of a transmitted packet.
Referring to FIG. 107D, before the failover control bit FAIL.sub.-- CNTL in the miscellaneous feature control register 1323 is set, the POST code 1370 reads 1480 the insolation-in-progress EV from an I.sup.2 C EEPROM (not shown), accessible from the I.sup.2 C controller 126 of the bridge chip 48B, to determine which slots are currently enabled. Based on the retrieved value, the appropriate bits in the slot enable register 817 are set 1482, along with the SO bit in the SIO control register 814 (FIG. 29) to initiate the required power up and power down sequence. After the BS bit in the serial input byte register 812 is cleared, the POST code 1370 sets 1484 failover control bit FAIL.sub.-- CNTL to 1 in the bridge chip 48B.
The standby bridge chip 48B maintains the slots which were left on by the failing host because one of the last things the failing host may have done was to detect a faulty board in a slot (e.g., the board which caused the crash) and turned it off. Thus, according to the contents of the isolation-in-progress EV, identified faulty slots are maintained powered off by setting corresponding bits in the slot enable register 817 of the SIO 50.
Setting the values of the slot enable register 817 and the SO bit in the standby bridge chip 48B ensures that the original value of the standby bridge chip's slot enable register 817 does not cause any slot to be sequenced on (or off) when it is already on (or off). The POST code 137 can also read the failover status bits in the register 1323 to determine the slot type (STANDBY.sub.-- high or low) and the mode of the bridge chip 48 (MODE high or low). Next, the POST code 1370 performs all necessary pre-boot initializations on the PCI bus 32 before initiating 1488 the boot process.
Referring to FIGS. 108-110, flowcharts are shown of the code executed by the NOS to periodically send a heartbeat to the secondary server 10A. Again, both the primary server 10B and the secondary server 10A execute this code because both boot the NOS from the storage system 1364, but as will be seen, a number of steps are bypassed when the code is running on the standby server 10B.
The software of FIGS. 108-110 is preferably implemented as tasks in the NOS. On Netware, these would be implemented as NLMs, or netware loadable modules. In Windows NT, these would be implemented as system services. Either way, these routines are periodically called by the NOS through what is known as the "health driver," described in U.S. Pat. No. 5,390,324, which was previously incorporated by reference. Referring to FIG. 108, a heartbeat initialization routine 1500 is called on the first entry into the health driver. Proceeding to step 1502, it is determined whether the global enable EV is set. If not, then secondary server monitoring is not implemented, so control proceeds to step 1504, where normal health driver initialization functions are executed and control returns to the NOS.
If at step 1502 the global enable EV is set, control proceeds to step 1506, where it is determined whether the primary EV is set. If not, then the heartbeat initialization routine 1500 is currently executing on the standby server 10B, so control proceeds to step 1507. At step 1507, the system administrator is notified that a switch over has occurred, and the fact of the switch over is logged in any desired log files.
Control then proceeds to step 1508, where the health driver performs normal initialization code and control returns to the NOS. If the NOS software is running on the standby server 10B, there is no need to attempt to establish a serial link with the primary server 10A, because the primary server 10A is presumed not to be running.
If at step 1506 it was determined that the primary EV is set, control proceeds to step 1510 where the status EV is cleared on this server, which must be the primary server 10A. The status EV remains cleared until communications are established with the standby server 10B.
Proceeding to step 1512, the primary server 10A attempts to establish serial communications with the standby server 10B over the serial cable 1320. It sends "AST" commands, which are intended to activate the failover timer on the standby server 10B (see step 1454 of FIG. 107C). After sending an "AST" command at step 1512, control proceeds to step 1514, where the primary server 10A waits for an appropriate amount of time to determine whether the standby server 10B has sent an affirmative acknowledge command ("104"). If it has not, and the primary server 10A has sent less than a predetermined number of "AST" commands at step 1512, control loops to step 1512, where another "AST" command is sent to the standby server 10B.
If at step 1514 a predetermined number of "AST" commands have been sent at step 1512, then the heartbeat initialization routine 1500 on the primary server 10A quits attempting to establish serial communications with the standby server 10B, and instead proceeds to step 1508, where the health driver performs normal initialization and control returns to the NOS. If at step 1514 serial communications were established, as indicated by receipt of a "104" command from the standby server 10B, control proceeds to step 1516, where the status EV is set on the primary server 10A. The status EV is set to indicate that the standby server 10B is responding and is operating in it standby mode. It is now incumbent on the primary server 10A to send periodic heartbeats ("TIKs") to the standby server 10B. Referring to step 1458, FIG. 107C, such heartbeats will reset the failover timer in the standby server 10B, preventing it from switching the expansion box 30 and booting the NOS.
After setting the status EV at step 1516, control proceeds to step 1508, where normal health driver initialization functions are performed and control returns to the NOS.
Referring to FIG. 109, this flowchart illustrates a heartbeat routine 1600 that is periodically called by the health driver, which is in turn periodically called by the NOS. Control first proceeds to step 1602, where it is determined whether the global enable EV is set. If not, control proceeds to step 1604, where control returns to the health driver, where normal health driver functions are performed and then control returns to the NOS.
If the global enable EV is set at step 1602, the standby server switchover mode is enabled, so control proceeds to step 1606, where it is determined whether the primary EV is set. If not, then the heartbeat routine 1600 is currently running on the standby server 10B, so control proceeds to step 1608, where normal health driver functions are performed and then control returns to the NOS. Because the primary server 10A is not running, there is no need to attempt to communicate with the primary server 10A.
From step 1606, if the primary EV is set, then the heartbeat routine 1600 is running on the primary server 10A. Control then proceeds to step 1610, where it is determined whether the status EV is set. If the status EV is not set, control then proceeds to step 1612, because this indicates that at step 1512 and 1514 of FIG. 108, communications were not established with the standby server 10B. At step 1612, the primary server 10A again attempts to establish communications with the standby server 10B by sending "AST" commands, requesting that the standby server 10B activate its timer. Control then proceeds from step 1612 to step 1614, where, if the standby server 10B did not confirm the "AST" with a "104" command, and less than a predetermined number of attempts have been made to establish communication, control loops to step 1612. If at step 1614 a predetermined number of attempts have been made, the secondary server 10B is not responding, so control proceeds to step 1616, where the heartbeat routine 1600 exits and returns to the health driver to execute normal health driver functions. If an affirmative "10B" command was received at step 1614 from the standby server 10B, communications have been established with the standby server 10B, which is now acting in its standby role, so control proceeds to step 1618, where the status EV is set, indicating as such. From step 1618, control then proceeds to step 1616.
If at step 1610 the status EV is set, this indicates the standby server 10B is acting in its standby role and expects heartbeats from the primary server 10A. Control then proceeds to step 1620, where the standby server 10B is "tickled" with a heartbeat command ("TIK") over the serial link 1320, which, as previously discussed in conjunction with FIG. 107C at step 1458, causes the standby server 10B to reset its failover timer.
Proceeding to step 1622, if an acknowledge (i.e., "104") was received from the standby server 10B, control then proceeds to step 1616. If at step 1622 an acknowledge was not received, control proceeds to step 1624. At step 1624, the primary server 10A determines whether a cable fault has occurred on itself or on the standby server 10B. This is done using normal serial communications techniques that determine whether the serial cable 1320 is disconnected at the primary server 10A or the standby server 10B. If the cable fault is not on this server, the primary server 10A, control proceeds to step 1626, where the status EV is cleared, causing a serial retry on the next entry into the heartbeat routine 1600. On the next entry into the heartbeat routine 1600, at step 1610 control will branch to step 1612, attempting to reestablish communications with the standby server 10B. If at step 1624 it was determined that the cable fault was on the primary server 10A, control proceeds to step 1628, where a "semi-graceful" shutdown is initiated, and the cable fault is logged to a critical error log as discussed in U.S. Pat. No. 5,390,324. The shutdown is only "semi-graceful" because although the NOS is gracefully shutdown, the status EV remains set, causing a diagnostic message to appear on the primary server 10A when rebooted as discussed in step 1416 of FIG. 107A. Because the standby server 10B is not receiving heartbeats, it will take over control from the primary server 10A as discussed in FIGS. 107A-107D. For this reason, the primary server 10A is shutdown at step 1628. A graceful shutdown is initiated using a flag which will be processed in the software of FIG. 110. Control then proceeds to step 1630, where normal health driver functions are performed.
A shutdown is necessary as illustrated in steps 1624, 1628, and 1630 because the standby server 10B will not be receiving a heartbeat message, and so will boot its NOS. To avoid conflicts on the network 100, the primary server 10A must shut down its NOS and relinquish control to the standby server 10B. This shutdown further avoids data loss when the expansion box 30 switches from the primary server 10A to the standby server 10B, as it results in files being closed, caches being flushed, and the operating system being gracefully exited.
Referring to FIG. 110, a flowchart of a system shutdown routine 1700 that is entered when there is a system failure or a normal shutdown has been requested. The shutdown routine 1700 first proceeds to step 1702, in which the global enable EV is checked. If the global enable EV is not set, control proceeds to step 1704, where normal health driver functions are performed followed by an exit, which in this case will be an operating system shutdown. Of note, the status EV will remain set, causing the standby server 10B to again boot the NOS on restart unless heartbeat messages are received from the primary server 10A, as discussed above in conjunction with FIGS. 107A-107C. From step 1702, if the global enable EV is set, control proceeds to step 1706, in which the primary EV is checked. If the primary EV is not set, then the shutdown routine 1700 is operating on the standby server 10B, so no other action is needed. Therefore, control proceeds to step 1708, where normal health driver functions are performed followed by an exit, again in the form of an operating system shutdown.
If at step 1706 the primary EV is set, control then proceeds to step 1710, where the status EV is checked. If the status EV is not set, the standby server 10B is not acting in its backup role, so control proceeds to step 1712, where normal health driver functions are performed, and an exit in the form of an operating system shutdown initiated.
If at step 1710 the status EV is set, then the standby server 10B is acting in its standby role and expects heartbeats. Control proceeds to step 1714, where it is determined whether this is a graceful operating system shutdown or a "panic" shutdown. A panic shutdown would typically be in the form of an NMI which will eventually cause a timeout of the ASR timer. If the shutdown is a panic shutdown caused by an NMI (nonmaskable interrupt), control proceeds from step 1714 to step 1716, where an entry is made in the critical error log and the ASR timer 72 will then reboot the system after a predetermined period of time. Control then proceeds to step 1718, in which the shutdown routine 1700 is exited. The status EV remains set, so on the next restart, the user will be advised to run diagnostics at step 1416 discussed in conjunction with FIG. 107A. Of further note, if a truly catastrophic failure occurs in which none of the shutdown routine 1700 is executed, the standby server 10B will stop receiving periodic heartbeats from the primary server 10A, and control will be seized from the primary server 10A on a timeout of the failover timer discussed in conjunction with FIGS. 107A-107C. When the primary server 10A does reboot, the status EV will still be set, so the user will be advised to run diagnostics as illustrated in step 1416 at FIG. 107A. Further, stopping at step 1416 avoids certain "race" conditions. If the primary server 10A shut down because of a software error, it would still be able to attempt to boot after the shutdown. If the boot procedure was not halted at step 1416, the primary server 10A could conceivably attempt to again boot before the standby server 10B had timed out and attempted to boot itself, resulting in a continuing cycle of software failures followed by reboots on the primary server 10A without the standby server 10B ever seizing control.
If at step 1714 it was determined that a graceful operating system shutdown has been initiated (by a user, for example), control then proceeds to step 1720. This shutdown is truly "graceful" because the failover timer in the standby server 10B will be disabled, preventing a switch to the standby server 10B. At step 1720, the status EV is cleared on this server, so that when the primary server 10A is rebooted, control will pass from step 1408 at FIG. 107A through steps 1410 and on to step 1412. That is, the user will not be advised to run diagnostics, because there was not a system failure on the primary server 10A.
From step 1720, control proceeds to step 1722, in which the standby server 10B is disabled by the primary server 10A sending a disables standby server command ("DSS") over the serial link 1320 to the standby server 10B. This will cause the standby server 10B to reset its status EV, preventing it from automatically assuming control from the primary server 10A.
Proceeding from step 1722 to step 1724, if the "DSS" command has not been acknowledged, but the primary server 10A has not attempted to disable the standby server 10B more than a predetermined number of times, control loops back to step 1722 for another try. If at step 1724 the "DSS" command has not been acknowledged after a predetermined number of attempts, then the communication link has failed with the standby server 10B, so control proceeds to step 1718. If an affirmative response in the form of a "104" command has been received from the standby server 10B, control proceeds from step 1724 to step 1718.
The following description provides an example of system operation of the standby server 10B in conjunction with the primary server 10A. The standby server 10B will continue running its POST code 1370 described in FIGS. 107A-107D until the primary server 10A fails to send a heartbeat within a predetermined length of time, preferably one minute. At this point, the standby server 10B will set the fail control bit in the standby expansion card 46B, causing the expansion box 30 to switch from the first expansion card 46A to the second expansion card 46B. The standby server 10B will then boot the NOS from the storage system 1364 connected to the secondary PCI bus 32 and run in place of the primary server 10A until the system supervisor has performed maintenance on the primary server 10A, has gracefully shut down the standby server 10B, and has rebooted the primary server 10A followed by the standby server 10B. Upon booting the primary server 10A after such failure, the user will be advised to run diagnostics, but will then be allowed to boot the NOS. A communications link will then once again be reestablished with the standby server 10B.
Further, if the standby server 10B boots the NOS, data recovery can typically occur at three levels. First, if a "smart" storage system is used as the storage system 1364, the SCSI controller 1360 within the standby server 10B will typically attempt to rebuild any data that may have been corrupted at a storage media level. Second, a typical NOS upon startup generally examines all storage media for corruption, and attempts to recover data at the operating system level. Third, many database applications, such as Oracle, attempt to recover lost transactions at an applications level.
In addition, the standby server 10B, because it is booting identical code from the storage system 1364, appears on the network 5 in all ways identical to the primary server 10A. Thus, any other systems on the network will need no modification to continue operating in conjunction with the standby server 10B.
Finally, because the standby server 10B seizes control from the primary server 10A, system reliability is increased, because the primary server 10A does not have to perform any positive steps upon failure to effect the switch to the standby server 10B and because the primary server 10A will then have no physical access to the expansion box 30.
Alternatively, by modifying the code, the primary server 10A could resume control from the standby server 10B without shutting down the standby server 10B. This would require additional commands, for example, to be sent from the primary server 10A to the standby server 10B, instructing the standby server 10B through its health driver routines that it must shut down. The primary server 10A would then set the fail control bit FAIL.sub.-- CNTL in the expansion card 46A to switch back from the second expansion card 46B on the secondary PCI bus 32. According to the disclosed embodiment, however, this automatic resumption of service by the primary server 10A is not implemented, because the system supervisor will generally have an opportunity to shut down the standby server 10B at a predetermined time in a graceful way, such as in the evening.
Further, as discussed in conjunction with FIG. 102C, multiple serial links 1320A-C can be connected to the standby server 10B to service multiple primary servers. This could be extended to an even larger number of primary servers, although additional serial ports would be necessary unless network messages are used as heartbeats. The code can be adapted to provide for multiple primary servers. The POST code 1370 of FIGS. 107A-107D would need to be slightly modified to handle heartbeats and failover timers for multiple primary servers.
Further, the serial link 1320, could be eliminated by providing heartbeats over the network 5 itself. This could further be used for multiple servers as discussed in conjunction with FIG. 102C. In such a system, rather than implementing the standby server 10B code as the POST code 1370 a local boot drive or disk on the standby server 10B could be used that would provide a small, bootable NOS, because network driver software must be installed and running for the standby server 10B to receive such packets of information over the network 5. One of ordinary skill in the art will readily appreciate how to adapt the POST code 1370 of FIGS. 107A-107D for such a system.
Referring to FIG. 111, a typical cabling diagram for the serial link 1320 is illustrated. The receive data line (RXD) for connection to the primary server 10A is connected to the transmit data line (TXD) of the standby server 10B, and vice versa. The request to send (RTS) and clear to send (CTS) lines are looped back upon themselves. Each data terminal ready (DTR) line is connected to the opposing data set ready (DSR) and data carrier detect (DCD) lines, and the grounds (GND) are connected. This will all be understood by those of ordinary skill in the art. Further, a great variety of other types of links other than serial links could be implemented.
Other embodiments are within the scope of the following claims. For example, the expansion box 30 can include an expansion bus other then the secondary PCI bus, such as an ISA or EISA bus.

Number	Name	Date
3810120	Huettner et al.	May 1974
4047157	Jenkins	Sep 1977
4145734	Bienvenu	Mar 1979
4347563	Paredes et al.	Aug 1982
4459693	Prang et al.	Jul 1984
4514845	Starr	Apr 1985
4590554	Glazer et al.	May 1986
4710926	Brown et al.	Dec 1987
4819159	Shipley et al.	Apr 1989
4857833	Gonzalez et al.	Aug 1989
4951283	Mastrocola et al.	Aug 1990
4972457	O'Sullivan	Nov 1990
5155729	Rysko et al.	Oct 1992
5157663	Major et al.	Oct 1992
5185693	Loftis et al.	Feb 1993
5249218	Sainton	Sep 1993
5390324	Burckhartt et al.	Feb 1995
5594882	Bell	Jan 1997
5596711	Burckhartt et al.	Jan 1997
5651113	Lin et al.	Jul 1997
5664124	Katz et al.	Sep 1997

Number	Date	Country
0 057 275	Aug 1992	EPX
3-268553	Nov 1991	JPX
4-56455	Feb 1992	JPX
4-51742	Feb 1992	JPX
4-56454	Feb 1992	JPX
4-354229	Dec 1992	JPX
1 516 559	Jul 1978	GBX
2 195 192	Mar 1988	GBX

Switching control in a fault tolerant system

Information

Patent Number

Date Filed

Date Issued

Inventors

Original Assignees

Examiners

Agents

CPC

US Classifications

Field of Search

US

International Classifications

Abstract

Description

Claims

CROSS REFERENCE TO RELATED APPLICATIONS

US Referenced Citations (21)

Foreign Referenced Citations (8)

Non-Patent Literature Citations (15)

Continuation in Parts (1)

Entry
Hayes, John P., Computer Architecture and Organization, 2D Edition, pp. 185-187, 368-375, 664-679 (1988).
Vijayan, Jaikumar, Vinca, Tricord Offer Low-Cost Fault Tolerance, ComputerWorld (Mar. 13, 1995) p. 53 .COPYRGT.1995 IBM Corp.
Katz, William F., Five Fault-Tolerant Products Follow Varied Routes to Goal of Data Security, PC Week (Jun. 27, 1994) .COPYRGT.1994 Ziff-David Publishing Co.
NSI 7000 Detects and Replaced Failed Servers, PC Week (Jan. 10, 1994) .COPYRGT.1994 Ziff-David Publishing Co.
Wilson, Jayne, Third Parties Offer LAN Fault Tolerance, Infoworld (Dec. 13, 1993) .COPYRGT.1993 Inforworld Publishing Co.
Smalley, Eric, Alternative to SFT III Permits Coupling of Dissimilar Servers, PC Week (Nov. 8, 1993) .COPYRGT.1993 Ziff-Davis Publishing Co.
Rigney, Steve, Netguard's Alternative to SFT III, PC Magazine (Oct. 12, 1993) .COPYRGT.1993 Ziff-David Publishing Co.
Shimmin, Bradley F., SFT Level III Protection, But Without the Big Price Tag, LAN Times (Oct. 4, 1993) .COPYRGT.1993 McGraw-Hill, Inc.
Shimmin, Bradley F. NSI 7250 Fail-Safe Subsystem: Netguard Systems Inc., LAN Times (Oct. 4, 1993) .COPYRGT.1993 McGraw-Hill, Inc.
Francis, Bob, Compaq Takes the High End, Infoworld (/1995) .COPYRGT.1995 InfoWorld Publ. Co.
HP 9000 Corporate Business Server, .COPYRGT.1995 Hewlett-Packard Co.
Dialog Record 01804009 of Newsbytes, pNEW07060027, Jul. 6, 1995, Clarion's Model 150 Disk Array, Updated Software.
Dialog Record 01810457 of Communications Week, p. 25(2), n560, Jun. 5, 1995, Standby Server for Netware.
Dialog Record 01688632 of PC Week, V11, n25, pn1(5), Jun. 24, 1994, Five Fault-Tolerant Products Follow Varied Routes to Goal of Data Security.
U.S. Ser. No. 08/491738, Jun. 1995.