The invention in general relates to chips and their design, and in particular to systems and methods for designing integrated circuits and interconnecting functional blocks of integrated circuits.
The design of modern integrated circuits can be significantly constrained by interconnect signal propagation delays. Signal propagation delays arise due to the resistance and capacitive coupling of interconnects connecting different parts (e.g. functional blocks) of a chip, and are commonly called RC delays. RC effects can also affect the amplitude or waveshape of the transmitted signals. Addressing RC effects is becoming increasingly important as the gate counts, clock speeds and chip sizes of integrated circuits continue to grow.
Signal repeaters such as buffers or inverters can be inserted in the signal paths between different functional blocks physically situated on distant parts of a chip. Since propagation delays typically increase non-linearly (e.g. quadratically) with signal path length, inserting such repeaters reduces the time required for signals to travel between the functional blocks. Nevertheless, as chip sizes and clock speeds increase, such signal repeaters may not be adequate for meeting timing constraints imposed by functional block communications protocols. Redesigning such communications protocols and/or chip layouts can add significant complexity, time, and cost to the design of integrated circuits. For information on integrated circuits and design methods employing signal repeaters see for example U.S. Pat. Nos. 6,473,889, 6,463,574, 6,449,769, 6,412,101, 6,408,426, 6,145,116, and 6,009,253.
The present invention provides an integrated circuit comprising: a shared resource functional block (e.g. a memory controller), a plurality of agent functional blocks connected to the shared resource over dedicated packet-based buses; and a repeater including a register stage situated in a data path defined by a packet-based bus between an agent and the shared resource, for receiving a data packet on a first clock cycle, and selectively transmitting the data packet on a second clock cycle subsequent to the first clock cycle. The communications protocol between the shared functional block and each agent functional block is independent of a number of clock cycles defining a signal traveltime over the packet bus connecting the agent functional block and the shared functional block. Any number of repeaters may be inserted in the path between an agent and the shared resource without re-designing the communications protocol between the agent and the shared resource. The repeater may include or form part of a router connecting multiple agents to a common routed bus connected to a routed port of the shared resource.
The foregoing aspects and advantages of the present invention will become better understood upon reading the following detailed description and upon reference to the drawings where:
FIGS. 2-B–C are timing diagrams illustrating exemplary memory write operations according to an embodiment of the present invention.
In the following description, it is understood that all recited connections between structures can be direct connections or indirect connections through intermediary structures. A set of elements includes one or more elements. Any recitation of an element is understood to refer to at least one element. As used below, a repeater can include a router, and a router can include a repeater.
The following description illustrates embodiments of the invention by way of example and not necessarily by way of limitation.
The lengths of the various connections illustrated in
As shown in
Agents 24b–c are connected to router 32 through respective, dedicated multi-bit output packet buses 26b–c. A common, routed output multi-bit packet bus 26bc connects router 32 to repeater 34 and memory controller 22. Agents 24a–c employ packet buses 26 to transmit memory access (write and/or read) packets containing commands and/or associated data to memory controller 22. Agents 24a–c are preferably further connected to memory controller 22 through a set of corresponding subagents 36 and a common input packet bus 30. Subagents 36 are functional blocks within agents 24a–c that are capable of separately accessing data received from memory controller 22. Data transmitted over packet bus 30 can include a subagent tag identifying a subagent destination for the data. A subagent 36 may perform processing and/or route received data to other parts of its corresponding agent 24a–c. Packet bus 30 can be segmented into multiple physical stages by one or more repeaters 40, 44. Memory controller 22 employs packet bus 30 to transmit write acknowledge packets and memory read packets to agents 24a–c in response to memory access packets received over input buses 26.
The interblock communication protocols used over packet buses 26, 30 do not depend on meeting any predetermined clock cycle relationships or establishing handshakes between the agents 24a–c and memory controller 22. Agents 24a–c and memory controller 22 send data to each other as packets, which in general can take any number of clock cycles to arrive at their destination. Consequently, in general any number of repeater register stages and/or routers can be inserted into buses 26, 30 to segment the buses into shorter stages (buses), without requiring the redesign of the communications protocols used by agents 24a–c and memory controller 22. Preferably, a packet is valid (sent) for only one clock cycle. It is up to the packet's receiver to decide when a new packet has arrived, and to latch the packet.
Preferably, each packet bus 26, 30 includes multiple fields (bit ranges) for transmitting different corresponding fields of packets. In a presently preferred implementation, packets sent from agents 24a–c to memory controller 22 include a target (memory controller) tag, an opcode (operation code), and a payload, while packets sent from memory controller 22 to agents 24a–c include an agent tag, a memory controller tag, an opcode, and a payload. Input bus 30 can have a larger width than output buses 26, in order to allow the transmission of extra fields. In an exemplary implementation, each output bus 26 is 79-bit wide while input bus 30 is 81-bit wide. Preferably, routed bus 26bc has a larger width than the single-agent buses 26a–c, to allow for additional routing information to be transmitted in the packet headers transmitted by router 32. In one exemplary implementation, routed bus 26bc is 83-bit wide. Memory controller 22 then includes demultiplexing logic connected to the 2-bit routing field of routed bus 26bc, for directing incoming packets to one of four sets of input registers, each corresponding to one of four agents that could be connected to router 32. Router 32 adds a 2-bit routing tag to all incoming packets, identifying the agent corresponding to each packet. Preferably, memory controller 22 has a number of direct, single-agent (non-routed) ports, and one or more routed ports each connected to a corresponding router. Each routed port corresponds to a number (e.g. 4) of virtual unrouted ports each assigned to an agent. Thus, each agent 24a–c may be assigned a memory controller port number uniquely identifying the agent.
Preferably, each agent 24a–c is assigned a unique agent tag or address, which can be host-programmable (software-programmable) after system 20 has been designed and manufactured. An agent tag preferably includes a port tag indicating which port of memory controller 22 the agent is connected to, and a sub-agent tag used to route input data to an appropriate sub-agent 36. The sub-agent tag is received by memory controller 22 from the corresponding agent as part of the output packet's payload. Memory controller 22 associates a request packet with an agent tag based on the requesting agent's input port connection and the received sub-agent tag. A packet sent by memory controller 22 to an agent includes both an appropriate port tag and a sub-agent tag. In an exemplary implementation, each of the sub-agent tag and the port tag corresponds to a five-bit bus field, for total of 10-bits in an agent tag. Such a scheme corresponds to 32 (25) memory controller ports and 32 sub-agents per agent/port. A memory controller tag indicates which memory controller an output packet is targeting. In general, one output bus could be connected to multiple memory controllers or other shared resources. Each agent 24a–c preferably includes a programmable port register for storing the agent tag identifying a corresponding memory controller port. Allowing the agent tag to be host-programmable allows assigning a memory controller port to each agent after the design of system 20, such that port assignment changes do not require re-synthesizing a gate-level description of system 20.
Operation codes (opcodes) characterize the memory access operation corresponding to a packet. Exemplary opcodes for output (agent to controller) packets include NOP (no operation), WRITE DATA, READ MEMORY REQUEST, WRITE MEMORY REQUEST, and WRITE LAST DATA (transmitted data is the last data for a write transaction). Exemplary opcodes for input (controller to agent) packets include NOP, WRITE ACKNOWLEDGE (Ok to send data), READ ACKNOWLEDGE (different opcodes can signal whether data in payload is error-free or contains uncorrectable error), and READ LAST DATA (data in payload is the last data for a read transaction; different opcodes can signal the presence or absence of an error).
Payloads represent transmitted data, and can be dependent on the corresponding opcode. Exemplary payload components for a read request packet include sub-agent tag, memory address (address of starting memory word), and data count (number of words to be read from memory). Exemplary payload components for a write memory request packet include sub-agent tag, memory address, and data count. Exemplary payload components for a write data payload include write data byte enable and write data (the data to be written). A read acknowledge payload can include the data to be read. A write acknowledge payload can include the data count of the data to be written. As is apparent to the skilled artisan, the preceding description of packet fields is presented for illustrative purposes only. In general, other fields can be used for memory controller or other shared resource applications.
Preferably, memory controller 22 includes first-in first-out (FIFO) command and data registers for storing memory access commands received from agents 24a–c, and an agent arbiter connected to the command and data registers. The agent arbiter selects one agent 24a–c per clock cycle for providing access to memory. If the agent is requesting a read from memory, the agent arbiter receives a read command packet over its corresponding bus 26, and posts the read command to the command register. Once the read command has been completed by the memory, memory controller 22 sends the data in one or more packets over output bus 30. If the agent is requesting a write to memory, the agent posts its request over a corresponding input bus 26 and waits to receive a write acknowledge packet. When the agent arbiter has selected the agent for access to the memory, the write acknowledge packet is sent over output bus 30. The agent sends the data to be written as one or more sequential packets over its corresponding input bus 26. The write command is posted to the command register, while the corresponding write data is posted to the data register of memory controller 22. Once the agent has sent all its data, the agent considers the write command complete.
Packets received over buses 26b–c are loaded into registers 54b–c, respectively. Arbitration logic 58 arbitrates the packets, and selects one packet at a time for loading from a register 54 into register 60 one clock cycle after the packet has been loaded into the register 54. Higher priority is preferably given to write data and write last data packets than to other packets, since write packets are preferably sent only once. The selected packet is transmitted from register 60 one clock cycle after loading. Arbitration logic 58 resets each register 54, 60 after its respective packet has been transmitted. A second register 60 is preferably used in router 32 so that the transmission time between router 32 and subsequent data recipients is not dependent on any delay caused by arbitration logic 58.
In a set of steps 108a–b, the floorplan and its interconnects are evaluated to determine whether routers and/or single-agent repeaters should be placed to reduce the chip floorspace taken up by signal paths and/or to break up interconnects corresponding to signal propagation delays longer than one clock cycle. Steps 108a–b are preferably performed concurrently, but may also be performed sequentially. An engineer may inspect the floorplan to determine whether and where to add routers and/or single-agent repeaters. The evaluation can include selecting various agent groupings, identifying an optimal agent grouping, and assigning the optimal agent grouping to a router. An engineer can then determine whether to generate appropriate router and/or repeater gate-level descriptions directly, or by re-synthesizing HDL code (step 109). In the initial design stages, the router/repeater descriptions are preferably inserted at the HDL level. Preferably, steps 102–109 are performed iteratively until the system netlist is sufficiently stable, bug-free, and the physical design is satisfactory. If no additional routers/repeaters are needed, the system netlist incorporating the inserted routers and/or single-agent repeaters is then finalized (step 112), and a final floorplan is generated from the final netlist (step 114).
A designer desiring to insert routers and/or single-agent repeaters relatively late in the design process can insert gate-level router/repeater code directly into the netlist, and update the HDL system description to reflect the additions. In a set of steps 110a–b, the system netlist can be updated directly by inserting gate-level router and single-agent repeater code implementing the design choices performed in steps 108a–b. Steps 110a–b may be performed concurrently or sequentially. Steps 108a–b, 110a–b can be performed manually by an engineer, for example through an engineering change order (ECO). The system description is then finalized as described above (steps 112, 114). In a set of steps 116a–b, the HDL-level system description generated in step 102 can be manually or automatically updated to reflect the netlist changes performed in steps 110a–b, in order to maintain internal consistency between the HDL-level description and the netlist. The updated HDL-level description is preferably not re-synthesized.
Preferably, the final floorplan differs from the tentative floorplan only through the presence of the added routers and/or single-agent repeaters, and not in the sizes or positions of the various functional blocks. Routers and single-agent repeaters are typically much smaller (e.g. 102–104 smaller) in area than system functional blocks. Consequently, inserting the routers and/or single agent repeaters ordinarily does not significantly increase the die area required by the system. Moreover, if the packet-based communications protocols used between agents and shared resources are independent of the number of clock cycles needed for packet travel between source and destination, inserting routers and/or single agent repeaters (and thus adding one or more clock cycles to the packet travel time) does not require altering any agent or shared resource code or communications protocol.
It will be clear to one skilled in the art that the above embodiments may be altered in many ways without departing from the scope of the invention. Various shared resources other than memory controllers may be used, such as queue managers, control units, and any other functional blocks. An agent may also be in turn a shared resource, and a shared resource can be thought of as a type of agent. Accordingly, the scope of the invention should be determined by the following claims and their legal equivalents.
Number | Name | Date | Kind |
---|---|---|---|
4445172 | Peters et al. | Apr 1984 | A |
5418970 | Gifford | May 1995 | A |
5481743 | Baxter | Jan 1996 | A |
5481749 | Grondalski | Jan 1996 | A |
5499385 | Farmwald et al. | Mar 1996 | A |
5559970 | Sharma | Sep 1996 | A |
5574930 | Halverson et al. | Nov 1996 | A |
5590283 | Hillis et al. | Dec 1996 | A |
5598410 | Stone | Jan 1997 | A |
5603043 | Taylor et al. | Feb 1997 | A |
5671432 | Bertolet et al. | Sep 1997 | A |
5671435 | Alpert | Sep 1997 | A |
5689508 | Lyles | Nov 1997 | A |
5717871 | Hsieh et al. | Feb 1998 | A |
5726586 | Chan et al. | Mar 1998 | A |
5734334 | Hsieh et al. | Mar 1998 | A |
5751955 | Sonnier et al. | May 1998 | A |
5754877 | Hagersten et al. | May 1998 | A |
5771362 | Bartkowiak et al. | Jun 1998 | A |
5805875 | Asanovic | Sep 1998 | A |
5828858 | Athanas et al. | Oct 1998 | A |
5845102 | Miller et al. | Dec 1998 | A |
5854909 | Agrawal | Dec 1998 | A |
5905723 | Varghese et al. | May 1999 | A |
5974527 | Ko | Oct 1999 | A |
6009253 | Srivatsa et al. | Dec 1999 | A |
6026227 | Furtek et al. | Feb 2000 | A |
6035365 | Farmwald et al. | Mar 2000 | A |
6044080 | Antonov | Mar 2000 | A |
6081884 | Miller | Jun 2000 | A |
6112294 | Merchant et al. | Aug 2000 | A |
6145116 | Tawada | Nov 2000 | A |
6157955 | Narad et al. | Dec 2000 | A |
6205537 | Albonesi | Mar 2001 | B1 |
6237130 | Soman et al. | May 2001 | B1 |
6330242 | Ogawa et al. | Dec 2001 | B1 |
6378061 | Carbine et al. | Apr 2002 | B1 |
6393504 | Leung et al. | May 2002 | B1 |
6408398 | Freker et al. | Jun 2002 | B1 |
6408426 | Josephson et al. | Jun 2002 | B1 |
6412061 | Dye | Jun 2002 | B1 |
6412101 | Chang et al. | Jun 2002 | B1 |
6438585 | Mousseau et al. | Aug 2002 | B2 |
6438680 | Yamada et al. | Aug 2002 | B1 |
6446174 | Dow | Sep 2002 | B1 |
6449759 | Whitney et al. | Sep 2002 | B1 |
6463574 | Culetu et al. | Oct 2002 | B1 |
6467004 | Iwamura et al. | Oct 2002 | B1 |
6467013 | Nizar | Oct 2002 | B1 |
6473889 | Gluss et al. | Oct 2002 | B1 |
6519695 | Kostic et al. | Feb 2003 | B1 |
6542569 | Manning | Apr 2003 | B2 |
6564335 | Freker | May 2003 | B1 |
6651131 | Chong et al. | Nov 2003 | B1 |
6661788 | Angle et al. | Dec 2003 | B2 |
6675283 | Cichon | Jan 2004 | B1 |
6690659 | Ahmed et al. | Feb 2004 | B1 |
6728777 | Lee et al. | Apr 2004 | B1 |
20010042193 | Fleck et al. | Nov 2001 | A1 |
20020009095 | Van Doren et al. | Jan 2002 | A1 |
20020038339 | Xu | Mar 2002 | A1 |
20020116715 | Apostolopoulos | Aug 2002 | A1 |
20020122428 | Fan et al. | Sep 2002 | A1 |
20030088826 | Kizhepat | May 2003 | A1 |