Fault and Variation Tolerant Energy and Area Efficient Links for Network-on-Chips

Description

FIELD OF INVENTION

The present invention relates to the storage and transmission of data in electrical devices. Specifically, the invention relates to methods for storing and transmitting data within Network-on-Chip architectures.

BACKGROUND

Advancements in complementary metal-oxide semiconductor (CMOS) fabrication and processing technology has allowed for shrinkage of circuit features and enabled the integration of multiple processing cores into System-on-Chip (SoC) platforms. However, feature scaling into the deep sub-micron regime has revealed interconnect design issues such as global wire delays, which do not scale as fast as gate delays, and limit the efficacy of design techniques typically used in traditional single-chip architectures. To address issues with wire delays in SoC architectures, it is possible to adopt one of a group of more flexible, scalable, packet-switched architectures, known as Network-on-Chip (NoC) or On-Chip Network (OCN).

SUMMARY

In other example implementations of methods of the first aspect, correcting an error may comprise selecting an output generated by a shadow-repeater and presenting the output of the shadow repeater at an output of the three-state repeater stage. The methods of the first aspect may further comprise transmitting a signal indicating the presence of an error from the three-state repeater stage.

In a second aspect, the invention provides methods for handling transmission errors in a Network-on-Chip architecture comprising: (i) transmitting a bit of data to a first three-state repeater, (ii) transmitting the bit of data to a second three-state repeater, (iii) detecting a difference between an output of the first three-state repeater and an output of the second three-state repeater, and (iv) selecting the output of the second three-state repeater for transmission. The methods of the second aspect may further comprise waiting during a delay period between transmitting the bit of data to the first three-state repeater and transmitting the bit of data to the second three-state repeater.

In other example implementations of the methods of the second aspect, the methods may further comprise receiving at the first three-state repeater and at the second three-state repeater a control signal transmitted by a control block. In such example implementations, the control signal transmitted by the control block may indicate a congestion status of a router within a Network-on-Chip architecture. In other example implementations, in response to receiving a control signal indicating a congestion status of a router, the first three-state repeater and the second three-state repeater may store the bit of data.

In example implementations of the methods of the third aspect, the methods may further comprise, in response to receiving the signal indicating the presence of an error within a three-state repeater stage, shifting a clock phase by 180 degrees. In such example implementations, the methods may further comprise correcting the error within a three state repeater stage. In additional example implementations of the methods of the third aspect, correcting the error within a three-state repeater stage may comprise: (i) selecting an output of a shadow-repeater in the three-state repeater stage, and (ii) overwriting the error within the three-state repeater stage with the output of the shadow-repeater in the three-state repeater stage.

BRIEF DESCRIPTION OF FIGURES

FIG. 1 depicts a schematic diagram of a fault-tolerant repeater that may be used in accordance with an aspect of the invention.

FIG. 2 depicts a schematic diagram of an inter-router link that may be used in accordance with an aspect of the invention.

FIG. 3 depicts a timing diagram depicting a dual-phase design that may be implemented in accordance with an aspect of the invention.

DETAILED DESCRIPTION OF EXAMPLE EMBODIMENTS

With technology scaling, the increased wire delays in current multi-core architectures have led to the modular and scalable packet-switched Network-on-Chip (NoC) paradigm. One of the challenges currently faced by NoC designers is that of power dissipation. Within an NoC architecture, a substantial amount of the NoC router power is consumed by the input buffers of the routers.

Current high-speed very-large-scale-integration (VLSI) designs often require the insertion of repeaters along the wires connecting routers in order to meet timing requirements and overcome the quadratic increase in delay that accompanies an increase in wire length. With rapidly diminishing feature size, inter-router links within an NoC architecture may become more susceptible to transient failures caused by coupling noise, process variations, and other sources. In the methods described herein, robust repeater designs are implemented as part of a plurality of methods for establishing fault-tolerant links capable of dynamic error correction. In addition to detecting a fault, the methods provide for sending the correct data to the next repeater stage while avoiding stalls in data flow.

Channel Buffer Implementation

In known designs, conventional repeaters are inserted along a link between routers, and arc sized and spaced according to a first-order resistor-capacitor (RC) wire delay model. In accordance with one aspect of the invention, the conventional repeaters are replaced with three-state repeaters. A single stage of the three-state repeaters comprises a three-state repeater inserted at along all of the wires within a particular link. Each such repeater stage may receive a control input for the corresponding control block. When the control input to a repeater stage is high, the repeaters in that stage function as channel buffers. When the control input to the repeater stage is low, the three-state repeaters function as conventional repeaters. Each stage can be controlled such that in the absence of congestion, the three-state repeater operates similarly to a conventional repeater—data moves through the link without being held in place by the three-state repeater. When the control block is activated in the presence of congestion, the control block can activate or tri-state the three-state repeaters.

Once activated, the three-state repeaters function as channel buffers and the data bits are held in position. Once congestion is alleviated, the control logic can be adjusted, and the three-state repeaters can function as conventional repeaters. Since the three-state repeaters can adaptively function as channel buffers, a given level of network performance can be achieved using routers with a reduced number of input buffers, effectively reducing the size and power consumption of a router.

Link Implementation

In example implementations, conventional repeaters along a link are replaced by fault-tolerant three-state repeaters. As used herein, a single “stage” of three-state repeaters comprises a three-state repeater inserted along all the wires in a given link. A stage of three-state repeaters may be controlled with signal sent from a control block. In an example implantation of a stage of three-state repeaters, the three-state repeaters function as conventional repeaters in response to receiving a low signal from a control block. In response to receiving a high signal from a control block, the three-state repeaters are tri-stated and hold the data in position at the stage of three-state repeaters.

Each three-state repeater may be protected by a shadow-repeater that captures signals with transient errors. As used herein, a shadow-repeater has the same design as the main repeater it is protecting, but receives a delayed control signal compared to the main repeater. The shadow-repeater and the main repeater have the same design in order to avoid timing difference at the output.

In example implementations involving a shadow-repeater, an output of the main repeater and an output of the shadow-repeater are comparing using a comparator or an XOR gate. If a difference between the compared repeater outputs is detected, an error is present. In response to detecting an error, a multiplexer may be used to select the output from the shadow-repeater. Since the shadow-repeater receives a delayed control signal, it is likely to be free from transient errors. After the multiplexer selects the shadow-repeater output, the corrected data can be either transmitted or held, depending on the state of the control signal.

In some example implementations of links, latches and/or clock signals are not needed as control signals for either the shadow repeater or the main repeater. In such configurations, errors in data along a link can be corrected without stalling the data or waiting for a clock signal. In other example implementations, latches or clock signals may be used as a control signal for a shadow repeater or a main repeater.

Control Block Implementation

Control blocks may be used to control both the main three-state repeater and the shadow-repeater inserted along a link between two routers. In example implementations, a single control block may be used to control the functionality of all the repeaters within a single stage of repeaters. In one example implementation of control blocks, an incoming congestion signal is delayed by one clock cycle at each control block. In the next clock cycle, the repeaters in that stage may be tri-stated, and the congestion signal may be passed to the next control block. This allows for each repeater stage to be successively tri-stated to hold the data in position until a congestion-release signal arrives. In example implementations of a control block, the control block may be configured to operate accurately at variable clock speeds. For example, a shadow flip-flop may be used to sample the congestion signal at a delayed clock, and thus catch timing errors. A control block may also be configured to use a dual-phase design, where in the presence of an error, the clock switches to the opposite phase. By switching to the opposite phase, the timing slack may be extended, to allow additional time to overwrite an erroneous signal within a repeater stage. In addition, a control block may be configured to be disabled when there is no congestion, thus reducing the power consumption of the control block.

Additional Aspects

In a first aspect, the present invention provides methods for correcting transmission errors in an Network-on-Chip architecture comprising: (i) configuring a plurality of three-state repeater stages to store data in response to receiving a control signal, (ii) detecting an error in one of the plurality of three-state repeater stages, and (iii) in response to detecting an error in a repeater stage correcting the error. Any of the three-state repeaters described herein may be used as part of a three-state repeater stage. For example, a stage may comprise a main three-state repeater and a shadow-repeater that are both electrically connected to a comparator configured to examine the outputs of the repeaters. In example implementation of the methods of the first aspect, correcting the error may comprises: (i) gating clock edge for one clock cycle, (ii) re-computing the result at each repeater stage, and (iii) replacing any errors with correct values. When the clock edge is gated, the entire link is stalled for just one clock cycle, which allows for each three-state repeater stage to detect and correct errors data during transmission, without requiring a second clock cycle to correct the errors. This stalled period also allows for each stage to recalculate its own result, thus allowing for errors that were previously forwarded to subsequent stages to be caught and corrected.

Example implementations of the methods of the first aspect may further comprise responding to detecting an error in a repeater stage by (i) shifting the clock phase by 180 degrees; and (ii) overwriting a signal with an error with a correct signal. Such implementations can be considered dual-phase implementations, and may allow for a corrected signal that arrives after an erroneous signal to have sufficient time to overwrite the erroneous signal, without requiring an additional clock cycle or further stalls in the transmission. In other example implementations of the methods of the first aspect, detecting an error in one of the plurality of three state repeater stages may comprise comparing an output generated by a first three-state repeater to an output generated a second three-state repeater. In such example implementations, the output generated by a second three-state repeater may be generated by a shadow-repeater. These outputs may be used to detect an error. For example, the outputs of both the main repeater and the shadow-repeater may be electrically coupled to inputs of a comparator and to inputs of a multiplexer. The output of the comparator may also be electrically coupled to an input of the multiplexer, allowing for the selection of the shadow-repeater output when an error is detected.

In example implementations of the methods of the second aspect, detecting a difference between an output of the first three-state repeater and an output of the second three-state repeater may comprise applying the outputs of the repeaters to input connections on a comparator. In such example implementations, the methods may further comprise transmitting an output of the comparator to a control block. In implementations where the output of the comparator is transmitted to a control block, the transmitted output may be used to trigger an action in the control block, such as the transmission of a signal instructing one or more repeater stages to cease transmitting and to hold data in place.

In additional example implementations of the methods of the second aspect, selecting the output of the second three-state repeater for transmission may comprise applying the output of the first three-state repeater to a first input connection of a multiplexer, applying the output of the second three-state repeater to a second input connection of the multiplexer, and applying an output of the comparator to a third input connection of the multiplexer. In such example implementations, the methods may further comprise configuring the multiplexer to select the output of the second three-state repeater in response to detecting an output of the comparator indicating the presence of an error. Since the transmission of data to the shadow-repeater may be slightly delayed with respect to transmission to the main repeater, the output of the shadow-repeater is less susceptible to transient errors, and thus, if there is a difference between the output of the main repeater and the shadow-repeater, it is likely that the main repeater output represents an error.

In a third aspect, the invention provides methods for controlling a three-state repeater stage in a Network-on-Chip architecture comprising: (i) receiving at a control block a signal indicating the presence of an error within a three-state repeater stage, and (ii) in response to receiving the signal indicating the presence of an error within a three-state repeater stage, transmitting a signal to a three-state repeater stage instructing the three-state repeater stage to hold the data at the three-state repeater stage in place. As described herein, the three-state repeaters may be configured such that when a high control signal is received from a control block, the repeaters are tri-stated and hold the data in place. When the three-state repeaters receive a low control signal from the control block, they may behave as conventional repeaters, and retransmit the data presented at their inputs.

EXAMPLES

Turning now to the figures, FIG. 1 depicts a schematic diagram of a fault-tolerant repeater 100 that may be used in accordance with an aspect of the invention. As shown in FIG. 1, the line marked “Data in” is electrically coupled to the inputs of the main three-state repeater 101 and the shadow-repeater 102. Both the main repeater 101 and the shadow-repeater 102 are configured to receive a signal from a control block, which can be used to instruct the repeaters to either hold or transmit the data presented at their respective inputs. The output of the main repeater 101 is electrically coupled to an input of comparator 103 and an input of multiplexer 104. Similarly, the output of shadow-repeater 102 is electrically coupled to an input of comparator 103 and multiplexer 104. Further, as shown in FIG. 1, the output of comparator 103 is electrically coupled to an input, such as a control input of multiplexer 104. The output of comparator 103 is also marked as “error,” indicating that the output can be used to signal the presence of a discrepancy between the outputs of repeaters 101 and 102, indicating the existence of an error. If an error is detected by comparator 103, it signals multiplexer 104 to output the signal received from the shadow-repeater 102, which can serve to correct the error, and prevent the propagation of the error to subsequent stages.

FIG. 2 depicts a schematic diagram of an inter-router link 200 that may be used in accordance with an aspect of the invention. In inter-router link 200 a control block 201 is used to control all of the stages of three-state repeaters 202-205 in a link between routers 206 and 207. As shown in FIG. 2, router 207 is electrically connected to control block 201 and can send several different signals to control block 201. The signal marked

“Enable” is an enable signal used to turn the control block 201 on and off. For example, when there is no congestion in the router 207, the control block 201 may be turned off to draw less power. The signal marked “Congestion” is a congestion signal, used to notify the control block 201 of a congestion status of the router 207. The signals marked with the numeral “4” comprise a plurality of signals sent from the router 207 to the control block 201 to instruct the control block to allow a particular stage to transmit data.

As shown in FIG. 2, control block 201 is also electrically coupled to each of the three-state repeater stages 202-205, and can be used to control whether the three-state repeaters in any stage store or transmit the data present at that stage. For example, the control block 201 can be used to selectively hold data in place along a link between routers 206 and 207 to allow for error correction in accordance with any of the methods described herein.

Control block 201 is also configured to receive a clock signal, marked “CLK out” from a multiplexer 208. Multiplexer 208 is configured to selectively output one of two phases of a clock signal, generated by the line marked “CLK” and inverter 209. Multiplexer 208 is also configured to accept a control signal, marked “Error Ctl” from NOR gate 210. NOR gate 210 receives at its inputs signals from each of the repeater stages 202-205, and if an signal indicating that an error is present in any of the repeater stages 202-205 is detected, NOR gate 210 is configured to cause the multiplexer 208 to switch clock phases, introducing a 180 degree shift, as described herein.

FIG. 3 depicts a timing diagram depicting a dual-phase design. In FIG. 3, the waveforms marked “first waveform” and “second waveform” are clock signals, and are offset by 180 degrees with respect to each other. During initial operation of an inter-router link, the first waveform is used as the clock. At point A, a repeater stage has detected an error, and triggered a switch to the second waveform, thus introducing a 180 degree phase shift in the clock. This extends the timing slack to allow the corrected signal to be captured, as shown at point B in FIG. 3. At point C, a successive timing error is detected, which can in turn trigger a 180 degree phase shift in the clock.

Various arrangements and embodiments in accordance with the present invention have been described herein. All embodiments of each aspect of the invention can be used with embodiments of other aspects of the invention. It will be appreciated, however, that those skilled in the art will understand that changes and modifications may be made to these arrangements and embodiments, as well as combinations of the various embodiments without departing from the true scope and spirit of the present invention, which is defined by the following claims.

Claims

1-20. (canceled)
21. A method comprising: providing a control signal to a first repeater stage and a second repeater stage, wherein the first and second repeater stages are part of a network-on-chip architecture;thereafter, detecting a first error at the first repeater stage;based at least in part on detecting the first error, reversing a phase of the control signal;after reversing the phase of the control signal, detecting a second error at the second repeater stage; andcorrecting the first and second errors.
22. The method of claim 21, wherein detecting the first error at the first repeater stage comprises receiving, from the first repeater stage, a signal indicative of the first error,and wherein detecting the second error at the second repeater stage comprises receiving, from the second repeater stage, a signal indicative of the second error.
23. The method of claim 21, further comprising, after correcting the first and second errors, again reversing the phase of the control signal so that the phase of the control signal is the same as the phase of the control signal before detecting the first error.
24. The method of claim 21, wherein the first repeater stage comprises first and second three-state repeaters,wherein the second repeater stage comprises third and fourth three-state repeaters, andwherein providing the control signal to the first and second repeater stages comprises: providing the control signal to respective control terminals of the first and third three-state repeaters; andproviding the control signal to respective input terminals of first and second delay buffers, wherein respective output terminals of the first and second delay buffers are coupled to respective control terminals of the second and fourth three-state repeaters.
25. The method of claim 24, wherein detecting the first error comprises detecting a difference in respective outputs of the first and second three-state repeaters, andwherein detecting the second error comprises detecting a difference in respective outputs of the third and fourth three-state repeaters.
26. The method of claim 25, wherein correcting the first and second errors comprises: correcting the first error by providing the respective output of the second three-state repeater to an output terminal of the first repeater stage; andcorrecting the second error by providing the respective output of the fourth three-state repeater to an output terminal of the second repeater stage.
27. A method comprising: a first control block of a network-on-chip architecture storing a first sample of a congestion signal, wherein the congestion signal indicates whether a router of the network-on-chip architecture is experiencing congestion;after storing the first sample, the first control block storing a second sample of the congestion signal;the first control block determining that the first and second samples are equal;after storing the second sample, the first control block storing a third sample of the congestion signal; andbased on determining that the first and second samples are equal, the first control block transmitting the third sample of the congestion signal to a second control block of the network-on-chip architecture.
28. The method of claim 27, further comprising the first control block transmitting the first sample to the second control block.
29. The method of claim 27, wherein the third sample indicates that the router is experiencing congestion, the method further comprising: the first control block transmitting the third sample to a repeater stage communicatively coupled to the muter; andbased on receiving the third sample from the first control block, the repeater stage storing data received at an input terminal of the repeater stage.
30. The method of claim 29, wherein the repeater stage comprises a first three-state repeater and a second three-state repeater, and wherein the repeater stage storing the data received at the input terminal of the repeater stage comprises: storing first data received at an input terminal of the first three-state repeater;thereafter, storing second data received at an input terminal of the second three-state repeater;determining that the first data is equal to the second data; andbased on determining that the first data is equal to the second data, providing the first data to an output terminal of the repeater stage.
31. The method of claim 29, wherein the repeater stage comprises a first three-state repeater and a second three-state repeater, and wherein the repeater stage storing the data received at the input terminal of the repeater stage comprises: storing first data received at an input terminal of the first three-state repeater;thereafter, storing second data received at an input terminal of the second three-state repeater;determining that the first data is unequal to the second data; andbased on determining that the first data is unequal to the second data, providing the second data to an output terminal of the repeater stage.
32. The method of claim 27, wherein the third sample indicates that the router is not experiencing congestion, the method further comprising: the first control block transmitting the third sample to a repeater stage communicatively coupled to the router; andbased on receiving the third sample from the first control block, the repeater stage continuing to transmit data received at an input terminal of the repeater stage.
33. The method of claim 27, wherein the first control block storing the first sample comprises a first repeater of the first control block storing the first sample, andwherein the first control block storing the second sample comprises a second repeater of the first control block storing the second sample, the method further comprising:prior to transmitting the third sample, the first repeater storing the third sample.
34. A method comprising: a first control block of a network-on-chip architecture storing a first sample of a congestion signal, wherein the congestion signal indicates whether a router of the network-on-chip architecture is experiencing congestion;after storing the first sample, the first control block storing a second sample of the congestion signal;the first control block determining that the first and second samples are unequal; andbased on determining that the first and second samples are unequal, the first control block transmitting the second sample to a second control block of the network-on-chip architecture.
35. The method of claim 34, wherein the second sample indicates that the router is experiencing congestion, the method further comprising: the first control block transmitting the second sample to a repeater stage communicatively coupled to the router; andbased on receiving the second sample from the first control block, the repeater stage storing data received at an input terminal of the repeater stage.
36. The method of claim 35, wherein the repeater stage comprises a first three-state repeater and a second three-state repeater, and wherein the repeater stage storing the data received at the input terminal of the repeater stage comprises: storing first data received at an input terminal of the first three-state repeater;thereafter, storing second data received at an input terminal of the second three-state repeater;determining that the first data is equal to the second data; andbased on determining that the first data is equal to the second data, providing the first data to an output terminal of the repeater stage.
37. The method of claim 35, wherein the repeater stage comprises a first three-state repeater and a second three-state repeater, and wherein the repeater stage storing the data received at the input terminal of the repeater stage comprises: storing first data received at an input terminal of the first three-state repeater;thereafter, storing second data received at an input terminal of the second three-state repeater;determining that the first data is unequal to the second data; andbased on determining that the first data is unequal to the second data, providing the second data to an output terminal of the repeater stage.
38. The method of claim 34, wherein the second sample indicates that the router is not experiencing congestion, the method further comprising: the first control block transmitting the second sample to a repeater stage communicatively coupled to the router; andbased on receiving the second sample from the first control block, the repeater stage continuing to transmit data received at an input terminal of the repeater stage.
39. The method of claim 34, wherein the first control block storing the first sample comprises a first repeater of the first control block storing the first sample, andwherein the first control block storing the second sample comprises a second repeater of the first control block storing the second sample.
40. The method of claim 34, wherein the first control block determining that the first and second samples are unequal comprises a comparator determining that the first and second samples are unequal.

CROSS-REFERENCE TO RELATED APPLICATIONS

The present patent application claims priority under 35 U.S.C. §119(c) to U.S. Provisional Patent Application Ser. No. 61/123,020 filed on Apr. 4, 2008, the entirety of which is herein incorporated by reference.

Provisional Applications (1)

	Number	Date	Country
	61123020	Apr 2008	US

Divisions (1)

	Number	Date	Country
Parent	12922948	Apr 2011	US
Child	14711469		US

Fault and Variation Tolerant Energy and Area Efficient Links for Network-on-Chips

Information

Publication Number

Date Filed

Date Published

Inventors

Original Assignees

CPC

International Classifications

Abstract

Description

Claims

CROSS-REFERENCE TO RELATED APPLICATIONS

Provisional Applications (1)

Divisions (1)