The present invention relates to communication systems, and more particularly to a communication path that includes one or more latency-aligning transceivers.
One technique for increasing the number of memory devices that can be used in a memory system without unacceptable loss in signaling margin or frequency response is to use buffering circuits to segment the communication path into multiple smaller channels. Unfortunately, buffers add latency that can be problematic, particularly in synchronous memory systems which rely on deterministic timing relationships. For example, in some memory systems, memory operations are pipelined by transmitting commands in the intervening time between transmission of an earlier command (e.g., a read command) and responsive transmission of the corresponding data (e.g., the read data). When buffers are positioned along the channel's length, however, the time intervals between command and response transmissions vary arbitrarily depending on the positions of the addressed memory devices (i.e., memory devices positioned downstream from one or more buffers or repeaters exhibit greater effective response delay than memory devices coupled directly to the memory controller). This significantly complicates command pipelining.
Thus, it is desirable to provide a memory subsystem that can support a large number of memory devices without degrading the reliability and performance of the memory system.
A memory system including one or more transceivers with latency alignment circuitry is disclosed in various embodiments. The memory system includes a communication path that is segmented into a primary channel and one or more stick channels by appropriate placement of the latency aligning transceivers. In one embodiment, the transceivers buffer clock, control and data signals while also aligning the latency in the round-trip path between the memory controller and the stick channel driven by the transceiver to a clock cycle boundary. When memory devices that have adjustable response delays are coupled to the different stick channels in the memory system, the memory system can be configured so that the total response latency is substantially the same for each memory IC in the memory system. This simplifies command pipelining significantly, permitting commands to be packed densely within the available channel bandwidth. As discussed below, stick channels themselves can feed one or more additional transceivers, making any number of interconnection topologies possible.
These and other features and advantages of the present invention will be apparent from the accompanying drawings and from the detailed description that follows.
The present invention is illustrated by way of example, and not by way of limitation, in the figures of the accompanying drawings and in which like reference numerals refer to similar elements and in which:
In an alternative embodiment, voltage mode signaling may be used in which the master device, transceivers and memory devices output digital voltage levels to the bus to effect digital signaling. In voltage mode embodiments, the bus may be allowed to float or the bus may be pulled up or down through termination impedances.
In the embodiment of
Regardless of whether CTM 240 and CFM 250 are the same signal or separately generated, CTM 240 and CFM 250 will have a different phase relationship at different points along the primary channel due to the fact that they are traveling in different directions. For example, if CFM and CTM are in phase at master device 210, then at transceiver 220B, they will be out of phase by the amount of time it takes for CTM 240 to travel from the transceiver 220B to the master 210 plus the time it takes for CFM 250 to travel from the master 210 to the transceiver 220B. This phase difference between CTM and CFM, referred to herein as tTR, is different at each point along the primary channel.
Each of transceivers 220A-220C serves as a bi-directional repeater between a host channel (i.e., a channel used to deliver signals from the master device 210) and at least one stick channel. More specifically, transceiver 220B serves as a bi-directional repeater between host channel 215 (the primary channel) and stick channel 275C; transceiver 220C serves as a bi-directional repeater between host channel 275C and stick channel 275D; and transceiver 220A serves as a bi-directional repeater between host channel 215 and each of stick channels 275A and 275B. In one embodiment, each of the transceivers 220A-220D provides regenerative gain and drive capability and resynchronizes signal transmissions between the clock domain of the host channel and the stick channel. It should be noted that the channel topology depicted in
By using transceivers 220A-220D to segment the overall communication path into multiple segments, the resistive and capacitive loading of any given length of the communication path may be kept below a tolerable threshold. This permits the communication path to be extended to support more memory devices without unacceptable loss of signal margin due to resistive or capacitive loading.
Although each of transceivers 220A-220C is shown in
In one embodiment, each of the transceivers uses the clock signals that correspond to its host channel to generate one or more clock signals for the stick channel (or channels) that it serves. For example, transceiver 220B generates a clock signal “clock-to-end” (CTE) 270C based on clock signals CTM 240 and CFM 250. CTE 270C is folded back at the end of stick channel 275C to provide clock signal “clock-to-transceiver” (CTT) 280C, which in turn is used to generate clock signal “clock-from-transceiver (CFT) 290C. Similarly, transceiver 220C generates clock signals CTE 270D, CTT 280D and CFT 290D based on clock signals CTT 280C and CFT 290C, and transceiver 220A generates clock signals CTE 270A, CTT 280A, CFT 290A, CTE 270B, CTT 280B and CFT 290B from clock signals CTM 240 and CFM 250.
The relationship between CTM 240 and CFM 250 described above applies to the clock signals CTT and CFT generated for each stick channel. For example, in the embodiment of
Regardless of whether CTT and CFT are the same signal or separately generated, CTT and CFT will have a different phase relationship at different points along the stick channel they serve. This phase difference between CTT and CFT for a given stick channel is analogous to the phase difference, tTR, between CTM 240 and CFM 250 discussed above, and is referred to herein as t-stickTR. As discussed below, transceivers 220A-220D perform a latency alignment function by adjusting the transfer latency from host channel to stick channel according to the phase difference between the host channel's clocks (i.e., tTR when the host channel is the primary channel 215 and t-stickTR when the host channel is a stick channel).
In one embodiment, the CFT and CTT clocks on stick channels (stick clocks) are synchronized to CTM 240 on the primary channel 215. Requests/commands from the master device 210 are received with CFM and resynchronized to CFT for retransmission on the stick channel. This timing relationship is discussed below in further detail.
At the falling edge of R×Clk 310, data A is available to the transceiver. For one embodiment, transceiver latches data A at this time. The data A is available on the stick channel 275C on the falling edge F of stick clock 330, after the rising edge 2R. The overall propagation delay from the primary channel 215 to the stick channel 275C is tLAT(PS).
Referring to
Note that, because the time to cross the transceiver 220 from primary channel 215 to stick channel 275 is compensated to account for the round trip flight time on the primary channel (tTR), the primary channel flight time does not appear in the expression for total latency. More specifically, the round-trip latency between the master device 210 and the stick channel 275 (i.e., node N) is equal to X+Y cycles. By selecting X and Y to add to a whole number of clock cycles, the round-trip latency between the master device 210 and the stick channel 275 is effectively aligned with a clock for the primary channel (CTM 240 in the embodiment of
Note that no matter how many transceivers must be crossed in the memory system of
Another benefit of the above-described latency-aligning tranceivers is that they may be used in conjunction with programmable-latency memory devices to provide a memory system with flat latency response. That is, the response latency of all memory devices may be made substantially equal, regardless of their proximity to the master device 210. Referring to
(N×M)+t-stickTR+tDEVLAT+tDEV
where tDEV
In this way, the total response latency will be substantially the same for each memory device in the memory system, regardless of the number of memory devices or stick channels in the memory system.
The transceiver 220 acts as a slave device toward the master device 210 and includes a slave interface 420 to receive data and control signals from the master device via host channel 410. To the master device, the transceiver 220 appears to be a memory device. Requests from the master device arrive at the transceiver in the CFM 250 timing domain, and responses are sent back to the master in the CTM 240 timing domain. The master device 210 does not need to be modified to interact with the transceiver.
On the stick channel 490, the transceiver 220 functions as a master device, providing a master interface 430 to retransmit the requests/commands from the master device to the memory devices (or transceivers) coupled to stick channel 490, and to forward responses from the memory devices to the master device via the slave interface 420 and host channel 410. The memory devices perceive no difference in system operation resulting from the presence of transceiver 220 and therefore require no design modification.
The transceiver 220 provides the clock-from-transceiver (CFT) 290 and clock-to-transceiver (CTT) 280 signals to the memory devices and transceivers coupled to channel 490. In one embodiment, CTE 270 is routed to the end of the stick channel where it is folded back to provide CTT 280. As discussed above, CTT 280 is folded back away from the transceiver 220 to provide CFT 290.
Data is transmitted to devices coupled to stick channel 490 in the CFT 290 clock domain and received from devices coupled to stick channel 490 in the CTT 280 clock domain.
For one embodiment, the transceiver 220 includes a stick transceiver 440 and a host transceiver 450. The stick transceiver 440 transmits and receives data on the stick channel 490. The host transceiver 450 transmits and receives data on the host channel 410.
The transceiver 220 further includes a first synchronizing unit 460. The synchronizing unit 460 synchronizes data transmitted from the memory channel to the stick channel to the CFT 290. For one embodiment, the transceiver 220 may also include a second synchronizing unit 470 for synchronizing signals transmitted from the stick channel 490 to the host channel 410 with CTM 240. For one embodiment, the second synchronizing unit 470 may be omitted if the CTT clock is synchronized with one of the clocks on the memory channel (e.g., in an embodiment in which the stick clocks CTT and CFT are synchronized with CTM 240).
The transceiver 220 further includes an isolation unit 480 that operates to prevent the transceiver 220 from repeating signals onto either the host channel 410 or the stick channel 490. For one embodiment, the isolation unit 480 asserts an isolate signal 595 to force both sets of bus driver circuits into a high-impedance (non-driving) state. Using the isolate feature, the transceiver 220 can effectively split a memory system into two partitions. In normal operation (not isolated), the transceiver 220 passes packets between the two partitions and the channel functions normally. When the transceiver's isolation unit 480 is enabled, the two partitions become electrically isolated and, if desired, each individual section can operate independently. This may be advantageous in certain graphics applications, for example with a frame buffer and normal (code and data) DRAMs sharing a single channel partitioned by a transceiver.
The transceiver 220 further includes a power logic 485 for turning off the transceiver 220 when it does not need to transmit. In one embodiment, power logic 485 merely turns off the stick transceiver 440, so that signals received via host channel 410 are not retransmitted on stick channel 490. Circuitry may be provided to interpret incoming addresses to determine whether they decode to memory devices coupled to stick channel 490 (or downstream stick channels). Stick transceiver 440 may then be selectively enabled and disabled depending on whether memory devices coupled to stick channel 490 are being addressed. For example, if a certain amount of time passes (or transactions detected) without memory devices coupled to stick channel 490 being addressed, power unit 485 may disable stick transceiver 440 to save power. Alternatively, transceiver 220 may power down stick transceiver 440 and other circuitry within transceiver 220 in response to a power-save command received on the host channel 410. Also, in alternative embodiments, transceiver 220 may remain fully enabled at all times and power unit 485 may be omitted altogether
For one embodiment the transceiver 220 does not interpret incoming transmissions on the host channel and therefore does not respond to commands. That is, the transceiver 220 cannot be “addressed” by a master device (e.g., device 210 of
The transceiver 220 also receives signal lines for clock signals CTE 580, CTT 585 and CFT 590 along with a stick channel 575 that couples the transceiver 220 to memory devices and/or other transceivers.
The transceiver 220 includes a phase locked loop (PLL) 510 which performs a clock recovery function, generating a buffered output 512 in phase alignment with CFM 250. This recovered version of CFM 250 is input to the primary receiver 515 where it is used to time reception of signals from the host channel 570. The transceiver 220 also includes PLL 525 to generate a recovered version of CTM 240 (i.e., buffered output 527) for clocking primary transmitter 520. A PLL 550 is used to generate CTE 580 for the stick channel such that CTT 585 arrives at the transceiver 180 degrees out of phase with CTM 240. This inverted version of CTM 240 is designated “stick clock” in
Because transceiver 220 receives data from the host channel 570 in response to edges of CFM 250 and then retransmits the data on the stick channel in response to edges of CTM 240, the time required to cross the transceiver in the direction of the stick channel (tLAT(PS)) is compensated by the amount of time by which CFM 250 lags CTM 240. That is, tLAT(PS) is equal to the number of cycles of CTM 240 that transpire during the transceiver crossing, less tTR. By contrast, data crossing the transceiver in the direction of the host channel 570 is both received and retransmitted in response to clock edges aligned with edges of CTM 240 (StickClk being an inverted version of CTM 240). That is, tLAT(SP) is equal to the number of cycles of CTM 240 consumed crossing the transceiver without compensation for tTR. This asymmetry between tLAT(PS) and tLAT(SP) results in a bidirectional transceiver crossing time that includes compensation for tTR, thus causing the round-trip latency between the master device and a given stick channel to be aligned to the CTM 240 clock.
Transceiver 220 also includes a re-timing circuit 530 that delays the data transfer between the primary receiver 515 and the secondary transmitter 535 when tTR becomes so small that half clock cycle boundary may be crossed. More specifically, re-timing circuit 530 determines the phase difference (tTR) between the recovered versions of CTM 240 and CFM 250 and selects between a delayed and a non-delayed path for transferring data from primary receiver 515 to secondary transmitter 535, ensuring that the overall tLAT(PS) is a fixed number of clock cycles less tTR.
Portions of the transceiver have been omitted from
A latch-up prevention logic 610 is placed between primary receiver 515 and primary transmitter 520. A similar latch-up prevention logic 620 is placed between secondary transmitter 535 and secondary receiver 540. The latch-up prevention logic 610 receives an input from the primary receiver 515 and from the secondary receiver 540. The output of the latch-up prevention logic 610 is coupled to a disable logic (DL) 630 in the primary transmitter 520. Similarly, the latch-up prevention logic 620 receives an input from the secondary receiver 540 and the primary receiver 515. The output of the latch-up prevention logic 620 is coupled to a disable logic (DL) 640 in the secondary transmitter 535. Pin 680 is coupled to the host channel 570 (not shown), while pin 690 is coupled to stick channel 575 (not shown).
When the primary receiver 515 receives data from the host channel 570, it sends a disable signal through node 517 to the latch-up prevention logic 610. The latch-up prevention logic 610 sends a disable signal to the primary transmitter's disable logic 630. The disable logic 630 prevents the primary transmitter 520 from transmitting information received from the secondary transceiver 540 for a period of time. The disable signal is also sent to the disable logic (DL) 625 of latch-up prevention logic 620. The disable signal turns off the latch-up prevention logic 620. The data received by the primary receiver 515 is transmitted, through the secondary transmitter 535 to the stick channel. When the secondary receiver 540 receives the same data from the stick channel, the latch-up prevention logic 620 is already disabled, preventing the turning off of the secondary transmitter 535. Furthermore, the primary transmitter 520 is already disabled, preventing the retransmission of the data to the host channel. In this manner, the latch-up prevention logic 610 prevents the system latch up.
The latch-up prevention logic 610, 620 releases their transmitter, 520 and 535 respectively, after the entire data is transmitted by the primary receiver 515.
Similarly, if data is first received on the stick channel by the secondary receiver, latch-up prevention logic 620 disables secondary transmitter 535 through disable logic 640. The disable signal further disables latch-up prevention logic 610 through disable logic 615. Using the above-described latch-up prevention logics, the danger of latch-up is avoided.
For one embodiment, the latch-up prevention logic 610 may be implemented as an AND gate and an inverter, such that the output of the secondary receiver 540 is inverted, and coupled as an input to an AND gate. The other input to the AND gate is the logic from the primary receiver 515. In this way, only when the output of the primary receiver 515 is on, while the output of the secondary receiver 540 is off, does the latch-up prevention logic 610 output its disable signal.
Although the exemplary embodiments of latency-aligning receivers and systems and methods for incorporating latency-aligning receivers have been described in terms of memory systems. It will be appreciated that the concepts and principles disclosed are not limited to memory systems, but rather may be applied in any system where it is desirable to increase the number of devices attached to a communication path without overloading the communication path or complicating system timing. More generally, though the invention has been described with reference to specific exemplary embodiments thereof, it will be evident that various modifications and changes may be made thereto without departing from the broader spirit and scope of the invention as set forth in the appended claims. The specification and drawings are, accordingly, to be regarded in an illustrative rather than a restrictive sense.
Number | Date | Country | |
---|---|---|---|
Parent | 10699116 | Oct 2003 | US |
Child | 11058333 | Feb 2005 | US |
Parent | 09458582 | Dec 1999 | US |
Child | 10699116 | Oct 2003 | US |