Computer systems include random-access memories (RAM) for storing data and machine code. RAMs are typically volatile memories, such that the stored information is lost when power is removed. In modern implementations, memories take the form of integrated circuits. Each integrated circuit includes several memory cells. To enable access to stored data and machine code, memories are place in electrical communication with processors. Typically, these electrical communications are implemented as metal traces formed on the substrates on which the memories and the processors are disposed.
Some embodiments relate to a computing system comprising: a photonic interposer having an optical network comprising a plurality of waveguides and a plurality of controllable optical switches; an electronic die having a surface bonded to the photonic interposer; an inner interface comprising a first plurality of ports electrically coupling the electronic die to the photonic interposer through the surface; and an outer interface comprising a second plurality of ports electrically coupling the electronic die to the photonic interposer through the surface, wherein the outer interface at least partially encloses the inner interface.
In some embodiments, each port of the first and second pluralities of ports comprises: an electric connection connecting the surface of the electronic die to the interposer; and a SerDes coupled to the electric connection.
In some embodiments, the SerDes is formed on the electronic die.
In some embodiments, the photonic interposer further comprises a transimpedance amplifier (TIA) and a modulator driver coupled to the optical network, wherein the SerDes couples to either the TIA, the modulator driver, or both.
In some embodiments, at least one port of the outer interface is positioned within 1 mm of an outer perimeter of the electronic die.
In some embodiments, at least one port of the inner interface is positioned more than 1 mm away from the outer perimeter of the electronic die.
In some embodiments, the surface of the electronic die is between 25 mm2 and 625 mm2.
In some embodiments, the inner interface spans at least 20% of the surface of the electronic die bonded to the photonic interposer.
In some embodiments, the photonic interposer further comprises an off-chip optical coupler, wherein the photonic network couples the off-chip optical coupler to at least one port of the inner interface.
In some embodiments, each port of the first and second pluralities of ports comprises an Advanced Interface Bus (AIB) interface or a Universal Chiplet Interconnect Express (UCIe) interface.
Some embodiments relate to a computing system comprising: a photonic interposer having an optical network comprising a plurality of waveguides and a plurality of controllable optical switches, the photonic interposer having a surface configured to bond to an electronic die; and an interface comprising a 2-dimensional array of ports configured to electrically couple the electronic die to the photonic interposer when the electronic die is bonded to the surface of the photonic interposer, wherein the array is arranged with at least three columns and at least three rows of ports.
In some embodiments, each port of the 2-dimensional array comprises an electric connection configured to connect the electronic die to the surface of the interposer; and a SerDes coupled to the electric connection.
In some embodiments, the SerDes is formed on the electronic die.
In some embodiments, the photonic interposer further comprises a transimpedance amplifier (TIA) and a modulator driver coupled to the optical network, wherein the SerDes couples to either the TIA, the modulator driver, or both.
In some embodiments, at least one port of the inner interface is positioned more than 1 mm away from an outer perimeter of the electronic die when the electronic die is bonded to the surface of the photonic interposer.
In some embodiments, the photonic interposer further comprises an off-chip optical coupler, wherein the photonic network couples the off-chip optical coupler to at least one port of the 2-dimensional array.
In some embodiments, each port of the 2-dimensional array comprises an Advanced Interface Bus (AIB) interface or a Universal Chiplet Interconnect Express (UCle) interface.
Some embodiments relate to a method for manufacturing a computing system, comprising obtaining a photonic interposer having an optical network comprising a plurality of waveguides and a plurality of controllable optical switches; bonding an electronic die to the photonic interposer through a surface of the electronic die, wherein the bonding comprises connecting the electronic die to the photonic interposer using: an inner interface comprising a first plurality of ports electrically coupling the electronic die to the photonic interposer through the surface; and an outer interface comprising a second plurality of ports electrically coupling the electronic die to the photonic interposer through the surface, wherein the outer interface at least partially encloses the inner interface.
In some embodiments, at least one port of the outer interface is positioned within 1 mm of an outer perimeter of the electronic die.
In some embodiments, at least one port of the inner interface is positioned more than 1 mm away from the outer perimeter of the electronic die.
In some embodiments, the surface of the electronic die is between 25 mm2 and 625 mm2.
Some embodiments relate to a computing system comprising a photonic interposer having an optical network comprising a plurality of waveguides and a plurality of controllable optical switches; a first electronic die having a first surface bonded to the photonic interposer, the first electronic die having: a first inner interface comprising a first plurality of ports electrically coupling the first electronic die to the photonic interposer; and a first outer interface comprising a second plurality of ports electrically coupling the first electronic die to the photonic interposer, wherein the first outer interface at least partially encloses the first inner interface; and a second electronic die having a surface bonded to the photonic interposer, the second electronic die having: a second inner interface comprising a third plurality of ports electrically coupling the second electronic die to the photonic interposer; and a second outer interface comprising a fourth plurality of ports electrically coupling the second electronic die to the photonic interposer, wherein the second outer interface at least partially encloses the second inner interface, wherein the optical network optically couples at least one port of the first inner interface to at least one port of the second inner interface.
In some embodiments, each port of the first and second pluralities of ports comprises: an electric connection connecting the first electronic die to the interposer; and a SerDes coupled to the electric connection.
In some embodiments, the SerDes is formed on the first electronic die.
In some embodiments, at least one port of the first outer interface is positioned within 1 mm of an outer perimeter of the first electronic die.
In some embodiments, at least one port of the first inner interface is positioned more than 1 mm away from the outer perimeter of the first electronic die.
In some embodiments, the inner interface spans at least 20% of the surface of the electronic die bonded to the photonic interposer.
Various aspects and embodiments of the application will be described with reference to the following figures. It should be appreciated that the figures are not necessarily drawn to scale. Items appearing in multiple figures are indicated by the same reference number in the figures in which they appear.
The inventors have developed computer architectures that significantly improve the bandwidth of die-to-die communication between chiplets using chip-on-optical-silicon solutions (e.g., photonic interposers). The architectures developed by the inventors and described herein allow electronic dies to communicate with each other from any location within the area of the die—without requiring the data to pass from the edge of the die, as is the case in some conventional architectures (this is often referred to as the “beachfront limitation”). Thus, these architectures eliminate the die-to-die bandwidth limitations resulting from the fact that common input/output (I/O) interfaces are only placed near the edge of the die.
The power and performance improvements of silicon technology do not scale as fast as in the past. Currently, there are two approaches to produce high-performance application-specific integrated circuits (ASIC). One approach involves creating larger and larger silicon dies and systems-on-chip (SoC). Large dies lead to large bandwidth, given the on-chip nature of the communication channels. However, creating larger and larger silicon dies has a major drawback
The second approach involves splitting the large dies into multiple smaller dies—often referred to as “chiplets”—which are interconnected using electronic interposers, substrates or printed circuit boards. This approach improves manufacturing yields, but is bandwidth-limited in that the die-to-die communication channels require significant area and are limited to short ranges, otherwise power consumption would be excessively large. Die-to-die communications between chiplets are implemented using a variety of 2.5D technologies.
These technologies are all short-range and thus can only communicate from the edge of the transmitting die to the edge of the receiving die. Thus, the die-to-die communication bandwidth is limited by the ports that can fit on the outer perimeter of the dies. Because these communication channels pass through large features (e.g., bumps and SerDes), the total communication bandwidth density is typically limited to about 400 Gbit/s per mm of die edge. This level of communication density is significantly lower than what can be achieved on-chip. In addition, this solution requires transferring data from the transmit logic unit to the I/O unit located near the edge of the die before the data can be transferred off-chip. This increases latency, area, and power consumption.
Optical solutions have been proposed, but these solutions do not address the beachfront limitations described above.
Δt relatively high frequencies, the maximum length of traces 231 is dictated by signal integrity considerations, similar to the example of
Solutions based on co-packaged optics (CPO) suffer from similar problems. An example is illustrated in
In summary, each of the chiplet solutions described above (
The photonic interposer 301 includes an optical network (not shown) having optical waveguides and controllable optical switches. Communication between the dies occurs optically via the optical network of photonic interposer 301. Because optical channels do not suffer from degraded signal integrity at higher frequencies (unlike electrical channels), the length of these optical channels can be significantly longer than the 2 cm ceiling discussed in connection with electrical connections. This opens up the ability to directly connect any portion of a die to any portion of another die—without first having to pass through the edges of the dies. The inventors have appreciated that moving data within a single die is costly in terms of power and latency (the more data that have to be shuttled around may lead to further congestion). If a data processed by one die is immediately needed by another die, the scheme enables the data to be directly sent to the die needing the data without having to send the data to the edges, where the I/O units are located in conventional settings. Further, the data arriving at the other die can be placed in close proximity to the compute or switch or processing block needing that data.
In the example of
Ports 230 allow die 302 to communicate with the underlying photonic substrate 301 (along the z-axis). As shown in
An off-chip optical coupler 340 permits coupling of optical signals between waveguides formed in the interposer and fibers 342. Coupler 340 may include, for example, multiple edge couplers and/or multiple grating couplers.
Ports 230 may be organized in a 2-dimensional array, with rows and columns. In some embodiments, there may be at least three columns and three rows of ports. In some embodiments, the inner interface may span a surface of the die that is at least 20% of the area of the die surface, at least 30%, at least 40% or at least 50%.
In some embodiments, each port (or at least one port) of the outer interface 400 may be within 1 mm of the outer perimeter 401 (or within 0.1 mm, 0.25 mm, 0.5 mm, 0.75 mm, 1.5 mm, 2 mm or 3 mm, for example). In some embodiments, each port (or at least one port) of the inner interface 402 may be more than 1 mm away from the outer perimeter 401 (or more than 0.1 mm, 0.25 mm, 0.5 mm, 0.75 mm, 1.5 mm, 2 mm or 3 mm, for example).
Each logic unit 500 may be a computational unit, a memory unit, a buffer unit, etc., and may be configured to transmit/receive data to/from other units of the die or units of another die. The I/O units 502 and 504 may include circuitry for transmitting and receiving information. For example, either one or both I/O units may include modulator drivers and transimpedance amplifiers (TIA). The I/O units may be configured to implement any suitable protocol, including Advanced Interface Bus (AIB), Universal Chiplet Interconnect Express (UCle), Low-voltage-In-Package-INterCONnect (LIPINCON), Bunch of Wires (BoW), etc. TX/RX 506 includes an optical transceiver that converts data from the electrical domain to the optical domain and vice versa. For example, TX/RX 506 may include at least one modulator and at least one photodetector. The modulator may be driven by the modulator driver, and the TIA may amplify signals detected by the photodetector.
TX/RX units 506 couple to waveguide 510, which in turn couples to a controllable optical switch 512. Controllable optical switch 512 may be controlled to route optical signals to one of several outputs of the switch (although only one output is shown in
Having thus described several aspects and embodiments of the technology of this application, it is to be appreciated that various alterations, modifications, and improvements will readily occur to those of ordinary skill in the art. Such alterations, modifications, and improvements are intended to be within the spirit and scope of the technology described in the application. It is, therefore, to be understood that the foregoing embodiments are presented by way of example only and that, within the scope of the appended claims and equivalents thereto, inventive embodiments may be practiced otherwise than as specifically described. In addition, any combination of two or more features, systems, articles, materials, and/or methods described herein, if such features, systems, articles, materials, and/or methods are not mutually inconsistent, is included within the scope of the present disclosure.
Also, as described, some aspects may be embodied as one or more methods. The acts performed as part of the method may be ordered in any suitable way. Accordingly, embodiments may be constructed in which acts are performed in an order different than described, which may include performing some acts simultaneously, even though shown as sequential acts in illustrative embodiments.
All definitions, as defined and used herein, should be understood to control over dictionary definitions, definitions in documents incorporated by reference, and/or ordinary meanings of the defined terms.
The indefinite articles “a” and “an,” as used herein in the specification and in the claims, unless clearly indicated to the contrary, should be understood to mean “at least one.”
The phrase “and/or,” as used herein in the specification and in the claims, should be understood to mean “either or both” of the elements so conjoined, i.e., elements that are conjunctively present in some cases and disjunctively present in other cases.
As used herein in the specification and in the claims, the phrase “at least one,” in reference to a list of one or more elements, should be understood to mean at least one element selected from any one or more of the elements in the list of elements, but not necessarily including at least one of each and every element specifically listed within the list of elements and not excluding any combinations of elements in the list of elements. This definition also allows that elements may optionally be present other than the elements specifically identified within the list of elements to which the phrase “at least one” refers, whether related or unrelated to those elements specifically identified.
The terms “approximately” and “about” may be used to mean within +20% of a target value in some embodiments, within +10% of a target value in some embodiments, within +5% of a target value in some embodiments, and yet within +2% of a target value in some embodiments. The terms “approximately” and “about” may include the target value.
This application claims the benefit under 35 U.S.C. § 119(e) of U.S. Provisional Patent Application Ser. No. 63/433,560, filed Dec. 19, 2022, under Attorney Docket No. L0858.70063US00 and entitled “CHIPLET COMMUNICATION USING AN OPTICAL COMMUNICATION SUBSTRATE,” which is hereby incorporated herein by reference in its entirety.
Number | Date | Country | |
---|---|---|---|
63433560 | Dec 2022 | US |