Embodiments of the present disclosure relate to electronic packages, and more particularly to electronic packages with chiplets that provide a disaggregated mesh and L4 cache.
As electronic packaging architectures continue to advance, there is a move in the industry away from monolithic die architectures to disaggregated chiplet architectures. The separation into chiplets is based on die size limitations, functions, and process capabilities. In the case of monolithic dies, on-die mesh or ring structures were used to interconnect various parts of the chip. These interconnects have to span across die-to-die (D2D) interfaces in chiplets. The overall solutions to die disaggregation should perform similar to the monolithic implementations. D2D transmitters (Tx), receivers (Rx), clocking circuits, matched routing channels, and power delivery units are needed to provide the coupling between the individual chiplets. Currently, this additional circuitry is provided on the chiplets, and wastes valuable real estate on advanced process node devices.
In some instances a single base die is provided below the chiplets in order to provide connections between each of the chiplets. In such an implementation, the channels are offloaded from the chiplets to the base die, but the rest of the active circuitry is provided on the overlying chiplets. In other instances, embedded bridge architectures are used to provide connections between chiplets. However, embedded bridges typically only include conductive lines. That is, there is no active circuitry in the embedded bridge, and the active circuitry remains on the chiplets. Such systems therefore result in wasted space on the top chiplets. This also incurs power and area penalties. The length of the D2D channels are also limited.
Described herein are electronic packages with chiplets that provide a disaggregated mesh and L4 cache, in accordance with various embodiments. In the following description, various aspects of the illustrative implementations will be described using terms commonly employed by those skilled in the art to convey the substance of their work to others skilled in the art. However, it will be apparent to those skilled in the art that the present invention may be practiced with only some of the described aspects. For purposes of explanation, specific numbers, materials and configurations are set forth in order to provide a thorough understanding of the illustrative implementations. However, it will be apparent to one skilled in the art that the present invention may be practiced without the specific details. In other instances, well-known features are omitted or simplified in order not to obscure the illustrative implementations.
Various operations will be described as multiple discrete operations, in turn, in a manner that is most helpful in understanding the present invention, however, the order of description should not be construed to imply that these operations are necessarily order dependent. In particular, these operations need not be performed in the order of presentation.
As noted above, die disaggregation is beneficial as it accommodates die size limitations, functions, and process capabilities. However, the disaggregation of a monolithic die into smaller dies (also sometimes referred to as chiplets) increases the complexity of providing communication pathways between the dies.
Referring now to
As shown, the mesh stops 115 and interface fabric 114 are provided on the overlying dies 110. Such mesh stops 115 and interface fabric 114 may include active circuitry for transmitters (Tx), receivers (Rx), clocking circuits, matched routing channels, and power delivery units. In some instances where the die 110 is an advanced process node die (e.g., a processor, a graphics processor, or the like) the mesh stops 115 and the interface fabric 114 may be at a less advanced process node. As such, a significant area of the die 110 is occupied by the mesh stops 115 and the interface fabric 114.
Furthermore, it is to be appreciated that existing architectures do not allow for the offloading of the mesh stops 115 and the interface fabric 114 to the underlying bridge 113. This is because the bridge 113 is typically a passive device that only includes conductive traces in order to provide a communication link between the dies 110.
Referring now to
Accordingly, embodiments disclosed herein include die module architectures with disaggregated dies that are communicatively coupled by underlying communication dies. The underlying communication dies may be chiplets or hub dies. A chiplet may be a smaller die that couples together a pair of overlying dies. A hub die may be a die that couples together a plurality of overlying dies. In various embodiments, communication functionality (e.g., mesh stops and fabric interfaces) are offloaded onto the underlying communication hub die or chiplets. As such, valuable real estate on the overlying dies is preserved since it is not needed for communication functionality.
In some embodiments, the communication dies may be provided between a base die and the overlying disaggregated dies. In other embodiments, the base die may be omitted. Furthermore, embodiments may include additional memory blocks provided on the communication dies. That is, the communication dies may have additional space that is not occupied by the communication circuitry, and the additional space may be occupied by memory blocks. For example level 4 (L4) cache may be provided on the communication dies in some embodiments. In yet another embodiment, high density interconnects are provided between various components of the die module. The high density interconnects may include hybrid bonding interconnect (HBI) interface architectures. In such embodiments, the bump pitch of the HBI interface may be approximately 20 μm or smaller, or approximately 10 μm or smaller.
Referring now to
In an embodiment, the disaggregated dies 210 may include an active circuitry layer 211 in a die substrate. The active circuitry layer 211 may include transistors and the like in order to provide logic, memory, or any other active circuitry functionality to the disaggregated die 210. The die substrate is a semiconductor substrate. For example, the die substrate may comprise silicon, or other semiconductor materials.
In an embodiment, routing layers 212 (sometimes referred to as metal layers (e.g., M0, M1, M2, etc.)) may be provided on the active circuitry layer 211. In an embodiment, the routing layers 212 may comprise copper or any other conductive material or materials suitable for semiconductor dies. In an embodiment, bottom layers of the disaggregated dies 210 in
In an embodiment, a pair of communication dies 240A and 240B are shown. However, it is to be appreciated that any number of communication dies 240 may be included in the die module 200. For example, a single communication die 240 may be used when a hub die approach is used (as will be described in greater detail below). Other embodiments may include more than two communication dies 240. It is to be appreciated that, while referred to as “communication dies”, the communication functionality may be limited to communication between disaggregated dies 210 within the die module. That is, communication to systems outside of the die module 200 (e.g., using wireless communication protocols) may be implemented with a separate communication chip that may be one of the disaggregated dies 210.
In an embodiment, the communication dies 240A and 240B may have a substrate 242. The substrate 242 may be a semiconductor substrate. For example, the substrate 242 may comprise silicon or any other semiconductor material or materials. In an embodiment, vias 241 may be provided through a portion of the substrate 242. The vias 241 may be coupled with the interconnect layers 216 of the overlying disaggregated dies 210. In the communication die 240A, the opposite end of the vias 241 may be coupled to an active circuitry layer 243.
In an embodiment, the active circuitry layer 243 may include circuitry in order to offload mesh stops and/or interface fabric from the disaggregated dies 210. For example, the active circuitry layer 243 may include transmitters (Tx), receivers (Rx), clocking circuits, matched routing channels, and power delivery units to provide the coupling between the individual disaggregated dies 210. As such, valuable real estate on the disaggregated dies 210 can be preserved.
In an embodiment, routing layers 244 may be provided in the substrate 242. In the communication die 240A, the routing layers 244 are on the active circuitry layer 243, and in the communication die 240B, the routing layers 244 are directly coupled to the vias 241. An interconnect layer 245 may be provided on the routing layers 244. The interconnect layer 245 may be a first level interconnect (FLI) architecture. For example, the interconnect layer 245 may comprise micro bumps, HBI interfaces, or the like.
In an embodiment, the die module 200 may be embedded in a mold layer 205. The mold layer 205 may be disposed over the base die 230 and surround the communication dies 240 and the disaggregated dies 210. A backside surface of the disaggregated dies 210 may be exposed. In an embodiment, vias 207 may pass through the mold layer 205 and/or the base die 230. The vias 207 may couple the disaggregated dies 210 and the communication dies 240 to the interconnects 281.
Referring now to
Referring now to
In an embodiment, the first die 310 may comprise a plurality of first bumps 346. The first bumps 346 may comprise copper or other conductive materials. In an embodiment, the first bumps 346 have a fine pitch. For example, HBI interfaces may be able to support first bumps 346 with a pitch that is approximately 20 μm or smaller, or approximately 10 μm or smaller. In an embodiment a first dielectric layer 347 surrounds the first bumps 346. The first dielectric layer 347 may be any suitable dielectric for hybrid bonding. For example, the first dielectric layer 347 may comprise silicon and oxygen (e.g., SiOX).
In an embodiment, the second die 340 may comprise a plurality of second bumps 348. The second bumps 348 may comprise copper or other conductive materials. In an embodiment, the second bumps 348 have a fine pitch that matches the pitch of the first bumps 346. For example, the second bumps 348 may have a pitch that is approximately 20 μm or smaller, or approximately 10 μm or smaller. In an embodiment a second dielectric layer 349 surrounds the second bumps 348. The second dielectric layer 349 may be any suitable dielectric for hybrid bonding. For example, the second dielectric layer 349 may comprise silicon and oxygen (e.g., SiOX).
In an embodiment, a hybrid bonding process is used to connect the first die 310 to the second die 340. The hybrid bonding process may begin with a low temperature bonding operation. During the low temperature bonding, the first dielectric layer 347 bonds with the second dielectric layer 349. Thereafter, a high temperature bonding process is implemented. During the high temperature bonding process, the first bumps 346 bond with the second bumps 348. Particularly, the first bumps 346 and the second bumps 348 may experience interdiffusion bonding. In the illustrated embodiment, the first bumps 346 and the second bumps 348 have a defined interface boundary. However, in some embodiments, there may not be a discernable interface boundary between the first bumps 346 and the second bumps 348. That is, a single conductive pillar may be provided between the first die 310 and the second die 340 in some embodiments.
Referring now to
In an embodiment, the disaggregated dies 410 may be communicatively coupled to each other through a hub die 440. The hub die 440 may be between the base die 430 and the disaggregated dies 410. The hub die 440 may have a footprint that is smaller than a combined footprint of the disaggregated dies 410. In an embodiment, the mesh stops 415 may be implemented on the hub die 440. In an embodiment, active circuitry on the hub die 440 may include transmitters (Tx), receivers (Rx), clocking circuits, matched routing channels, and power delivery units. As such, circuitry can be offloaded from the disaggregated dies 410.
In an embodiment, a fabric loop 418 is provided entirely within the hub die 440. This shrinks the length of the fabric loop 418 compared to the fabric loop 118 described with respect to
Referring now to
In an embodiment, the hub die 440 may also include conductive routing (not visible in
Referring now to
In
Referring now to
In an embodiment, the die module 500 may further comprise disaggregated dies 510. The disaggregated dies 510 may be CPUs, GPUs, or the like. In an embodiment, IO dies 522 may be adjacent to the disaggregated dies 510. In an embodiment, the disaggregated dies 510 may be communicatively coupled together by a communication die 540A. The communication die 540A may be similar to the hub die 440 described in greater detail above. For example, the communication die 540A may include active circuitry in order to accommodate mesh stops and/or fabric interfaces. In some embodiments, transmitters (Tx), receivers (Rx), clocking circuits, matched routing channels, and power delivery units may be provided on the communication die 540A.
In an embodiment, the communication die 540A may be coupled to the disaggregated dies 510 by an interconnect interface 516. While shown as a solid box in order to not overly complicate
In an embodiment, additional communication dies 540E may provide communicative coupling between the disaggregated dies 510 and the IO dies 522. The communication dies 540E may be substantially similar to the communication die 540A. In other embodiments, the communication dies 540E may only include conductive routing. That is, active circuitry may be omitted from communication dies 540E in some embodiments.
In an embodiment, the die module 500 may be embedded in a mold layer 505. The mold layer 505 may entirely embed the communication dies 540A and 540B. The mold layer 505 may partially embed the disaggregated dies 510 and the IO dies 522. For example, top surfaces of the disaggregated dies 510 and the IO dies 522 may be exposed in some embodiments.
Referring now to
Referring now to
In an embodiment, one or more of the plurality of dies 540A may include active circuitry. The active circuitry may allow for mesh stops and/or fabric interfaces to be offloaded from the overlying disaggregated dies 510. For example, transmitters (Tx), receivers (Rx), clocking circuits, matched routing channels, and power delivery units may be provided on one or more of the plurality of dies 540A. In an embodiment, the plurality of dies 540A may include memory dies. For example, one or more of the plurality of dies 540A may be L4 cache.
Referring now to
In the illustrated embodiment, the die module 600 is similar to the die module 500 in
A plurality of communication dies 640A and 640B are provided in the mold layer 605. The communication dies 640A and 640B may include active circuitry in order to accommodate mesh stops and/or fabric interfaces. For example, transmitters (Tx), receivers (Rx), clocking circuits, matched routing channels, and power delivery units may be provided on the communication dies 640A and 640B. The communication dies 640 may couple together overlying disaggregated dies 610 and/or overlying IO dies 622. In an embodiment, the communication dies 640 are coupled to the disaggregated dies 610 and the IO dies 622 by interconnect interface 616. For example, the interconnect interfaces 616 may comprise FLIs, such as HBI interfaces. In an embodiment, the bottoms of the communication dies 640 may be coupled to vias 607 by interfaces 645, such as HBI interfaces or the like.
These other components include, but are not limited to, volatile memory (e.g., DRAM), non-volatile memory (e.g., ROM), flash memory, a graphics processor, a digital signal processor, a crypto processor, a chipset, an antenna, a display, a touchscreen display, a touchscreen controller, a battery, an audio codec, a video codec, a power amplifier, a global positioning system (GPS) device, a compass, an accelerometer, a gyroscope, a speaker, a camera, and a mass storage device (such as hard disk drive, compact disk (CD), digital versatile disk (DVD), and so forth).
The communication chip 706 enables wireless communications for the transfer of data to and from the computing device 700. The term “wireless” and its derivatives may be used to describe circuits, devices, systems, methods, techniques, communications channels, etc., that may communicate data through the use of modulated electromagnetic radiation through a non-solid medium. The term does not imply that the associated devices do not contain any wires, although in some embodiments they might not. The communication chip 706 may implement any of a number of wireless standards or protocols, including but not limited to Wi-Fi (IEEE 802.11 family), WiMAX (IEEE 802.16 family), IEEE 802.20, long term evolution (LTE), Ev-DO, HSPA+, HSDPA+, HSUPA+, EDGE, GSM, GPRS, CDMA, TDMA, DECT, Bluetooth, derivatives thereof, as well as any other wireless protocols that are designated as 3G, 4G, 5G, and beyond. The computing device 700 may include a plurality of communication chips 706. For instance, a first communication chip 706 may be dedicated to shorter range wireless communications such as Wi-Fi and Bluetooth and a second communication chip 706 may be dedicated to longer range wireless communications such as GPS, EDGE, GPRS, CDMA, WiMAX, LTE, Ev-DO, and others.
The processor 704 of the computing device 700 includes an integrated circuit die packaged within the processor 704. In some implementations of the invention, the integrated circuit die of the processor may be part of an electronic package that comprises a die module with a communication die that includes mesh stops and/or fabric interfaces, in accordance with embodiments described herein. The term “processor” may refer to any device or portion of a device that processes electronic data from registers and/or memory to transform that electronic data into other electronic data that may be stored in registers and/or memory.
The communication chip 706 also includes an integrated circuit die packaged within the communication chip 706. In accordance with another implementation of the invention, the integrated circuit die of the communication chip may be part of an electronic package that comprises a die module with a communication die that includes mesh stops and/or fabric interfaces, in accordance with embodiments described herein.
The above description of illustrated implementations of the invention, including what is described in the Abstract, is not intended to be exhaustive or to limit the invention to the precise forms disclosed. While specific implementations of, and examples for, the invention are described herein for illustrative purposes, various equivalent modifications are possible within the scope of the invention, as those skilled in the relevant art will recognize.
These modifications may be made to the invention in light of the above detailed description. The terms used in the following claims should not be construed to limit the invention to the specific implementations disclosed in the specification and the claims. Rather, the scope of the invention is to be determined entirely by the following claims, which are to be construed in accordance with established doctrines of claim interpretation.
Example 1: a die module, comprising: a plurality of first dies; and a second die under the plurality of first dies, wherein the second die is coupled to individual ones of the plurality of first dies, and wherein the second die comprises: a plurality of mesh stops; and conductive routing to electrically couple the mesh stops together.
Example 2: the die module of Example 1, wherein the individual ones of the plurality of mesh stops are below a corresponding one of the plurality of first dies.
Example 3: the die module of Example 1 or Example 2, wherein the second die is coupled to the plurality of first dies by hybrid bonding interconnect interfaces.
Example 4: the die module of Example 3, wherein the hybrid bonding interconnect interfaces comprise: a plurality of conductive bumps; and a dielectric layer surrounding the conductive bumps.
Example 5: the die module of Examples 1-4, further comprising: a third die below the second die, wherein a footprint of the third die is greater than a footprint of the second die.
Example 6: the die module of Example 5, further comprising: a mold layer around the plurality of first dies and the second die.
Example 7: the die module of Example 6, further comprising: a via through the mold layer, wherein the via connects a first die to the third die.
Example 8: the die module of Examples 1-7, wherein individual ones of the mesh stops comprise one or more of a transmitter circuitry, a receiver circuitry, a clock circuitry, and power delivery circuitry.
Example 9: the die module of Examples 1-8, further comprising: a memory block on the second die.
Example 10: the die module of Example 9, wherein the memory block is an L4 cache.
Example 11: the die module of claim Examples 1-10, wherein the plurality of first dies have an outer perimeter, and wherein the second die is entirely within the outer perimeter.
Example 12: a die, comprising: a substrate, wherein the substrate comprises a semiconductor material; a plurality of mesh stops on the substrate; and conductive routing to electrically couple the mesh stops together.
Example 13: the die of Example 12, wherein individual ones of the mesh stops comprise one or more of a transmitter circuitry, a receiver circuitry, a clock circuitry, and power delivery circuitry.
Example 14: the die of Example 12 or Example 13, further comprising: a memory block on the substrate.
Example 15: the die of Example 14, wherein the memory block is an L4 cache.
Example 16: the die of Examples 12-15, wherein the die comprises an interconnect interface configured to connect with a second die.
Example 17: the die of Example 16, wherein the interconnect interface is a hybrid bonding interconnect interface.
Example 18: the die of Example 17, wherein the hybrid bonding interconnect interface comprises: a plurality of conductive bumps; and a dielectric layer surrounding the conductive bumps.
Example 19: the die of Examples 12-18, wherein the conductive routing is a fabric loop for coupling together the plurality of mesh stops.
Example 20: the die of Examples 12-19, wherein the die comprises an active circuitry layer, wherein the mesh stops are in the active circuitry layer.
Example 21: the die of Example 20, further comprising vias into the die, wherein the vias electrically couple the active circuitry layer to a surface of the die.
Example 22: an electronic system, comprising: a board; a package substrate coupled to the board; and a die module coupled to the package substrate, wherein the die module comprises a plurality of first dies that are communicatively coupled together by a second die, wherein mesh stops and routing circuitry is provided on the second die.
Example 23: the electronic system of Example 22, wherein the routing circuitry comprises one or more of a transmitter circuitry, a receiver circuitry, a clock circuitry, and power delivery circuitry.
Example 24: the electronic system of Example 22 or Example 23, wherein the die module further comprises: a third die, wherein the second die is between the plurality of first dies and the third die.
Example 25: the electronic system of Examples 22-24, wherein the second die further comprises memory blocks.