Embodiments of the present disclosure relate to semiconductor devices, and more particularly to electronic packages with a compute die over an array of memory die stacks.
The drive towards increased computing performance has yielded many different packaging solutions. In one such packaging solution, dies are arranged over a base substrate. The dies may include compute dies and memory dies. Connections between the compute dies and the memory dies are provided in the base substrate. While higher density is provided, the lateral connections over the base substrate result in higher power consumption and reduced bandwidth. Such integration may not be sufficient to meet the memory capacity and bandwidth needs of certain applications, such as high performance computing (HPC) applications.
Described herein are electronic packages with a compute die over an array of memory die stacks, in accordance with various embodiments. In the following description, various aspects of the illustrative implementations will be described using terms commonly employed by those skilled in the art to convey the substance of their work to others skilled in the art. However, it will be apparent to those skilled in the art that the present invention may be practiced with only some of the described aspects. For purposes of explanation, specific numbers, materials and configurations are set forth in order to provide a thorough understanding of the illustrative implementations. However, it will be apparent to one skilled in the art that the present invention may be practiced without the specific details. In other instances, well-known features are omitted or simplified in order not to obscure the illustrative implementations.
Various operations will be described as multiple discrete operations, in turn, in a manner that is most helpful in understanding the present invention, however, the order of description should not be construed to imply that these operations are necessarily order dependent. In particular, these operations need not be performed in the order of presentation.
As noted above, existing electronic packaging architectures may not provide the memory capacity and bandwidth sufficient for some high performance computing (HPC) systems. An example of one such existing electronic package 100 is shown in
As shown, a plurality of first dies 125 and second dies 135 may be disposed in an array over the base substrate 120. The first dies 125 may be compute dies (e.g., CPU, GPU, etc.), and the second dies 135 may be memory dies. The first dies 125 and the second dies 135 may be attached to the base substrate 120 by interconnects 122. It is to be appreciated that the number of second dies 135 is limited by the footprint of the base substrate 120. Since it is difficult to form large area base substrates 120, the number second dies 135 is limited. As such, the memory capacity of the electronic package 100 is limited. In order to provide additional memory, a high bandwidth memory (HBM) 145 stack may be attached to the package substrate 110. The HBM 145 may be electrically coupled to the base substrate 120 by an embedded bridge 144 or other conductive routing architecture.
The first dies 125 may be electrically coupled to the second dies 135 through interconnects 136 (e.g., traces, vias, etc.) in the base substrate 120. Similarly, an interconnect 146 through the bridge 144 may electrically couple the HBM 145 to the base substrate 120. Such lateral routing increases power consumption and decreases the available bandwidth of the memory.
Accordingly, embodiments disclosed herein include an electronic packaging architecture that allows for improved memory capacity and bandwidth. Particularly, embodiments disclosed herein include a first die (e.g., a compute die) and an array of die stacks comprising second dies (e.g., memory dies) that are coupled to the first die. The three-dimensional (3D) stacking of the second dies allows for increased memory capacity within a restricted footprint. Additionally, each die stack may be located below a compute engine cluster of the first die. In some embodiments, local compute engines within a cluster may be above a memory block of individual ones of the second dies. Therefore, each compute engine cluster has direct access to memory with minimal lateral routing. This reduces the power consumption and provides an increase to bandwidth. In some embodiments, power delivery paths from the package substrate (or the base substrate) to the first die may be routed between the die stacks. In other embodiments, the power delivery paths may be routed through the die stacks.
The additional memory capacity also allows for offloading memory from the base substrate. Without the need to provide memory in the base substrate, the processing node of the base substrate may be relaxed. For example, the base substrate may be processed at the 14 nm or 22 nm process node. As such, yields of the base substrate are improved and costs are decreased. Additionally, larger area base substrates may be provided, which allows for even more memory capacity to be provided.
In an embodiment, a plurality of first dies may be included in the electronic package. For example, each first die may be positioned over a different portion of the array of die stacks. Each first die, may therefore have a dedicated bank of memory. This allows for smaller compute dies, and therefore may drive a higher yield and lower costs. The use of die stacks may also improve yield of the electronic package. For example, each die stack may be tested prior to assembly. As such, only known good die stacks may be included in the electronic package.
Referring now to
In the illustrated embodiment, the array of die stacks 230 comprises a four-by-four array. That is, there are 16 instances of the die stacks 230 shown in
Referring now to
In an embodiment, the package substrate 310 may be any suitable packaging substrate. For example, the package substrate 310 may be cored or coreless. In an embodiment, the package substrate 310 may comprise conductive features (not shown for simplicity) to provide routing. For example, conductive traces, vias pads, etc. may be included in the package substrate.
In an embodiment, each die stack 330 may comprise a plurality of second dies 335. In the illustrated embodiment five second dies 335 are shown in each die stack 330, but it is to be appreciated that the die stacks 330 may comprise two or more second dies 335. In an embodiment, the second dies 335 may be connected to each other by interconnects 337/338. Interconnects 338 represent power supply interconnects, and interconnects 337 may represent communication interconnects (e.g., I/O, CA, etc.). In an embodiment, through substrate vias (TSVs) may pass through the second dies 335. The TSVs are not shown for simplicity. In a particular embodiment, the interconnects 337/338 are implemented using a TSV/micro-bump architecture. In other embodiments, hybrid wafer bonding may be used to interconnect the stacked second dies. However, it is to be appreciated that other suitable interconnect architectures may also be used. As shown, the power delivery path from the package substrate 310 to the first die 325 is provided through the die stacks 330. That is, power supply interconnects 338 are shown coupling the topmost second dies 335 to the first die 325.
In an embodiment, the first die 325 may be a compute die. For example, the first die 325 may comprise a processor (e.g., CPU), a graphics processor (e.g. GPU), or any other type of die that provides computation capabilities. The second dies 335 may be memory dies. In a particular embodiment, the memory dies are SRAM memory, though other types of memory (e.g., e.g., eDRAM, STT-MRAM, ReRAM, 3DXP, etc.) may also be included in the die stacks 330. In an embodiment, the first die 325 may be fabricated at a different process node than the second dies 335. For example, the first die 325 may be fabricated at with a more advanced process node than the second dies 335.
In an embodiment, the die stacks 330 that are integrated into the electronic package 330 may be known good die stacks 330. That is, the individual die stacks 330 may be tested prior to assembly. As such, embodiments may include providing only functional die stacks 330 in the assembly of the electronic package 330. This provides an increase in the yield of the electronic package 300 and reduces costs.
Referring now to
In an embodiment, the base substrate 320 may be a semiconductor material. For example, the base substrate 320 may comprise silicon or the like. In an embodiment, the base substrate 320 may be a passive substrate, without any active circuitry. In other embodiments, the base substrate 320 may be an active substrate that comprises active circuitry. In an embodiment, the base substrate 320 may comprise power regulation circuitry blocks (e.g., FIVR, or the like). Furthermore, in some embodiments, the base substrate 320 may be substantially free of memory circuitry (e.g., SRAM blocks). This is because the die stacks 330 provide sufficient memory capacity for the electronic package 300.
In some embodiments, the base substrate 320 may be fabricated at a process node that is different than the process nodes of the first die 325 and the second dies 335 in the die stacks 330. For example, the first die 325 may be fabricated at a 7 nm process node, the second dies 335 may be fabricated at a 10 nm process node, and the base substrate 320 may be fabricated at a 14 nm process node or larger. As such, the cost of the base substrate 320 is reduced. Additionally, the footprint of the base substrate 320 may be increased in order to provide more area for die stacks 330. In an embodiment, the footprint of the base substrate 320 may be larger than the footprint of the array of die stacks 330 and larger than the footprint of the first die 325. In an embodiment, the footprint of the base substrate 320 may be approximately 100 mm2 or larger, approximately 200 mm2 or larger, or approximately 500 mm2 or larger.
Referring now to
Referring now to
Referring now to
Since the power delivery path to the first die 325 is not provided through the die stacks 330, the topmost second dies 335 may only include communication interconnects 337. However, in other embodiments, dummy power interconnects (i.e., interconnects that provide structural support but are not active parts of the circuitry) may be provided over the topmost second dies 335 to provide manufacturing and mechanical reliability. It is to be appreciated that the power delivery paths through the die stacks 330 may be made with interconnects 338.
Referring now to
Referring now to
In an embodiment, each of the first dies 325A and 325B may be directly connected to an underlying base substrate 320. For example, power delivery paths 326 pass through the mold layer 350 outside of the die stacks 330 between the first dies 325 and the base substrate 320. The power delivery paths 326 may be TMVs, pillars, or any other conductive structure to provide a vertical connection through the mold layer 350. Since the power delivery path 326 is not provided through the die stacks 330, the topmost second dies 335 may only include communication interconnects 337. However, in other embodiments, dummy power interconnects (i.e., interconnects that provide structural support but are not active parts of the circuitry) may be provided over the topmost second dies 335 to provide manufacturing and mechanical reliability.
Referring now to
Referring now to
Referring now to
Lateral routing may be further reduced by locating individual memory blocks in a memory die below a local compute engine 461. For example,
In an embodiment, communication pads 463 may be provided within each cluster 462 of the first die 425. The communication pads 463 are positioned to interface with the communication interconnects 437 of the second dies 437. While a simple linear layout of the communication interconnects 437 is shown, it is to be appreciated that the communication interconnects 437 may have any suitable layout.
Referring now to
In an embodiment, the first die 525 in
Similar to the embodiment described with respect to
Referring now to
In an embodiment, the electronic package 600 may comprise a package substrate 610. A base substrate 620 may be disposed over the package substrate 610. In an embodiment, an array of die stacks 630 may be positioned over the base substrate 620. The die stacks 630 may each comprise a plurality of second dies 635. For example, the second dies 635 may be memory dies. A first die 625 may be disposed over the die stacks 630. The first die 625 may be a compute die. In an embodiment, the first die 625 may be provided power through a power delivery paths 626 that directly connects to the base substrate 620. In an embodiment, a mold layer 650 may surround the electronic package 600.
In
These other components include, but are not limited to, volatile memory (e.g., DRAM), non-volatile memory (e.g., ROM), flash memory, a graphics processor, a digital signal processor, a crypto processor, a chipset, an antenna, a display, a touchscreen display, a touchscreen controller, a battery, an audio codec, a video codec, a power amplifier, a global positioning system (GPS) device, a compass, an accelerometer, a gyroscope, a speaker, a camera, and a mass storage device (such as hard disk drive, compact disk (CD), digital versatile disk (DVD), and so forth).
The communication chip 706 enables wireless communications for the transfer of data to and from the computing device 700. The term “wireless” and its derivatives may be used to describe circuits, devices, systems, methods, techniques, communications channels, etc., that may communicate data through the use of modulated electromagnetic radiation through a non-solid medium. The term does not imply that the associated devices do not contain any wires, although in some embodiments they might not. The communication chip 706 may implement any of a number of wireless standards or protocols, including but not limited to Wi-Fi (IEEE 802.11 family), WiMAX (IEEE 802.16 family), IEEE 802.20, long term evolution (LTE), Ev-DO, HSPA+, HSDPA+, HSUPA+, EDGE, GSM, GPRS, CDMA, TDMA, DECT, Bluetooth, derivatives thereof, as well as any other wireless protocols that are designated as 3G, 4G, 5G, and beyond. The computing device 700 may include a plurality of communication chips 706. For instance, a first communication chip 706 may be dedicated to shorter range wireless communications such as Wi-Fi and Bluetooth and a second communication chip 706 may be dedicated to longer range wireless communications such as GPS, EDGE, GPRS, CDMA, WiMAX, LTE, Ev-DO, and others.
The processor 704 of the computing device 700 includes an integrated circuit die packaged within the processor 704. In some implementations of the invention, the integrated circuit die of the processor may be part of an electronic package that comprises a first die over an array of die stacks, in accordance with embodiments described herein. The term “processor” may refer to any device or portion of a device that processes electronic data from registers and/or memory to transform that electronic data into other electronic data that may be stored in registers and/or memory.
The communication chip 706 also includes an integrated circuit die packaged within the communication chip 706. In accordance with another implementation of the invention, the integrated circuit die of the communication chip may be part of an electronic package that comprises a first die over an array of die stacks, in accordance with embodiments described herein.
The above description of illustrated implementations of the invention, including what is described in the Abstract, is not intended to be exhaustive or to limit the invention to the precise forms disclosed. While specific implementations of, and examples for, the invention are described herein for illustrative purposes, various equivalent modifications are possible within the scope of the invention, as those skilled in the relevant art will recognize.
These modifications may be made to the invention in light of the above detailed description. The terms used in the following claims should not be construed to limit the invention to the specific implementations disclosed in the specification and the claims. Rather, the scope of the invention is to be determined entirely by the following claims, which are to be construed in accordance with established doctrines of claim interpretation.
Example 1: an electronic package, comprising: a package substrate; a first die electrically coupled to the package substrate; and an array of die stacks electrically coupled to the first die, wherein the array of die stacks are between the first die and the package substrate, and wherein individual ones of the die stacks comprise: a plurality of second dies arranged in a vertical stack.
Example 2: the electronic package of Example 1, wherein the first die is a compute die, and wherein the second dies are memory dies.
Example 3: the electronic package of Example 1 or Example 2, further comprising: a base substrate.
Example 4: the electronic package of Example 3, wherein the base substrate is between the array of die stacks and the package substrate.
Example 5: the electronic package of Example 3, wherein the base substrate is between the array of die stacks and the first die.
Example 6: the electronic package of Example 3, wherein the first die is between the base substrate and the package substrate.
Example 7: the electronic package of Examples 3-6, wherein the base die is a passive substrate.
Example 8: the electronic package of Examples 3-6, wherein the base die is an active substrate.
Example 9: the electronic package of Example 8, wherein the base die comprises circuitry for power delivery.
Example 10: the electronic package of Examples 1-9, wherein a power delivery path from the package substrate to the first die passes through one or more of the second dies.
Example 11: the electronic package of Examples 1-10, wherein a power delivery path from the package substrate to the first die passes between die stacks.
Example 12: the electronic package of Examples 1-11, further comprising: a third die, wherein a first portion of the array of die stacks is below the first die, and
wherein a second portion of the array of die stacks is below the third die.
Example 13: an electronic package, comprising: a package substrate; a base substrate over the package substrate; an array of die stacks over the base substrate; and a first die over the array of die stacks.
Example 14: the electronic package of Example 13, wherein the first die comprises a plurality of compute engine clusters, and wherein an individual one of the die stacks is positioned below an individual one of the compute engine clusters.
Example 15: the electronic package of Example 14, wherein individual die stacks comprise a plurality of second dies, and wherein each second die comprises a plurality of memory blocks.
Example 16: the electronic package of Example 15, wherein each compute engine cluster comprises a plurality of local compute engines, and wherein individual ones of the local compute engines are above individual ones of the memory blocks.
Example 17: the electronic package of Examples 13-16, wherein a power delivery path from the package substrate to the first die passes through the plurality of die stacks.
Example 18: the electronic package of Examples 13-17, wherein a power delivery path from the package substrate to the first die passes between die stacks.
Example 19: the electronic package of Examples 13-18, further comprising: a third die, wherein a first portion of the array of die stacks is below the first die, and
wherein a second portion of the array of die stacks is below the third die.
Example 20: the electronic package of Examples 13-19, wherein the array of die stacks comprises a four by four array of die stacks.
Example 21: the electronic package of Examples 13-20, wherein individual die stacks comprise two or more second dies arranged in a vertical stack.
Example 22: the electronic package of Example 21, wherein the first die is a compute die, and wherein the second dies are memory dies.
Example 23: an electronic system, comprising: a board; a package substrate attached to the board; a first die electrically coupled to the package substrate; and an array of die stacks electrically coupled to the first die, wherein individual ones of the die stacks comprise: a plurality of second dies arranged in a vertical stack.
Example 24: the electronic system of Example 23, further comprising: a base substrate, wherein the base substrate is between the package substrate and the array of die stacks, between the array of die stacks and the first die, or over the first die.
Example 25: the electronic system of Example 23 or Example 24, wherein a power delivery path from the package substrate to the first die passes between die stacks or passes through the die stacks.