This application is based on and claims priority under 35 U.S.C. § 119 to Korean Patent Application Nos. 10-2022-0170062, filed on Dec. 7, 2022, and 10-2023-0081335, filed on Jun. 23, 2023, in the Korean Intellectual Property Office, the disclosures of which are incorporated by reference herein in their entirety.
The inventive concept relates to a semiconductor device, and more particularly, to a memory device and system that selectively uses some physical interfaces in a memory device constituting a plurality of physical interfaces.
Applications like high performance and/or graphics algorithms are data-intensive and compute-intensive. Machine learning applications, such as neural networks, may include a large number of operations including a large amount of computations and memory requirements. Machine learning applications may require a computing system with large computational and memory capabilities to more accurately train or learn different data sets.
A high bandwidth memory (HBM) is a high-performance RAM interface for 3-dimensionally stacked dynamic random access memories (DRAM). An HBM may be used for memory-centric and heavy computation neural networks or other artificial intelligences (AI). An HBM provides wide input/output in the form of a multi-channel interface and may include a physical interface (hereinafter referred to as “PHY”) used for communication with a memory controller of a host using the HBM. The memory controller may also include a PHY used for communication with the HBM, wherein the PHY of the memory controller corresponds to the PHY of the HBM on the one-on-one basis.
An HBM may perform high-capacity memory operations demanded by applications and may include multiple PHYs to support the high-capacity memory operations. Correspondingly, the number of PHYs in the memory controller may also increase, and thus the chip area of the memory controller may increase.
Embodiments of inventive concept may provide a memory device and a system that selectively utilizes a plurality of physical interfaces included in the memory device without increasing the chip area of a memory controller.
According to an aspect of the inventive concept, there is provided a memory device including a buffer die including a first interface circuit and a second interface circuit configured to communicate with an external device, wherein the first interface circuit is configured to activate responsive to a first selection signal, and the second interface circuit is configured to activate responsive to a second selection signal, and a memory die stack mounted on the buffer die and including a plurality of memory dies, wherein the plurality of memory dies are electrically connected to the first interface circuit and the second interface circuit, wherein the first selection signal and the second selection signal are received from a memory controller external to the memory device.
According to another aspect of the inventive concept, there is provided a memory device including a buffer die including a first interface circuit and a second interface circuit configured to communicate with an external device, wherein the first interface circuit is configured to activate responsive to a first selection signal, and the second interface circuit is configured to activate responsive to a second selection signal, and a memory die stack mounted on the buffer die and including a plurality of memory dies, wherein the plurality of memory dies are electrically connected to the first interface circuit and the second interface circuit, wherein, which of the first interface circuit and the second interface circuit is activated to communicate with an external memory controller is based on whether the first selection signal is fixed to a first voltage level or a second voltage level different from the first voltage level and whether the second selection signal is fixed to the first voltage level or the second voltage level.
According to another aspect of the inventive concept, there is provided a memory device including a buffer die including a first interface circuit and a second interface circuit configured to communicate with an external device, wherein the first interface circuit is configured to activate responsive to a first selection signal, and the second interface circuit is configured to activate responsive to a second selection signal, and a memory die stack mounted on the buffer die and including a plurality of memory dies, wherein the plurality of memory dies are electrically connected to the first interface circuit and the second interface circuit, wherein the first selection signal and the second selection signal are generated inside the memory device responsive to an interface selection signal received from a memory controller external to the memory device.
Embodiments of the inventive concept will be more clearly understood from the following detailed description taken in conjunction with the accompanying drawings in which:
a and 9B are diagrams that illustrate a memory device according to embodiments;
a and 11B are diagrams that illustrate a memory device according to embodiments;
Referring to
The CPU 110 may be configured to execute instructions, software, firmware, or pieces of combinations thereof that may be executed by one or more machines. The CPU 110 may include any number of processor cores. For example, the CPU 110 may include a single-core or a multi-core like dual-core, quad-core, and hexa-core.
The memory device 100 may be a high bandwidth memory (HBM) including a plurality of stacked memory dies 240 (
The CPU 110 may include a memory controller 111 that controls the HBM 100. The memory controller 111 may include an interface circuit 112 for performing data communication with the HBM 100. The interface circuit 112 is connected to the HBM PHY 102 and may include a physical or electrical layer and a logical layer provided for signals, frequencies, timings, operation parameters, detailed operation parameters, and functionality needed for efficient communication between the CPU 110 and the HBM 100. The interface circuit 112 may perform memory interfacing, such as transmitting a memory cell address and write data to the HBM 100 and receiving read data output from the HBM 100. The interface circuit 112 may be referred to as a controller PHY 112, in correspondence to the term HBM PHY 102.
The controller PHY 112 may be coupled to a bus 130 that transfers a clock signal CK, a command/address CMD/ADDR, and data DQ to the channels CH1 to CH8 of the HBM 100. The controller PHY 112 and the HBM PHY 102 may communicate with each other through various buses. The clock signal CK may be provided between the memory controller 111 and the HBM 100 through a clock bus 130. The clock bus 130 may include signal lines for providing clock signals received by the HBM 100 (e.g., CK_t, CK_c, WDQS_t, and WDQS_c) and read clock signals (e.g., RDQS_t and RDQS_c) provided by the HBM 100 to the memory controller 111. The command/address CMD/ADDR is received by the HBM 100 on a command/address bus 130, and the data DQ is transmitted between the memory controller 111 and the HBM 100 through a DQ bus 130. Each bus 130 may include one or more signal lines on which signals are provided.
Clock signals CK_t and CK_c provided to the HBM 100 by the memory controller 111 are used for timing in the operations of providing and capturing the command/address CMD/ADDR, and clock signals WDQS_t and WDQS_c are used for timing in the operations of providing the data DQ. Clock signals RDQS_t and RDQS_c provided to the memory controller 111 by the HBM 100 are used for timing in the operations of providing the data DQ read from the HBM 100. The clock signals CK_t and CK_c clocks and the clock signals WDQS_t and WDQS_c are complementary with respect to each other, and the clock signals RDQS_t and RDQS_c are complementary with respect to each other. Clock signals are complementary with respect to each other when the rising edge of a first clock signal coincides with the falling edge of a second clock signal and the rising edge of the second clock signal coincides with the falling edge of the first clock signal. Hereinafter, for convenience of description, the clock signals CK_t and CK_c may be referred to as clock signals CK, the clock signals WDQS_t and WDQS_c may be referred to as clock signals WDQS, and the clock signals RDQS_t and RDQS_c may be referred to as clock signals RDQS.
When executing an application, the CPU 110 may need a large amount of computational capability and high memory capability to cooperatively execute jobs or tasks in parallel. The CPU 110 may allow overall jobs or tasks to be executed in parallel on the HBM PHY 102. In other words, the CPU 110 may use a parallel processing approach of dividing a job into smaller jobs by using a plurality of HBM PHYs 102a and 102b to solve an overall job or task, as shown in
Referring to
Therefore, because the two HBM PHYs 102a and 102b may be selectively controlled by using one bus 130 and one controller PHY 112, a high-speed and high-performance solution for the CPU 110 may be provided without increasing the chip area of the memory controller 111a.
Referring to
The first selection signal PS1 is provided from the controller PHY 212 to the first HBM PHY 202a and may serve as a signal to activate or deactivate the operation of the first HBM PHY 202a. The second selection signal PS2 is provided from the controller PHY 212 to the second HBM PHY 202b and may serve as a signal to activate or deactivate the operation of the second HBM PHY 202b. Activation or deactivation of each of the first HBM PHY 202a and the second HBM PHY 202b may be determined according to the logic level of each of the first selection signal PS1 and the second selection signal PS2. The different logic values may respectively correspond to different signal voltage levels. For example, when the first selection signal PS1 is at a logic high level, the first HBM PHY 202a may be activated, and, when the first selection signal PS1 is at a logic low level, the first HBM PHY 202a may be deactivated. When the second selection signal PS2 is at a logic high level, the second HBM PHY 202b may be activated, and, when the second selection signal PS2 is at a logic low level, the second HBM PHY 202b may be deactivated. The first selection signal PS1 and the second selection signal PS2 may each be received by the HBM 200 through an electrical connector (or a solder ball) of the HBM 200. The HBM 200 may activate or deactivate each of the first HBM PHY 202a and the second HBM PHY 202b according to the logic levels of the first selection signal PS1 and the second selection signal PS2, respectively.
The HBM 200 may include a mode register set (MRS) 204 that sets a plurality of operation options, various functions, characteristics, and modes of the HBM 200. The MRS 204 includes mode registers that store parameter codes for various operation parameters and control parameters and may be set up during initialization of the HBM 200 after the system 20 is powered up. The memory controller 211 may store codes representing the operating frequency, timing, drivers, detailed operation parameters, etc. of the HBM 200 to the MRS 204 according to the specifications of the HBM 200, such that the memory controller 211 may normally interoperate with the HBM 200. For example, the MRS 204 may store a burst length BL, a read latency RL, and operation parameter codes associated with the first HBM PHY 202a and the second HBM PHY 202b, etc. The burst length BL may be provided to set the maximum number of column locations that may be accessed for a read command and/or a write command. The read latency RL may be provided to define a clock cycle delay between a read command and a first bit of valid output data. The operation parameter codes associated with the first HBM PHY 202a and the second HBM PHY 202b may be provided to define a PHY operation mode and a multi-PHY connection sequence, as shown in
Referring to
Referring to
The first mode register 302 may store PHY mode parameters indicating whether a single PHY mode or a multi-PHY mode is supported for the first HBM PHY 202a and the second HBM PHY 202b. A PHY mode parameter may be expressed by an 1-bit parameter code. For example, a bit value “0” stored in a register OP[0] of the first mode register 302 may indicate the single PHY mode in which one HBM PHY of the first HBM PHY 202a and the second HBM PHY 202b is activated, and a bit value “1” stored in the register OP[0] may indicate the multi-PHY mode in which both the first HBM PHY 202a and the second HBM PHY 202b are activated. Conversely, the bit value “0” stored in the register OP[0] may indicate the multi-PHY mode, and the bit value “1” stored in the register OP[0] may indicate the single PHY mode. According to some embodiments, the PHY mode parameter code for the first HBM PHY 202a and the second HBM PHY 202b may include more than 1 bit.
In the single PHY mode, the HBM 200 may perform data communication between each of the first HBM PHY 202a and the second HBM PHY 202b and the memory controller 211 according to respective logic levels of the first selection signal PS1 and the second selection signal PS2 selectively provided by the memory controller 211. For example, according to the logic high level of the first selection signal PS1, the first HBM PHY 202a may be connected to the bus 230 to perform data communication between the memory controller 211 and the first HBM PHY 202a, and, according to the logic high level of the second selection signal PS2, the second HBM PHY 202b may be connected to the bus 230 to perform data communication between the memory controller 211 and the second HBM PHY 202b (e.g.,
In the multi PHY mode, the HBM 200 may perform data communications between the first HBM PHY 202a and the second HBM PHY 202b and the memory controller 211 according to the logic high level of the first selection signal PS1 and the second selection signal PS2 substantially simultaneously provided by the memory controller 211. At this time, the first HBM PHY 202a and the second HBM PHY 202b need to perform data communications with the memory controller 211 through the bus 230 in a specific sequence. In other words, the multi PHY mode set in the first mode register 302 may be supported along with an order that the first HBM PHY 202a and the second HBM PHY 202b are connected to the bus 230.
The second mode register 304 may store a multi PHY connection order parameter indicating the order that the first HBM PHY 202a and the second HBM PHY 202b are connected to the bus 230. The multi PHY connection order parameter may be expressed by a 2-bit parameter code. A bit value “00” stored in the register OP[1:0] of the second mode register 304 is a default value and may indicate that a multi PHY connection order is disabled. For example, when the single PHY mode is set in the first mode register 302, it is not necessary to set the multi PHY connection order, and thus the multi PHY connection order is disabled.
A bit value “01” stored in the register OP[1:0] of the second mode register 304 may indicate an order that the first HBM PHY 202a is connected to the bus 230 first and the second HBM PHY 202b is connected to the bus 230 later, and a bit value “10” stored in the register OP[1:0] may indicate an order that the second HBM PHY 202b is connected to the bus 230 first and the first HBM PHY 202a is connected to the bus 230 later. Conversely, the bit value “01” stored in the register OP[1:0] of the second mode register 304 may indicate an order that the second HBM PHY 202b is connected to the bus 230 first and the first HBM PHY 202a is connected to the bus 230 later, and the bit value “10” stored in the register OP[1:0] may indicate an order that the first HBM PHY 202a is connected to the bus 230 first and the second HBM PHY 202b is connected to the bus 230 later. According to some embodiments, the multi PHY connection order parameter codes for the first HBM PHY 202a and the second HBM PHY 202b may include more than 2 bits.
Meanwhile, in the multi PHY mode, an HBM (e.g., 800 of
The third mode register 306 may store an HBM version parameter indicating whether the HBM 200 is an HBM3 product or an HBM4 product. The HBM version parameter may be expressed by an 1-bit parameter code. For example, a bit value “0” stored in the register OP[0] of the third mode register 306 may indicate an HBM3 product, and a bit value “1” stored in the register OP[0] may indicate an HBM4 product. Conversely, the bit value “0” stored in the register OP[0] of the third mode register 306 may indicate an HBM4 product, and the bit value “1” stored in the register OP[0] of the third mode register 306 may indicate an HBM3 product. According to some embodiments, the HBM version parameter code for the HBM 200 may include more than 1 bit.
The fourth mode register 308 may store an HBM model name parameter indicating the model name of the HBM 200. An HBM IC specific number parameter code may be expressed as a vendor-specific 8-bit parameter code.
Referring to
The buffer die 222 may communicate with the memory controller 211 through conductive means formed on the outer surface of the HBM 200, e.g., bumps or solder balls (e.g., 250 of
The HBM 200 may include a plurality of through silicon vias (TSVs) 262 penetrating or extending through the DRAM dies 240a to 240d of the DRAM die stack 240. When each of the channels CH1 to CH8 has a bandwidth of 128 bits, the TSVs 262 may include components for inputting/outputting data of 1024 bits. Each of the channels CH1 to CH8 may be separated into two pseudo channels. For example, in the fourth DRAM die 240d, the sixth channel CH6 may be divided into pseudo channels CH6a and CH6b and the eighth channel CH6 may be divided into pseudo channels CH8a and CH8b. Each of pseudo channels CH6a, CH6b, CH8a, and CH8b may include 64-bit data DQ. The TSVs 262 may be arranged between the pseudo channels CH6a and CH6b of the sixth channel CH6 and between pseudo channels CH8a and CH8b of the eighth channel CH8.
The buffer die 222 may include the MRS 204, the first HBM PHY 202a, and the second HBM PHY 202b. The MRS 204 may store parameter codes indicating a PHY operation mode and a multi PHY connection order for the first HBM PHY 202a and the second HBM PHY 202b. The first HBM PHY 202a may be activated by the first selection signal PS1, may transmit the clock signal CK, the command/address CMD/ADDR, and the data DQ received from the memory controller 211 through the bus 230 to each of the channels CH1 to CH8, and may transmit the data DQ output from each of the channels CH1 to CH8 to the memory controller 211 through the bus 230. The second HBM PHY 202b may be activated by the second selection signal PS2, may transmit the clock signal CK, the command/address CMD/ADDR, and the data DQ received from the memory controller 211 through the bus 230 to each of the channels CH1 to CH8, and may transmit the data DQ output from each of the channels CH1 to CH8 to the memory controller 211 through the bus 230. The first HBM PHY 202a and the second HBM PHY 202b may be configured to be identical to each other, except that the first HBM PHY 202a and the second HBM PHY 202b are activated by the first selection signal PS1 and the second selection signal PS2, respectively.
Referring to
The DRAM die stack 240 may include the TSVs 262. A TSV 262 is an electrode formed by forming a hole in a wafer through laser drilling or chemical etching such as deep reactive ion etching (DRIE) and filling the hole through plating. The first to fourth DRAM dies 240a to 240d of the DRAM die stack 240 may be stacked through the TSVs 262 and electrically connected to one another through bumps 272. The bumps 272 are conductive protrusions that may electrically interconnect the first to fourth DRAM dies 240a to 240d and the buffer die 222.
The memory controller 211 may control the HBM 200 by transmitting various commands needed for operation of the HBM 200 to the HBM 200. The memory controller 211 may perform data communication to store specific data in the HBM 200 or to read data stored in the HBM 200. The memory controller 211 may perform data communication with the HBM 200 through the first HBM PHY 202a and the second HBM PHY 202b. For example, the memory controller 211 may perform data communication by using any one of the first HBM PHY 202a and the second HBM PHY 202b or both of them. Parameter codes indicating a PHY operation mode and a multi PHY connection order for the first HBM PHY 202a and the second HBM PHY 202b used for data communication with the memory controller 211 may be set to the MRS 204 (
The interposer 502 may buffer the difference between circuit line widths of the HBM 200 and the PCB 504. The interposer 502 is an electrical interface that provides routes between connections to one socket or another to extend electrical wires to a wider pitch or to reroute wires to wires of a different pitch. The interposer 502 may physically connect the HBM 200, the memory controller 211, and the PCB 504. The HBM 200 and the memory controller 211 may transmit and receive data through wires arranged at the interposer 502. A line for the first selection signal PS1 for selecting and activating the first HBM PHY 202a and a line for the second selection signal PS2 for selecting and activating the second HBM PHY 202b may be arranged at the interposer 502.
Referring to
At the time point Ta3, a second read command RD2 synchronized to the clock signal CK may be applied. Together with the second read command RD2, a column address designating memories of the channels CH1 to CH8 on which the read operation is to be performed and the second selection signal PS2 at the logic high level may be received. At this time, the first selection signal PS1 may be received at a logic low level. The first HBM PHY 202a may be deactivated in response to the first selection signal PS1 being at the logic low level, and the second HBM PHY 202b may be activated in response to the second selection signal PS2 being at the logic high level. After the read latency RL is elapsed from the time point Ta3, read data DQ corresponding to the burst length BL=8 output from the second HBM PHY 202b may be synchronized to the clock signal RDQS and output to the data bus 230 at a time point Ta4. The read data DQ of the second HBM PHY 202b according to the second read command RD2 and the second selection signal PS2 may be synchronized to the clock signal RDQS and output from the time point Ta4 to a time point Ta5.
Referring to
After read latency RL is elapsed from the time point Tb1, at a time point Tb2, the first HBM PHY 202a may prepare to output the read data DQ having the burst length BL=8, and the second HBM PHY 202b may also prepare to output the read data DQ having the burst length BL=8. According to the multi PHY connection order stored in the MRS 204, the read data DQ of the first HBM PHY 202a may be output first to the data bus 230, and then the read data DQ of the second HBM PHY 202b may be output to the data bus 230. In synchronization with the clock signal RDQS, the read data DQ of the first HBM PHY 202a may be output from the time point Tb2 to a time point Tb3, and the read data DQ of the second HBM PHY 202b may be output from the time point Tb3 to a time point Tb4.
a and 9B are diagrams that illustrate a memory device according to embodiments.
Referring to
The system 20b may be configured to perform a multi PHY mode operation on the first HBM PHY 802a and the second HBM PHY 802b of the HBM 800, as shown in
The system 20b may be configured to perform a single PHY mode operation on the first HBM PHY 802a and the second HBM PHY 802b of the HBM 800, as shown in
For example, the first selection signal PS1 of the first HBM PHY 802a may be connected to a line of the power voltage VDD, and the second selection signal PS2 of the second HBM PHY 802b may be connected to a line of the ground voltage VSS. Such line connections of the first selection signal PS1 and the second selection signal PS2 for the first HBM PHY 802a and the second HBM PHY 802b may be implemented by using the interposer 502 (
Referring to
Referring to
a and 11B are diagrams that illustrate a memory device according to embodiments.
Referring to
Referring to
Referring to
Referring to
The decoder circuit 1202 may decode the PHY selection signal PS provided from the memory controller 211 and generate the first internal selection signal iPS1 and the second internal selection signal iPS2. The first internal selection signal iPS1 may be provided to the first HBM PHY 202a, and the first HBM PHY 202a may be activated in response to the first internal selection signal iPS1 at a logic high level. The second internal selection signal iPS2 may be provided to the second HBM PHY 202b, and the second HBM PHY 202b may be activated in response to the second internal selection signal iPS2 at a logic high level. For example, when the PHY selection signal PS is provided at a logic low level, the decoder circuit 1202 may output the first internal selection signal iPS1 at a logic high level and the second internal selection signal iPS2 at the logic low level. When the PHY selection signal PS at the logic high level is provided, the decoder circuit 1202 may output the first internal selection signal iPS1 at the logic low level and the second internal selection signal iPS2 at the logic high level. According to some embodiments, the decoder circuit 1202 may be implemented as a demultiplexer circuit.
In the system 20d, the memory controller 211 may set the single PHY mode to the MRS 204 of the HBM 1200. The memory controller 211 may activate any one HBM PHY from between the first HBM PHY 202a and the second HBM PHY 202b by using the logic level of the PHY selection signal PS and perform data communication with an activated HBM PHY through the bus 1230.
In the system 20d, the memory controller 211 may set the multi PHY mode to the MRS 204 of the HBM 1200 and set a multi PHY connection order to a default value (disabled). The memory controller 211 may perform data communications between each of the first HBM PHY 202a and the second HBM PHY 202b and the memory controller 211 by using the logic level of the PHY selection signal PS. For example, the memory controller 211 may provide the PHY selection signal PS at the logic low level to perform data communication with the first HBM PHY 802a first and perform data communication with the second HBM PHY 802b after the first PHY 802a. Alternatively, the memory controller 211 may provide the PHY selection signal PS of the logic high level to perform data communication with the second HBM PHY 802b first and perform data communication with the first HBM PHY 802a after the second HBM PHY 802b.
Referring to
The HBM 200 may perform a control operation to operate according to the HBM3 version in operation S1320. The HBM 200 may perform a control operation to operate according to the HBM4 version in operation S1321.
Based on the HBM3 version determined in operation S1320, HBM 200 may operate in the single PHY mode (operation S1330). In the single PHY mode of the HBM3, the HBM 200 may control the first HBM PHY 202a and the second HBM PHY 202b to perform data communication with the memory controller 211 based on the logic levels of the first selection signal PS1 and the second selection signal PS2 selectively provided by the memory controller 211, respectively.
Based on the HBM4 version determined in operation S1321, the HBM 200 may operate in the single PHY mode (operation S1340) or the multi PHY mode (operation S1341). In the single PHY mode of the HBM4, the HBM 200 may control the first HBM PHY 202a and the second HBM PHY 202b to perform data communication with the memory controller 211 based on the logic levels of the first selection signal PS1 and the second selection signal PS2 selectively provided by the memory controller 211, respectively. In the multi PHY mode of the HBM4, the HBM 200 may connect the first HBM PHY 202a and the second HBM PHY 202b to the bus 230 in the order set in the multi PHY connection order parameter and control each of the first HBM PHY 202a and the second HBM PHY 202b to perform data communication with the memory controller 211 according to the multi PHY connection order.
Referring to
The camera 2100 may capture a still image or a video according to a user's control and may store captured image/video data or transmit the captured image/video data to the display 2200. The audio processor 2300 may process audio data included in the flash memories 2600a and 2600b or network content. The modem 2400 may transmit a modulated signal for wired/wireless data transmission/reception to a receiver and the modulated signal may be demodulated by the receiver to restore an original signal. The I/O devices 2700a and 2700b may include devices providing a digital input function and/or digital output function, e.g., a Universal Serial Bus (USB), a storage, a digital camera, a Secure Digital (SD) card, a Digital Versatile Disc (DVD), a network adapter, a touch screen, etc.
The AP 2800 may control the overall operation of the system 2000. The AP 2800 may include a control block 2810, an accelerator block or accelerator chip 2820, and an interface block 2830. The AP 2800 may control the display 2200, such that a part of content stored in the flash memories 2600a and 2600b is displayed on the display 2200. When a user input is received through the I/O devices 2700a and 2700b, the AP 2800 may perform a control operation corresponding to the user input. The AP 2800 may include an accelerator block, which is a circuit dedicated for calculation of Artificial Intelligence (AI) data, or may include an accelerator chip 2820 separately from the AP 2800. The DRAM 2500b may be additionally provided in the accelerator block or the accelerator chip 2820. The accelerator block is a functional block that specializes in performing a particular function of the AP 2800 and may include a GPU, which is a functional block that specializes in processing graphic data, a neural processing unit (NPU), which is a block that specializes in AI calculation and inference, and a data processing unit (DPU), which is a block that specializes in data transmission.
The system 2000 may include a plurality of DRAMs 2500a and 2500b. The AP 2800 may set up a DRAM interface protocol and communicate with the DRAMs 2500a and 2500b to control the DRAMs 2500a and 2500b through commands complying with the Joint Electron Device Engineering Council (JEDEC) standard and mode register (MRS) setting or to use company-specific functions such as low voltage/high-speed/reliability and a cyclic redundancy check (CRC)/error correction code (ECC) function. For example, the AP 2800 may communicate with the DRAM 2500a through an interface complying with the JEDEC standards such as LPDDR4 and LPDDR5, and the accelerator block or the accelerator chip 2820 may set and use a new DRAM interface protocol to control the DRAM 2500b for an accelerator, which has a greater bandwidth than the DRAM 2500a.
Although
In the DRAMs 2500a and 2500b, four arithmetic operations (i.e., addition, subtraction, multiplication, and division), vector calculations, address calculations, or Fast Fourier Transform (FFT) calculations may be performed. Also, in the DRAMs 2500a and 2500b, a function for an operation used for an inference may be performed, e.g., an AI operation. Here, the inference may be performed in a deep learning algorithm using an artificial neural network. The deep learning algorithm may include operations for training a model through various data and operations for operating the model in inference or prediction mode for recognizing data with the trained model. According to an embodiment, an image captured by a user through the camera 2100 is signal-processed and stored in the DRAM 2500b, and the accelerator block or accelerator chip 2820 may perform AI data calculation for recognizing data using data stored in the DRAM 2500b and a trained model used for inference.
The system 2000 may include a plurality of storage entities or flash memories 2600a and 2600b having a larger capacity than the DRAMs 2500a and 2500b. The accelerator block or accelerator chip 2820 may perform a training operation for an AI model and an AI data calculation associated with an inference or prediction when the AI model is in inference mode using the flash memories 2600a and 2600b. According to an embodiment, the flash memories 2600a and 2600b may include a memory controller 2610 and a flash memory device 2620, and a training operation and an inference AI data calculation performed by the AP 2800 and/or the accelerator chip 2820 may be performed more efficiently by using an arithmetic unit included in the memory controller 2610. The flash memories 2600a and 2600b may store images captured through the camera 2100 or data transmitted through a data network. For example, the flash memories 2600a and 2600b may store Augmented Reality/Virtual Reality content, High Definition (HD) content, or Ultra High Definition (UHD) content.
In the system 2000, the DRAMs 2500a and 2500b may include the memory device described above with reference to
While the inventive concept has been particularly shown and described with reference to embodiments thereof, it will be understood that various changes in form and details may be made therein without departing from the spirit and scope of the following claims.
Number | Date | Country | Kind |
---|---|---|---|
10-2022-0170062 | Dec 2022 | KR | national |
10-2023-0081335 | Jun 2023 | KR | national |