Read threshold voltage estimation systems and methods for parametric PV-level modeling

Abstract

Embodiments provide a scheme for estimating an optimal read threshold voltage using a deep neural network (DNN) with reduced number of processing. A controller receives first and second program voltage (PV) levels associated with read operations on cells. The controller estimates first and second probability distribution parameter sets representing skew normal distributions of the first and second PV levels, respectively. The controller estimates an optimal read threshold voltage based on the first and second probability distribution parameter sets. The optimal read threshold voltage is a read threshold voltage such that first probability density function (PDF) value of the skew normal distribution of the first PV level is the same as the second PDF value of the skew normal distribution of the second PV level.

Description

BACKGROUND

1. Field

Embodiments of the present disclosure relate to a scheme for determining an optimal read threshold voltage in a memory system.

2. Description of the Related Art

The computer environment paradigm has shifted to ubiquitous computing systems that can be used anytime and anywhere. As a result, the use of portable electronic devices such as mobile phones, digital cameras, and notebook computers has rapidly increased. These portable electronic devices generally use a memory system having memory device(s), that is, data storage device(s). The data storage device is used as a main memory device or an auxiliary memory device of the portable electronic devices.

Memory systems using memory devices provide excellent stability, durability, high information access speed, and low power consumption, since the memory devices have no moving parts. Examples of memory systems having such advantages include universal serial bus (USB) memory devices, memory cards having various interfaces such as a universal flash storage (UFS), and solid state drives (SSDs). Memory systems may determine an optimal read threshold voltage among read threshold voltages according to various schemes.

SUMMARY

Aspects of the present invention include a system and a method for an optimal read threshold voltage estimation using parametric PV-level modeling based on a deep neural network (DNN) with reduced number of processing.

In one aspect of the present invention, a memory system includes a memory device including a plurality of cells and a controller. The controller receives first and second program voltage (PV) levels associated with read operations on the cells; estimates first and second probability distribution parameter sets representing skew normal distributions of the first and second PV levels, respectively; and estimates an optimal read threshold voltage based on the first and second probability distribution parameter sets, the optimal read threshold voltage being a read threshold voltage such that first probability density function (PDF) value of the skew normal distribution of the first PV level is the same as the second PDF value of the skew normal distribution of the second PV level.

In another aspect of the present invention, a method for operating a memory system, which includes a memory device including a plurality of cells and a controller, includes: receiving first and second program voltage (PV) levels associated with read operations on the cells; estimating first and second probability distribution parameter sets representing skew normal distributions of the first and second PV levels, respectively; and estimating an optimal read threshold voltage based on the first and second probability distribution parameter sets, the optimal read threshold voltage being a read threshold voltage such that first probability density function (PDF) value of the skew normal distribution of the first PV level is the same as the second PDF value of the skew normal distribution of the second PV level.

Additional aspects of the present invention will become apparent from the following description.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a block diagram illustrating a data processing system in accordance with an embodiment of the present invention.

FIG. 2 is a block diagram illustrating a memory system in accordance with an embodiment of the present invention.

FIG. 3 is a circuit diagram illustrating a memory block of a memory device in accordance with an embodiment of the present invention.

FIG. 4 is a diagram illustrating distributions of states for different types of cells of a memory device in accordance with an embodiment of the present invention.

FIG. 5A is a diagram illustrating an example of Gray coding for a multi-level cell (MLC) in accordance with an embodiment of the present invention.

FIG. 5B is a diagram illustrating state distributions for pages of a multi-level cell (MLC) in accordance with an embodiment of the present invention.

FIG. 6A is a diagram illustrating an example of Gray coding for a triple-level cell (TLC) in accordance with an embodiment of the present invention.

FIG. 6B is a diagram illustrating state distributions for pages of a triple-level cell (TLC) in accordance with an embodiment of the present invention.

FIG. 7 is a diagram illustrating a flow of an error recovery algorithm in a memory system in accordance with an embodiment of the present invention.

FIG. 8 is a diagram illustrating an operation for estimating an optimal read threshold voltage by various eBoost algorithms in accordance with an embodiment of the present invention.

FIGS. 9A and 9B illustrate read threshold voltage (Vt) distributions of memory cells in accordance with an embodiment of the present invention.

FIG. 10 is a diagram illustrating a memory system in accordance with an embodiment of the present invention.

FIG. 11 is a diagram illustrating a neural network in accordance with an embodiment of the present invention.

FIG. 12 is a diagram illustrating a training component in accordance with an embodiment of the present invention.

FIG. 13 is a diagram illustrating an inference component in accordance with an embodiment of the present invention.

FIG. 14 illustrates an operation for determining an optimal read threshold voltage in accordance with an embodiment of the present invention.

FIG. 15 is a diagram illustrating an optimal read threshold determination apparatus in accordance with an embodiment of the present invention.

FIG. 16 illustrates a graph of an example optimal read threshold voltage estimated by a voltage determiner in accordance with an embodiment of the present invention.

DETAILED DESCRIPTION

Various embodiments of the present invention are described below in more detail with reference to the accompanying drawings. The present invention may, however, be embodied in different forms and thus should not be construed as limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure is thorough and complete, and fully conveys the scope of the present invention to those skilled in the art. Moreover, reference herein to “an embodiment,” “another embodiment,” or the like is not necessarily to only one embodiment, and different references to any such phrase are not necessarily to the same embodiment(s). The term “embodiments” as used herein does not necessarily refer to all embodiments. Throughout the disclosure, like reference numerals refer to like parts in the figures and embodiments of the present invention.

The present invention can be implemented in numerous ways, including as a process; an apparatus; a system; a computer program product embodied on a computer-readable storage medium; and/or a processor, such as a processor suitable for executing instructions stored on and/or provided by a memory coupled to the processor. In this specification, these implementations, or any other form that the present invention may take, may be referred to as techniques. In general, the order of the operations of disclosed processes may be altered within the scope of the present invention. Unless stated otherwise, a component such as a processor or a memory described as being suitable for performing a task may be implemented as a general component that is temporarily configured to perform the task at a given time or a specific component that is manufactured to perform the task. As used herein, the term ‘processor’ or the like refers to one or more devices, circuits, and/or processing cores suitable for processing data, such as computer program instructions.

The methods, processes, and/or operations described herein may be performed by code or instructions to be executed by a computer, processor, controller, or other signal processing device. The computer, processor, controller, or other signal processing device may be those described herein or one in addition to the elements described herein. Because the algorithms that form the basis of the methods (or operations of the computer, processor, controller, or other signal processing device) are described in detail, the code or instructions for implementing the operations of the method embodiments may transform the computer, processor, controller, or other signal processing device into a special-purpose processor for performing methods herein.

When implemented at least partially in software, the controllers, processors, devices, modules, units, multiplexers, generators, logic, interfaces, decoders, drivers, generators and other signal generating and signal processing features may include, for example, a memory or other storage device for storing code or instructions to be executed, for example, by a computer, processor, microprocessor, controller, or other signal processing device.

A detailed description of embodiments of the present invention is provided below along with accompanying figures that illustrate aspects of the present invention. The present invention is described in connection with such embodiments, but the present invention is not limited to any embodiment. The scope of the present invention is limited only by the claims. The present invention encompasses numerous alternatives, modifications and equivalents within the scope of the claims. Numerous specific details are set forth in the following description in order to provide a thorough understanding of the present invention. These details are provided for the purpose of example; the present invention may be practiced according to the claims without some or all of these specific details. For clarity, technical material that is known in technical fields related to the present invention has not been described in detail so that the invention is not unnecessarily obscured.

FIG. 1 is a block diagram illustrating a data processing system 2 in accordance with an embodiment of the present invention.

Referring FIG. 1, the data processing system 2 may include a host device 5 and a memory system 10. The memory system 10 may receive a request from the host device 5 and operate in response to the received request. For example, the memory system 10 may store data to be accessed by the host device 5.

The host device 5 may be implemented with any of various types of electronic devices. In various embodiments, the host device 5 may include an electronic device such as a desktop computer, a workstation, a three-dimensional (3D) television, a smart television, a digital audio recorder, a digital audio player, a digital picture recorder, a digital picture player, and/or a digital video recorder and a digital video player. In various embodiments, the host device 5 may include a portable electronic device such as a mobile phone, a smart phone, an e-book, an MP3 player, a portable multimedia player (PMP), and/or a portable game player.

The memory system 10 may be implemented with any of various types of storage devices such as a solid state drive (SSD) and a memory card. In various embodiments, the memory system 10 may be provided as one of various components in an electronic device such as a computer, an ultra-mobile personal computer (PC) (UMPC), a workstation, a net-book computer, a personal digital assistant (PDA), a portable computer, a web tablet PC, a wireless phone, a mobile phone, a smart phone, an e-book reader, a portable multimedia player (PMP), a portable game device, a navigation device, a black box, a digital camera, a digital multimedia broadcasting (DMB) player, a 3-dimensional television, a smart television, a digital audio recorder, a digital audio player, a digital picture recorder, a digital picture player, a digital video recorder, a digital video player, a storage device of a data center, a device capable of receiving and transmitting information in a wireless environment, a radio-frequency identification (RFID) device, as well as one of various electronic devices of a home network, one of various electronic devices of a computer network, one of electronic devices of a telematics network, or one of various components of a computing system.

The memory system 10 may include a memory controller 100 and a semiconductor memory device 200. The memory controller 100 may control overall operations of the semiconductor memory device 200.

The semiconductor memory device 200 may perform one or more erase, program, and read operations under the control of the memory controller 100. The semiconductor memory device 200 may receive a command CMD, an address ADDR and data DATA through input/output lines. The semiconductor memory device 200 may receive power PWR through a power line and a control signal CTRL through a control line. The control signal CTRL may include a command latch enable signal, an address latch enable signal, a chip enable signal, a write enable signal, a read enable signal, as well as other operational signals depending on design and configuration of the memory system 10.

The memory controller 100 and the semiconductor memory device 200 may be integrated in a single semiconductor device such as a solid state drive (SSD). The SSD may include a storage device for storing data therein. When the semiconductor memory system 10 is used in an SSD, operation speed of a host device (e.g., host device 5 of FIG. 1) coupled to the memory system 10 may remarkably improve.

The memory controller 100 and the semiconductor memory device 200 may be integrated in a single semiconductor device such as a memory card. For example, the memory controller 100 and the semiconductor memory device 200 may be integrated to configure a personal computer (PC) card of personal computer memory card international association (PCMCIA), a compact flash (CF) card, a smart media (SM) card, a memory stick, a multimedia card (MMC), a reduced-size multimedia card (RS-MMC), a micro-size version of MMC (MMCmicro), a secure digital (SD) card, a mini secure digital (miniSD) card, a micro secure digital (microSD) card, a secure digital high capacity (SDHC), and/or a universal flash storage (UFS).

FIG. 2 is a block diagram illustrating a memory system in accordance with an embodiment of the present invention. For example, the memory system of FIG. 2 may depict the memory system 10 shown in FIG. 1.

Referring to FIG. 2, the memory system 10 may include a memory controller 100 and a semiconductor memory device 200. The memory system 10 may operate in response to a request from a host device (e.g., host device 5 of FIG. 1), and in particular, store data to be accessed by the host device.

The memory device 200 may store data to be accessed by the host device.

The memory device 200 may be implemented with a volatile memory device such as a dynamic random access memory (DRAM) and/or a static random access memory (SRAM) or a non-volatile memory device such as a read only memory (ROM), a mask ROM (MROM), a programmable ROM (PROM), an erasable programmable ROM (EPROM), an electrically erasable programmable ROM (EEPROM), a ferroelectric random access memory (FRAM), a phase change RAM (PRAM), a magnetoresistive RAM (MRAM), and/or a resistive RAM (RRAM).

The controller 100 may control storage of data in the memory device 200. For example, the controller 100 may control the memory device 200 in response to a request from the host device. The controller 100 may provide data read from the memory device 200 to the host device, and may store data provided from the host device into the memory device 200.

The controller 100 may include a storage 110, a control component 120 which may be implemented as a processor such as a central processing unit (CPU), an error correction code (ECC) component 130, a host interface (I/F) 140 and a memory interface (I/F) 150, which are coupled through a bus 160.

The storage 110 may serve as a working memory of the memory system 10 and the controller 100, and store data for driving the memory system 10 and the controller 100. When the controller 100 controls operations of the memory device 200, the storage 110 may store data used by the controller 100 and the memory device 200 for such operations as read, write, program and erase operations.

The storage 110 may be implemented with a volatile memory such as a static random access memory (SRAM) or a dynamic random access memory (DRAM). As described above, the storage 110 may store data used by the host device in the memory device 200 for the read and write operations. To store the data, the storage 110 may include a program memory, a data memory, a write buffer, a read buffer, a map buffer, and the like.

The control component 120 may control general operations of the memory system 10, and a write operation or a read operation for the memory device 200 in response to a write request or a read request from the host device. The control component 120 may drive firmware, which is referred to as a flash translation layer (FTL), to control general operations of the memory system 10. For example, the FTL may perform operations such as logical-to-physical (L2P) mapping, wear leveling, garbage collection, and/or bad block handling. The L2P mapping is known as logical block addressing (LBA).

The ECC component 130 may detect and correct errors in the data read from the memory device 200 during the read operation. The ECC component 130 may not correct error bits when the number of the error bits is greater than or equal to a threshold number of correctable error bits, and instead may output an error correction fail signal indicating failure in correcting the error bits.

In various embodiments, the ECC component 130 may perform an error correction operation based on a coded modulation such as a low density parity check (LDPC) code, a Bose-Chaudhuri-Hocquenghem (BCH) code, a turbo code, a turbo product code (TPC), a Reed-Solomon (RS) code, a convolution code, a recursive systematic code (RSC), a trellis-coded modulation (TCM), or a Block coded modulation (BCM). However, error correction is not limited to these techniques. As such, the ECC component 130 may include any and all circuits, systems or devices for suitable error correction operation.

The host interface 140 may communicate with the host device through one or more of various communication standards or interfaces such as a universal serial bus (USB), a multi-media card (MMC), a peripheral component interconnect express (PCI-e or PCIe), a small computer system interface (SCSI), a serial-attached SCSI (SAS), a serial advanced technology attachment (SATA), a parallel advanced technology attachment (PATA), an enhanced small disk interface (ESDI), and an integrated drive electronics (IDE).

The memory interface 150 may provide an interface between the controller 100 and the memory device 200 to allow the controller 100 to control the memory device 200 in response to a request from the host device. The memory interface 150 may generate control signals for the memory device 200 and process data under the control of the control component 120. When the memory device 200 is a flash memory such as a NAND flash memory, the memory interface 150 may generate control signals for the memory and process data under the control of the control component 120.

The memory device 200 may include a memory cell array 210, a control circuit 220, a voltage generation circuit 230, a row decoder 240, a page buffer 250 which may be in the form of an array of page buffers, a column decoder 260, and an input and output (input/output) circuit 270. The memory cell array 210 may include a plurality of memory blocks 211 which may store data. The voltage generation circuit 230, the row decoder 240, the page buffer array 250, the column decoder 260 and the input/output circuit 270 may form a peripheral circuit for the memory cell array 210. The peripheral circuit may perform a program, read, or erase operation of the memory cell array 210. The control circuit 220 may control the peripheral circuit.

The voltage generation circuit 230 may generate operation voltages of various levels. For example, in an erase operation, the voltage generation circuit 230 may generate operation voltages of various levels such as an erase voltage and a pass voltage.

The row decoder 240 may be in electrical communication with the voltage generation circuit 230, and the plurality of memory blocks 211. The row decoder 240 may select at least one memory block among the plurality of memory blocks 211 in response to a row address generated by the control circuit 220, and transmit operation voltages supplied from the voltage generation circuit 230 to the selected memory blocks.

The page buffer 250 may be coupled with the memory cell array 210 through bit lines BL (shown in FIG. 3). The page buffer 250 may precharge the bit lines BL with a positive voltage, transmit data to and receive data from, a selected memory block in program and read operations, or temporarily store transmitted data in response to page buffer control signal(s) generated by the control circuit 220.

The column decoder 260 may transmit data to and receive data from, the page buffer 250 or transmit and receive data to and from the input/output circuit 270.

The input/output circuit 270 may transmit to the control circuit 220 a command and an address, received from an external device (e.g., the memory controller 100 of FIG. 1), transmit data from the external device to the column decoder 260, or output data from the column decoder 260 to the external device, through the input/output circuit 270.

The control circuit 220 may control the peripheral circuit in response to the command and the address.

FIG. 3 is a circuit diagram illustrating a memory block of a semiconductor memory device in accordance with an embodiment of the present invention. For example, the memory block of FIG. 3 may be any of the memory blocks 211 of the memory cell array 210 shown in FIG. 2.

Referring to FIG. 3, the memory block 211 may include a plurality of word lines WL0 to WLn-1, a drain select line DSL and a source select line SSL coupled to the row decoder 240. These lines may be arranged in parallel, with the plurality of word lines between the DSL and SSL.

The memory block 211 may further include a plurality of cell strings 221 respectively coupled to bit lines BL0 to BLm-1. The cell string of each column may include one or more drain selection transistors DST and one or more source selection transistors SST. In the illustrated embodiment, each cell string has one DST and one SST. In a cell string, a plurality of memory cells or memory cell transistors MC0 to MCn-1 may be serially coupled between the selection transistors DST and SST. Each of the memory cells may be formed as a multiple level cell. For example, each of the memory cells may be formed as a single level cell (SLC) storing 1 bit of data. Each of the memory cells may be formed as a multi-level cell (MLC) storing 2 bits of data. Each of the memory cells may be formed as a triple-level cell (TLC) storing 3 bits of data. Each of the memory cells may be formed as a quadruple-level cell (QLC) storing 4 bits of data.

The source of the SST in each cell string may be coupled to a common source line CSL, and the drain of each DST may be coupled to the corresponding bit line. Gates of the SSTs in the cell strings may be coupled to the SSL, and gates of the DSTs in the cell strings may be coupled to the DSL. Gates of the memory cells across the cell strings may be coupled to respective word lines. That is, the gates of memory cells MC0 are coupled to corresponding word line WL0, the gates of memory cells MC1 are coupled to corresponding word line WL1, etc. The group of memory cells coupled to a particular word line may be referred to as a physical page. Therefore, the number of physical pages in the memory block 211 may correspond to the number of word lines.

The page buffer array 250 may include a plurality of page buffers 251 that are coupled to the bit lines BL0 to BLm-1. The page buffers 251 may operate in response to page buffer control signals. For example, the page buffers 251 my temporarily store data received through the bit lines BL0 to BLm-1 or sense voltages or currents of the bit lines during a read or verify operation.

In some embodiments, the memory blocks 211 may include a NAND-type flash memory cell. However, the memory blocks 211 are not limited to such cell type, but may include NOR-type flash memory cell(s). Memory cell array 210 may be implemented as a hybrid flash memory in which two or more types of memory cells are combined, or one-NAND flash memory in which a controller is embedded inside a memory chip.

FIG. 4 is a diagram illustrating distributions of states or program voltage (PV) levels for different types of cells of a memory device in accordance with an embodiment of the present invention.

Referring to FIG. 4, each of memory cells may be implemented with a specific type of cell, for example, a single level cell (SLC) storing 1 bit of data, a multi-level cell (MLC) storing 2 bits of data, a triple-level cell (TLC) storing 3 bits of data, or a quadruple-level cell (QLC) storing 4 bits of data. Usually, all memory cells in a particular memory device are of the same type, but that is not a requirement.

An SLC may include two states P0 and P1. P0 may indicate an erase state, and P1 may indicate a program state. Since the SLC can be set in one of two different states, each SLC may program or store 1 bit according to a set coding method. An MLC may include four states P0, P1, P2 and P3. Among these states, P0 may indicate an erase state, and P1 to P3 may indicate program states. Since the MLC can be set in one of four different states, each MLC may program or store two bits according to a set coding method. A TLC may include eight states P0 to P7. Among these states, P0 may indicate an erase state, and P1 to P7 may indicate program states. Since the TLC can be set in one of eight different states, each TLC may program or store three bits according to a set coding method. A QLC may include 16 states P0 to P15. Among these states, P0 may indicate an erase state, and P1 to P15 may indicate program states. Since the QLC can be set in one of sixteen different states, each QLC may program or store four bits according to a set coding method.

Referring back to FIGS. 2 and 3, the memory device 200 may include a plurality of memory cells (e.g., NAND flash memory cells). The memory cells are arranged in an array of rows and columns as shown in FIG. 3. The cells in each row are connected to a word line (e.g., WL0), while the cells in each column are coupled to a bit line (e.g., BL0). These word and bit lines are used for read and write operations. During a write operation, the data to be written (‘1’ or ‘0’) is provided at the bit line while the word line is asserted. During a read operation, the word line is again asserted, and the threshold voltage of each cell can then be acquired from the bit line. Multiple pages may share the memory cells that belong to (i.e., are coupled to) the same word line. When the memory cells are implemented with MLCs, the multiple pages include a most significant bit (MSB) page and a least significant bit (LSB) page. When the memory cells are implemented with TLCs, the multiple pages include an MSB page, a center significant bit (CSB) page and an LSB page. When the memory cells are implemented with QLCs, the multiple pages include an MSB page, a center most significant bit (CMSB) page, a center least significant bit (CLSB) page and an LSB page. The memory cells may be programmed using a coding scheme (e.g., Gray coding) in order to increase the capacity of the memory system 10 such as SSD.

FIG. 5A is a diagram illustrating an example of coding for a multi-level cell (MLC) in accordance with an embodiment of the present invention.

Referring to FIG. 5A, an MLC may be programmed using a set type of coding. An MLC may have 4 program states, which include an erased state E (or PV0) and a first program state PV1 to a third program state PV3. The erased state E (or PV0) may correspond to “11.” The first program state PV1 may correspond to “10.” The second program state PV2 may correspond to “00.” The third program state PV3 may correspond to “01.”

In the MLC, as shown in FIG. 5B, there are 2 types of pages including LSB and MSB pages. 1 or 2 thresholds may be applied in order to retrieve data from the MLC. For an MSB page, the single threshold value is VT1. VT1 distinguishes between the first program state PV1 and the second program state PV2. For an LSB page, 2 thresholds include a threshold value VT0 and a threshold value VT2. VT0 distinguishes between the erased state E and the first program state PV1. VT2 distinguishes between the second program state PV2 and the third program state PV3.

FIG. 6A is a diagram illustrating an example of Gray coding for a triple-level cell (TLC) in accordance with an embodiment of the present invention.

Referring to FIG. 6A, a TLC may be programmed using Gray coding. A TLC may have 8 program states, which include an erased state E (or PV0) and a first program state PV1 to a seventh program state PV7. The erased state E (or PV0) may correspond to “111.” The first program state PV1 may correspond to “011.” The second program state PV2 may correspond to “001.” The third program state PV3 may correspond to “000.” The fourth program state PV4 may correspond to “010.” The fifth program state PV5 may correspond to “110.” The sixth program state PV6 may correspond to “100.” The seventh program state PV7 may correspond to “101.”

In the TLC, as shown in FIG. 6B, there are 3 types of pages including LSB, CSB and MSB pages. 2 or 3 thresholds may be applied in order to retrieve data from the TLC. For an MSB page, 2 thresholds include a threshold value VT0 that distinguishes between an erase state E and a first program state PV1 and a threshold value VT4 that distinguishes between a fourth program state PV4 and a fifth program state PV5. For a CSB page, 3 thresholds include VT1, VT3 and VT5. VT1 distinguishes between a first program state PV1 and a second program state PV2. VT3 distinguishes between a third program state PV3 and the fourth program state PV4. VT5 distinguishes between the fifth program state PV5 and the sixth program state PV6. For an LSB page, 2 thresholds include VT2 and VT6. VT2 distinguishes between the second program state PV2 and the third program state PV3. VT6 distinguishes between the sixth program state PV6 and a seventh program state PV7.

After a memory array including a plurality of memory cells is programmed as described in FIGS. 5A and 6A, when a read operation is performed on the memory array using a certain reference voltage such as a read threshold voltage (also called “read voltage level” or “read threshold”), the electrical charge levels of the memory cells (e.g., threshold voltage levels of transistors of memory cells) are compared to one or more reference voltages to determine the state of individual memory cells. When a certain read threshold is applied to the memory array, those memory cells that have threshold voltage levels higher than the certain reference voltage are turned on and detected as “on” cells, whereas those memory cells that have threshold voltage levels lower than the certain reference voltage are turned off and detected as “off” cells, for example. Therefore, each read threshold is arranged between neighboring threshold voltage distribution windows corresponding to different programmed states so that each read threshold can distinguish such programmed states by turning on or off the memory cell transistors.

When a read operation is performed on memory cells in a data storage device using MLC technology, the threshold voltage levels of the memory cells are compared to more than one read threshold level to determine the state of individual memory cells. Read errors can be caused by distorted or overlapped threshold voltage distributions. An ideal memory cell threshold voltage distribution can be significantly distorted or overlapped due to, e.g., program and erase (P/E) cycles, cell-to-cell interference, and/or data retention errors. For example, as program/erase cycles increase, the margin between neighboring threshold voltage distributions of different programmed states decreases and eventually the distributions overlap. As a result, the memory cells with threshold voltages that fall within the overlapping region of the neighboring distributions may be read as being programmed to a value other than the original targeted value and thus cause read errors. Such read errors may be managed in most situations by using error correction codes (ECC). When the number of bit errors on a read operation exceeds the ECC correction capability of the data storage, the read operation using a set read threshold voltage fails. The set read threshold voltage may be a previously used read threshold voltage (i.e., history read threshold voltage). The history read threshold voltage may be the read threshold voltage used in the last successful decoding, that is, a read voltage used in a read-passed read operation performed before read retry operations. When the read operation using the set read threshold voltage failed, the controller 120 may control an error recovery algorithm as shown in FIG. 7.

Referring to FIG. 7, the controller 120 may perform one or more read retry operations for the memory cells using one or more read threshold voltages applied in a set order (S100). For example, the read threshold voltages may include N (e.g., N is 5 or 10) read threshold voltages (or read voltage levels) including a first read threshold voltage to an Nth read threshold voltage. The first read threshold voltage may be a previously used read threshold voltage (i.e., history read threshold voltage). The history read threshold voltage may be the read threshold voltage used in the last successful decoding, that is, a read voltage used in a read-passed read operation performed before the read retry operations. The controller 120 may perform the read retry operations until it is determined that decoding associated with a corresponding read retry operation is successful.

When all read retry operations using the read threshold voltages failed, the controller 120 may perform additional recovery operations. For example, the additional recovery operations may include an optimal read threshold voltage search (S200), a soft decoding using an error correction code (ECC) (S300) and a redundant array of independent disks (RAID) recovery (S400).

As described above, in memory systems such as NAND flash storage systems, after a read command is received, a sequence of data recovery steps is executed with the aim of retrieving the noise-free data from a memory device (i.e., NAND flash memory device). In the first attempt, a read operation using the history read threshold voltage (i.e., a history read) is performed. The history read may be maintained separately per physical block and may be updated if decoding associated with the history read fails. If the history read fails, read retry attempts, which are referred to as a high priority read retry (HRR), are performed. HRR is a series of read threshold voltages (i.e., Vt) that remain the same all the time. The read retry threshold voltages don't change according to NAND condition, or a physical location of data to be read. Typically, there are 5 to 10 HRR read attempts. If all HRR reads fail, an optimal read threshold voltage will be found through the optimal read level search (i.e., an eBoost algorithm) and the soft read and soft decoding operation will be performed. The eBoost algorithm may perform multiple reads to find the best center Vt for soft read. There are many different eBoost algorithms such as Gaussian Modeling (GM), cumulative cell count search (CCS) and advanced valley search (AVA) algorithms.

FIG. 8 is a diagram illustrating an operation for estimating an optimal read threshold voltage by various eBoost algorithms such as GM, CCS and AVA algorithms in accordance with an embodiment of the present invention.

Referring to FIG. 8, a read threshold voltage obtained by each of GM, CCS and AVA algorithms is shown in comparison with an optimal read threshold voltage OPT. GM algorithm is trying to find a read threshold voltage (Vt) assuming that all PV states (i.e., PV11, PV12) follow a Gaussian distribution with known/constant variance and unknown means. CCS algorithm is trying to find Vt such that the number of cells falling into both sides are equal. AVA is trying to find the lowest point, as Vt, on the overall distribution around the valley. As shown in FIG. 8, when one (e.g., PV12) of two PV states is asymmetric and has heavier tail than the other one, all these algorithms may estimate a read threshold voltage (i.e., GM, CCS, AVA), which are biased from the optimal read threshold voltage OPT.

FIGS. 9A and 9B illustrate examples of threshold voltage (Vt) distributions or programmed states of a triple-level cell (TLC) and a quadruple-level cell (QLC), respectively, in accordance with an embodiment of the present invention.

In the illustrated examples of FIGS. 9A and 9B, one or more states of multiple PV states are asymmetric and have a heavier tail than the other ones. In the example of FIG. 9A, three states PV25 to PV27 among PV21 to PV27 are asymmetric with heavy tails. In the example of FIG. 9B, the state PV315 among PV301 to PV315 are asymmetric with a heavy tail. In such cases, all three types of existing algorithms above may give biased Vt estimation. Accordingly, it is desirable to provide a scheme for estimating a read threshold voltage in order to overcome the weakness of all existing algorithms.

Embodiments use deep learning and provide a parametric framework for program voltage or program verify (PV)-level modeling and optimal read threshold voltage (Vt) estimation.

FIG. 10 is a diagram illustrating a memory system 10 in accordance with an embodiment of the present invention.

Referring to FIG. 10, the memory system 10 may include a controller 100 and a memory device 200. The memory device 200 may include a plurality of memory cells (e.g., NAND flash memory cells) 210. The memory cells are arranged in an array of rows and columns as shown in FIG. 3. The cells in each row are connected to a word line (e.g., WL0), while the cells in each column are coupled to a bit line (e.g., BL0). These word and bit lines are used for read and write operations. During a write operation, the data to be written (‘1’ or ‘0’) is provided at the bit line while the word line is asserted. During a read operation, the word line is again asserted, and the threshold voltage of each cell can then be acquired from the bit line. Multiple pages may share the memory cells that belong to (i.e., are coupled to) the same word line. When the memory cells are implemented with MLCs, the multiple pages include a most significant bit (MSB) page and a least significant bit (LSB) page. When the memory cells are implemented with TLCs, the multiple pages include an MSB page, a center significant bit (CSB) page and an LSB page. When the memory cells are implemented with QLCs, the multiple pages include an MSB page, a center most significant bit (CMSB) page, a center least significant bit (CLSB) page and an LSB page. The memory cells may be programmed using a coding scheme (e.g., Gray coding) in order to increase the capacity of the memory system 10 such as an SSD.

The controller 100 may include a read processor 1010, a decoder 1020 and an optimal read threshold determiner 1030. Although it is illustrated that components of the controller 100 are implemented separately, these components may be implemented with an internal component (i.e., firmware (FW)) of the control component 120 in FIG. 2. Although not shown in FIG. 10, the controller 100 and the memory device 200 may include various other components as shown in FIG. 2.

The read processor 1010 may control one or more read operations for the memory device 200 in response to a read request from a host (e.g., the host 5 of FIG. 1). The read processor 1010 may control the read operations using various read thresholds. The decoder 1020 may decode data associated with the read operations.

In some embodiments, the read processor 1010 may control a read operation for the memory cells using a select read threshold from a set read level table. In some embodiments, the read level table may include multiple read thresholds and the select read threshold may include a default read threshold. When the read operation is performed for the MSB page of TLC, the select read threshold may include a pair of first and second read thresholds [VT0, VT4] as shown in FIG. 6B. The first read threshold value VT0 is used to distinguish between an erase state (i.e., E) and a first program state (i.e., PV1), and the second read threshold value VT4 is used to distinguish between a fourth program state (i.e., PV4) and a fifth program state (i.e., PV5). When the read operation is performed for the LSB page of TLC, the select read threshold may include a pair of first and second read thresholds [VT2, VT6] as shown in FIG. 6B. The first read threshold value VT2 is used to distinguish between a second program state (i.e., PV2) and a third program state (i.e., PV3), and the second read threshold value VT6 is used to distinguish between a sixth program state (i.e., PV6) and a seventh program state (i.e., PV7).

It may be determined whether the read operation using a read threshold selected from a read threshold set succeeded or failed, depending on the decoding result of the decoder 1020. When the read operation using the selected read threshold failed, the read processor 1010 may control one or more read retry operations for the memory cells using read retry entries, as shown in FIG. 7.

The optimal read threshold determiner 1030 may provide a parametric framework for program voltage or program verify (PV)-level modeling and optimal read threshold voltage (Vt) estimation. The optimal read threshold determiner 1030 may be implemented with one or more deep neural networks (DNNs). For a parametric DNN framework, the optimal read threshold determiner 1030 may include a training component 1030A and an inference component 1030B.

FIG. 11 is a diagram illustrating an example of a neural network 1100 in accordance with an embodiment of the present invention. In some embodiments, the neural network 1100 may be included in the controller 100 of the memory system 10 in FIG. 10.

Referring to FIG. 11, a feature map 1102 associated with one or more input conditions may input to the neural network 1100. In turn, the neural network 1100 may output information 1104. As illustrated, the neural network 1100 includes an input layer 1110, one or more hidden layers 1120 and an output layer 1130. Features from the feature map 1102 may be connected to input nodes in the input layer 1110. The information 1104 may be generated from an output node of the output layer 1130. One or more hidden layers 1120 may exist between the input layer 1110 and the output layer 1130. The neural network 1100 may be pre-trained to process the features from the feature map 1102 through the different layers 1110, 1120, and 1130 in order to output the information 1104.

The neural network 1100 may be a multi-layer neural network that represents a network of interconnected nodes, such as an artificial deep neural network, where knowledge about the nodes (e.g., information about specific features represented by the nodes) is shared across layers and knowledge specific to each layer is also retained. Each node represents a piece of information. Knowledge may be exchanged between nodes through node-to-node interconnections. Input to the neural network 1100 may activate a set of nodes. In turn, this set of nodes may activate other nodes, thereby propagating knowledge about the input. This activation process may be repeated across other nodes until nodes in the output layer 1130 are selected and activated.

As illustrated, the neural network 1100 includes a hierarchy of layers representing a hierarchy of nodes interconnected in a feed-forward way. The input layer 1110 may exist at the lowest hierarchy level. The input layer 1110 may include a set of nodes that are referred to herein as input nodes. When the feature map 1102 is input to the neural network 1100, each of the input nodes of the input layer 1110 may be connected to each feature of the feature map 1102. Each of the connections may have a weight. These weights may be one set of parameters that are derived from the training of the neural network 1100. The input nodes may transform the features by applying an activation function to these features. The information derived from the transformation may be passed to the nodes at a higher level of the hierarchy.

The output layer 1130 may exist at the highest hierarchy level. The output layer 1130 may include one or more output nodes. Each output node may provide a specific value of the output information 1104. The number of output nodes may depend on the needed number of the output information 1104. In other words, there is a one-to-one relationship or mapping between the number of output nodes and the number of the output information 1104.

The hidden layer(s) 1120 may exist between the input layer 1110 and the output layer 1130. The hidden layer(s) 1120 may include “N” number of hidden layers, where “N” is an integer greater than or equal to one. Each of the hidden layers 1120 may include a set of nodes that are referred to herein as hidden nodes. Example hidden layers may include up-sampling, convolutional, fully connected layers, and/or data transformation layers.

At the lowest level of the hidden layer(s) 1120, hidden nodes of that layer may be interconnected to the input nodes. At the highest level of the hidden layer(s) 1120, hidden nodes of that level may be interconnected to the output node. The input nodes may be not directly interconnected to the output node(s). If multiple hidden layers exist, the input nodes are interconnected to hidden nodes of the lowest hidden layer. In turn, these hidden nodes are interconnected to the hidden nodes of the next hidden layer. An interconnection may represent a piece of information learned about the two interconnected nodes. The interconnection may have a numeric weight that can be tuned (e.g., based on a training dataset), rendering the neural network 1100 adaptive to inputs and capable of learning.

Generally, the hidden layer(s) 1120 may allow knowledge about the input nodes of the input layer 1110 to be shared among the output nodes of the output layer 1130. To do so, a transformation ƒ may be applied to the input nodes through the hidden layer 1120. In an example, the transformation ƒ is non-linear. Different non-linear transformations ƒ are available including, for instance, a rectifier function ƒ(x)=max(0, x). In an example, a particular non-linear transformation ƒ is selected based on cross-validation. For example, given known example pairs (x,y), where x∈X and y∈Y, a function ƒ: X→Y is selected when such a function results in the best matches.

For example, the neural network 1100 may be a deep learning neural network used for a memory system including a NAND flash memory device. The deep leaning neural network may be created with “K” input nodes and an output node, where “K” is the number of factors (e.g., features) that define input conditions for the memory system. The output node(s) may be used to perform an activation function for a certain combination of input conditions. The number of layers and size of each layer in the neural network 1100 may depend on the NAND flash memory device and an amount of the data that this memory can store.

Inventors observed that in some cases (e.g., curves indicated with PV26 and PV27 in FIGS. 9A and 9B), cell-level distributions of a particular threshold voltage range corresponding to a PV level may be modeled by a skew normal distribution. Generally, skew normal distribution is defined as a continuous probability distribution that generalizes the normal distribution to allow for non-zero skewness. Each cumulative distribution function (CDF) value may represent a skew normal distribution model of a particular PV level. To describe characteristics of a skew normal distribution, probability distribution parameters may be a set of parameters including location k, scale co, and shape a.

In some embodiments, the neural network 1100 may be a first deep neural network (DNN1) or a second deep neural network (DNN2) in FIGS. 12 and/or 13. For DNN1, one or more input conditions may be CDF values and output information 1104 may be probability distribution parameters. For example, the neural network 1100 (e.g., DNN1) may be pre-trained to process the features (i.e., CDF values) from the feature map 1102 through the different layers 1110, 1120, and 1130 in order to output the probability distribution parameters 1104. For DNN2, one or more input conditions may be probability distribution parameters and output information 1104 may be probability density function (PDF) values.

FIG. 12 is a diagram illustrating a training component 1030A in accordance with an embodiment of the present invention.

Referring to FIG. 12, the training component 1030A may include a synthetic model 1210 to train a first deep neural network (DNN1) 1200. To train this network 1200, synthetic dataset (or data) may be collected by the synthetic model 1210. The synthetic dataset may be any production data applicable to a given situation that are not obtained by direct measurement. In some embodiments, the deep neural network 1200 may be used for a memory system including a NAND flash memory device. As described above, threshold voltage (Vt) distributions (i.e., PV levels) of memory cells may be modeled by a parametric distribution (i.e., a skew normal distribution). A skew normal distribution has the cumulative distribution function (CDF) as represented as below:

$\mathrm{CDF}\left(x\right)=\underset{T\left(h,a\right)\mathrm{is}\mathrm{Owen}\text{'}sT\mathrm{function}}{\Phi \left(\frac{x-\xi }{\omega }\right)-2T\left(\frac{x-\xi }{\omega },\alpha \right)}$ $\begin{array}{cc}T\left(h,a\right)=\frac{1}{2\pi }{\int }_0^a\frac{e^{-\frac{1}{2}{h}^2\left(1+x^2\right)}}{1+x^2}& \left(-\infty <h,a<+\infty \right).\end{array}$

As expressed in Equation above, a skew normal distribution has 3 parameters, namely location ξ, scale ω and shape a. In other words, for a read threshold voltage range corresponding to each PV level, 3 probability distribution parameters may be used to describe the probability distribution for each PV level. In Equation above, x represents a sampling read threshold voltage (i.e., PV level) and T(h, a) defines Owen's T function.

The synthetic model 1210 may generate synthetic dataset (x,CDF(x)) based on probability distribution parameters p, which collectively represent 3 parameters (i.e., ξ, ω and a). DNN1 1200 may be trained on the synthetic dataset that includes CDF values CDF(x) from the parametric distributions at the various sampling voltages x, and output probability distribution parameters p′ as the training result. The probability distribution parameters p′ may be used to determine the characteristics of a voltage range curve for a memory cell.

Training result by DNN1 1200 may be provided to a loss function component 1220. The loss function component 1220 may use a loss function (or a cost function) to find an optimal solution for trained probability distribution parameters p′. DNN1 1200 may be trained to refine the probability distribution parameters such that the difference (or error) between actual probability distribution parameters p of the synthetic model 1210 and the predicted probability distribution parameters p′ by DNN1 1200 is minimized.

As such, the relationship between CDF values CDF(x) and probability distribution parameters Θ may be trained by DNN1 1200. Once trained, training results may be used by the inference component 1030B.

FIG. 13 is a diagram illustrating an inference component 1030B in accordance with an embodiment of the present invention.

Referring to FIG. 13, the inference component 1030B may include first deep neural networks (DNN1) 1200A,1200B, second deep neural networks (DNN2) 1300A,1300B and a cross-point calculation component 1310. Each DNN1 1200A,1200B may be trained as shown in FIG. 12. Each of DNN1 and DNN2 may be implemented in SoC or FW depending on the size of the DNN used.

In FIG. 13, PV_A and PV_B represent two adjacent PV levels. CDF_A(x_i) represents PV_A's CDF value of the threshold voltage distribution sampled at voltage x_i. CDF_B(x_i) represents PV_B's CDF value of the threshold voltage distribution sampled at voltage x_i. p_A represents probability distribution parameters of PV_A. p_B represents probability distribution parameters of PV_B. Optimal read threshold voltage Vt_opt represents the cross-point voltage between the threshold voltage distributions of PV_A and PV_B.

Threshold voltage distributions of cells in a PV level may be modeled by a parametric distribution (i.e., skew normal distribution). The parametric distribution models the relationship between the CDF value and probability distribution parameters p for each PV level. Skew normal distributions of PV_A and PV_B are modeled with probability distribution parameters p_A and p_B, respectively.

For an n-bit multi-level cell NAND flash memory, a threshold voltage of each cell can be programmed to 2ⁿ possible values. In an ideal multi-level cell NAND flash memory, each value corresponds to a non-overlapping threshold voltage range. However, in many systems due to operational conditions, the threshold voltage range for each value may overlap for a portion. An example of this overlap is illustrated in FIGS. 8 to 9B.

DNN1 1200A may receive a first CDF value CDF_A(x_i) that represents a skew normal distribution model of a first threshold voltage range. The first CDF CDF_A(x_i) may be generated by iterative modeling to determine a parametric representation of the threshold voltage range, as shown in FIG. 12. The first CDF value CDF_A(x_i) may correspond to a first level of the multi-level cell NAND-flash memory. Each multi-level cell has multiple levels based on how many bits are stored in a cell. In one example, a triple level cell (TLC) stores three bits per multi-level cell and has 2ⁿ levels, or eight levels. Each of the eight levels of the three-bit TLC correspond to a voltage range that can be represented by the first CDF value CDF_A(x_i). DNN1 1200B may receive a second CDF value CDFs(x_i) that represents a skew normal distribution model of a second threshold voltage range. The second CDF value CDF_B(x_i) may correspond to a second level of the multi-level cell.

Each DNN1 1200A, 1200B may estimate probability distribution parameters p based on a CDF value, which is given through measurement of memory cells. For example, DNN1 1200A may estimate probability distribution parameters p_A based on the first CDF value CDF_A(x_i). DNN1 1200B may estimate probability distribution parameters p_B based on the second CDF sample CDF_B(x_i). Probability distribution parameters are expressed as p_A=(ξ_A, ω_A, α_A) and p_B=(ξ_B, ω_B, α_B).

Each DNN2 1300A, 1300B may determine PDF values of the distributions for various candidate read threshold voltages based on the estimated probability distribution parameters p. For example, DNN2 1300A may receive the estimated probability distribution parameters p_A and determine PDF values PDF_A based on the estimated probability distribution parameters p_A. DNN2 1300B may receive the estimated probability distribution parameters p_B and determine PDF values PDF_B based on the estimated probability distribution parameters p_B. In some embodiments, each DNN2 1300A, 1300B may determine PDF values of the distributions for various candidate read threshold voltages based on the estimated probability distribution parameters p, by using the following equation:

$\mathrm{PDF}\left(x\right)=\frac{2}{\omega \sqrt{2\pi }}{e}^{-\frac{{\left(x-\xi \right)}^2}{2{\omega }^2}}{\int }_{-\infty }^{\alpha \left(\frac{x-\xi }{\omega }\right)}\frac{1}{\sqrt{2\pi }}{e}^{-\frac{t^2}{2}}\mathrm{dt},$ wherein ξ represents location, ω represents scale and α represents shape, which are the probability distribution parameters p.

In some embodiments, each DNN2 1300A, 1300B may include a look-up table (LUT), which stores the relationship between probability distribution parameters and PDF values.

The cross-point calculation component 1310 may find two candidate read threshold voltages which produce approximately equal PDF values. Further, the cross-point calculation component 1310 may determine the cross-point of the two candidate read threshold voltages as the optimal read threshold voltage Vt_opt.

As such, the inference component 1030B may estimate the cross-point of underlying PDF values based on a few noisy samples of CDF values.

FIG. 14 illustrates an operation for obtaining ICMF samples to be used for estimating an optimal read threshold voltage in accordance with an embodiment of the present invention. This operation may be performed by the read processor 1010 of the controller 100 in FIG. 10. By way of example, ICMF samples may be obtained in order to estimate an optimal read threshold voltage for an LSB page of TLC.

In FIG. 14, 1410 represents parametric distributions corresponding to threshold voltage distributions of PV levels of TLC, as shown in FIG. 6A. As illustrated, the distributions of a TLC include 8 zones including Zone 0 to Zone 7 and each zone corresponds to a program states or a PV level.

At operation S1410, the controller 100 may read LSB, MSB and CSB pages to generate PV state counts. Further, the controller 100 may generate a first ICMF sample set for PV 2,3,6,7 based on the PV state counts. Here, ICMF means the inverse of a cumulative mass function (CMF). In some embodiments, for each read threshold voltage, a cumulative mass function (CMF) value may be determined based on number of cells (cell count) and the number of a particular binary value (1 or 0) among the cells, which are associated with a read operation using each read threshold voltage. For example, each CMF value may be determined as {the number of 1's or 0's (e.g., 1's)/cell count}, i.e., the percentage of 1's or 0's.

1420 represents the first ICMF sample set for PV 2,3,6,7, which is generated at S1410. Samples for each page in the first ICMF sample set are generated from the parametric distributions at various read threshold voltages. In the illustrated example, for MSB pages, ICMF samples are generated at read threshold voltages Vt0, Vt4. The ICMF sample at the read threshold voltages Vt0 indicates a percentage 75% of 1's and a percentage 25% of 0's, and the ICMF sample at the read threshold voltages Vt4 indicates a percentage 80% of 1's and a percentage 20% of 0's. For CSB pages, ICMF samples are generated at read threshold voltages Vt1, Vt3, Vt5. The ICMF sample at the read threshold voltages Vt1 indicates a percentage 10% of 1's and a percentage 90% of 0's, the ICMF sample at the read threshold voltages Vt3 indicates a percentage 30% of 0's and a percentage 70% of 1's and the ICMF sample at the read threshold voltages Vt5 indicates a percentage 30% of 1's and a percentage 70% of 0's. For LSB pages, ICMF samples are generated at read threshold voltages Vt2, Vt6. The ICMF sample at the read threshold voltages Vt2 indicates a percentage 40% of 1's and a percentage 60% of 0's, and the ICMF sample at the read threshold voltages Vt6 indicates a percentage 40% of 0's and a percentage 60% of 1's.

At operation S1420, the controller 100 may read one or more LSB and CSB pages to generate second and third ICMF sample sets for PV 2,3,6,7. In the illustrated embodiment in 1430, 2 LSB and CSB pages may be read. This embodiment considers distributions based on skew normal model (SNM). The number of LSB and CSB pages to be read may vary according to a distribution model. For distributions of improved Gaussian model (IGM), 1 LSB and CSB pages may be read. For distributions of non-central model (NCTM), 3 LSB and CSB pages may be read.

1430 represents the second and third ICMF sample sets for PV 2,3,6,7, which are generated at S1420. Samples for each page in the second ICMF sample set are generated from the parametric distributions at various read threshold voltages. In the illustrated example, for CSB pages, ICMF samples are generated at read threshold voltages Vt′3, Vt′5. For LSB pages, ICMF samples are generated at read threshold voltages Vt′2, Vt′6. Samples for each page in the third ICMF sample set are generated from the parametric distributions at various read threshold voltages. In the illustrated example, for CSB pages, ICMF samples are generated at read threshold voltages Vt″3, Vt″5. For LSB pages, ICMF samples are generated at read threshold voltages Vt″2, Vt″6. Although not illustrated, each ICMF sample of the second and third ICMF sample sets indicate a percentage of 0's and a percentage of 1's.

As such, the operations S1410 and S1420 are performed to estimate distributions for a particular page (i.e., LSB page) and to eliminate other components (e.g., noise). At operation S1430, the controller 100 may provide the ICMF samples to DNN1 1200A,1200B in order to estimate an optimal read threshold voltage. In some embodiments, CDF values corresponding to the ICMF samples (or CMF samples) may be provided to DNN1 1200A,1200B, as shown in FIG. 13B.

As described above, in order to estimate an optimal read threshold voltage, the controller 10 may be implemented with components as shown in FIG. 13. This implementation is described in U.S. patent application Ser. No. 17/233,167, entitled “SYSTEMS AND METHODS FOR PARAMETRIC PV-LEVEL MODELING AND READ THRESHOLD VOLTAGE ESTIMATION” which is incorporated by reference herein in its entirety. In the illustrated implementation of FIG. 13, the controller 10 performs a three-step processing to estimate the optimal read threshold voltage Vt_opt. As the number of processing increases, more errors may be introduced. Accordingly, it is desirable to provide a scheme for estimating an optimal read threshold voltage with reduced number of processing.

Another implementation of the controller is described in U.S. patent application Ser. No. 17/011,983, entitled “EFFICIENT READ-THRESHOLD CALCULATION METHOD FOR PARAMETRIC PV-LEVEL MODELING” (hereinafter referred to as '983 patent application) and incorporated by reference herein. This '983 patent application provides a computer system 500 with a structure including a neural network 506, a voltage read threshold generator 510, a floating-point unit (FPU) 512 and an approximation generator 516, as shown in FIG. 5. The voltage read threshold generator 510, the floating-point unit 512 and the approximation generator 516 correspond to a firmware implementation to calculate the cross-point voltage from parameters estimated by the neural network 506. The floating-point unit 512 performs the cross-point voltage calculation through a floating-point digital signal processing (or floating-point multiply-accumulate (MAC) operations), in which numbers are represented with a mantissa and an exponent (e.g., A×2^B, where ‘A’ is the mantissa and ‘B’ is the exponent). Thus, the floating-point unit 512 may require a relatively more hardware area and increases peak power consumption, for gates associated with the floating-point digital signal processing. Accordingly, it is desirable to provide a scheme for estimating an optimal read threshold voltage with reduced hardware area and peak power consumption.

FIG. 15 is a diagram illustrating an optimal read threshold determination apparatus 1500 in accordance with an embodiment of the present invention.

Referring to FIG. 15, the optimal read threshold determination apparatus 1500 may include a parameter determiner 1510 and a voltage determiner 1520.

The parameter determiner 1510 may receive measurements of two adjacent PV levels M_L(x_i), M_R(x_j) and their corresponding location of measurement x_i and x_j. The parameter determiner 1510 may estimate first and second probability distribution parameter sets (or channel parameter sets) Θ_L and Θ_R corresponding to the PV levels M_L(x_i) and M_R(x_j), respectively. The parameter determiner 1510 may be implemented with an algorithm for producing estimated channel parameter sets Θ_L and Θ_R for PV levels M_L(x_i) and M_R(x_j). By way of example and without any limitation, the parameter determiner 1510 may be implemented with two instances of DNN1 1200A and 1200B in FIG. 13.

In some embodiments, the first and second probability distribution parameter sets Θ_L and Θ_R may represent skew normal distributions of the first and second PV levels, respectively. Each probability distribution parameter set may include location, scale CO, and shape a of a curve associated with the skew normal distribution of a PV level.

The voltage determiner 1520 may receive the first and second probability distribution parameter sets (or channel parameter sets) Θ_L and Θ_R from the parameter determiner 1510. The voltage determiner 1520 may estimate an optimal read threshold voltage Vt_opt based on the first and second probability distribution parameter sets Θ_L and Θ_R. As mentioned above, cell-level distributions of two adjacent PV levels PV levels M_L(x_i) and M_R(x_j) may be modelled as skew normal distributions with probability distribution parameter sets Θ_L=(ξ_L, ω_L, α_L) and Θ_R=(ξ_R,ω_R,α_R). Probability density function (PDF) of the skew normal distribution may be represented as

$f\left(x;\Theta \right)=\frac{2}{\omega }·\varphi \left(\frac{x-\xi }{\omega }\right)·\Phi \left(\alpha ·\frac{x-\xi }{\omega }\right).$

In Equation above,

$\varphi \left(y\right)=\frac{1}{\sqrt{2\pi }}{e}^{-\frac{y^2}{2}}$ and Φ(y)=∫_−∞^y(t) dt are PDF and cumulative distribution function (CDF) of a normal distribution, respectively.

The voltage determiner 1520 may estimate, as the optimal read threshold voltage Vt_opt, a read threshold voltage such that first PDF value of the skew normal distribution of the first PV level M_L(x_i) is the same as the second PDF value of the skew normal distribution of the second PV level M_L(x_i). In other words, the optimal read threshold voltage Vt_opt may have the value x* such that ƒ(x*; Θ_L)=ƒ(x*; Θ_R). As such, the optimal read threshold voltage Vt_opt may be estimated through the cross-point calculation between the first PDF value of the skew normal distribution of the first PV level M_L(x_i) and the second PDF value of the skew normal distribution of the second PV level M_L(x_i).

In other embodiments, a distribution (e.g., Gaussian distribution) other than skew normal distribution may be used for modeling cell level distribution of PV levels. When Gaussian distribution is used, each probability distribution parameter set Θ may include means and variance of PV level. In this embodiment, the estimated parameters (i.e., means and the variances of PV_L and PV_R) may be used as inputs to determine the corresponding optimal cross-point without the need for a LUT as shown in FIG. 13.

FIG. 16 illustrates a graph 1600 of an example voltage read threshold estimated by the voltage determiner 1520 according to an embodiment of the present invention.

Referring to FIG. 16, the graph 1600 depicts a first curve 1602 (i.e., ƒ(x;Θ_L=(ξ_L, ω_L, α_L))) that represents a probability distribution of the first voltage range 1608 and a second curve 1604 (i.e., (i.e., ƒ(x;Θ_R=(ξ_R,ω_R,α_R))) that represents the second voltage range 1610. An optimal read threshold voltage (i.e., −0.29151) 1606 is determined as the cross-point between the first voltage range 1608 and the second voltage range 1610, which is illustrated by the intersection of the first curve 1602 and the second curve 1604. In the illustrated example of FIG. 16, the first curve 1602 and the second curve 1604 depict logarithmic functions of probability distribution parameters p=(ξ, ω, α) in two voltage ranges. In detail, the first curve 1602 corresponds to ƒ(x;Θ_L=(ξ_L=−1.0, ω_L=0.4, α_L=0.0)) and the second curve 1604 corresponds to ƒ(x;Θ_R=(ξ_R=1.0, ω_R=0.7, α_R=−2.0)). Each of the first voltage range 1608 and the second voltage range 1610 are modelled by a set of skew normal distribution parameters, which are shown in the legend of graph 1600.

Referring back to FIG. 15, the voltage determiner 1520 may be implemented with a deep neutral network (DNN), which calculates the optimal read threshold voltage Vt_opt from probability distribution parameter sets Θ_L and Θ_R based on fixed-point multiply-accumulate (MAC) operations. The DNN may include hardware blocks with very small size: inventors estimated that 32 MAC operations by the DNN are performed per cycle operating at 1 GHz and the runtime of the DNN are estimated to be around 1 us. If the parameter determiner 1510 is implemented with DNN1 in FIG. 13, MAC hardware blocks (i.e., gates) used for DNN1 can be reconfigured as DNN for the voltage determiner 1520. Weights for DNN of the voltage determiner 1520 can be reconfigured based on the model used in DNN1. In comparison to the floating-point unit (FPU) 512 for a floating-point arithmetic operation (or signal processing) in '983 patent application, MAC hardware blocks in DNN for the voltage determiner 1520 may be implemented to perform fixed-point arithmetic, in which numbers are represented with a fixed number of digits. Since the fixed-point arithmetic operation is less complicated than the floating-point arithmetic operation, the voltage determiner 1520 can be controlled for reduced gate-count and peak power consumption with small loss of accuracy of the cross-point calculation.

As described above, embodiments provide a scheme for estimating an optimal read threshold voltage with one-step processing by using the predicted probability distribution parameters directly for the cross-point voltage calculation. Fixed-point MAC hardware blocks of a deep neural network (DNN) may be used for the cross-point voltage calculation. Thus, when implementing DNN for the cross-point voltage calculation, embodiments reduce hardware area (i.e., gate-count) and peak power consumption.

Although the foregoing embodiments have been illustrated and described in some detail for purposes of clarity and understanding, the present invention is not limited to the details provided. There are many alternative ways of implementing the invention, as one skilled in the art will appreciate in light of the foregoing disclosure. The disclosed embodiments are thus illustrative, not restrictive. The present invention is intended to embrace all modifications and alternatives that fall within the scope of the claims. Furthermore, the embodiments may be combined to form additional embodiments.

Claims

1. A memory system comprising: a memory device including a plurality of cells; anda controller configured to:receive first and second program voltage (PV) levels associated with read operations on the cells;determine skew normal distributions for the first and second PV levels, respectively;estimate, by a first neural network, first and second probability distribution parameter sets based on the skew normal distributions of the first and second PV levels, respectively;determine, by a second neural network, first probability density function (PDF) values and second PDF values for respective ones of the first and second probability distribution parameter sets;estimate an optimal read threshold voltage based on the first and second PDF values, the optimal read threshold voltage being a read threshold voltage that is determined based on a probability density function value of the first PDF values that is approximately equal to a probability density function value of the second PDF values, andperform a read operation for the memory device based on the optimal read threshold voltage.

2. The memory system of claim 1, wherein the controller is further configured to perform a next read operation on the cells using the optimal read threshold voltage.

3. The memory system of claim 1, wherein the first and second probability distribution parameter sets include location, scale and shape of a curve associated with the skew normal distributions of the first and second PV levels, respectively.

4. The memory system of claim 1, wherein the optimal read threshold voltage is estimated as the cross-point voltage of the first and second PDF values.

5. The memory system of claim 1, wherein the neural network performs fixed-point multiply-accumulate (MAC) operations.

6. The memory system of claim 1, wherein each of the first and second probability distribution parameter sets is estimated by the first neural network, which is trained to output each of multiple probability distribution parameter sets corresponding to each of the first and second PV levels.

7. The memory system of claim 6, wherein the second neural network performs fixed-point multiply-accumulate (MAC) operations.

8. A method for operating a memory system including a memory device including a plurality of cells and a controller, the method comprising: receiving first and second program voltage (PV) levels associated with read operations on the cells;determining skew normal distributions for the first and second PV levels, respectively;estimating, by a first neural network, first and second probability distribution parameter sets based on skew normal distributions of the first and second PV levels, respectively;determining, by a second neural network, first probability density function (PDF) values and second PDF values for respective ones of the first and second probability distribution parameter sets;estimating an optimal read threshold voltage based on the first and second PDF values, the optimal read threshold voltage being a read threshold voltage that is determined based on a probability density function value of the first PDF values that is approximately equal to a probability density function value of the second PDF values, andperforming a read operation for the memory device based on the optimal read threshold voltage.

9. The method of claim 8, wherein further comprising: performing a next read operation on the cells using the optimal read threshold voltage.

10. The method of claim 8, wherein the first and second probability distribution parameter sets include location, scale and shape of a curve associated with the skew normal distributions of the first and second PV levels, respectively.

11. The method of claim 8, wherein the optimal read threshold voltage is estimated as the cross-point voltage of the first and second PDF values.

12. The method of claim 8, wherein the second neural network performs fixed-point multiply-accumulate (MAC) operations.

13. The method of claim 8, wherein each of the first and second probability distribution parameter sets is estimated by the first neural network, which is trained to output each of multiple probability distribution parameter sets corresponding to each of the first and second PV levels.

14. The method of claim 13, wherein the second neural network performs fixed-point multiply-accumulate (MAC) operations.