Patent Application
20220013191
The present invention relates generally to systems and methods for storage devices, and specifically to improving performance of non-volatile memory devices.
NAND-Flash based solid state drives (SSDs) have better random-read performance compared with magnetic-based hard disk drives (HDDs). However, these drives have low write performance, and the cost per gigabytes (GB) is still approximately 10× higher compared with high capacity HDDs. Improvements in these metrics can increase the total addressable market of SSDs by allowing them to be used in write-heavy and cost-sensitive applications that currently depend on HDDs.
Previous Flash memories are single-level cell (SLC) flash memories, which stores one bit per memory cell. A current approach to reducing cost is to pack more bits per Flash cell, for example, multi-level cell (MLC) Flash memories, to increase the density over SLC Flash memory. However, this approach can reduce the noise-margin in cell-level distributions for triple-lever cell (TLC) and quad-level cell (QLC) Flash memories. Due to the smaller noise margin, these memories have lower yield as well as require longer programming time (t-prog). The lower yield can reduce the benefits of the cost reduction, and the longer t-prog can lead to higher write latencies. To maintain low latencies for host-writes, these SSDs often employ expensive super-capacitor backed dynamic random access memories (DRAMs) as write-buffers for cost-insensitive applications like enterprise SSDs or suffer from the high write-latencies.
In the conventional method of bad-block management, a single bad page in a block can cause the whole block to be removed from usage. The inventors have recognized that this practice can reduce overprovision (OP), which refers to the difference between the physical capacity of the flash memory and the logical capacity presented as available for the user, and lead to more write amplification (WA), which refers to the actual amount of information physically-written to the storage media as a multiple of the logical amount intended to be written. Reducing overprovision and increasing write amplification can degrade the reliability of the memory device, as explained further below. Some embodiments of the invention provide an intermediate state between a physical block changing from a good block to a bad block, when the number of bad word lines inside a block is less than a certain threshold. This technique can delay the block retirement, increase overprovisioning, and reduce unnecessary background operations. Some embodiments also includes techniques to cluster the block types and program the degraded block.
For example, flash memory blocks that are not able to meet tight noise margins of TLC/QLC can be identified as bad blocks and are used as write-buffers in SLC mode which allows a wider margin. Assigning bad block to SLC write-buffer may happen during initial screening to improve wafer-yield. In addition, when TLC/QLC blocks degrade during the lifetime of the drive such that they may no longer meet the margin requirement, the SSD firmware can mark these bad blocks and use these bad blocks as additional SLC write-buffers instead of increasing the number of bad blocks. Increase in the write-buffer size can improve the write quality-of-service (QoS), by requiring lower rate of flushing host-writes from buffer to Flash). It may also be used to improve the accuracy of programming for other blocks, by allowing additional programming steps for finer control, thereby reducing bit-error rates of read operations.
Some embodiments of the present invention provide a non-volatile data storage device that includes memory cells arranged in blocks and a memory controller coupled to the memory cells for controlling operations of the memory cells. An example of a data storage device is described above in connection with
In some embodiments, a method is provided for controlling a storage system. The storage system can include memory cells arranged in a plurality of blocks and a memory controller coupled to the memory cells for controlling operations of the memory cells. The method includes determining if a given block is a bad m-bit multi-level block, wherein each memory cell is an m-bit multi-level cell (MLC), m being an integer equal to or greater than 2. Upon determining that the given block is a good m-bit multi-level block, the method assigns the given block to be an m-bit multi-level user block. Upon determining that the given block is a bad m-bit multi-level block, the method includes determining if the given block is a good n-bit block, wherein each memory cell is an n-bit cell, n being an integer less than m. Upon determining that the given block is a good n-bit block, the method assigns the given block to be an n-bit user block or an n-bit write-buffer block.
A further understanding of the nature and advantages of the present invention may be realized by reference to the remaining portions of the specification and the drawings.
A sense amplifier block 150 is coupled to memory cell array 110 through bit lines 152. A buffer block 160 is coupled to sense amplifier block 150 and provides output data to an external device. In a read operation, sense amplifier block 150 senses the data stored in each memory cell of the memory cell array 110 and provides the data to buffer block 160. In a write or program operation, buffer block 160 presents the data to be written or programmed to the memory array 110.
During a memory read operation, the charges in a non-volatile memory cell selected by a word line are read out. Depending on the charges stored in a memory cell, its cell threshold voltage can vary. A read voltage higher than cell threshold voltage can be used to determine the data stored in the memory cell. In some embodiments, each of the non-volatile memory cells can be a multilevel memory cell, and multiple threshold voltages are used to determine the data state of the memory cell, as represented by a bit pattern. In these cases, a threshold control circuit 170, which provides read thresholds 178, can be used to control the threshold voltages.
Flash-memory based solid state disk (SSD) drive can contain many flash memory dies. Each flash die can contain thousands of physical blocks. Each block can contain hundreds or thousands of flash pages. In some cases, a flash block is the atomic unit (i.e., the smallest addressable unit) for erase operation, and a flash page can be the atomic unit for read or program operation. In other words, in these cases, an erase operation is carried out one block at a time, and a read or program operation is carried out one page at a time.
In some embodiments, the data storage device can include multi-level user blocks 111, in which each memory cell is an m-bit multi-level cell (MLC), m being an integer. The data storage device can also include single-level user blocks 112 for storing user data, wherein each memory cell is a one-bit single level cell (SLC), and single-level write-buffer blocks 113 for improving write operation latency, wherein each memory cell is a one-bit single level cell (SLC).
Like previous 2D flash memory, the different PV-levels on neighbor flash cells in a 3D flash memory can have different noise-variances on the neighboring victim flash cells, which might cause the threshold voltage of the victim cell, or target cell, to increase or decrease. The amount of threshold voltage increase can depend on several factors, for example, 1) the exact neighbor values being programmed; and 2) how the neighbor values are programmed, etc. This can cause challenges in designing flash controller to support changing flash memory, especially new generations flash memory such as QLC drives.
Some QLC drives are built with stacked charge-trapping based 3-D NAND cells. In these cells, influence of an upper neighboring cell and lower neighboring cells can be caused by charge leakage into or from the target or victim cell. These neighboring cells can cause increase or decrease of the threshold voltage of the target cell as the retention time increases. In this case, the upper neighboring cell and the lower neighboring cell can share a bit line with the target cell. In addition, neighboring cells along a shared word line can also influence the threshold voltage of the target get, as a result of, e.g., programming operations.
One method of reducing error-rates is to use a larger number of program-verify pulses with each pulse of a shorter duration. However, increasing the number of program-verify pulses can increase the programming time (t-prog), which causes write performance and QoS degradation.
During the lifetime of SSD, the reliability quality of flash blocks may be degraded overtime, and some blocks may be identified as bad blocks and removed from the available flash block list. Removing bad blocks can reduce the actual overprovisioning (OP) of the whole SSD and thus cause larger write amplification. In a data storage device such as a solid state drive (SSD), overprovisioning (OP) refers to the inclusion of extra storage capacity. SSD overprovisioning can increase the endurance of a solid state drive by distributing the total number of writes and erases across a larger population of NAND flash blocks and pages over time. It can also improve performance by giving the flash controller additional buffer space for managing program/erase (P/E) cycles and improving the probability that a write operation will have immediate access to a pre-erased block. The extra capacity is not visible to the host as available storage.
Because flash memory must be erased before it can be rewritten, with much coarser granularity of the erase operation when compared to the write operation, the process to perform these operations results in moving (or rewriting) user data and metadata more than once. Thus, rewriting some data requires an already used portion of flash to be read, updated, and written to a new location, together with initially erasing the new location if it was previously used at some point in time; due to the way flash works, much larger portions of flash must be erased and rewritten than actually required by the amount of new data. This multiplying effect, known as write amplification (WA), can increase the number of writes required over the life of the SSD, which shortens the time it can reliably operate. The increased writes also consume bandwidth to the flash memory which mainly reduces random write performance to the SSD. Write amplification can be measured by the ratio of writes committed to the flash memory to the writes coming from the host system.
Flash manufacturers often allow some bad blocks in the NAND devices during the initial screening process by building some redundant blocks that are used as replacement. This allows higher wafer-yields but dies with initial bad blocks greater than the number of replacement blocks that are rejected during the screening.
Moreover, when the number of bad blocks increases during the lifetime of the device, the overprovisioning (OP) of the drive goes down which in turn increases the write-amplification (WA) dramatically, as shown in
Due to the reasons explained above, the rate of program-erase cycling accelerates towards the end-of life (EOL) of the drive as more blocks reach their endurance limits and are marked as bad by the SSD firmware. The reduced OP also increases the frequency of garbage collection operations which further degrades write-QoS.
In embodiments of the present invention, bad blocks with insufficient noise-margins for TLC/QLC operations can still be candidates to be used as single-level cells (SLCs).
In some embodiments, the bad blocks are used as SLC write-caches or write buffers since the write cache requires much smaller retention periods (less than a minute) compared to other blocks (many weeks). These SLC write-cache blocks may be used to supplement the write-cache pages in DRAM. Under such a scheme, the number of write-cache buffers varies dynamically during the lifetime of the device. As the number of bad blocks increases, OP decreases but the number of write-cache buffers increases. The increased number of write-buffers allows the use of a larger number of program-verify pulses without degrading the write-QoS due to the increased t-prog. This increases the noise margin in other blocks and reduces the chances of encountering another bad block.
In some other embodiments, the bad block can be utilized for storing user data but as a SLC block, if it can still support the required reliability at higher retention periods and the number of write-cache buffers has reached a fixed threshold Nmax. Under this method the drop in OP is reduced by 33%, since the capacity of an SLC block is ⅓ of the capacity of a TLC block. Further, the impact of bad blocks on write-amplification and write-QoS is reduced.
Some embodiments of the present invention provide a non-volatile data storage device that includes memory cells arranged in blocks and a memory controller coupled to the memory cells for controlling operations of the memory cells. An example of a data storage device is described above in connection with
Upon determining that the given block is a good m-bit multi-level block, the memory controller assigns the given block to be an m-bit multi-level user block. Upon determining that the given block is a bad m-bit multi-level block, the memory controller determines if the given block is a good n-bit block, wherein each memory cell is an n-bit cell, n being an integer less than m. Upon determining that the given block is a good n-bit block, the memory controller assigns the given block to be an n-bit user block or an n-bit write-buffer block. As an example, m=3 and n=1, and each memory cell in an m-bit multi-level block is a 3-bit tri-level cell (MLC), and each memory cell in an n-bit multi-level block is a single-bit single-level cell (MLC). In some cases, upon determining that the given block is a good 2-bit block, the memory controller assigns the given block to be an 2-bit user block or an n-bit write-buffer block. In other cases, upon determining that the given block is a good single-bit (SLC) block, the memory controller assigns the given block to be a single-bit (SLC) user block or a single-bit (SLC) write-buffer block.
Some embodiments of the present invention provide a non-volatile data storage device that includes memory cells arranged in blocks, each block including multiple pages and each of the multiple pages having a number of memory cells. An example of the data storage device is described above in connection with
In some embodiments, a method is provided for controlling a storage system. The storage system can include memory cells arranged in a plurality of blocks and a memory controller coupled to the memory cells for controlling operations of the memory cells. The method includes determining if a given block is a bad m-bit multi-level block, wherein each memory cell is an m-bit multi-level cell (MLC), m being an integer equal to or greater than 2. Upon determining that the given block is a good m-bit multi-level block, the method assigns the given block to be an m-bit multi-level user block. Upon determining that the given block is a bad m-bit multi-level block, the method includes determining if the given block is a good n-bit block, wherein each memory cell is an n-bit cell, n being an integer less than m. Upon determining that the given block is a good n-bit block, the method assigns the given block to be an n-bit user block or an n-bit write-buffer block.
As an example, in an embodiment of the above method, m=3 and n=1. In this case, each memory cell in an m-bit multi-level block is a 3-bit tri-level cell (TLC), and each memory cell in an n-bit multi-level block is a single-bit single-level cell (SLC).
In another example, in an embodiment of the above method, m=3 and n=2. In this case, each memory cell in an m-bit multi-level block is a 3-bit tri-level cell (TLC), and each memory cell in an n-bit multi-level block is a two-bit multi-level cell (MLC).
In other examples, m and n can be any suitable integer, with m being equal to or greater than 2. In an embodiment, m=4 and n=3. In another example, m=4 and n=2. In still another example, m=4 and n=1.
Controller 1104 can include one or more processors 1106 and memories 1108 for performing the control functions described above. Storage controller 1160 can also include lookup tables 1110, which can include a table for degraded blocks and a table for bad blocks, etc. Registers 1114 can be used to store data for control functions, such as threshold values for degraded block counts, etc.
Controller 1104 can be coupled to solid state storage 1150 through a storage interface 1102. Error correction decoder 1112 (e.g., an LDPC decoder or a BCH decoder) can perform error correction decoding on the read data and send the corrected data to controller 1104. Controller 1104 can identify the pages with read failures to garbage collector 1116, which performs corrective processing on those pages (e.g., by copying the data, with or without error correction decoding, to a new location).
As shown in
User input devices 1240 include all possible types of devices and mechanisms for inputting information to computer system 1220. These may include a keyboard, a keypad, a touch screen incorporated into the display, audio input devices such as voice recognition systems, microphones, and other types of input devices. In various embodiments, user input devices 1240 are typically embodied as a computer mouse, a trackball, a track pad, a joystick, wireless remote, drawing tablet, voice command system, eye tracking system, and the like. User input devices 1240 typically allow a user to select objects, icons, text and the like that appear on the monitor 1210 via a command such as a click of a button or the like.
User output devices 1230 include all possible types of devices and mechanisms for outputting information from computer 1220. These may include a display (e.g., monitor 1210), non-visual displays such as audio output devices, etc.
Communications interface 1250 provides an interface to other communication networks and devices. Communications interface 1250 may serve as an interface for receiving data from and transmitting data to other systems. Embodiments of communications interface 1250 typically include an Ethernet card, a modem (telephone, satellite, cable, ISDN), (asynchronous) digital subscriber line (DSL) unit, FireWire interface, USB interface, and the like. For example, communications interface 1250 may be coupled to a computer network, to a FireWire bus, or the like. In other embodiments, communications interfaces 1250 may be physically integrated on the motherboard of computer 1220, and may be a software program, such as soft DSL, or the like.
In various embodiments, computer system 1200 may also include software that enables communications over a network such as the HTTP, TCP/IP, RTP/RTSP protocols, and the like. In alternative embodiments of the present invention, other communications software and transfer protocols may also be used, for example IPX, UDP or the like. In some embodiments, computer 1220 includes one or more Xeon microprocessors from Intel as processor(s) 1260. Further, one embodiment, computer 1220 includes a UNIX-based operating system.
RAM 1270 and disk drive 1280 are examples of tangible media configured to store data such as embodiments of the present invention, including executable computer code, human readable code, or the like. Other types of tangible media include floppy disks, removable hard disks, optical storage media such as CD-ROMS, DVDs and bar codes, semiconductor memories such as flash memories, non-transitory read-only-memories (ROMS), battery-backed volatile memories, networked storage devices, and the like. RAM 1270 and disk drive 1280 may be configured to store the basic programming and data constructs that provide the functionality of the present invention.
Software code modules and instructions that provide the functionality of the present invention may be stored in RAM 1270 and disk drive 1280. These software modules may be executed by processor(s) 1260. RAM 1270 and disk drive 1280 may also provide a repository for storing data used in accordance with the present invention.
RAM 1270 and disk drive 1280 may include a number of memories including a main random access memory (RAM) for storage of instructions and data during program execution and a read only memory (ROM) in which fixed non-transitory instructions are stored. RAM 1270 and disk drive 1280 may include a file storage subsystem providing persistent (non-volatile) storage for program and data files. RAM 1270 and disk drive 1280 may also include removable storage systems, such as removable flash memory.
Bus subsystem 1290 provides a mechanism for letting the various components and subsystems of computer 1220 communicate with each other as intended. Although bus subsystem 1290 is shown schematically as a single bus, alternative embodiments of the bus subsystem may utilize multiple busses. Bus system 1290 may be a PCI Express bus that may be implemented using PCIe PHY embodiments of the present disclosure.
Various embodiments of the present invention can be implemented in the form of logic in software or hardware or a combination of both. The logic may be stored in a computer readable or machine-readable non-transitory storage medium as a set of instructions adapted to direct a processor of a computer system to perform a set of steps disclosed in embodiments of the present invention. The logic may form part of a computer program product adapted to direct an information-processing device to perform a set of steps disclosed in embodiments of the present invention. Based on the disclosure and teachings provided herein, a person of ordinary skill in the art will appreciate other ways and/or methods to implement the present invention.
The data structures and code described herein may be partially or fully stored on a computer-readable storage medium and/or a hardware module and/or hardware apparatus. A computer-readable storage medium includes, but is not limited to, volatile memory, non-volatile memory, magnetic and optical storage devices such as disk drives, magnetic tape, CDs (compact discs), DVDs (digital versatile discs or digital video discs), or other media, now known or later developed, that are capable of storing code and/or data. Hardware modules or apparatuses described herein include, but are not limited to, application-specific integrated circuits (ASICs), field-programmable gate arrays (FPGAs), dedicated or shared processors, and/or other hardware modules or apparatuses now known or later developed.
The methods and processes described herein may be partially or fully embodied as code and/or data stored in a computer-readable storage medium or device, so that when a computer system reads and executes the code and/or data, the computer system performs the associated methods and processes. The methods and processes may also be partially or fully embodied in hardware modules or apparatuses, so that when the hardware modules or apparatuses are activated, they perform the associated methods and processes. The methods and processes disclosed herein may be embodied using a combination of code, data, and hardware modules or apparatuses.
The embodiments disclosed herein are not to be limited in scope by the specific embodiments described herein. Various modifications of the embodiments of the present invention, in addition to those described herein, will be apparent to those of ordinary skill in the art from the foregoing description and accompanying drawings. Further, although some of the embodiments of the present invention have been described in the context of a particular implementation in a particular environment for a particular purpose, those of ordinary skill in the art will recognize that its usefulness is not limited thereto and that the embodiments of the present invention can be beneficially implemented in any number of environments for any number of purposes.
