The present invention relates generally to Flash memory. More particularly, the present invention relates to a multi-device Flash memory system for mass storage applications.
Flash memory is a commonly used type of non-volatile memory in widespread use as mass storage for consumer electronics, such as digital cameras and portable digital music players for example. The density of a presently available Flash memory chip can be up to 32 Gbits (4 GB), which is suitable for use in popular USB Flash drives since the size of one Flash chip is small.
The advent of 8 mega pixel digital cameras and portable digital entertainment devices with music and video capabilities has spurred demand for ultra-high capacities to store the large amounts of data, which cannot be met by the single Flash memory device. Therefore, multiple Flash memory devices are combined together into a memory system to effectively increase the available storage capacity. For example, Flash storage densities of 20 GB may be required for such applications.
Channel 20 includes a set of common buses, which include data and control lines that are connected to all its corresponding memory devices. While not shown, each memory device is enabled/disabled with a respective chip select signal provided by Flash memory controller 14. The Flash controller 14 is responsible for issuing commands and data, via the channel, to a selected memory device based on the operation of the host system 12. Data read from the memory devices is transferred via the channel back to the Flash memory controller 14 and host system 12. Flash memory system 10 is generally referred to as a multi-drop configuration, in which the memory devices 16 are connected in parallel with respect to channel 20.
In Flash memory system 10, non-volatile memory devices 16 are identical to each other, and are typically implemented as NAND Flash memory devices. Those skilled in the art will understand that Flash memory is organized into banks, and each bank is organized into blocks to facilitate block erasure. Most commercially available NAND Flash memory devices are configured to have two banks of memory. Prior to a discussion of the operation of Flash memory system 10, a brief overview of a single NAND Flash memory device memory core is described.
Connected to each bitline outside of the bank 30 is a data register 32 for storing one page of write data to be programmed into one page of Flash memory cells. Data register 32 also includes sense circuits for sensing data read from one page of Flash memory cells. During programming operations, the data registers perform program verify operations to ensure that the data has been properly programmed into the Flash memory cells connected to the selected wordline. Programming within a block typically starts at the page corresponding to WL0, and proceeds sequentially up to WLi to fill the present block. Then programming continues with WL0 of a new block. Within a device, blocks are programmed in sequence.
Returning to the Flash memory system 10 of
The configuration of Flash memory system 10 imposes physical performance limitations. With the large number of parallel signals running across the system, the signal integrity of the signals they carry will be degraded by crosstalk, signal skew, and simultaneous switching noise (SSN). Power consumption in such a configuration becomes an issue as each signal track between the flash controller and flash memory devices is frequently charged and discharged for signaling. With increasing system clock frequencies, the power consumption will increase as well.
From an architectural perspective, programming operations will take too much time. A primary function of the Flash controller 14 is to manage the writing of data to the memory devices in the system. In the Flash memory context, writing of data is more commonly referred to as programming data. There are two significant issues related to Flash programming. First, Flash programming is slow relative to volatile memories such as DRAM and SRAM, and other non-volatile memories such as hard disk drives. Programming data to Flash memory cells requires high voltages and a stepped programming sequence to obtain a tight programmed threshold voltage distribution. In a NAND Flash memory device having two banks of memory, two pages of data are concurrently programmed, one for each bank. Since there is only one data register per bank, further programming operations must wait until the current pages have been successfully programmed. Therefore, programming large quantities of data to the Flash devices 16 may require a significant amount of time.
A second issue with the conventional Flash memory system 10 is the linear file structure of the program data.
This linear file structure coupled with the relatively long programming time per page of the data file per memory device, results in a Flash memory system that requires significant time to store data. Another issue which is related to the linear file structure is device reliability, and more specifically, program/erase wearing of one memory device relative to the other memory devices in the system. Program/erase wearing refers to a progressive degradation of a Flash memory cell due to cumulative program and erase operations. The effect of such cumulative program and erase operations is the alteration of the program and erase characteristics of the memory cell beyond optimal parameters. When memory cells are degraded, higher program and erase voltages are needed to program or erase the memory cells to the desired threshold voltages. Eventually, the memory cells will fail to function properly. This is the reason that Flash memory are rated for a limited number of erase-program cycles, which is between 10,000 and 100,000 cycles.
If for example, the first memory device 52 in
An inherent technical architecture of most Flash memory is that the smallest unit of memory which is erasable is a block of memory. This means that if even one page within the block is to be modified, the entire block must be re-programmed along with the new page. This is referred to as block re-programming, which requires significant programming time and hence negatively impacts performance of the system.
Therefore, presently known Flash memory systems have slow throughput for programming data, and due to the unequal program and erase wearing across the devices, the entire system will have a lifespan limited to the first memory device to fail.
It is, therefore, desirable to provide a high speed Flash memory system architecture having a scheme for maximizing the lifespan of the system.
It is an object of the present invention to obviate or mitigate at least one disadvantage of previous control schemes for Flash memory systems. In particular, it is an object of the present invention to improve Flash memory system programming throughput by interleaving programming operations in each Flash memory device of the system.
In a first aspect, the present invention provides a method for controlling first and second Flash memory devices connected to a channel. The method includes executing a first operation in the first Flash memory device in response to a first command, and initiating a second operation in the second Flash memory device in response to the a second command, while the first Flash memory device is executing the first operation.
In an embodiment of the present aspect, the first Flash memory device and the second Flash memory device are serially connected to each other, and the second command is passed to the second Flash memory device through the first Flash memory device before the step of initiating. In further embodiments, the step of executing the first operation includes programming at least one page of a data file in the first memory device. The second operation includes initiating programming of at least one other page of the data file in the second memory device, while the method further includes initiating a third operation in the first Flash memory device in response to a third command. The second operation includes initiating a read operation of data in the second memory device or initiating an erase operation in the second memory device. In yet another embodiment, executing the first operation includes one of a read operation and an erase operation in the first memory device.
In a second aspect, the present invention provides a method for high speed wear leveling programming in a Flash memory system having a plurality Flash memory devices. The method includes receiving a data file having k pages, k being an integer greater than 0; selecting a programming profile corresponding to the size of k and configuration parameters of the Flash memory system; and programming at least one of the k pages of the data file in each of to at least two of the plurality of Flash memory devices in accordance with the selected programming profile.
According to an embodiment of the present aspect, the configuration parameters includes j Flash memory devices, and each of the j Flash memory devices have i pages per block, where j and i are integer values greater than 0. The step of selecting includes calculating a ceiling function of z, where z=k/i, and the programming profile includes a single file structure for storing k pages of the data file in z of j Flash memory devices when z is less than or equal to j. The step of programming includes sequentially providing program commands to each of the z Flash memory devices for programming the k pages, where each program command programs the at least one of the k pages.
In another embodiment of the present aspect, the programming profile includes a multiple file structure when z is greater than j. The multiple file structure includes storing m units of j*i pages of the data file in j Flash memory devices, and storing k−(m*j*i)) pages of the data file in z of j Flash memory devices when z is less than or equal to j, where m is an integer value greater than 0. The step of programming includes sequentially providing program commands to each of the j Flash memory devices for programming the j*i pages of the data file, where each program command programs the at least one of the k pages. The step of programming further includes sequentially providing program commands to each of the z Flash memory devices for programming the k−(m*j*i)) pages, where each program command programs the at least one of the k pages.
In a third aspect, the present invention provides a data file storage architecture for a memory system having at least two memory devices connected to the same channel. The data file storage architecture includes portions of the data file stored in two of the at least two memory devices. According to embodiments of the present aspect, the portions are substantially equal in size to each other, and the portions are stored in each of the at least two memory devices of the memory system.
In a fourth aspect, the present invention provides a method for high speed wear leveling programming in a Flash memory system having j Flash memory devices, where each of the j Flash memory devices has i pages per block, where j and i are integer values greater than 0. The method includes receiving a data file having k pages, k being an integer greater than 0; providing commands for programming k pages within z of j memory devices if a ceiling function of z=k/i is less than or equal to j; providing commands for programming j*i pages within j memory devices if the ceiling function of z=k/i is greater than j; updating k by setting k=k−(j*i); and repeating the step of programming updated k pages.
In a fifth aspect, the present invention provides a Flash memory system. The Flash memory system includes a controller, a first Flash memory device, and a second Flash memory device. The controller has a channel for providing a first command and a second command. The first Flash memory device is coupled to the channel for executing a first operation in response to the first command. The second Flash memory device is coupled to the channel for initiating a second operation in response to the second command while the first Flash memory device is executing the first operation.
According to embodiments of the present aspect, the first Flash memory device and the second Flash memory device are serially connected to each other, and the second command is passed to the second Flash memory device through the first Flash memory device. The first operation includes a programming operation, and the first Flash memory device programs at least one page of a data file. The second operation includes another programming operation, and the second Flash memory device programs at least one other page of the data file.
Other aspects and features of the present invention will become apparent to those ordinarily skilled in the art upon review of the following description of specific embodiments of the invention in conjunction with the accompanying figures.
Embodiments of the present invention will now be described, by way of example only, with reference to the attached Figures, wherein:
A Flash memory system architecture having serially connected Flash memory devices to achieve high speed programming of data. High speed programming of data is achieved by interleaving pages of the data amongst the memory devices in the system, such that different pages of data are stored in different memory devices. A memory controller issues program commands for each memory device in a bitstream having one or more signal lines. As each memory device receives a program command, it either begins a programming operation or passes the command to the next memory device. Therefore, the memory devices in the Flash system sequentially program pages of data one after the other, thereby minimizing delay in programming each page of data into the Flash memory system. The memory controller executes a wear level control algorithm to optimize programming performance and endurance for data of any size.
Flash memory device 106 is the first device in the chain, and receives commands, such as read, program and erase commands, from Flash memory controller 102. In the MISL Flash device of U.S. patent application Ser. No. 11/324,023, all commands, data and address information are received as a serial bitstream. The commands include data information, address information, and any other information required by the memory device for executing a particular operation. As each Flash memory device should include flow-through logic circuitry, any received command not intended for a particular device is passed to the next Flash memory device, and so forth, until it is acted upon by the intended Flash memory device. The last Flash memory device 112 in the chain has outputs connected to the Flash memory controller 102, for providing read data in response to a read command. The presently shown embodiment of
As previously discussed, the Flash memory controller 102 is responsible for issuing program commands for each Flash memory device. For high speed programming of data according to an embodiment of the present invention, pages of a data file are programmed to different memory devices. This is done by issuing program commands serially one after the other to initiate program operations in each Flash memory device in rapid succession.
If it is assumed that each programming command requires about 85 microseconds to transfer to the memory device (time t1), then the total sequence for transferring the four program commands will require 4×85 microseconds=340 microseconds. The time required for programming the at least one page of data per memory device is fixed, and assumed to be about 200 microseconds. Therefore, the total elapsed time for programming all the data to the Flash memory system 100 will be about 340 microseconds+200 microseconds=540 microseconds. The 200 microsecond programming time is contributed by the last memory device to receive a programming command. In contrast, programming 4 pages to the same memory device will take 1140 microseconds. The overlapping programming operations of the Flash memory devices is more clearly shown in the expanded timing diagram of
As soon as program command Data[0] has been transferred to memory device 106, the second program command Data[1] is received by memory device 108 during a second time period t2 at step 306. A program operation follows at step 308, and because the programming operation for memory device 106 has already commenced at the end of time period t1, there is a period of time where both memory devices 106 and 108 are executing programming operations at the same time. The process would repeat in the same manner for the next program command and memory device. In the present example, programming operations in memory devices 106 and 108 will have been completed by the end of time period t4. The programming operation in memory device 110 will be completed as the programming operation in memory device 112 continues.
The above example presents a scenario where the first memory device to receive a command is 106. Alternately, any one of the memory devices in the system can be the first memory device to receive the first program command. A fifth program command is issued to memory device 106 after time period t4, provided that device 106 has finished its programming operation. Those skilled in the art will understand that different Flash memory devices will have varying programming times. In the presently shown example of
While high speed programming is beneficial to systems using Flash memory system 100, some systems may require maximized endurance of the Flash memory system 100. The file structure shown in
Therefore, according to another embodiment of the invention, the above described high speed programming control method is adjusted to minimize program/erase wear, or to optimize programming performance and program/erase wear. More specifically, the Flash controller 102 of
The high speed wear leveling programming method starts at step 400 where a variable i is set to be the number of pages per block in each memory device of the Flash memory system, and a variable j is set to be the number of memory devices in the Flash memory system. It is presumed that all the memory devices in the Flash memory system are identical to each other, and have the same block size. This information is pre-programmed into the memory controller. At step 402, a data file consisting of a number of pages k, is received by the memory controller for programming. Proceeding to step 404, a calculation is made to determine if k is less than or equal to i. If k is less than or equal to i, meaning that the data file is less than or equal to one block of storage space in a memory device, then all k pages of the data file are programmed to one block of one memory device at step 406. This is an example of a programming profile having a single file structure. The memory controller selects the specific memory device to which the data file will be programmed to in accordance with one or more selection parameters. For example, one selection parameter is the memory device with the highest number of remaining program/erase cycles, while another selection parameter includes the last memory device to be programmed to.
On the other hand, if k is greater than i, meaning that the data file includes more pages than one block of storage space in a memory device, then the method proceeds to step 408. At step 408, a calculation is made to determine if k/i is less than or equal to j. It should be noted that the calculation of k/i should yield integer numbers only. Since the present method determines the minimum number of blocks required for storing the k data, a non-integer result having a whole number and decimal portion (ie. a real number) indicates that one block more than the whole number is required. This is done through known mathematical functions such as a ceiling function. Those skilled in the art will understand that a ceiling function returns the smallest integer that is not less than the real number. On the other hand, a direct integer result from k/i does not require further mathematical processing. From this point forward, reference to the k/i result will presume that a ceiling function has been applied to it.
If the k/i integer value is less than j, the number of memory devices in the Flash memory system, then the k pages of the data file are interleave programmed between k/i memory devices in step 410. This is another example of a programming profile having a single file structure. The interleave programming will proceed as previously described in the method of
If k/i is at least j, the number of memory devices in the system, then different optimization programming sequences, will be used for programming differently sized groups of the data file. More specifically, very large data files are treated as multiple units of smaller data files, which are programmed according to any one of the previously described programming sequences. Continuing at step 412, all page locations in one block of each memory device is programmed with j*i pages of the k pages of the data file, according to the interleaved programming sequence of step 410. Following at step 414, the number of pages k is updated by setting it equal to k−(j*i). Therefore, the remaining number of pages to be programmed is calculated. The method loops back to step 404 to repeat the decision tree processing and programming sequences based on the updated value of k. In summary, the present method will iteratively program multiple units of j*i pages of the data file using the same file structure for each unit of j*i pages, and then program the remaining k−(j*i) pages using a different file structure. Hence the present method has a programming profile consisting of multiple file structures for the data file.
A practical example will now be used to illustrate this embodiment. If I =32, j =4 and k =192, then the first 128 pages will be programmed across all the memory devices as described in step 412. At step 414, k is updated to be 192−(128)=64. Then the remaining 64 pages are programmed across two memory devices as described in step 410. As previously mentioned, any two memory devices are selected for programming the remaining 64 pages. While the presently described embodiment illustrates a method where programming is followed by recalculation of k, the entire sequence can be determined by the Flash controller in advance and before any programming operations begin by employing the above described calculations. While it is presumed that the first pages of the data file to be programmed are the j*i pages, the first pages to be programmed can be the k−(j*i) pages instead, followed by the multiple units of j*i pages.
The presently described high speed wear leveling programming method has been described for a Flash memory system having a single channel, such as the embodiment shown in
Additionally, the present embodiment has been described in operation with memory devices having a single memory bank. Of course, memory devices having two or more memory banks can be used. With two memory banks, there will be two available page buffers for storing up to two pages of data. In a multi-bank device configuration, several programming options are available. In a first option, all the pages of data to be programmed to one memory device are programmed to one block within one bank of the memory device. The operation would be analogous to a memory device having only one memory bank. In a second option, two pages of the data file are loaded into one memory device concurrently, or in a single program command. This will effectively increase programming throughput as each memory device will program two pages at the same time. In a third option, programming operations are interleaved between banks of the memory devices. For example, programming pages to two memory devices will proceed in the following sequence: device 1 [bank 1], device 2 [bank 1], device 1 [bank 2], and device 2 [bank 2]. The programming sequence should be obvious for memory devices having more than 2 banks.
Furthermore, while the previously described high speed wear leveling programming method has been described for Flash memory systems having serially connected, or daisy-chained memory devices, the embodiments are applicable to multi-drop configured Flash systems such as the one shown in
The previously described embodiments of the invention illustrate examples where programming operations in the Flash memory system of
Memory device 110 will commence its internal data transfer operation after receiving its respective read command. However, now that the signal lines between memory devices 108 and 110 are unused, upstream memory device 108 will begin outputting the data in its data registers to memory device 110, which passes the data through to memory device 112. This is done in a sequential manner, for example. At the end of time period t3, memory device 108 will have finished outputting all its read data, thereby allowing memory device 110 to start outputting its read data at the start of time period t4. Since memory device 110 cannot output its data until memory device 108 has finished outputting its data, an internal NOP period 502 is entered. At the end of time period t4, the signal lines between memory devices 110 and 112 will be unused as all the data from memory device 110 has been outputted through memory device 112. Hence at the beginning of time period t5, memory device 112 will receive program command Data[1].
While interleaved read and program operations have been illustrated, interleaved read, program and erase operations are executable in any combination.
The previously described high speed interleaved programming method is used to maximize programming performance in a Flash memory system having serially connected memory devices. High speed interleaved programming is applied to data files of any size. However, to improve endurance of all the memory devices, a high speed wear leveling programming method is used to distribute the pages of a data file with a file structure based on a size of the data file. While the embodiments are directed to Flash memory devices, the embodiments of the invention are applicable to other memory devices in which pages of data files are programmed or written to at least two memory devices.
In the preceding description, for purposes of explanation, numerous details are set forth in order to provide a thorough understanding of the embodiments of the invention. However, it will be apparent to one skilled in the art that these specific details are not required in order to practice the invention. In other instances, well-known electrical structures and circuits are shown in block diagram form in order not to obscure the invention. For example, specific details are not provided as to whether the embodiments of the invention described herein are implemented as a software routine, hardware circuit, firmware, or a combination thereof.
Embodiments of the invention can be represented as a software product stored in a machine-readable medium (also referred to as a computer-readable medium, a processor-readable medium, or a computer usable medium having a computer-readable program code embodied therein). The machine-readable medium can be any suitable tangible medium, including magnetic, optical, or electrical storage medium including a diskette, compact disk read only memory (CD-ROM), memory device (volatile or non-volatile), or similar storage mechanism. The machine-readable medium can contain various sets of instructions, code sequences, configuration information, or other data, which, when executed, cause a processor to perform steps in a method according to an embodiment of the invention. Those of ordinary skill in the art will appreciate that other instructions and operations necessary to implement the described invention can also be stored on the machine-readable medium. Software running from the machine-readable medium can interface with circuitry to perform the described tasks.
The above-described embodiments of the invention are intended to be examples only. Alterations, modifications and variations can be effected to the particular embodiments by those of skill in the art without departing from the scope of the invention, which is defined solely by the claims appended hereto.
This application claims the benefit of priority of U.S. Provisional Patent Application No. 60/788,083 filed Mar. 31, 2006, which is incorporated herein by reference in its entirety.
Number | Name | Date | Kind |
---|---|---|---|
4174536 | Misunas et al. | Nov 1979 | A |
4733376 | Ogawa | Mar 1988 | A |
4796231 | Pinkham | Jan 1989 | A |
5126808 | Montalvo et al. | Jun 1992 | A |
5136292 | Ishida | Aug 1992 | A |
5175819 | Le Ngoc et al. | Dec 1992 | A |
5243703 | Farmwald et al. | Sep 1993 | A |
5280539 | Yeom et al. | Jan 1994 | A |
5365484 | Cleveland et al. | Nov 1994 | A |
5404460 | Thomsen et al. | Apr 1995 | A |
5440694 | Nakajima | Aug 1995 | A |
5452259 | McLaury | Sep 1995 | A |
5473563 | Suh et al. | Dec 1995 | A |
5473566 | Rao | Dec 1995 | A |
5473577 | Miyake et al. | Dec 1995 | A |
5530828 | Kaki et al. | Jun 1996 | A |
5596724 | Mullins et al. | Jan 1997 | A |
5602780 | Diem et al. | Feb 1997 | A |
5636342 | Jeffries | Jun 1997 | A |
5671178 | Park et al. | Sep 1997 | A |
5721840 | Soga | Feb 1998 | A |
5740379 | Hartwig | Apr 1998 | A |
5761146 | Yoo et al. | Jun 1998 | A |
5771199 | Lee | Jun 1998 | A |
5802006 | Ohta | Sep 1998 | A |
5818785 | Ohshima | Oct 1998 | A |
5828899 | Richard et al. | Oct 1998 | A |
5835935 | Estakhri et al. | Nov 1998 | A |
5859809 | Kim | Jan 1999 | A |
5872994 | Akiyama et al. | Feb 1999 | A |
5937425 | Ban | Aug 1999 | A |
5941974 | Babin | Aug 1999 | A |
5959930 | Sakuria | Sep 1999 | A |
5995417 | Chen et al. | Nov 1999 | A |
6002638 | John | Dec 1999 | A |
6085290 | Smith et al. | Jul 2000 | A |
6091660 | Sasaki et al. | Jul 2000 | A |
6107658 | Itoh et al. | Aug 2000 | A |
6144576 | Leddige et al. | Nov 2000 | A |
6148364 | Srinivasan et al. | Nov 2000 | A |
6178135 | Kang | Jan 2001 | B1 |
6304921 | Rooke | Oct 2001 | B1 |
6317350 | Pereira et al. | Nov 2001 | B1 |
6317352 | Halbert et al. | Nov 2001 | B1 |
6438064 | Ooishi | Aug 2002 | B2 |
6442098 | Kengeri | Aug 2002 | B1 |
6535948 | Wheeler et al. | Mar 2003 | B1 |
6584303 | Kingswood et al. | Jun 2003 | B1 |
6594183 | Lofgren et al. | Jul 2003 | B1 |
6601199 | Fukuda et al. | Jul 2003 | B1 |
6611466 | Lee et al. | Aug 2003 | B2 |
6658582 | Han | Dec 2003 | B1 |
6680904 | Kaplan et al. | Jan 2004 | B1 |
6715044 | Lofgren et al. | Mar 2004 | B2 |
6732221 | Ban | May 2004 | B2 |
6754807 | Parthasarathy et al. | Jun 2004 | B1 |
6763426 | James et al. | Jul 2004 | B1 |
6807103 | Cavaleri et al. | Oct 2004 | B2 |
6816933 | Andreas | Nov 2004 | B1 |
6850443 | Lofgren et al. | Feb 2005 | B2 |
6853557 | Haba et al. | Feb 2005 | B1 |
6853573 | Kim et al. | Feb 2005 | B2 |
6928501 | Andreas et al. | Aug 2005 | B2 |
6944697 | Andreas | Sep 2005 | B2 |
6950325 | Chen | Sep 2005 | B1 |
6967874 | Hosono | Nov 2005 | B2 |
7296112 | Yarlagadda et al. | Nov 2007 | B1 |
20020188781 | Schoch et al. | Dec 2002 | A1 |
20040001380 | Becca et al. | Jan 2004 | A1 |
20040019736 | Kim et al. | Jan 2004 | A1 |
20040024960 | King et al. | Feb 2004 | A1 |
20040039854 | Estakhri et al. | Feb 2004 | A1 |
20040199721 | Chen | Oct 2004 | A1 |
20040230738 | Lim et al. | Nov 2004 | A1 |
20050120163 | Chou et al. | Jun 2005 | A1 |
20050144361 | Gonzalez et al. | Jun 2005 | A1 |
20050160218 | See et al. | Jul 2005 | A1 |
20050166006 | Talbot et al. | Jul 2005 | A1 |
20050213421 | Polizzi et al. | Sep 2005 | A1 |
20060050594 | Park | Mar 2006 | A1 |
Number | Date | Country |
---|---|---|
WO 0169411 | Sep 2001 | WO |
2005069150 | Jul 2005 | WO |
WO 2005069150 | Jul 2005 | WO |
Number | Date | Country | |
---|---|---|---|
20070233939 A1 | Oct 2007 | US |
Number | Date | Country | |
---|---|---|---|
60788083 | Mar 2006 | US |