1. Technical Field
This disclosure relates to non-volatile data storage devices and methods for accelerating data operations in such devices.
2. Description of the Related Art
Database operations are often performed in an environment where speed of execution is of great importance. Common operations such as returning query results and indexing are often I/O-intensive and consume much data bandwidth between a host system (e.g., computing device) and a data storage device at which such operations are executed.
Systems and methods that embody the various features of the various embodiments of the invention will now be described with reference to the following drawings, in which:
Some embodiments of this disclosure are directed to a data storage device (e.g., solid-state drive (SSD)) that is configured to accelerate database operations. In an embodiment, the data storage device supports a variable sized logical page whose size can be customized to match the individual data units (e.g., tuples) within a database data structure. As a result, certain database operations can be accelerated as certain data may be skipped by logical address range(s) to reduce the number of data read out of the storage media and transferred to the host, which results in more efficient database operations.
While certain embodiments of the disclosure are described, these embodiments are presented by way of example only, and are not intended to limit the scope of the disclosure. Indeed, the novel methods and systems described herein may be embodied in a variety of other forms. Furthermore, various omissions, substitutions and changes in the form of the methods and systems described herein may be made without departing from the spirit of the disclosure.
Data Storage System Overview
The controller 130 can receive data and/or storage access commands from a storage interface 112 (e.g., a device driver) in a host system 110. Storage access commands communicated by the storage interface 112 can include write and read commands issued by the host system 110. The commands can specify a logical block address in the data storage device 120, and the controller 130 can execute the received commands in the non-volatile solid-state memory 140. In a hybrid hard drive, data may be stored in magnetic media storage component (not shown in
The data storage device 120 can store data received from the host system 110 so that the data storage device 120 can act as memory storage for the host system 110. To facilitate this function, the controller 130 can implement a logical interface. The logical interface can present to the host system 110 the storage device's memory as a set of logical addresses (e.g., contiguous address) where data can be stored. Internally, the controller 130 can map logical addresses to various physical memory addresses in the non-volatile solid-state memory 140 and/or other memory module(s).
In one embodiment, the controller 130 includes storage device hardware and firmware 148 and a memory for database operation code/firmware 150. The storage device hardware and firmware 148 is/are used to control data operations within the data storage device. In one embodiment, the database operation code/firmware in memory 150 is configurable by the host, and can be executed in its own dedicated processor (not shown in
Acceleration of Database Operations
In one embodiment, the size of the logical page is configured to be equal to the size of a tuple of the database, or an integer multiple of it. Due to this flexibility in the logical page size, a database administrator, when designing/configuring the database, can create a matching correlation between the stored data and the access index. For example, as shown in
In addition, the logical page and database data alignment may allow for selective skipping of certain logical page ranges in query operations (for example, during the execution of the action in the block 172 in
In one embodiment, the data storage device includes a dedicated buffer for query processing, e.g., the query processing buffer 160 shown in
In addition, in one embodiment, the data storage device includes a buffer to hold a response to the host query, e.g., the host response buffer 162 shown in
In addition, in one embodiment, the data storage device includes a dedicated processor to execute host-provided code (xenocode, or XC). In one embodiment, xenocode shall have as minimum read access to the query processing buffer 160 and read/write access to the host response buffer 162. In one embodiment, the data storage device includes a code memory for the xenocode (XC memory or XCM), as shown in element 150 of
In one embodiment, the data storage device is configured to provide to the host information about XC type, size of the XCM and HRB, XCR configuration, and execution timing. This information can be provided electronically or in the product documentation.
Query Execution Flows
In one embodiment, the data storage device may be filled with relational database tuples in accordance with the description above.
In one embodiment, an indexing operation may take place as follows. Much like
In one embodiment, the data storage device may provide configurable watchdog timing to better match xenocode execution with expected traffic.
In one embodiment, the data storage device can go beyond read-only access to the data content. For example, the xenocode can provide read-modify-write operations if necessary. The data storage device may implement this functionality by supporting write access to the query processing buffer by the xenocode, and providing the ability to write the modified logical page back to the solid-state memory. The xenocode, for example, may be configured to read out a page matching certain value, perform some operation, and write the modified page back to the solid-state memory. This can be done without data transfer between the host system and the data storage device and without requiring the host system's processing power to perform such operations.
Other Variations
Those skilled in the art will appreciate that in some embodiments, other approaches and methods can be used. For example, the non-volatile solid-state memory array can be implemented using NAND flash memory devices. Other types of solid-state memory devices can alternatively be used, such as array of flash integrated circuits, Chalcogenide RAM (C-RAM), Phase Change Memory (PC-RAM or PRAM), Programmable Metallization Cell RAM (PMC-RAM or PMCm), Ovonic Unified Memory (OUM), Resistance RAM (RRAM), NOR memory, EEPROM, Ferroelectric Memory (FeRAM), Magnetoresistive RAM (MRAM), other discrete NVM (non-volatile solid-state memory) chips, or any combination thereof. In one embodiment, the non-volatile solid-state memory array preferably includes multi-level cell (MLC) devices having multi-level cells capable of storing more than a single bit of information, although single-level cell (SLC) memory devices or a combination of SLC and MLC devices may be used. In one embodiment, the data storage device 120 can include other memory modules, such as one or more magnetic memory modules. In addition, the systems and methods of this disclosure may also be useful in more conventional hard drives and hybrid drives including both solid-state and hard drive components. For example, certain hard disk drive employing magnetic recording technology may employ the data addressing and processing schemes described above.
While certain embodiments of the disclosure have been described, these embodiments have been presented by way of example only, and are not intended to limit the scope of the disclosure. Indeed, the novel methods and systems described herein may be embodied in a variety of other forms. Furthermore, various omissions, substitutions and changes in the form of the methods and systems described herein may be made without departing from the spirit of the disclosure. The accompanying claims and their equivalents are intended to cover such forms or modifications as would fall within the scope and spirit of the disclosure. For example, the various components described may be implemented as software and/or firmware on a processor, ASIC/FPGA, or dedicated hardware. For example, those skilled in the art will appreciate that in some embodiments, the actual steps taken in the processes of some embodiments may differ from those shown in the figures. Depending on the embodiment, certain of the steps described in the example above may be removed, others may be added, and the sequence of steps may be altered and/or performed in parallel. Also, the features and attributes of the specific embodiments disclosed above may be combined in different ways to form additional embodiments, all of which fall within the scope of the present disclosure. Although the present disclosure provides certain preferred embodiments and applications, other embodiments that are apparent to those of ordinary skill in the art, including embodiments which do not provide all of the features and advantages set forth herein, are also within the scope of this disclosure. Accordingly, the scope of the present disclosure is intended to be defined only by reference to the appended claims.
This application claims the benefit of U.S. provisional application No. 61/895,263, filed Oct. 24, 2013, entitled “Data Storage Device Supporting Accelerated Database Operations,” the disclosure of which is hereby incorporated in its entirety.
Number | Name | Date | Kind |
---|---|---|---|
6401185 | Sexton | Jun 2002 | B1 |
6446062 | Levine | Sep 2002 | B1 |
6549977 | Horst et al. | Apr 2003 | B1 |
6856556 | Hajeck | Feb 2005 | B1 |
7055015 | Shiota | May 2006 | B2 |
7126857 | Hajeck | Oct 2006 | B2 |
7424478 | Licon | Sep 2008 | B2 |
7430136 | Merry, Jr. et al. | Sep 2008 | B2 |
7447807 | Merry et al. | Nov 2008 | B1 |
7502256 | Merry, Jr. et al. | Mar 2009 | B2 |
7509441 | Merry et al. | Mar 2009 | B1 |
7596643 | Merry, Jr. et al. | Sep 2009 | B2 |
7653778 | Merry, Jr. et al. | Jan 2010 | B2 |
7685337 | Merry, Jr. et al. | Mar 2010 | B2 |
7685338 | Merry, Jr. et al. | Mar 2010 | B2 |
7685374 | Diggs et al. | Mar 2010 | B2 |
7733712 | Walston et al. | Jun 2010 | B1 |
7765373 | Merry et al. | Jul 2010 | B1 |
7898855 | Merry, Jr. et al. | Mar 2011 | B2 |
7912991 | Merry et al. | Mar 2011 | B1 |
7936603 | Merry, Jr. et al. | May 2011 | B2 |
7962792 | Diggs et al. | Jun 2011 | B2 |
8078918 | Diggs et al. | Dec 2011 | B2 |
8090899 | Syu | Jan 2012 | B1 |
8095851 | Diggs et al. | Jan 2012 | B2 |
8108692 | Merry et al. | Jan 2012 | B1 |
8122185 | Merry, Jr. et al. | Feb 2012 | B2 |
8127048 | Merry et al. | Feb 2012 | B1 |
8135903 | Kan | Mar 2012 | B1 |
8151020 | Merry, Jr. et al. | Apr 2012 | B2 |
8161227 | Diggs et al. | Apr 2012 | B1 |
8166245 | Diggs et al. | Apr 2012 | B2 |
8243525 | Kan | Aug 2012 | B1 |
8254172 | Kan | Aug 2012 | B1 |
8261012 | Kan | Sep 2012 | B2 |
8296625 | Diggs et al. | Oct 2012 | B2 |
8312207 | Merry, Jr. et al. | Nov 2012 | B2 |
8316176 | Phan et al. | Nov 2012 | B1 |
8341339 | Boyle et al. | Dec 2012 | B1 |
8375151 | Kan | Feb 2013 | B1 |
8392635 | Booth et al. | Mar 2013 | B2 |
8397107 | Syu et al. | Mar 2013 | B1 |
8407449 | Colon et al. | Mar 2013 | B1 |
8423722 | Deforest et al. | Apr 2013 | B1 |
8433858 | Diggs et al. | Apr 2013 | B1 |
8443167 | Fallone et al. | May 2013 | B1 |
8447920 | Syu | May 2013 | B1 |
8458435 | Rainey, III et al. | Jun 2013 | B1 |
8478930 | Syu | Jul 2013 | B1 |
8489854 | Colon et al. | Jul 2013 | B1 |
8503237 | Horn | Aug 2013 | B1 |
8521972 | Boyle et al. | Aug 2013 | B1 |
8549236 | Diggs et al. | Oct 2013 | B2 |
8583835 | Kan | Nov 2013 | B1 |
8601311 | Horn | Dec 2013 | B2 |
8601313 | Horn | Dec 2013 | B1 |
8612669 | Syu et al. | Dec 2013 | B1 |
8612804 | Kang et al. | Dec 2013 | B1 |
8615681 | Horn | Dec 2013 | B2 |
8638602 | Horn | Jan 2014 | B1 |
8639872 | Boyle et al. | Jan 2014 | B1 |
8683113 | Abasto et al. | Mar 2014 | B2 |
8700834 | Horn et al. | Apr 2014 | B2 |
8700950 | Syu | Apr 2014 | B1 |
8700951 | Call et al. | Apr 2014 | B1 |
8706985 | Boyle et al. | Apr 2014 | B1 |
8707104 | Jean | Apr 2014 | B1 |
8713066 | Lo et al. | Apr 2014 | B1 |
8713357 | Jean et al. | Apr 2014 | B1 |
8719531 | Strange et al. | May 2014 | B2 |
8724422 | Agness et al. | May 2014 | B1 |
8725931 | Kang | May 2014 | B1 |
8745277 | Kan | Jun 2014 | B2 |
8751728 | Syu et al. | Jun 2014 | B1 |
8769190 | Syu et al. | Jul 2014 | B1 |
8769232 | Suryabudi et al. | Jul 2014 | B2 |
8775720 | Meyer et al. | Jul 2014 | B1 |
8782327 | Kang et al. | Jul 2014 | B1 |
8788778 | Boyle | Jul 2014 | B1 |
8788779 | Horn | Jul 2014 | B1 |
8788880 | Gosla et al. | Jul 2014 | B1 |
8793429 | Call et al. | Jul 2014 | B1 |
20020116457 | Eshleman et al. | Aug 2002 | A1 |
20020178328 | Honda et al. | Nov 2002 | A1 |
20040225831 | Pail | Nov 2004 | A1 |
20060143238 | Tamatsu | Jun 2006 | A1 |
20070204128 | Lee | Aug 2007 | A1 |
20080071785 | Kabra | Mar 2008 | A1 |
20080140918 | Sutardja | Jun 2008 | A1 |
20090138654 | Sutardja | May 2009 | A1 |
20090288101 | Gandin | Nov 2009 | A1 |
20100174849 | Walston et al. | Jul 2010 | A1 |
20100250793 | Syu | Sep 2010 | A1 |
20110099323 | Syu | Apr 2011 | A1 |
20110283049 | Kang et al. | Nov 2011 | A1 |
20110296440 | Laurich et al. | Dec 2011 | A1 |
20120179869 | Flynn | Jul 2012 | A1 |
20120221534 | Gao et al. | Aug 2012 | A1 |
20120260020 | Suryabudi et al. | Oct 2012 | A1 |
20120278531 | Horn | Nov 2012 | A1 |
20120284460 | Guda | Nov 2012 | A1 |
20120324191 | Strange et al. | Dec 2012 | A1 |
20130132638 | Horn et al. | May 2013 | A1 |
20130145106 | Kan | Jun 2013 | A1 |
20130290793 | Booth et al. | Oct 2013 | A1 |
20140059405 | Syu et al. | Feb 2014 | A1 |
20140101369 | Tomlin et al. | Apr 2014 | A1 |
20140115427 | Lu | Apr 2014 | A1 |
20140133220 | Danilak et al. | May 2014 | A1 |
20140136753 | Tomlin et al. | May 2014 | A1 |
20140149826 | Lu et al. | May 2014 | A1 |
20140157078 | Danilak et al. | Jun 2014 | A1 |
20140181432 | Horn | Jun 2014 | A1 |
20140215129 | Kuzmin | Jul 2014 | A1 |
20140223255 | Lu et al. | Aug 2014 | A1 |
Entry |
---|
International Search Report and Written Opinion dated Jan. 27, 2015 from related PCT Serial No. PCT/US2014/062066, 9 pages. |
Sungchan Kim, et al., “Fast, Energy Efficient Scan inside Flash Memory SSDs,” The Second International Workshop on Accelerating Data Management Systems using Modern Processor and Storage Architecture (ADMS' 11), 2011, pp. 1-8. |
Number | Date | Country | |
---|---|---|---|
20150120770 A1 | Apr 2015 | US |
Number | Date | Country | |
---|---|---|---|
61895263 | Oct 2013 | US |