Data storage assembly for archive cold storage

Information

  • Patent Grant
  • 9135205
  • Patent Number
    9,135,205
  • Date Filed
    Thursday, January 29, 2015
    10 years ago
  • Date Issued
    Tuesday, September 15, 2015
    9 years ago
Abstract
A data storage assembly for cold storage. The data storage assembly includes a circuit board and a plurality of hard disk assemblies (HDA). Each HDA includes a platter and a head assembly to read and write data on the platter. The circuit board includes a processor and a read channel. The processor acts as a hard disk controller for the plurality of HDAs and controls the platters. The processor further manages which HDAs are active at a time and the read channel is shared by the plurality of HDAs.
Description
BACKGROUND

Data centers can provide cloud storage systems to remotely store data for networked systems. However, such cloud storage systems can consume large amounts of power at the data center to store and manage data in an array of data storage devices (DSDs).


“Cold storage” or archive storage generally refers to ways of providing more cost effective storage for rarely accessed data. The cost of storage is usually the most important metric, sacrificing time to data. Such cold storage can include powering only the DSD required for an active request for data. For example, the Open Compute specification calls for an Open Vault tray of 15 DSDs. Only one DSD in the tray is powered at a time, to reduce power, heat, and vibration. However, because only one DSD is powered at a time, the other inactive DSDs may include components which are not simultaneously needed or utilized, and may therefore be redundant while consuming excess power.





BRIEF DESCRIPTIONS OF THE DRAWINGS

The features and advantages of the implementations of the present disclosure will become more apparent from the detailed description set forth below when taken in conjunction with the drawings. The drawings and the associated descriptions are provided to illustrate implementations of the disclosure and not to limit the scope of what is claimed.



FIG. 1A presents a data storage rack according to an implementation of the present disclosure;



FIG. 1B presents a data storage tray according to an implementation of the present disclosure;



FIG. 1C presents a box diagram of a data storage tray according to an implementation of the present disclosure;



FIG. 2A presents a hard disk assembly (HDA) according to an implementation of the present disclosure;



FIG. 2B presents a conceptual diagram of an HDA according to an implementation of the present disclosure;



FIG. 2C presents an HDA connecting to a main board according to an implementation of the present disclosure;



FIG. 3 presents a single board implementation according to an implementation of the present disclosure;



FIG. 4A presents a top view of a single board implementation according to an implementation of the present disclosure;



FIG. 4B presents a main circuit board according to an implementation of the present disclosure;



FIG. 4C presents a main circuit board according to another implementation of the present disclosure;



FIG. 5A presents a block diagram of a data storage tray according to an implementation of the present disclosure;



FIG. 5B presents a diagram of a data storage tray with a bridge card according to an implementation of the present disclosure;



FIG. 6 presents a diagram of a board configured for distributed computing according to an implementation of the present disclosure; and



FIG. 7 presents a diagram of a board configured for distributed computing and a direct input according to an implementation of the present disclosure.





DETAILED DESCRIPTION

In the following detailed description, numerous specific details are set forth to provide a full understanding of the present disclosure. It will be apparent, however, to one of ordinary skill in the art that the various implementations disclosed may be practiced without some of these specific details. In other instances, well-known structures and techniques have not been shown in detail to avoid unnecessarily obscuring the various implementations.


While the description herein refers generally to a NAND flash memory, it is understood that other implementations can include one or more of various types of solid state memory such as Chalcogenide RAM (C-RAM), Phase Change Memory (PC-RAM or PRAM), Programmable Metallization Cell RAM (PMC-RAM or PMCm), Ovonic Unified Memory (OUM), Resistance RAM (RRAM), NAND memory (e.g., single-level cell (SLC) memory, multi-level cell (MLC) memory, or any combination thereof), NOR memory, EEPROM, Ferroelectric Memory (FeRAM), Magnetoresistive RAM (MRAM), spin-transfer torque RAM (STT-RAM), other discrete non-volatile memory (NVM) chips, or any combination thereof.



FIG. 1A presents a server rack 100, which may be used for cold storage. The server rack 100 includes a plurality of trays 150 for storing DSDs. FIG. 1B presents a tray 150. The tray 150 includes a plurality of DSDs 160, a drive-plane board 170, a Serially Attached SCSI (SAS) expander board 180, and an expander board 190. The tray 150 may follow the Open Compute specification for an Open Vault tray of 15 DSDs. Although the present disclosure discusses the Open Compute specifications, implementations of the present disclosure are not limited to the Open Compute specification and may be adapted to work with other specifications or applications.


The DSDs 160 may be a conventional drive, such as a hard disk drive (HDD), solid state drive (SSD), solid state hybrid drive (SSHD), or other DSD known in the art. The DSDs 160 are each connected to the drive-plane board 170, which may provide more mechanically reliable connections than cables. The drive-plane board 170 allows for connections to each individual DSD 160. For example, the SAS expander board 180 may be a plug-in card that connects to each DSD 160 through the drive-plane board 170. Because SAS is typically a point-to-point connection (i.e. a direct connection between a host system and a device), the SAS expander board 180 manages multiple direct or point-to-point connections to each DSD 160. Power flows through the drive-plane board 170. The expander board 190 may manage a fan (not shown) and power connections.



FIG. 1C presents a conceptual diagram of the tray 150. The expander board 190 includes a memory 140, a System-on-Chip (SoC) 130, a network interface 135, a plurality of SATA multipliers 110, and a drive plane board interface 120. The SoC 130 may include a processor as well as other components integrated into a single chip. The expander board 190 works in conjunction with a fan card 192 and a backplane card 194. Interfacing with 16 DSDs 160 is performed with at least 4 SATA multipliers 110, which can consume power, create heat, and increase manufacturing costs.



FIG. 2A illustrates a view of a hard disk assembly (HDA) 200 according to an implementation of the present disclosure. The HDA 200 includes a main device 201, a feed through connector 202 and a helium charge port 203. The HDA 200 may be a conventional drive, such as a hard disk drive (HDD), solid state drive (SSD), solid state hybrid drive (SSHD), or other DSD known in the art. In addition, the HDA 200 may be a modified DSD, as will be discussed below.



FIG. 2B presents a conceptual block diagram of the HDA 200. The HDA 200 includes a printed circuit board assembly (PCBA) or bridge board (or bridge card) 210, a platter 220, a head assembly 230, and a preamp 235 to reduce a Signal-to-Noise Ratio (SNR) for data read from platter 220. The HDA 200 may include an increased or decreased number of platters 220 than conventionally used. The bridge board 210 includes a preamp 211, a motor controller 212, a bridge 213, a first circuitry 214, and a second circuitry 215. The preamp 211 may further reduce a SNR for data read from platter 220. The first circuitry 214 and/or the second circuitry 215 may be a sensor, a power large-scale integrated circuit (PLSI), an emergency power off retract (EPOR), or other component. In alternative implementations, the bridge board 210 may include more or less of the above components, in that the components are optional.


The HDA 200 is a simplified disk drive without certain circuitry. Circuitry for functions such as a primary read channel, controller, host interface, and memory are moved to a shared circuit board, such as a shared bridge board 210 or a shared motherboard/main board (MB) 250 in FIG. 2C, to reduce redundant components. Because only one drive is powered on at a time, one instance of circuitry functions such as primary read channel, controller, host interface, and memory can be shared by the drives to reduce components, cost, heat, and power consumption.



FIG. 2C depicts one implementation of mounting the HDA 200 to the MB 250. The bridge board 210 further includes an HDA connector 240 and MB connector space 245. The MB 250 includes a MB connector 255.


The HDA 200 connects to the HDA connector 240 through, for example, the feed through connector 202. The HDA connector 240 and the feed through connector 202 may be interchanged or modified to match DSD design and assembly processes. The MB connector 255 connects to the MB connector space 245. The MB connector 255 and the MB connector space 245 may be similar to the HDA connector 240 and the feed through connector 202. Alternatively, the MB connector 255 and the MB connector space 245 may be an alternate or unique configuration to facilitate the preferred orientation and removability of the HDA 200. The bridge board 210 may be on a parallel plane as the MB 250 and the HDA 200. Alternatively, the bridge board 210 may be placed perpendicular to the MB 250, as an edge card.



FIG. 3 presents a conceptual diagram of a single board implementation, an MB 300. Rack connectors 340 provide host and power connections to the MB 300, specifically connecting a host to the SoC subsystem 310 and a 12V power connection to a power converter 350. Although FIG. 3 depicts a 12V power supply, in other implementations other appropriate power connections and voltages may be utilized.


The SoC subsystem 310 includes a clock 319, a flash memory 317, an SoC 311, a random-access memory (RAM) 313, and a regulator 315. The SoC 311 may include a processor as well as other circuitry integrated onto a single chip. The SoC subsystem 310 and/or the SoC 311 may serve as a controller and may perform other functions, such as error recovery for reading and writing data. The SoC subsystem 310 further interfaces with a multiplexer (mux) subsystem 320. The mux subsystem 320 includes a preamp mux 322 and a mux controller 324. The mux subsystem 320 connects to a bank 330, which includes a plurality of sensors 334. The sensors 334 may be PLSI sensors mounted in the same location as a production HDA circuit board, to ensure that accurate shock and vibration information is captured and communicated to the SoC subsystem 310. The mux subsystem 320 also controls a fan and cabinet services 360, which can include lights, fan control, and temperature reporting.


The MB 300 includes the plurality of sensors 334 to ensure better reliability by having a sensor 334 for each attached HDA (not shown in FIG. 3). In other implementations, the bank 330 may include more or less sensors 334. The mux subsystem 320 allows the plurality of sensors 334 to communicate with the SoC subsystem 310.


Because the HDAs are configured without their own individual hard disk controllers (HDC), the SoC subsystem 310 acts as the HDC, connected through the mux subsystem 320. The SoC subsystem 310 replaces redundant HDCs from the HDAs. The SoC subsystem 310 further controls which HDAs are activated or powered up. For example, the SoC subsystem 310 may power up only one HDA. In alternative implementations, the SoC subsystem 310 may power up more than one HDA, for example to actively read/write data from one HDA while another HDA finishes a background task before powering down. The use of the SoC subsystem 310 reduces the amount of components on the MB 300, which further reduces manufacturing costs as well as reduces heat and power consumption.



FIG. 4A shows a data storage tray 400. FIG. 4A depicts a top view of an MB 410, which is placed over a plurality of HDAs 450. Slots 412 in the MB 410 allow clearance for rails of the HDAs 450. An extended tab 420 allows for power and data connection ports. The extended tab 420 is about half the width of the MB 410, which allows panelization, which during manufacturing allows multiple copies of the MB 410 to be cut out of a single board. For example, if the main board 410 is rotated 180 degrees, it can be placed along another MB 410, with the extended tabs 420 fitting together before the individual MBs 410 being cut. In other implementations the width of the extended tab 420 may be more or less than the width of the MB 410. A motor driver 451 and a sensor 452 are located under the main board 410, at a location corresponding to the location for a motor driver and a sensor on a standalone DSD. An SoC subsystem, such as the SoC subsystem 310 in FIG. 3, and a mux subsystem, such as the mux subsystem 320, may be centrally located on the main board 410 (not visible in FIG. 4A), but in other implementations may be located elsewhere as needed. For example, the SoC and mux subsystems may be located closer to an edge for easier mounting of HDAs 450 or for shorter connections.



FIG. 4B shows another view of the data storage tray 400. The main board 410 and the plurality of HDAs 450 are mounted onto a tray 402. In this view, a connector 422 and a power connector 424 are visible. The connector 422 may be a mini SAS connector, although in other implementations, the connector 422 may be a connector for another suitable protocol. The power connector 424 may be a 12V power connection, although in other implementations, other suitable power connectors may be used.


Mounting the HDAs 450 directly to the MB 410, as in FIG. 4B, allows the use of existing HDA to board connectors and signal impedance matching techniques, which provides a simple, low cost implementation.



FIG. 4C depicts an alternate data storage tray 401. The data storage tray 401 differs from the data storage tray 400 in FIG. 4B in that the MB 410 includes a second extended tab 426. The second extended tab 426 is less than half the width of the main board 410, and is also less than the width of the extended tab 420, although in other implementations the width of the second extended tab 426 may vary as needed. The second extended tab 426 includes an interface 404. The interface 404 may be used for lights, such as status indicators or other light emitting diodes (LED), additional display, or another connection, such as a data connection.



FIG. 5A shows a conceptual diagram of a data storage tray 500. The data storage tray 500 includes a MB 550 including a SoC subsystem 530, a power converter 540, a fan controller 545, and a mux subsystem 520. The SoC subsystem 530 may include a processor as well as other circuitry incorporated into a single chip. The data storage tray 500 further includes a plurality of HDAs 501, each of which includes a bridge board 510. Unlike in FIGS. 4A-C, the HDAs 501 are not directly mounted or attached to the MB 550, but use bridge boards 510. The use of the bridge boards 510 allows easier hot plug and replacement. The HDA 501 can be removed while leaving the bridge board 510 connected to the main board 550, because the connectors, such as the HDA connector 240, facilitate removal of the HDA 501. Alternatively, the bridge board 510 may be removed along with the HDA 501 such that another HDA 501, which may or may not have a respective bridge board 510, may be connected to the MB 550. The use of the bridge boards 510 allows further flexibility in the types of connections and connectors compatible with the MB 550.



FIG. 5B depicts a simplified diagram of the data storage tray 500. The MB 550 includes regulators 552, a power input 542, a RAM 532, the SoC subsystem 530, a data connection 554, and a fan out bridge 556. The data connection 554 may be an SAS interface for connecting to a compute node, but in alternative implementations other suitable protocols may be used. Motor controllers, such as the motor controller 212, on the bridge board 510 allows the HDAs 501 to be hot swapped with emergency power off retract ability, which safely prevents heads, such as the head assembly 230, from contacting and damaging the disks, such as the platter 220.



FIGS. 6 and 7 depict implementations configured for distributed computing. FIG. 6 shows a diagram of a data storage tray 600, which includes rack connectors 640, a compute node 645, a power converter 650, a fan and cabinet services 660, an SoC subsystem 610, a mux subsystem 620, and an HDA bank 630. The SoC subsystem 610 includes a clock 619, regulators 615, a RAM 613, a flash memory 617, and an SoC 611. The SoC 611 may include a processor as well as other circuitry integrated into a single chip. The mux subsystem 620 includes a preamp mux 622 and a mux controller 624. The HDA bank 630 includes a plurality of HDAs 632, and a respective plurality of sensors 634. The rack connectors 640 include a power connection and an external data connection (or network connection), which connects to the compute node 645. The compute node 645 may be a processor for use in a distributed computing system, and may be aware of other compute nodes to share data object manipulation and perform distributed computing tasks, such as running a SQL database. Although Ethernet is a common network interface, other suitable protocols may be used for the external data/network connection. Likewise, the host interface may be SAS, although PCIe or other protocols may be used.



FIG. 7 presents a diagram of another implementation configured for distributed computing. A data storage tray 700 includes an HDA bank 730, and an MB 701 which further includes a power converter 750, a fan and cabinet services 760, an SoC subsystem 710, and a mux subsystem 720. The SoC subsystem 710 includes a clock 719, a flash memory 717, an SoC 711, a RAM 713, and regulators 715. The SoC 711 may include a processor as well as other circuitry integrated into a single chip. The mux subsystem 720 includes a preamp mux 722 and a mux controller 724. The HDA bank 730 includes a plurality of HDAs 732, with a corresponding plurality of sensors 734.


Unlike the data storage tray 600, the data storage tray 700 lacks a compute node and rack connectors. An external data connection or network connection 740, such as Ethernet or other suitable protocol, allows direct connection to the SoC subsystem 710 for a distributed computing system to share data object manipulation and distributed computing tasks with at least one external processor.


Those of ordinary skill in the art will appreciate that the various illustrative logical blocks, modules, and processes described in connection with the examples disclosed herein may be implemented as electronic hardware, computer software, or combinations of both. Furthermore, the foregoing processes can be embodied on a computer readable medium which causes a processor or computer to perform or execute certain functions.


To clearly illustrate this interchangeability of hardware and software, various illustrative components, blocks, and modules have been described above generally in terms of their functionality. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the overall system. Those of ordinary skill in the art may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present disclosure.


The various illustrative logical blocks, units, modules, and controllers described in connection with the examples disclosed herein may be implemented or performed with a general purpose processor, a digital signal processor (DSP), an application specific integrated circuit (ASIC), a field programmable gate array (FPGA) or other programmable logic device, discrete gate or transistor logic, discrete hardware components, or any combination thereof designed to perform the functions described herein. A general purpose processor may be a microprocessor, but in the alternative, the processor may be any conventional processor, controller, microcontroller, or state machine. A processor may also be implemented as a combination of computing devices, e.g., a combination of a DSP and a microprocessor, a plurality of microprocessors, one or more microprocessors in conjunction with a DSP core, or any other such configuration.


The activities of a method or process described in connection with the examples disclosed herein may be embodied directly in hardware, in a software module executed by a processor, or in a combination of the two. The steps of the method or algorithm may also be performed in an alternate order from those provided in the examples. A software module may reside in RAM memory, flash memory, ROM memory, EPROM memory, EEPROM memory, registers, hard disk, a removable media, an optical media, or any other form of storage medium known in the art. An exemplary storage medium is coupled to the processor such that the processor can read information from, and write information to, the storage medium. In the alternative, the storage medium may be integral to the processor. The processor and the storage medium may reside in an Application Specific Integrated Circuit (ASIC).


The foregoing description of the disclosed example implementations is provided to enable any person of ordinary skill in the art to make or use the implementations in the present disclosure. Various modifications to these examples will be readily apparent to those of ordinary skill in the art, and the principles disclosed herein may be applied to other examples without departing from the spirit or scope of the present disclosure. The described implementations are to be considered in all respects only as illustrative and not restrictive and the scope of the disclosure is, therefore, indicated by the following claims rather than by the foregoing description. All changes which come within the meaning and range of equivalency of the claims are to be embraced within their scope.

Claims
  • 1. A data storage assembly comprising: a circuit board comprising: a processor; anda read channel; anda plurality of hard disk assemblies (HDAs), each HDA comprising: a platter configured to store data; anda head assembly configured to read data from and write data to the platter;wherein the processor is configured to be a hard disk controller (HDC) for the plurality of HDAs and manage which of the plurality of HDAs are active at a time, and the plurality of HDAs are configured to share a read channel among the plurality of HDAs.
  • 2. The data storage assembly of claim 1, wherein the processor is further configured to determine which one of the plurality of HDAs to utilize for a data command.
  • 3. The data storage assembly of claim 1, wherein the processor is further configured to perform error recovery for reading and writing to the plurality of HDAs.
  • 4. The data storage assembly of claim 1, further comprising a motor controller configured to spin the platters of the plurality of HDAs and move the head assemblies of the plurality of HDAs across the respective platters of the plurality of HDAs.
  • 5. The data storage assembly of claim 1, further comprising a multiplexer configured to communicate with each of the plurality of HDAs.
  • 6. The data storage assembly of claim 1, further comprising a plurality of sensors configured to detect environmental information of the plurality of HDAs.
  • 7. The data storage assembly of claim 1, wherein the processor is further configured to manage power to the plurality of HDAs.
  • 8. The data storage assembly of claim 1, further comprising a network connection.
  • 9. A hard disk assembly (HDA) comprising: a platter configured to store data;a head assembly configured to read data from and write data to the platter;a motor controller configured to move the head assembly across the platter; anda circuit board configured to communicate between the HDA and a read channel external to the HDA and shared among a plurality of HDAs.
  • 10. The HDA of claim 9, wherein the circuit board is further configured to communicate between the HDA and a memory external to the HDA and shared among a plurality of HDAs.
  • 11. The HDA of claim 9, wherein the circuit board further includes a preamp configured to reduce a Signal-to-Noise Ratio (SNR) for data read from the platter.
  • 12. The HDA of claim 9, wherein the circuit board further includes a power large-scale integrated circuit (PLSI) configured to allow hotplugging the HDA.
  • 13. The HDA of claim 9, wherein the circuit board further includes an emergency power off retract (EPOR) configured to safely power off the HDA.
  • 14. The HDA of claim 9, wherein the HDA is further configured to communicate with a network via a network connection external to the HDA that is shared among the plurality of HDAs.
  • 15. A non-transitory computer readable medium storing computer executable instructions for controlling a plurality of hard disk assemblies (HDAs), wherein when the computer executable instructions are executed by circuitry, the computer executable instructions cause the circuitry to: manage which of the plurality of HDAs are active at a time; andact as a hard disk controller (HDC) for the plurality of HDAs so that the plurality of HDAs share a read channel among the plurality of HDAs.
  • 16. The non-transitory computer readable medium of claim 15, wherein the computer executable instructions further cause the circuitry to determine which one of the plurality of HDAs to utilize for a data command.
  • 17. The non-transitory computer readable medium of claim 15, wherein the computer executable instructions further cause the circuitry to perform error recovery for reading data from and writing data to the plurality of HDAs.
  • 18. The non-transitory computer readable medium of claim 15, wherein the computer executable instructions further cause the circuitry to act as an HDC for the plurality of HDAs so that the plurality of HDAs share a memory among the plurality of HDAs.
  • 19. The non-transitory computer readable medium of claim 15, wherein the computer executable instructions further cause the circuitry to interface with a multiplexer to receive environmental information from a plurality of sensors for the plurality of HDAs, with each of the plurality of sensors detecting environmental information for one of the plurality of HDAs.
  • 20. The non-transitory computer readable medium of claim 15, wherein the computer executable instructions further cause the circuitry to manage power to the plurality of HDAs.
  • 21. The non-transitory computer readable medium of claim 15, wherein the computer executable instructions further cause the circuitry to interface with a network connection.
CROSS-REFERENCE TO RELATED APPLICATIONS

This application is a continuation of U.S. application Ser. No. 14/023,386, filed Sep. 10, 2013, which claims the benefit of U.S. Provisional Application No. 61/818,287, filed May 1, 2013, both of which are hereby incorporated by reference in their entirety.

US Referenced Citations (456)
Number Name Date Kind
4851939 Seo et al. Jul 1989 A
5084789 Kamo et al. Jan 1992 A
5544135 Akin et al. Aug 1996 A
5572699 Kamo et al. Nov 1996 A
5696933 Itoh et al. Dec 1997 A
5710675 Goldstone et al. Jan 1998 A
5832204 Apperley et al. Nov 1998 A
6018789 Sokolov et al. Jan 2000 A
6065095 Sokolov et al. May 2000 A
6078452 Kittilson et al. Jun 2000 A
6081447 Lofgren et al. Jun 2000 A
6092149 Hicken et al. Jul 2000 A
6092150 Sokolov et al. Jul 2000 A
6094707 Sokolov et al. Jul 2000 A
6105104 Guttmann et al. Aug 2000 A
6111717 Cloke et al. Aug 2000 A
6145052 Howe et al. Nov 2000 A
6175893 D'Souza et al. Jan 2001 B1
6178056 Cloke et al. Jan 2001 B1
6191909 Cloke et al. Feb 2001 B1
6195218 Guttmann et al. Feb 2001 B1
6205494 Williams Mar 2001 B1
6208477 Cloke et al. Mar 2001 B1
6223303 Billings et al. Apr 2001 B1
6230233 Lofgren et al. May 2001 B1
6246346 Cloke et al. Jun 2001 B1
6249393 Billings et al. Jun 2001 B1
6256695 Williams Jul 2001 B1
6262857 Hull et al. Jul 2001 B1
6263459 Schibilla Jul 2001 B1
6272694 Weaver et al. Aug 2001 B1
6278568 Cloke et al. Aug 2001 B1
6279089 Schibilla et al. Aug 2001 B1
6289484 Rothberg et al. Sep 2001 B1
6292912 Cloke et al. Sep 2001 B1
6310740 Dunbar et al. Oct 2001 B1
6317850 Rothberg Nov 2001 B1
6327106 Rothberg Dec 2001 B1
6337778 Gagne Jan 2002 B1
6369969 Christiansen et al. Apr 2002 B1
6384999 Schibilla May 2002 B1
6388833 Golowka et al. May 2002 B1
6405342 Lee Jun 2002 B1
6408357 Hanmann et al. Jun 2002 B1
6408406 Parris Jun 2002 B1
6411452 Cloke Jun 2002 B1
6411458 Billings et al. Jun 2002 B1
6412083 Rothberg et al. Jun 2002 B1
6415349 Hull et al. Jul 2002 B1
6425128 Krapf et al. Jul 2002 B1
6441981 Cloke et al. Aug 2002 B1
6442328 Elliott et al. Aug 2002 B1
6445524 Nazarian et al. Sep 2002 B1
6449767 Krapf et al. Sep 2002 B1
6453115 Boyle Sep 2002 B1
6470420 Hospodor Oct 2002 B1
6480020 Jung et al. Nov 2002 B1
6480349 Kim et al. Nov 2002 B1
6480932 Vallis et al. Nov 2002 B1
6483986 Krapf Nov 2002 B1
6487032 Cloke et al. Nov 2002 B1
6490635 Holmes Dec 2002 B1
6493173 Kim et al. Dec 2002 B1
6499083 Hamlin Dec 2002 B1
6519104 Cloke et al. Feb 2003 B1
6525892 Dunbar et al. Feb 2003 B1
6545830 Briggs et al. Apr 2003 B1
6546489 Frank, Jr. et al. Apr 2003 B1
6550021 Dalphy et al. Apr 2003 B1
6552880 Dunbar et al. Apr 2003 B1
6553457 Wilkins et al. Apr 2003 B1
6578106 Price Jun 2003 B1
6580573 Hull et al. Jun 2003 B1
6594183 Lofgren et al. Jul 2003 B1
6600620 Krounbi et al. Jul 2003 B1
6601137 Castro et al. Jul 2003 B1
6603622 Christiansen et al. Aug 2003 B1
6603625 Hospodor et al. Aug 2003 B1
6604220 Lee Aug 2003 B1
6606682 Dang et al. Aug 2003 B1
6606714 Thelin Aug 2003 B1
6606717 Yu et al. Aug 2003 B1
6611393 Nguyen et al. Aug 2003 B1
6615312 Hamlin et al. Sep 2003 B1
6639748 Christiansen et al. Oct 2003 B1
6647481 Luu et al. Nov 2003 B1
6654193 Thelin Nov 2003 B1
6657810 Kupferman Dec 2003 B1
6661591 Rothberg Dec 2003 B1
6665772 Hamlin Dec 2003 B1
6687073 Kupferman Feb 2004 B1
6687078 Kim Feb 2004 B1
6687850 Rothberg Feb 2004 B1
6690523 Nguyen et al. Feb 2004 B1
6690882 Hanmann et al. Feb 2004 B1
6691198 Hamlin Feb 2004 B1
6691213 Luu et al. Feb 2004 B1
6691255 Rothberg et al. Feb 2004 B1
6693760 Krounbi et al. Feb 2004 B1
6694477 Lee Feb 2004 B1
6697914 Hospodor et al. Feb 2004 B1
6704153 Rothberg et al. Mar 2004 B1
6708251 Boyle et al. Mar 2004 B1
6710951 Cloke Mar 2004 B1
6711628 Thelin Mar 2004 B1
6711635 Wang Mar 2004 B1
6711660 Milne et al. Mar 2004 B1
6715044 Lofgren et al. Mar 2004 B2
6724982 Hamlin Apr 2004 B1
6725329 Ng et al. Apr 2004 B1
6735650 Rothberg May 2004 B1
6735693 Hamlin May 2004 B1
6744772 Eneboe et al. Jun 2004 B1
6745283 Dang Jun 2004 B1
6751402 Elliott et al. Jun 2004 B1
6757481 Nazarian et al. Jun 2004 B1
6772281 Hamlin Aug 2004 B2
6781826 Goldstone et al. Aug 2004 B1
6782449 Codilian et al. Aug 2004 B1
6791779 Singh et al. Sep 2004 B1
6792486 Hanan et al. Sep 2004 B1
6799274 Hamlin Sep 2004 B1
6809895 Choi Oct 2004 B1
6811427 Garrett et al. Nov 2004 B2
6826003 Subrahmanyam Nov 2004 B1
6826614 Hanmann et al. Nov 2004 B1
6832041 Boyle Dec 2004 B1
6832929 Garrett et al. Dec 2004 B2
6845405 Thelin Jan 2005 B1
6845427 Atai-Azimi Jan 2005 B1
6850443 Lofgren et al. Feb 2005 B2
6851055 Boyle et al. Feb 2005 B1
6851063 Boyle et al. Feb 2005 B1
6853731 Boyle et al. Feb 2005 B1
6854022 Thelin Feb 2005 B1
6862660 Wilkins et al. Mar 2005 B1
6880043 Castro et al. Apr 2005 B1
6882486 Kupferman Apr 2005 B1
6884085 Goldstone Apr 2005 B1
6888831 Hospodor et al. May 2005 B1
6892217 Hanmann et al. May 2005 B1
6892249 Codilian et al. May 2005 B1
6892313 Codilian et al. May 2005 B1
6895455 Rothberg May 2005 B1
6895500 Rothberg May 2005 B1
6898730 Hanan May 2005 B1
6910099 Wang et al. Jun 2005 B1
6910101 Obara et al. Jun 2005 B2
6928470 Hamlin Aug 2005 B1
6931439 Hanmann et al. Aug 2005 B1
6934104 Kupferman Aug 2005 B1
6934713 Schwartz et al. Aug 2005 B2
6940873 Boyle et al. Sep 2005 B2
6943978 Lee Sep 2005 B1
6948165 Luu et al. Sep 2005 B1
6950267 Liu et al. Sep 2005 B1
6954733 Ellis et al. Oct 2005 B1
6961814 Thelin et al. Nov 2005 B1
6965489 Lee et al. Nov 2005 B1
6965563 Hospodor et al. Nov 2005 B1
6965966 Rothberg et al. Nov 2005 B1
6967799 Lee Nov 2005 B1
6968422 Codilian et al. Nov 2005 B1
6968450 Rothberg et al. Nov 2005 B1
6973495 Milne et al. Dec 2005 B1
6973570 Hamlin Dec 2005 B1
6976190 Goldstone Dec 2005 B1
6983316 Milne et al. Jan 2006 B1
6986007 Procyk et al. Jan 2006 B1
6986154 Price et al. Jan 2006 B1
6995933 Codilian et al. Feb 2006 B1
6996501 Rothberg Feb 2006 B1
6996669 Dang et al. Feb 2006 B1
7002926 Eneboe et al. Feb 2006 B1
7003674 Hamlin Feb 2006 B1
7006316 Sargenti, Jr. et al. Feb 2006 B1
7009820 Hogg Mar 2006 B1
7023639 Kupferman Apr 2006 B1
7024491 Hanmann et al. Apr 2006 B1
7024549 Luu et al. Apr 2006 B1
7024614 Thelin et al. Apr 2006 B1
7027716 Boyle et al. Apr 2006 B1
7028174 Atai-Azimi et al. Apr 2006 B1
7031902 Catiller Apr 2006 B1
7046465 Kupferman May 2006 B1
7046488 Hogg May 2006 B1
7050252 Vallis May 2006 B1
7054937 Milne et al. May 2006 B1
7055000 Severtson May 2006 B1
7055167 Masters May 2006 B1
7057836 Kupferman Jun 2006 B1
7062398 Rothberg Jun 2006 B1
7075746 Kupferman Jul 2006 B1
7076604 Thelin Jul 2006 B1
7082494 Thelin et al. Jul 2006 B1
7088538 Codilian et al. Aug 2006 B1
7088545 Singh et al. Aug 2006 B1
7092186 Hogg Aug 2006 B1
7095577 Codilian et al. Aug 2006 B1
7099095 Subrahmanyam et al. Aug 2006 B1
7106537 Bennett Sep 2006 B1
7106947 Boyle et al. Sep 2006 B2
7110202 Vasquez Sep 2006 B1
7111116 Boyle et al. Sep 2006 B1
7114029 Thelin Sep 2006 B1
7120737 Thelin Oct 2006 B1
7120806 Codilian et al. Oct 2006 B1
7126776 Warren, Jr. et al. Oct 2006 B1
7129763 Bennett et al. Oct 2006 B1
7133600 Boyle Nov 2006 B1
7136244 Rothberg Nov 2006 B1
7146094 Boyle Dec 2006 B1
7149046 Coker et al. Dec 2006 B1
7150036 Milne et al. Dec 2006 B1
7155616 Hamlin Dec 2006 B1
7171108 Masters et al. Jan 2007 B1
7171110 Wilshire Jan 2007 B1
7194576 Boyle Mar 2007 B1
7200698 Rothberg Apr 2007 B1
7205805 Bennett Apr 2007 B1
7206497 Boyle et al. Apr 2007 B1
7215496 Kupferman et al. May 2007 B1
7215771 Hamlin May 2007 B1
7237054 Cain et al. Jun 2007 B1
7240161 Boyle Jul 2007 B1
7249365 Price et al. Jul 2007 B1
7263709 Krapf Aug 2007 B1
7274639 Codilian et al. Sep 2007 B1
7274659 Hospodor Sep 2007 B2
7275116 Hanmann et al. Sep 2007 B1
7280302 Masiewicz Oct 2007 B1
7292774 Masters et al. Nov 2007 B1
7292775 Boyle et al. Nov 2007 B1
7296284 Price et al. Nov 2007 B1
7302501 Cain et al. Nov 2007 B1
7302579 Cain et al. Nov 2007 B1
7318088 Mann Jan 2008 B1
7319806 Willner et al. Jan 2008 B1
7325244 Boyle et al. Jan 2008 B2
7330323 Singh et al. Feb 2008 B1
7346790 Klein Mar 2008 B1
7366641 Masiewicz et al. Apr 2008 B1
7369340 Dang et al. May 2008 B1
7369343 Yeo et al. May 2008 B1
7372650 Kupferman May 2008 B1
7380147 Sun May 2008 B1
7392340 Dang et al. Jun 2008 B1
7404013 Masiewicz Jul 2008 B1
7406545 Rothberg et al. Jul 2008 B1
7415571 Hanan Aug 2008 B1
7436610 Thelin Oct 2008 B1
7437502 Coker Oct 2008 B1
7440214 Ell et al. Oct 2008 B1
7451344 Rothberg Nov 2008 B1
7471483 Ferris et al. Dec 2008 B1
7471486 Coker et al. Dec 2008 B1
7486060 Bennett Feb 2009 B1
7496493 Stevens Feb 2009 B1
7518819 Yu et al. Apr 2009 B1
7526184 Parkinen et al. Apr 2009 B1
7539924 Vasquez et al. May 2009 B1
7543117 Hanan Jun 2009 B1
7551383 Kupferman Jun 2009 B1
7562282 Rothberg Jul 2009 B1
7577973 Kapner, III et al. Aug 2009 B1
7596797 Kapner, III et al. Sep 2009 B1
7599139 Bombet et al. Oct 2009 B1
7619841 Kupferman Nov 2009 B1
7647544 Masiewicz Jan 2010 B1
7649704 Bombet et al. Jan 2010 B1
7653927 Kapner, III et al. Jan 2010 B1
7656603 Xing Feb 2010 B1
7656763 Jin et al. Feb 2010 B1
7657149 Boyle Feb 2010 B2
7672072 Boyle et al. Mar 2010 B1
7673075 Masiewicz Mar 2010 B1
7688540 Mei et al. Mar 2010 B1
7724461 McFadyen et al. May 2010 B1
7725584 Hanmann et al. May 2010 B1
7730295 Lee Jun 2010 B1
7760458 Trinh Jul 2010 B1
7768776 Szeremeta et al. Aug 2010 B1
7804657 Hogg et al. Sep 2010 B1
7813954 Price et al. Oct 2010 B1
7827320 Stevens Nov 2010 B1
7839588 Dang et al. Nov 2010 B1
7843660 Yeo Nov 2010 B1
7852596 Boyle et al. Dec 2010 B2
7859782 Lee Dec 2010 B1
7872822 Rothberg Jan 2011 B1
7898756 Wang Mar 2011 B1
7898762 Guo et al. Mar 2011 B1
7900037 Fallone et al. Mar 2011 B1
7907364 Boyle et al. Mar 2011 B2
7929234 Boyle et al. Apr 2011 B1
7933087 Tsai et al. Apr 2011 B1
7933090 Jung et al. Apr 2011 B1
7934030 Sargenti, Jr. et al. Apr 2011 B1
7940491 Szeremeta et al. May 2011 B2
7944639 Wang May 2011 B1
7945727 Rothberg et al. May 2011 B2
7949564 Hughes et al. May 2011 B1
7974029 Tsai et al. Jul 2011 B2
7974039 Xu et al. Jul 2011 B1
7982993 Tsai et al. Jul 2011 B1
7984200 Bombet et al. Jul 2011 B1
7990648 Wang Aug 2011 B1
7992179 Kapner, III et al. Aug 2011 B1
8004785 Tsai et al. Aug 2011 B1
8006027 Stevens et al. Aug 2011 B1
8014094 Jin Sep 2011 B1
8014977 Masiewicz et al. Sep 2011 B1
8019914 Vasquez et al. Sep 2011 B1
8040625 Boyle et al. Oct 2011 B1
8078943 Lee Dec 2011 B1
8079045 Krapf et al. Dec 2011 B2
8082433 Fallone et al. Dec 2011 B1
8085487 Jung et al. Dec 2011 B1
8089719 Dakroub Jan 2012 B1
8090902 Bennett et al. Jan 2012 B1
8090906 Blaha et al. Jan 2012 B1
8091112 Elliott et al. Jan 2012 B1
8094396 Zhang et al. Jan 2012 B1
8094401 Peng et al. Jan 2012 B1
8116020 Lee Feb 2012 B1
8116025 Chan et al. Feb 2012 B1
8134793 Vasquez et al. Mar 2012 B1
8134798 Thelin et al. Mar 2012 B1
8139301 Li et al. Mar 2012 B1
8139310 Hogg Mar 2012 B1
8144419 Liu Mar 2012 B1
8145452 Masiewicz et al. Mar 2012 B1
8149528 Suratman et al. Apr 2012 B1
8154812 Boyle et al. Apr 2012 B1
8159768 Miyamura Apr 2012 B1
8161328 Wilshire Apr 2012 B1
8164849 Szeremeta et al. Apr 2012 B1
8174780 Tsai et al. May 2012 B1
8190575 Ong et al. May 2012 B1
8194338 Zhang Jun 2012 B1
8194340 Boyle et al. Jun 2012 B1
8194341 Boyle Jun 2012 B1
8201066 Wang Jun 2012 B1
8271692 Dinh et al. Sep 2012 B1
8279550 Hogg Oct 2012 B1
8281218 Ybarra et al. Oct 2012 B1
8285923 Stevens Oct 2012 B2
8289656 Huber Oct 2012 B1
8305705 Roohr Nov 2012 B1
8307156 Codilian et al. Nov 2012 B1
8310775 Boguslawski et al. Nov 2012 B1
8315006 Chahwan et al. Nov 2012 B1
8316263 Gough et al. Nov 2012 B1
8320067 Tsai et al. Nov 2012 B1
8324974 Bennett Dec 2012 B1
8332695 Dalphy et al. Dec 2012 B2
8341337 Ong et al. Dec 2012 B1
8350628 Bennett Jan 2013 B1
8356184 Meyer et al. Jan 2013 B1
8370683 Ryan et al. Feb 2013 B1
8375225 Ybarra Feb 2013 B1
8375274 Bonke Feb 2013 B1
8380922 DeForest et al. Feb 2013 B1
8390948 Hogg Mar 2013 B2
8390952 Szeremeta Mar 2013 B1
8392689 Lott Mar 2013 B1
8407393 Yolar et al. Mar 2013 B1
8413010 Vasquez et al. Apr 2013 B1
8417566 Price et al. Apr 2013 B2
8421663 Bennett Apr 2013 B1
8422172 Dakroub et al. Apr 2013 B1
8427771 Tsai Apr 2013 B1
8429343 Tsai Apr 2013 B1
8433937 Wheelock et al. Apr 2013 B1
8433977 Vasquez et al. Apr 2013 B1
8458526 Dalphy et al. Jun 2013 B2
8462466 Huber Jun 2013 B2
8467151 Huber Jun 2013 B1
8489841 Strecke et al. Jul 2013 B1
8493679 Boguslawski et al. Jul 2013 B1
8498074 Mobley et al. Jul 2013 B1
8499198 Messenger et al. Jul 2013 B1
8512049 Huber et al. Aug 2013 B1
8514506 Li et al. Aug 2013 B1
8531791 Reid et al. Sep 2013 B1
8554741 Malina Oct 2013 B1
8560759 Boyle et al. Oct 2013 B1
8565053 Chung Oct 2013 B1
8576511 Coker et al. Nov 2013 B1
8578100 Huynh et al. Nov 2013 B1
8578242 Burton et al. Nov 2013 B1
8589773 Wang et al. Nov 2013 B1
8593753 Anderson Nov 2013 B1
8595432 Vinson et al. Nov 2013 B1
8599510 Fallone Dec 2013 B1
8601248 Thorsted Dec 2013 B2
8611032 Champion et al. Dec 2013 B2
8612650 Carrie et al. Dec 2013 B1
8612706 Madril et al. Dec 2013 B1
8612798 Tsai Dec 2013 B1
8619383 Jung et al. Dec 2013 B1
8621115 Bombet et al. Dec 2013 B1
8621133 Boyle Dec 2013 B1
8626463 Stevens et al. Jan 2014 B2
8630052 Jung et al. Jan 2014 B1
8630056 Ong Jan 2014 B1
8631188 Heath et al. Jan 2014 B1
8634158 Chahwan et al. Jan 2014 B1
8635412 Wilshire Jan 2014 B1
8640007 Schulze Jan 2014 B1
8654619 Cheng Feb 2014 B1
8661193 Cobos et al. Feb 2014 B1
8667248 Neppalli Mar 2014 B1
8670205 Malina et al. Mar 2014 B1
8683295 Syu et al. Mar 2014 B1
8683457 Hughes et al. Mar 2014 B1
8687306 Coker et al. Apr 2014 B1
8693133 Lee et al. Apr 2014 B1
8694841 Chung et al. Apr 2014 B1
8699159 Malina Apr 2014 B1
8699171 Boyle Apr 2014 B1
8699172 Gunderson et al. Apr 2014 B1
8699175 Olds et al. Apr 2014 B1
8699185 Teh et al. Apr 2014 B1
8700850 Lalouette Apr 2014 B1
8743502 Bonke et al. Jun 2014 B1
8749910 Dang et al. Jun 2014 B1
8751699 Tsai et al. Jun 2014 B1
8755141 Dang Jun 2014 B1
8755143 Wilson et al. Jun 2014 B2
8756361 Carlson et al. Jun 2014 B1
8756382 Carlson et al. Jun 2014 B1
8769593 Schwartz et al. Jul 2014 B1
8773802 Anderson et al. Jul 2014 B1
8780478 Huynh et al. Jul 2014 B1
8782334 Boyle et al. Jul 2014 B1
8793532 Tsai et al. Jul 2014 B1
8797669 Burton Aug 2014 B1
8799977 Kapner, III et al. Aug 2014 B1
8819375 Pruett et al. Aug 2014 B1
8825976 Jones Sep 2014 B1
8825977 Syu et al. Sep 2014 B1
8947816 Ryan et al. Feb 2015 B1
20060039108 Chikusa et al. Feb 2006 A1
20070061638 Nishiuchi et al. Mar 2007 A1
20070183088 Hatchett et al. Aug 2007 A1
20090113702 Hogg May 2009 A1
20100306551 Meyer et al. Dec 2010 A1
20110211276 Tsunoda et al. Sep 2011 A1
20110226729 Hogg Sep 2011 A1
20110317303 Yoshida Dec 2011 A1
20120159042 Lott et al. Jun 2012 A1
20120275050 Wilson et al. Nov 2012 A1
20120281963 Krapf et al. Nov 2012 A1
20120324980 Nguyen et al. Dec 2012 A1
20140201424 Chen et al. Jul 2014 A1
Non-Patent Literature Citations (3)
Entry
Mike Yan, “Cold Storage Hardware v0.5 ST-draco-abraxas-0.5” http://www.opencompute.org/wp/wp-contentuploads/2013/01/ Open.sub.--Compute.sub.--Project.sub.--Cold.sub.--Storage.sub.--Specifica- tion.sub.--v0.5.pdf, pp. 1-13, Jan. 16, 2013.
Notice of Allowance dated Sep. 25, 2014 from U.S. Appl. No. 14/023,386, 6 pages.
Office Action dated Mar. 25, 2014 from U.S. Appl. No. 14/023,386, 15 pages.
Provisional Applications (1)
Number Date Country
61818287 May 2013 US
Continuations (1)
Number Date Country
Parent 14023386 Sep 2013 US
Child 14608980 US