Any and all applications for which a foreign or domestic priority claim is identified in the Application Data Sheet as filed with the present application are incorporated by reference under 37 CFR 1.57 and made a part of this specification.
Certain embodiments disclosed herein relate generally to high density servers, such as rack mounted servers for cold storage of data.
Rack mountable servers are generally shaped and sized based on industry standards. For example, a standard server-rack configuration (one rack unit or “1 U”) is 19 inches (480 mm) wide and 1.75 inches (44 mm) tall. The most common computer rack form-factor is 42 U high, which can receive up to 42 discrete computer devices that are directly mountable in the rack.
To maximize storage capacity of certain servers, rack mountable or otherwise, disk drives are tightly packed side by side within an enclosure. A 1 U server hosting either eight (8×) or twelve (12×) disk drives is an example of a densely packed storage server. Such a server has very little space for air movement between each disk drive. Thus, it will be understood that placing a large number of disk drives close together can introduce cooling issues.
Various embodiments are depicted in the accompanying drawings for illustrative purposes, and should in no way be interpreted as limiting the scope of the inventions.
To maximize storage capacity of certain servers, storage drives are tightly packed side by side within an enclosure. Placing a large number of storage drives close together can introduce cooling issues. Many servers utilize forced convection cooling systems to remove the heat from disk drives and controlling electronics. Such cooling systems are designed to move a large volume of air across or throughout the server in order to remove the heat energy created by the operation of the server.
Effective air flow mass movement generally requires open spaces (low impedance) between and around storage drives and surrounding electronics throughout the server. At the same time, it is desirable to have size efficient enclosures where the volume and footprint of the enclosure are minimized as much as possible. In many cases, the necessity of open space limits the overall server storage density within a given volumetric space of the server.
A 1 U server hosting either eight (8×) or twelve (12×) disk drives is an example of a densely packed storage server having very little space for air movement between each storage drive.
In some applications, servers are used for cold storage of data (e.g., data that is inactive for extended period of time). Cold storage data servers are typically used for backups, archiving, and multimedia applications. Cold storage is the retention of data that is accessed infrequently. For example, cold storage of data may include activating less than 5 to 10% of the disk drives at any one time during data access. Stated differently, during access of cold storage data, 90 to 95% of the disk drives remain inactive.
The servers can be placed in a refrigeration room to reduce the heat of the server, including generally reducing the need for fans (in the room, on the rack, on the server, etc.). Though room refrigeration can reduce the individual cooling needs for each server, high storage density can still create heating issues. A cold storage facility for cold storage servers can be an air conditioned room or free air room sufficient to cool the servers. A cold storage facility can use ice blocks to cool the servers.
As an example, the servers will preferably be high storage density servers containing data that is archived as it is rarely accessed. Such archive storage can include powering only a data storage device required for an active request for data. For example, the Open Compute specification calls for an Open Vault tray of fifteen (15×) data storage devices. One or a few data storage device(s) in the tray is powered at a time to reduce power, heat, and vibration. However, because one or a few data storage device(s) is powered at a time, the other inactive data storage devices may include components which are not simultaneously needed or utilized, and may therefore be redundant while consuming excess power.
One way in which heating issues of a high storage density server can be reduced is to connect multiple bare data storage devices to a common controller printed circuit board assembly (pcba). As used herein, bare data storage devices are data storage devices without a dedicated controller pcba. A bare data storage device can be a conventional drive, such as a hard disk drive (HDD), solid state drive (SSD), solid state hybrid drive (SSHD), a storage drive, or other storage device known in the art. Certain examples of a data storage assembly that can use a common controller pcba to control multiple bare data storage devices can be found in U.S. Pat. No. 8,947,816, incorporated by reference herein and made a part of this specification.
Looking now to
The illustrated chassis form factor adheres to the Facebook Open Architecture Design Guidelines (21.12 inch (536.5 mm)×1.75 inch (44.5 mm)×27.39 inch (695.6 mm)), although a similar chassis architecture could be applied to a standard 1 U form factor rackmount server (19.0 inches (480 mm)×1.75 inches (44.5 mm)×26.4 inch (670 mm)), but hosting twelve (12×) or sixteen (16×) 3.5 inch form factor drives. In addition, in some embodiments using an Open Architecture Design or a 1 U (or 1 U-like) form factor, up to 20 disk drives could be positioned within the server.
In some embodiments, the derived 1 U chassis server design can be used to build a cold storage server and take advantage of disk drives with Shingle Magnetic Recording (SMR) drive technology. The SMR drive technology along with the capability to spin down and up an individual drive among many drives can be a very cost effective technology for cold storage applications.
As illustrated in
The server 100 can be rack mountable (such as with additional hardware) or standalone. The server 100 can hold the storage drives 2 organized into rows and columns. Other configurations can also be used where the storage drives 2 do not need to be symmetrically organized or evenly spaced and positioned as in the illustrated embodiment.
A single controller pcba 4 is shown designed to control the fifteen (15) bare disk drives 2. A retaining cover 14 is also shown that can be used to secure the storage drives 2 in the server 100.
A computer module 16 is also shown. It will be understood that the server 100 can include any number of different features such as the computer module 16, but also one or more of a power supply, bus, fan, storage drive, printed circuit board(s) (central processing unit (CPU), input/output (I/O) board, memory modules), etc.
Looking to
In the illustrated embodiment, only fourteen (14) storage drives 2 are shown, with one open space in the nest being illustrated. It will be noted that typically all spaces of the nest will be full, though some embodiments may have fewer than all spaces with a corresponding storage drive.
Once the controller pcba 4 is in place, a retaining cover 14 can be used to secure the storage drives 2 in the server 100 and then a chassis cover 8 can be secured in place as shown in
Moving now to
In
In
The nest 12 also has large cutouts 32 at each storage drive receiving area 26. This can increase the cooling of each storage drive as more of its surface area is exposed and can be cooled through air flow.
The cutouts 32 can create an air passageway to allow a flow of air to access the bottom of a storage drive 2. Channeling air directly to the bottom of the storage drive 2 can increase cooling in an efficient matter.
According to some embodiments, the cutout 32 can have a footprint on the nest 12 smaller than a footprint 34 of the storage drive 2 on the nest (see
A nest 12 can be used to form a bottom of one or more of the storage drive receiving areas 26. The nest can be positioned between the top 8 and bottom 6 of the chassis enclosure and establish an air channel between the nest and the bottom surface of the chassis. For example, an air channel 28, 30 can be formed in the bottom of the nest. The nest can be placed on the bottom surface of the chassis to establish air channels on the bottom of the server as shown in
Air can flow above and below the storage drives 2 and storage drive receiving areas 26. As will be described in more detail below, the retaining cover 14 can be positioned above the storage drives 2 to allow air flow therebetween. The chassis cover 8 can also be positioned above the retaining cover 14 to allow air flow between the two covers. It will be understood that, in some embodiments, the retaining cover 14 can directly contact the storage drives 2 so that little to no air can effectively flow between them. The relationship between the retaining cover 14 and chassis cover 8 can be positioned likewise.
In some embodiments, the server chassis can be size efficient per the type of storage drive. Thus, even with the air channels, a height of the server chassis defined by the distance from the top wall to the bottom wall of the enclosure can be less than two times a height of a storage drive to be received within the enclosure. In other embodiments, it can be less than 1.5, 1.6, 1.7, 1.8, or 1.9 times. Put another way, the height of the storage drive can be 40%, 50%, 60%, 70%, 80%, or 90% of the height of the enclosure. In some embodiments, the height of the storage drive can be between 40% and 80%, 50% and 70%, 55% and 65% of the height of the enclosure.
Turning now to
In the illustrated storage drive receiving area 26, there are a number of datums 40, 41, 42, 43, 44, 46, 48, 50, 52 used to control the positioning of the storage drive. The datums can be used to position the storage drive in one or both of the X and Y axes as also illustrated in
The datums can be used to position the storage drive in the Z axis as illustrated in
Once the controller pcba 4 is in place on the storage drives 2, with the pins and connectors connected, screws or other fasteners can be used to secure the controller pcba in place. In some embodiments, 7 to 10 screws are used to connect each storage drive to the controller pcba. The screws can help ensure that the storage drives and controller pcba stay properly aligned.
With the controller pcba 4 in place, a retaining cover 14 can be used to secure the storage drives and controller pcba in the server.
In
In some embodiments, the air space between the pcba and the retaining cover can be larger than the thickness of the controller pcba, such as twice as thick.
Looking now to
Any number of fasteners 54 can be used to secure the storage drives 2 and retaining cover 14. In the illustrated embodiment, four (4) fasteners 54 are used to secure each storage drive 2 to the retaining cover. Looking to
As shown in
As discussed herein, a chassis architecture can be a high density server to accommodate eight, twelve, fifteen, sixteen, twenty, or a different number of storage drives such as disk drives. Among other benefits, the server can provide for drive attachment and clamping, drive registration and alignment, drive cooling, controller size optimization and disk drive arrangement inside the chassis, and optimized natural convection cooling.
In some embodiments, a server can beneficially provide ultra-high density server capacity (e.g., 15 drives), highly integrated design (e.g., common controller), and optimized natural convection cooling.
In some embodiments, a mechanical chassis architecture can be used for a cold storage server comprising a 1 U type form factor adhering to the Facebook Open Architecture Design Guidelines. The mechanical chassis architecture can comprise a nest for holding up to 15 bare drives, wherein the nest comprises a plurality of drive cooling channels residing on the underside of the nest, the mechanical chassis architecture further comprising rear, front, and side air flow paths to allow for natural convection cooling.
According to some embodiments, a server can comprise a chassis, a plurality of disk drives, a nest, a printed circuit board (pcb), a retaining cover, a plurality of fasteners and a plurality of spacers. The nest can be positioned within the chassis and having a plurality of bays, each disk drive of the plurality of disk drives positioned within one of the bays of the plurality of bays. The printed circuit board can be a single pcb that is physically and electrically connected to all of the disk drives of the plurality of disk drives. The retaining cover can secure the plurality of disk drives within the chassis. Each spacer of the plurality of spacers can be positioned on one of the fasteners of the plurality of fasteners, the spacers maintaining a gap between a top of the single printed circuit board and a bottom of the retaining cover, each spacer being in contact with a disk drive of the plurality of disk drives and the retainer cover so that heat may be transferred from the disk drive to the retainer cover.
In some embodiments, the nest comprises a plurality of air channels, and each bay of the plurality of bays comprises a cutout in fluid communication with at least one of the plurality of air channels to thereby provide cooling to a bottom of a disk drive. Each bay can include at least three (e.g., three, four, or more) datums configured to position the respective disk drive within the bay. The bays can be organized in rows and columns. According to some embodiments, in at least one pair of a first row adjacent a second row, the respective bays of the first row are mirror images of the bays of the second row.
The server can also include a plurality of electrical pins and connectors, each of the electrical pins being on the printed circuit board or one of the hard disk drives and connected to one of the electrical connectors on the other of the printed circuit board or one of the hard disk drives. The server may further be part of a data storage system with a plurality of the servers and a fan, wherein each server does not include a dedicated fan.
In some embodiments, a cold storage server can comprise a chassis, a plurality of hard disk drives, a nest, a printed circuit board, a retaining cover, a plurality of fasteners and a plurality of spacers. The nest is positioned within the chassis and having a plurality of bays, the bays being organized in rows and columns and each hard disk drive of the plurality of disk drives positioned within one of the bays of the plurality of bays. The pcb can be a single printed circuit board physically and electrically connected to all of the hard disk drives of the plurality of hard disk drives. The server can also include a plurality of electrical pins and connectors. Each of the electrical pins being on the printed circuit board or one of the hard disk drives and connected to one of the electrical connectors on the other of the printed circuit board or one of the hard disk drives. The retaining cover can secure the plurality of hard disk drives within the chassis. Each spacer of the plurality of spacers can be positioned on one of the fasteners of the plurality of fasteners, the spacers maintaining a gap between a top of the single printed circuit board and a bottom of the retaining cover, each spacer being in contact with a hard disk drive of the plurality of disk drives and the retainer cover so that heat may be transferred from the hard disk drive to the retainer cover.
Although this invention has been disclosed in the context of certain preferred embodiments and examples, it will be understood by those skilled in the art that the present invention extends beyond the specifically disclosed embodiments to other alternative embodiments and/or uses of the invention and obvious modifications and equivalents thereof. In addition, while a number of variations of the invention have been shown and described in detail, other modifications, which are within the scope of this invention, will be readily apparent to those of skill in the art based upon this disclosure. It is also contemplated that various combinations or sub-combinations of the specific features and aspects of the embodiments may be made and still fall within the scope of the invention. Accordingly, it should be understood that various features and aspects of the disclosed embodiments can be combined with or substituted for one another in order to form varying modes of the disclosed invention. Thus, it is intended that the scope of the present invention herein disclosed should not be limited by the particular disclosed embodiments described above, but should be determined only by a fair reading of the claims that follow.
Similarly, this method of disclosure, is not to be interpreted as reflecting an intention that any claim require more features than are expressly recited in that claim. Rather, as the following claims reflect, inventive aspects lie in a combination of fewer than all features of any single foregoing disclosed embodiment. Thus, the claims following the Detailed Description are hereby expressly incorporated into this Detailed Description, with each claim standing on its own as a separate embodiment.
Number | Name | Date | Kind |
---|---|---|---|
5414591 | Kimura et al. | May 1995 | A |
5477416 | Schkrohowsky et al. | Dec 1995 | A |
6480380 | French et al. | Nov 2002 | B1 |
6556438 | Bolognia et al. | Apr 2003 | B1 |
6567271 | Stone et al. | May 2003 | B2 |
6574100 | Anderson | Jun 2003 | B1 |
6618248 | Dalheimer | Sep 2003 | B1 |
6621693 | Potter et al. | Sep 2003 | B1 |
6754082 | Ding et al. | Jun 2004 | B1 |
7079390 | Barr et al. | Jul 2006 | B2 |
7495906 | Fujie et al. | Feb 2009 | B2 |
7586741 | Matsushima et al. | Sep 2009 | B2 |
7660107 | Leung | Feb 2010 | B2 |
7701705 | Szeremeta | Apr 2010 | B1 |
7703291 | Bushnik et al. | Apr 2010 | B2 |
8064194 | Szeremeta | Nov 2011 | B2 |
8113873 | Sarraf | Feb 2012 | B1 |
8133426 | Yurchenco et al. | Mar 2012 | B1 |
8358395 | Szeremeta | Jan 2013 | B1 |
8417979 | Maroney | Apr 2013 | B2 |
8451600 | Ross | May 2013 | B1 |
8462460 | Szeremeta et al. | Jun 2013 | B1 |
8498088 | Klein | Jul 2013 | B1 |
8547658 | Szeremeta | Oct 2013 | B1 |
8947816 | Ryan et al. | Feb 2015 | B1 |
9060425 | Yin et al. | Jun 2015 | B2 |
9443560 | Szeremeta et al. | Sep 2016 | B2 |
9877415 | Szeremeta | Jan 2018 | B2 |
20030043550 | Ives | Mar 2003 | A1 |
20040172642 | Ding et al. | Sep 2004 | A1 |
20050114876 | Atarashi et al. | May 2005 | A1 |
20050162831 | Shum et al. | Jul 2005 | A1 |
20060061955 | Imblum | Mar 2006 | A1 |
20070053154 | Fukuda et al. | Mar 2007 | A1 |
20070247805 | Fujie et al. | Oct 2007 | A1 |
20080024972 | Yamaguchi | Jan 2008 | A1 |
20100073868 | Mayer et al. | Mar 2010 | A1 |
20110292602 | Narasimhan et al. | Dec 2011 | A1 |
20120069514 | Ross | Mar 2012 | A1 |
20130088823 | Yang | Apr 2013 | A1 |
20130155599 | Ross et al. | Jun 2013 | A1 |
20130210334 | Tan | Aug 2013 | A1 |
20140376174 | Dean et al. | Dec 2014 | A1 |
20150026515 | Arnouse | Jan 2015 | A1 |
20150192970 | Jau et al. | Jul 2015 | A1 |
Number | Date | Country |
---|---|---|
2003-323789 | Nov 2003 | JP |
Entry |
---|
“Business Storage 8-bay Rackmount NAS,” Technology paper, www.Seagate.com, Jan. 1, 2014, pp. 1-3. |
International Written Opinion in PCT Application No. PCT/US2015/056573, dated Jan. 28, 2016 in 8 pages. |
International Search Report in PCT Application No. PCT/US2015/056573, dated Jan. 28, 2016 in 3 pages. |
International Preliminary Report on Patentability in PCT Application No. PCT/US2015/056573, dated May 18, 2017 in 11 pages. |
International Search Report in PCT Application No. PCT/US2017/020803, dated Jun. 5, 2017 in 6 pages. |
International Written Opinion in PCT Application No. PCT/US2017/020803, dated Jun. 5, 2017 in 4 pages. |
Number | Date | Country | |
---|---|---|---|
20190104647 A1 | Apr 2019 | US |
Number | Date | Country | |
---|---|---|---|
62305484 | Mar 2016 | US |
Number | Date | Country | |
---|---|---|---|
Parent | 15195806 | Jun 2016 | US |
Child | 15875983 | US |