Organizations such as on-line retailers, Internet service providers, search providers, financial institutions, universities, and other computing-intensive organizations often conduct computer operations from large scale computing facilities. Such computing facilities house and accommodate a large amount of server, network, and computer equipment to process, store, and exchange data as needed to carry out an organization's operations. Typically, a computer room of a computing facility includes many server racks. Each server rack, in turn, includes many servers and associated computer equipment.
Because a computing facility may contain a large number of servers, a large amount of electrical power may be required to operate the facility. In addition, the electrical power is distributed to a large number of locations spread throughout the computer room (e.g., many racks spaced from one another, and many servers in each rack). Usually, a facility receives a power feed at a relatively high voltage. This power feed is stepped down to a lower voltage (e.g., 110V). A network of cabling, bus bars, power connectors, and power distribution units, is used to deliver the power at the lower voltage to numerous specific components in the facility.
Computer systems typically include a number of components that generate waste heat. Such components include printed circuit boards, mass storage devices, power supplies, and processors. For example, some computers with multiple processors may generate 250 watts of waste heat. Some known computer systems include a plurality of such larger, multiple-processor computers that are configured into rack-mounted components, and then are subsequently positioned within a racking system. Some known racking systems include 40 such rack-mounted components and such racking systems will therefore generate as much as 10 kilowatts of waste heat. Moreover, some known data centers include a plurality of such racking systems. Some known data centers include methods and apparatus that facilitate waste heat removal from a plurality of racking systems, typically by circulating air through one or more of the rack systems.
Many data center includes numerous rack-mounted servers housed in a building, which provides protection operating equipment. Such buildings may require a substantial investment in the form of construction costs, maintenance costs, and/or leasing costs. In addition, substantial time and resources are typically required to design and build a data center (or expansion thereof), lay cables, install racks and cooling systems. Additional time and resources are typically needed to conduct inspections and obtain certifications and approvals, such as for electrical and HVAC systems.
Many data centers rely on forced air systems and air conditioning to maintain the temperatures and other environmental conditions in the data center within acceptable limits. The initial and ongoing costs of installing and operating these systems may add substantial cost and complexity to data center operations.
The amount of computing capacity needed for any given data center may change rapidly as business needs dictate. Most often, there is a need for increased computing capacity at a location. Initially providing computing capacity in a data center, or expanding the existing capacity of a data center (in the form of additional servers, for example), is resource-intensive and may take many months to effect.
While the invention is susceptible to various modifications and alternative forms, specific embodiments thereof are shown by way of example in the drawings and will herein be described in detail. It should be understood, however, that the drawings and detailed description thereto are not intended to limit the invention to the particular form disclosed, but on the contrary, the intention is to cover all modifications, equivalents and alternatives falling within the spirit and scope of the present invention as defined by the appended claims. The headings used herein are for organizational purposes only and are not meant to be used to limit the scope of the description or the claims. As used throughout this application, the word “may” is used in a permissive sense (i.e., meaning having the potential to), rather than the mandatory sense (i.e., meaning must). Similarly, the words “include,” “including,” and “includes” mean including, but not limited to.
Systems and methods for providing computing resources are disclosed. According to one embodiment, a data center includes a floor that supports rack computing systems and walls that enclose a computing room. The computing room has a length and a width. The computing room holds the rack computing systems. The walls include a pair of opposing parallel walls defining the width of the computing room and one or more movable walls. At least one of the movable walls substantially spans the opposing parallel walls. The movable walls can translate to increase or decrease the length of the computing room.
According to one embodiment, a data center includes a floor that supports rack computing systems and walls that enclose a computing room. The computing room has a length and a width. The computing room holds the rack computing systems. One of the walls is a movable wall. The movable wall translates relative to the other walls to increase or decrease the size of the computing room.
According to one embodiment, a method of changing the size of a computing room includes providing a computing room enclosed by walls. A movable wall is translated relative to the other walls of the computing room to increase or decrease the size of the computing room.
According to one embodiment, a method of enlarging a computing room includes moving a movable wall of a computing room away from one or more other walls of the computing room such that a gap is created in an expansion zone between the movable wall and the other walls. One or more side modules are coupled in the gap between the movable wall and the other walls such that the side modules, the movable wall, and the other walls define an enlarged computing room that includes the expansion zone.
According to one embodiment, a method of enlarging a computing room includes extending support structure elements from a computing room into an expansion zone for the computing room. One or more side modules are coupled to the supporting structure elements in the expansion zone for the computing room to enclose an enlarged computing room.
According to one embodiment, a data center includes a floor that supports rack computing systems and walls. One of the walls is a movable end wall that can be moved away from the other walls of the computing room to create an expansion zone between the movable wall and the other walls. Side modules can couple in a gap between the movable wall and the one or more other walls such that the one or more side modules, the movable wall, and at least one of the other walls define an enlarged computing room that includes the expansion zone.
According to one embodiment, a data center includes rack computing systems, a floor that supports the rack computing systems, two or more opposing end walls, two or more side modules. The side modules and end walls are arranged to enclose a computing room for the rack computing systems. One of the end walls is movable to allow insertion of additional side modules along the sides of the computing room to enlarge the computing room.
As used herein, “data center infrastructure” means systems, components, or elements of a system that provide resources for computing devices, such as electrical power, data exchange capability with external systems, air, heat removal, and environmental control (for example, humidity control, particulate control).
As used herein, a “modular panel” includes a panel, plate, frame, that can partially enclose a space. A modular panel may have one or more openings. In some embodiments, a modular panel works in combination with other elements to partially enclose a space. For example, a data center infrastructure module may couple in an opening of the modular panel such that the data center infrastructure module and the modular panel combine to enclose a computing room.
As used herein, “room” means a room or a space of a building. As used herein, “computing room” means a room of a building in which computing devices, such as rack-mounted servers, can be operated.
As used herein, a “support structure element” includes one or more elements that support elements that enclose a computing room. Examples of support structure elements include a floor, slab, false floor, rail, frame, rod, bar, or scaffold.
As used herein, an “aisle” means a space next to one or more racks.
As used herein, “air handling system” means a system that provides or moves air to, or removes air from, one or more systems or components.
As used herein, “air moving device” includes any device, element, system, or combination thereof that can move air. Examples of air moving devices include fans, blowers, and compressed air systems.
As used herein, “ambient” refers to a condition of outside air at the location of a system or data center. An ambient temperature may be taken, for example, at or near an intake hood of an air handling system.
As used herein, a “cable” includes any cable, conduit, or line that carries one or more conductors and that is flexible over at least a portion of its length. A cable may include a connector portion, such as a plug, at one or more of its ends.
As used herein, a “cold aisle” means an aisle from which air can be drawn for use in removing heat from a system, such as a rack computing system.
As used herein, “computing” includes any operations that can be performed by a computer, such as computation, data storage, data retrieval, or communications.
As used herein, “computing device” includes any of various devices in which computing operations can be carried out, such as computer systems or components thereof. One example of a computing device is a rack-mounted server. As used herein, the term computing device is not limited to just those integrated circuits referred to in the art as a computer, but broadly refers to a processor, a server, a microcontroller, a microcomputer, a programmable logic controller (PLC), an application specific integrated circuit, and other programmable circuits, and these terms are used interchangeably herein. Some examples of computing devices include e-commerce servers, network devices, telecommunications equipment, medical equipment, electrical power management and control devices, and professional audio equipment (digital, analog, or combinations thereof). In various embodiments, memory may include, but is not limited to, a computer-readable medium, such as a random access memory (RAM). Alternatively, a compact disc-read only memory (CD-ROM), a magneto-optical disk (MOD), and/or a digital versatile disc (DVD) may also be used. Also, additional input channels may include computer peripherals associated with an operator interface such as a mouse and a keyboard. Alternatively, other computer peripherals may also be used that may include, for example, a scanner. Furthermore, in the some embodiments, additional output channels may include an operator interface monitor and/or a printer.
As used herein, “data center” includes any facility or portion of a facility in which computer operations are carried out. A data center may include servers dedicated to specific functions or serving multiple functions. Examples of computer operations include information processing, communications, simulations, and operational control.
As used herein, a “hot aisle” means an aisle into which heated air can be discharged for use in removing heat from a system, such as a rack computing system.
As used herein, “mechanical cooling” means cooling of air by a process that involves doing mechanical work on at least one fluid, such as occurs in vapor-compression refrigeration systems.
As used herein, a “module” is a component or a combination of components physically coupled to one another. A module may include functional elements and systems, such as computer systems, circuit boards, racks, blowers, ducts, and power distribution units, as well as structural elements, such a base, frame, housing, or container.
As used herein, an “operating environment”, in the context of computing resources, means the space, facilities and infrastructure resources provided for the computing resources. An operating environment for a set of rack computing systems includes the space, power, data interchange, cooling, and environmental control resources provided for the set of computing systems.
As used herein, “power distribution unit” refers to any device, module, component, or a combination thereof, that can be used to distribute electrical power. The elements of a power distribution unit may be embodied within a single component or assembly (such as a transformer and a rack power distribution unit housed in a common enclosure), or may be distributed among two or more components or assemblies (such as a transformer and a rack power distribution unit each housed in separate enclosure, and associated cables, etc.)
As used herein, “power panel” means any panel, device, module, component, or combination thereof, that can be used to transfer or distribute electrical power from one or more input conductors to one or more output conductors. In certain embodiments, a remote power panel includes main lug only panel conductors. A remote power panel may be housed in an enclosure, such as a cabinet.
As used herein, “rack computing systems” means a computing system that includes one or more computing devices mounted in a rack.
As used herein, a “space” means a space, area or volume.
Ground level space is bounded by floor 112 and ceiling 114. Ground-level space 106 includes hall 116 and peripheral room 118. Hall 116 is separated from peripheral spaces 118 by side walls 120.
Data center 100 includes movable wall 124. Movable wall 124 includes panel 126 and roller assemblies 128. Movable wall 124 may span hall 118 between side walls 120. Movable wall 124 may run from floor 130 of hall 116 to ceiling 114.
Computing room 132 is enclosed by opposing side walls 120, end wall 134, and movable wall 124. Computing room 132 houses rack computing systems 136. Each of rack computing systems 136 may include computing devices, such as servers, as well as other systems and devices for supporting computing operations in computing room, such as power supply units, rack power distribution units, and fans.
Data infrastructure modules 140 are provided in peripheral rooms 118. Data center infrastructure modules 140 may provide infrastructure resources, such as electrical power, cooling air, network connections, and storage, for compute resources in computing room. In
In some embodiments, opposing side walls 120, end wall 134, movable wall 124, ceiling 114, and floor 106 may combine to serve as a plenum for air used to cool computing devices in rack computing systems 134. For example, air may be maintained at a higher pressure inside computing room 132 than in the portion of hall 114 outside of computing room 132. In some embodiments, sealing elements (such as flaps) are provided at the junctions between movable 124 and the adjoining elements of the enclosure, such as side walls 120, floor 130, and ceiling 114. In some embodiments, fire retardant materials are used for the main structure of movable wall 124, the sealing elements, or both.
Movable wall 124 may divide computing space from non-computing space. For example, computing room 124 may be suitable for holding rack-mounted computing devices to perform computing operations. Non-computing space 158 may be used for purposes other than computing, such as equipment storage, office space, or warehouse space. In certain embodiments, non-computing space 158 holds systems used to provide data center infrastructure, such as CRACs, UPSs, generators, power panels, or network switches.
Second-level space 108 includes exhaust plenum 160, catwalk 162, and mixing plenum 164. Air handling system 146 may be installed in second level space 108. Air handling systems 166 may draw air from host aisle 168 of computing room 132 through an opening in ceiling 114 and exhaust the air into exhaust plenum 160. Air in exhaust plenum 160 may be discharged to the outside by way of roof vent 162.
In some embodiments, mixing plenum 164 mixes air removed from computing room 132 with air from outside the data center. Air from mixing plenum 164 may be ducted into computing room 132.
Subfloor space 110 includes subfloor plenum 170. Subfloor plenum 170 may hold a source of air for removing heat from computing devices in rack computing systems 136. Floor vents 172 allow air from subfloor plenum 170 to be drawn into cold aisles 174. The arrows in
From time to time, the amount of computing space needed for a data center may increase or decrease. In some embodiments, a movable wall is translated to increase or decrease the size of a computing room. For example, in the data center shown in
At 182, a movable wall is translated relative to the other walls of the computing room to increase or decrease the size of the computing room. The movable wall may be, for example, translated away from an opposing wall to increase the length of the computing room.
In some embodiments, a computing room is enlarged by adding side modules in an expansion zone. Enlarging a computing room may include extending support structure elements from the computing room into an expansion zone for the computing room. Side modules may be coupled to the support structure elements in the expansion zone to enclose an enlarged computing room. In some embodiments, enlarging a computing room includes moving an end wall relative to one or more other walls of a computing room. Gaps at the expansion zone may be filled with side modules.
In some embodiments, support structure elements are extended from a computing room into an expansion zone for the computing room. Examples of support structure elements include section of floor (such as a concrete slab), raised rails, floor rails, beams, frames, trusses, or posts.
At 202, side modules are installed in the expansion zone for a computing room. The side modules may be coupled to supporting structure elements, such as a frame, rail, or floor. The side modules may be arranged to enclose additional computing space. Side modules in the expansion zone may, in combination with other enclosing elements, define an enlarged computing room.
In some embodiments, side module (such as side modules 206) couple with interior frame members for a computing room. Examples of interior frame members for a computing room include a rail, stud, column, beam, or joist.
Systems 212 in each of side modules 206 may vary from module to module. Some modules may include systems for providing infrastructure resources, such as electrical power, cooling air, network connections, and storage, for compute resources in a computing room. In some embodiments, different functions are provided by each side module. For example, one side module may include mechanical equipment for cooling, another side module may provide electrical power, and another may provide network connections to systems external to the computing room. Power cables, data cables, or cooling air may be provided to computing resources in the computing room through the opening 214 in frame 208.
Modular panels 226 include modular side panels 232 and modular ceiling panels 234. Modular panels 226 include modular side panels 232 and modular ceiling panels 234 may be installed on raised rails 224. In some embodiments, fasteners, such screws, bolts, or clips, are used to secure modular side panels 232 and modular ceiling panels 234 on raised rails 224.
Rack computing systems 238 may be operated in computing room 242. Computing room 242 may be enclosed by modular panels 226, interior wall 228, and floor 222.
Data center 220 includes data center infrastructure modules 240. Data center infrastructure modules 240 and 241 may be coupled to any or all of modular panels 226. Each combination of a data center infrastructure module 240 and modular side panel 226 may serve as a side module. Data center infrastructure modules 240 may provide infrastructure resources, such as electrical power, cooling air, network connections, and storage, for compute resources in computing room 242. Data center infrastructure module 241 may include a hallway that spans between computing room 242 and another computing room in data center 220. Data center infrastructure modules 240 may be similar to data center infrastructure modules 140 described above relative to
In some embodiments, cooling modules are mounted on a ceiling panel of an expandable data center. For example, in the data center shown in
Interior wall 228 and exterior wall 230 may be translated on floor rails 223 and raised rails 224. Interior wall 228 and exterior wall 230 each include rollers 260. Rollers 260 may be used to facilitate moving of interior wall 228 and exterior wall 230. In certain embodiments, interior wall 228 and exterior wall 230 include a drive system. Drive systems may be operated to move interior wall 228 and exterior wall 230 from one position to another. A drive system may include motors, cables, pulleys, wheels, gantries or other systems or devices for moving a wall. In certain embodiments, an interior wall, exterior wall, or both, are carried (for example, hung), on structural elements above or along the sides of the walls. Rollers or sliders may be provided along the sides or on top of the interior wall or exterior to allow the wall to be carried on the structural elements.
In some embodiments, a movable wall is used in combination with modular panels to enclose a computing room of a data center.
In the example shown in
Exterior wall 230 may remain spaced away from interior wall 228. In some embodiments, exterior wall 232 provides protection from outdoor environmental conditions, such as rain, in the portion of the data center outside computing room 242.
As the need arises, a computing room may be made larger or smaller by installing or removing modular panel and data infrastructure modules. In some embodiments, a movable wall is pulled away from existing panels to encompass an expansion zone for more compute resources. In some embodiments, modular panels or infrastructure modules, or both, are added to previously installed supporting structure elements. In certain embodiments, supporting structure elements are added on an as-needed basis in advance of expanding computing space. For example, in the data center shown in
In some embodiments, a data center includes side modules that connect two or more computing rooms.
In some embodiments, a data center includes an expandable exterior enclosure for housing computing space.
Exterior shell 324 includes canopy 330, end wall 332, and movable exterior wall 334. Movable exterior wall may travel on rails 336. Exterior shell 324 may provide environmental protection for computing room 322 and for the portion of data center 320 outside of computing room 322.
Canopy 330 may have a bellows-type construction. A portion of canopy 330 may cover computing room 332 (for example, section 330a). As additional room is needed to house computing resources, exterior movable wall 334 may be moved out (for example, rolled along rails 336).
In the example shown in
Canopy 330 may be supported on guide wire 333. The opposing ends of guide wire 333 may be attached to opposing end walls in the data center. Each of interface plates 331 may be hung on guide wire 333. Guide wire 333 may support canopy 330. For example, guide wire 333 may inhibit sagging of canopy 330 between the opposing end walls of the data center. In some embodiments, canopy 330 is at least partially made out of cloth.
Although in the embodiment shown in
Although in the data center shown in
Although in many embodiments described above, movable walls include rollers, a movable wall may in various embodiments not include rollers. In certain embodiments, a movable wall may swing out (for example, on one or more hinges). In some embodiments, two or more movable walls are provided next to another.
Although in many embodiments described above, movable walls move on floor rails, a movable wall may in various embodiments be carried on rails or tracks above the floor, such as overhead rails of side rails. In certain embodiments, a movable end wall for a computing room may not be coupled to any tracks or rails.
Although in many embodiments described above, existing portions of computing space is enlarged by an expansion zone, in certain embodiments, a partition may be maintained between the old computing space and the new computing space in a computing room.
In some embodiments, expansion of one or more computing rooms in a data center may occur in different directions. For example, a computing room may be expanded in two, perpendicular directions (for example, by moving one moving wall to the north and another moving wall to the east.
Although in many embodiments described above, a computing room is protected by a preexisting roof structure, a computing may in various embodiments, have a roof that is constructed as the computing room expanded.
Although in many embodiments described above, a computing room is illustrated as having one movable end wall and one fixed end wall, a data center may in some embodiments, have movable end walls on both ends of a computing room. For example, wall 134 shown in
Although in many embodiments described above, rollers for a movable wall roll on the floor of a computing room or on floor rails, a movable wall may in some embodiments include rollers that engage structure elements above the floor. For example, a movable wall may include rollers that engage on rails above the floor, such as rails 224 shown in
Although the embodiments above have been described in considerable detail, numerous variations and modifications will become apparent to those skilled in the art once the above disclosure is fully appreciated. It is intended that the following claims be interpreted to embrace all such variations and modifications.