IN-ROW COOLING SYSTEM

Abstract

A framework for in-row cooling is described herein. The cooling system employs a fan unit with a plurality of smaller fans for improving the spread of air flowing through a V-shaped heat exchanger. The use of multiple smaller fans and the V-shaped heat exchanger enables the cooling system to be cooled using ambient temperature water or processed water at ambient temperature.

Description

TECHNICAL FIELD

The present disclosure generally relates to temperature controls, and more particularly to cooling systems for information technology (IT) systems.

BACKGROUND

With increasing heat density of servers, as well as the growing role of energy costs, cooling has become an important issue, particularly in data centers. While it is generally known that power consumption is the primary challenge for future high-performance computing systems, there can be a myopic focus on the issue by assuming power is consumed by the computer hardware only, without accounting for the necessary increase in cooling power that is required for highly integrated, more densely packaged information technology (IT) hardware.

Furthermore, traditional coolers, such as computer room air conditioners (CRACs) or computer room air handlers (CRAHs), are generally physically too large as well as providing too much cooling capacity. Such types of cooling devices consume excessive amount of energy, rendering them operationally inefficient.

Based on the foregoing discussion, there is a need for efficient and effective cooling of, for example, data centers.

SUMMARY

Described herein is an in-row cooling framework. In one embodiment, a cooling system is described. The cooling system includes a cooling system housing, a plurality of fan modules, a heat exchanger, and conduits. The cooling system housing has at least opposing front and rear sides. The plurality of fan modules has a plurality of fans, wherein fans of the fan modules are configured as smaller fans to fit on the rear side of the cooling system housing. The heat exchanger including a V-shaped coil is disposed within the cooling system housing. During operation, conduits facilitate circulating a cooling fluid through the heat exchanger. The plurality of fan modules creates improved air flow spread and the V-shaped coil produces increased surface area of the heat exchanger to increase cooling efficiency of the cooling system.

BRIEF DESCRIPTION OF THE DRAWINGS

A more complete appreciation of the present disclosure and many of the attendant aspects thereof will be readily obtained as the same becomes better understood by reference to the following detailed description when considered in connection with the accompanying drawings.

FIGS. 1a-e show various views of an exemplary in-row cooling system;

FIG. 2 shows a front interior schematic view of an exemplary in-row cooling system;

FIG. 3 shows an exemplary configuration in a data center;

FIG. 4 shows another exemplary configuration in a high-density data center;

FIG. 5 illustrates specifications of an exemplary in-row cooling unit;

FIG. 6 shows an exemplary control system; and

FIG. 7 shows an exemplary method of managing the in-row cooling system.

DETAILED DESCRIPTION

In the following description, numerous specific details are set forth such as examples of specific components, devices, methods, etc., in order to provide a thorough understanding of implementations of the present framework. It will be apparent, however, to one skilled in the art that these specific details need not be employed to practice implementations of the present framework. In other instances, well-known materials or methods have not been described in detail in order to avoid unnecessarily obscuring implementations of the present framework. While the present framework is susceptible to various modifications and alternative forms, specific embodiments thereof are shown by way of example in the drawings and will herein be described in detail. It should be understood, however, that there is no intent to limit the invention to the particular forms disclosed; on the contrary, the intention is to cover all modifications, equivalents, and alternatives falling within the spirit and scope of the invention. Furthermore, for ease of understanding, certain method steps are delineated as separate steps; however, these separately delineated steps should not be construed as necessarily order dependent in their performance.

A high-density in-row cooling system or cooler is described herein. In accordance with one aspect, the dimensions (e.g., height, depth, breadth) of the surface area for thermal exchange in the present cooling system are larger than typical systems so as to dramatically enhance cooling capacity for a given footprint. For example, a single form factor in-row cooling system may provide up to about 100 kW of sensible cooling at a footprint of 600×1200×2089. For example, the in-row cooling system may provide about 75 kW of sensible cooling. The cooling system may include a plurality of fans configured in multiple modules of fans, such as 9 modules. Providing multiple modules advantageously provides more modular spread across the surface area for improved cooling. This also advantageously enables repair with minimal interruption in service.

In accordance with another aspect, variable flow rates are controlled and monitored through the increased surface area to allow operation of the system with non-chilled water at, e.g., ambient temperature or 73° F., instead of chilled water. Advantageously, the cooling system does not require any compressors to chill the water, which makes it extremely energy efficient. The cooling system is able to utilize the higher temperature supply water and run the overall containment at a higher temperature, thus removing the requirement for a dedicated chilling plant that typically provides 45-60° F. chilled water. However, an existing chilled water source may also be used if desired to increase the capacity of sensible cooling. For example, about 100 kW of sensible cooling may be achieved with the use of chilled water.

Existing systems provide large perimeter computer room air conditioner/computer room air handler (CRAC/CRAH), air handling unit (AHU) and in-row cooling (IRC) up to 40 kW and consumes up to 30-40% of total data center power PUE (power usage effectiveness). Similar capacity may be obtained through multiple units, which increases the number of failure points. Unlike existing system, the present in-row cooling system advantageously provides high cooling capacity (up to 100 kW), small footprint, high energy efficiency (with no compressors) and special end-to-end method of manufacture, integration and distribution. These and other features and advantages will be described in more details herein.

FIGS. 1a-e show various views of an exemplary in-row cooling system or cooler 100. More particularly, FIG. 1a shows a front view and FIG. 1b shows a rear view of the exemplary in-row cooling system 100. The in-row cooling system 100 includes a housing that has a front panel 111, a rear panel 112, top, bottom and two side panels (not shown). A control panel 101 is provided for the cooling system. The control panel, for example, may be positioned on the front panel 111 for providing a user interface, such as a human machine interface (HMI), to display, access, manipulate and/or manage various control parameters (e.g., fan speed, temperature, control valve position). The control panel 101 may be, for example, a touchscreen interface that displays information and is responsive to user touch events. Other types of control panels are also useful. The housing may support various other components for cooling, such as a set of fan modules which includes a plurality of fans for moving air over a heat exchanger, sensors, a control system (not shown) for monitoring and managing various control parameters in response to, for example, user input and/or sensor feedback data to achieve precision and efficiency.

The front panel 101, for example, may be rotatably secured to the housing and pivotable about one or more stationary hinges, enabling it to open and close. As for the rear penal 112, it may include one or more hinged doors that are pivotable about stationary hinges to provide access to interior components. Accessing the interior components facilitate servicing and repairing of the cooling system. The front and rear panels may be opened to provide access for different internal components. For example, the front panel may be opened to provide access to the heat exchanger while the rear panel may be opened to provide access to the electrical panel, condensate pump, fan coil as well as other interior components. Other configurations of accessing the internal components may also be useful.

FIG. 1c shows a side perspective view of the exemplary in-row cooling system 100 with the side panel 102 in place and the rear panel 112 removed. FIG. 1d shows the same side view of the in-row cooling system 100 with the rear panel 112 and side panel 102 removed. In some implementations, a fan unit is provided at the rear of the housing. The fan unit includes, in one embodiment, a plurality of fan modules 104. A fan module, for example, may include a pair of fans. Providing a module with other number of fans, including a single fan, may also be useful. For example, a fan module may include more or less than 2 fans. In some embodiments, the fan modules may have different number of fans. For example, one or more fan modules of the fan unit may have two fans and one or more fan modules may have one fan.

In one embodiment, fan modules are configured to be modular. In one embodiment, the modules are configured to have a similar size such that fan modules can easily be swapped for repair as well as swapping for different fan number modules. For example, a 2-fan module can be swapped with two 1-fan modules or a 2-fan module and a 1-fan module can be swapped for a 3-fan module. The use of fan modules facilitates repair without interrupting operation of the cooling system. For example, the fan modules may be hot-swappable fan modules 104 which advantageously enable repair with minimum interruption in service. Furthermore, providing a plurality of fans or fan modules advantageously creates a more modular spread of air to improve cooling.

In addition, the fans have variable speeds, for example, 18 different speeds. Providing fans with other number of speeds may also be useful. For example, a fan may be ramped up from 0% to 100% of the fan's rpm capacity. In some implementations, the speeds of the fans are automatically monitored and controlled by a control system in response to sensor data feedback. This facilitates efficient operation of the cooling system. For example, higher or lower speeds may be configured for the fans base on sensor readings. Furthermore, different fans or fan modules may be controlled to be at different operating speeds based on sensor readings.

In one embodiment, the fan unit includes 18 fans. The 18 fans, for example, are provided by nine 2-fan modules 104. The fan modules 104 are arranged in row. For example, the fan modules are arranged in 3 rows of three 2-fan modules, with each 2-fan module arranged in a vertical direction. It should be appreciated that other configurations of fan modules may also be provided. In another embodiment, the fan unit includes 15 fans. For example, the fan unit may include 2 rows of three 2-fan modules, each arranged in the vertical direction, and 1 row of three 1-fan modules. Other configurations of fan units and fan modules may also be useful. Providing numerous smaller fans, for example, at least 10 fans and preferably at least 15, creates better spread of air which improves cooling as compared to conventional use of a single pair of larger fans.

Air from the external environment is drawn into the cooling system by fans 104. For example, hot air from an aisle of servers is drawn into the cooling system. The hot air passes through the heat exchanger 106 and is cooled. The cooled air exits the cooling system into an aisle, thereby cooling the aisle.

A cooling fluid circulates through the heat exchanger 106. In one embodiment, the cooling fluid circulates through the heat exchanger using a pump. In one embodiment, the pump is external to the cooling system. Providing a pump which is internal to the cooling system may also be useful. The cooling fluid, in one embodiment, includes water or processed water. For example, the cooling fluid may be condenser water. The cooling fluid, in some implementations, is at or processed at ambient temperature. The ambient temperature, for example, is at about 69 to 72° F. Unlike typical systems, the cooling system 100 is able to utilize the higher temperature supply water and runs the overall containment at a higher temperature, thus reducing the need for a dedicated chilling plant that provides chilled water, which typically is at about 45-60° F. Since chilled water is not required, the cooling system 100 is advantageously very energy efficient. Alternatively, the cooling system may employ chilled water as the cooling fluid. For example, the chilled water may be at 45-60° F. The use of chill water as the cooling fluid increases the capacity of sensible cooling.

FIG. 1e shows an interior perspective view of the in-row cooling system 100 with the front panel 111 and side panels removed. As shown, the cooling system includes conduits, such as pipes, which facilitate circulating the cooling fluid through the heat exchanger. In one embodiment, the conduits include a return conduit and an exit conduit. As shown, the return conduit includes an upper or first inlet 108. The upper inlet may be coupled to a cooling fluid supply with a return system via an outlet of the exit conduit. This, for example, forms a closed loop for circulating the cooling fluid through the heat exchanger. In one embodiment, the cooling fluid supply and return system are disposed external to the cooling system. This facilitates a compact cooling system. Other configurations of the cooling fluid supply and return system may also be useful. For example, the cooling fluid supply and/or return system may be internal to the cooling system.

In one embodiment, the return conduit may include a lower or second inlet 110. The lower inlet may serve as an alternate inlet to be coupled to an external cooling fluid supply. For example, the external cooling fluid supply may be disposed under the floor of the facility in which the unit is installed. The external cooling fluid supply may be coupled to the return system which is coupled to the outlet of the exit conduit. Other configurations of cooling fluid supply and return systems may also be useful.

The upper and lower inlet each includes an inlet control valve. The inlet control valve can be set in the opened or closed position using the control panel. Depending on the implementation, the control valves may be appropriately set. For example, if the upper inlet is used, the control valve for the upper inlet is set in the opened position while the control valve for the lower inlet is set in the closed position. The valves, for example, may be set based on the setting that is configured using the control panel or HMI. In some cases, both inlets may be active. For example, both inlets may provide cooling fluid to the cooling system.

FIG. 2 shows a front interior schematic view of an exemplary in-row cooling system 100. In some implementations, the heat exchanger 106 has a V-coil configuration to maximize cooling capacity. The V-coil configuration, as shown, includes two cooling plates 202a-b that are joined at an angle θ along a vertical edge 204 to form a V-shape. Preferably, the cooling plates are symmetrical. The angle θ may be about 60°-110°. Configuring the V-coil at other angles may also be useful. For example, θ may be less than 60° or greater than 110°. The opposing vertical edges 206a-b of the cooling plates 202a-b are separated by a predetermined distance A to form a V-shape in front of the fan modules 104. The distance A depends on angle θ. However, the distance A should be smaller than the footprint of the cooling system, enabling the heat exchanger to be contained therein.

The vertex of the V-shape, as shown, points towards the front of the in-row cooling system 100. For example, warm air is drawn in from the rear by the fans and directed to the heat exchanger. The warm air is cooled by the heat exchanger and exits the cooling system through the front. Each cooling plate 202a-b may include cooling fins to increase the surface area for heat transfer. The density of fins may be, for example, 14 fins per inch. Other densities are also useful. Variable flow rates of the cooling fluid through the increased surface area may be controlled and monitored by the control system in response to sensor data feedback.

Configuring the heat exchanger in a V-coil configuration increases surface area of the heat exchanger for a given footprint as compared to non-V-coil configurations, such as slanted or slab type coils. Increasing surface area of the heat exchanger improves cooling efficiency and capacity of the cooling system. In other embodiments, multiple cooling plates are provided and joined at angles, creating a coil with multiple V-grooves. For example, three cooling plates may be joined to form 2 V-grooves. Other number of cooling plates may also be useful. It is understood that the angles between different cooling plates need not be the same.

Controls, in one embodiment, are integrated into the cooling system unit for managing the cooling system unit. For example, controls may be provided to control the rate of fan speed and rate of water flow based on either the supply air (cold) temperature or the return air (warm) temperature. Based on the settings, the unit will increase or decrease the water flow rate and fan speed to maintain the desired operational conditions.

FIG. 3 shows an exemplary configuration 301 in a data center. The data center configuration 301 includes two in-row cooling systems 100a-b disposed within two respective rows of server cabinets 303a-f to provide localized cooling. Each in-row cooling system 100a-b occupies about 1.5× (e.g., 900 mm) of a standard 19 inch rack of row space without additional side clearance. The server cabinets 303a-f are designed to support heat generating electronic equipment, such as servers, processors, power units, etc. Although only two rows of server cabinets 303a-f are shown, it should be appreciated that the number of server cabinets may be increased or decreased depending on requirements.

The rows of server cabinets are arranged in such a manner that there are cold aisles and hot aisles. The cold aisles provide access to the front of the server cabinets, while the hot aisles provide access to the back of the server cabinets. Each in-row-cooling system 100a-b draws in warm exhaust air heated by the heat generating electronic equipment directly from a hot aisle, cools it to, for example, slightly below or at ambient temperature, and distributes it to a cool aisle.

FIG. 4 shows another exemplary configuration 401 in a high-density data center. Multiple in-row cooling systems (100a-d or 100e-h) are interspersed within each row of server cabinets (403a or b) to more efficiently cool the data center. More particularly, 4 in-row cooling systems (100a-d or 100e-h) are interspersed between server cabinets within each row of 25 server cabinets (403a or b). It should be appreciated that other types of configurations are also useful.

FIG. 5 illustrates specifications of an exemplary in-row cooling unit. More particularly, table 501 shows the operating specifications and table 502 shows the performance specifications for the exemplary in-row cooling unit with different entering water temperatures (EWT). Column 504 shows the performance at EWT=70° F., while column 506 shows the performance at EWT=72° F. It should be noted that the net capacity data has fan motor heat factored in for all ratings. Capacity data may be factory-certified with 5% tolerance. The data is rated with a standard MERV8 filter.

FIG. 6 shows an exemplary control system 600. The exemplary control system 600 may be incorporated in the in-row cooling system 100 described with reference to FIGS. 1a-e and 2. The control system includes a controller 601. The controller, for example, may include a processor unit 604, a storage unit 609 and input/output (I/O) unit 610. The storage unit may store a computer program for controlling and managing operation of the in-row cooling system of the data center. As for the I/O unit, it may include a display for displaying a user interface used in controlling and managing the in-row cooling system. The display may be a touch screen display with a soft keyboard for inputting information. In addition, the I/O unit may include a keyboard for inputting information. The control system communicates sensors 602, actuators 603 and client devices 613. The sensors may include, for example, temperature sensors, airflow sensors and coolant flow sensors as well as other types of sensors. As for the actuators, they may include control valves for the water supply and fan speed control as other types of actuators. Client devices may be devices which can connect and communicate with the control system.

FIG. 7 shows an exemplary method 700 of managing the in-row cooling system. It should be understood that the steps of the method 700 may be performed in the order shown or a different order. Additional, different, or fewer steps may also be provided. Further, the method 700 may be implemented with the system 600 of FIG. 6, a different system, or a combination thereof.

Initially, at step 702, data from various sensors in the data center is retrieved. For example, temperature data, airflow data, IT load data from the server rack power distribution units (PDUs). Based on the information retrieved, supply or return air temperature in the data center is controlled based on set points at step 704. The IT load in various zones of the data center can be determined based at step 706. The load can be determined based on the information retrieved. The IT load is determined based on various parameters, including time of day, percentage of CPU usage, and percentage of power consumption to actual usage. Basing IT load on other parameters may also be useful.

At step 708, the various in-row cooling units are configured to collaborate with each other to cool the data center. For example, the in-row cooling units may be linked together in what may be referred to as a teamwork mode. The in-row cooling units may be programmed based on IT load according to location and time of day. For example, different cooling units are programmed based on respective IT load according to location and time of day.

At step 710, the efficiency is measured with the instrumented IT load and other parameters against standard set point temperature performance.

Based on the results, at step 712, the settings of the in-row cooling units may be optimized to improve efficiency using the input and feedback from the control loop of the sensors and data. In one embodiment, in teamwork mode, the in-row cooling units may communicate with each other and adjust automatically based on the settings of each of the units to improve cooling efficiency based the selected temperature set points. The data center may be continuously monitored and adjusted to optimize efficiency.

In accordance with yet another aspect, a control system that manages the in-row cooler (IRC) is provided. The control system may include local and/or remote sensors that are mounted on-board to monitor temperature, humidity, and/or pressure differential (PD) of the supply air and/or return air. Additional remote wireless sensors may be mounted in front of server or rear of server rack (e.g., top, middle, bottom) to feedback data to the IRC. The control system may manage various parameters (e.g., fan speed, control valve position, compressor speed) in response to the sensor feedback data to achieve precision and efficiency. Fans may be decoupled from capacity (valve/compressor) control. The control system may be integrated with other systems (e.g., ZPE™ Systems console, NodeGrid Manager®). The control system may include automation logic and programmable controls (local and/or remote) and can be capable of remote control and monitoring. The control system may further be communicatively coupled via, e.g., Bluetooth, to client devices installed with a mobile App with a control interface.

While the present framework has been described in detail with reference to exemplary embodiments, those skilled in the art will appreciate that various modifications and substitutions can be made thereto without departing from the spirit and scope of the invention as set forth in the appended claims. For example, elements and/or features of different exemplary embodiments may be combined with each other and/or substituted for each other within the scope of this disclosure and appended claims.

Claims

1. A cooling system comprising: a cooling system housing having at least opposing front and rear sides;a plurality of fan modules having a plurality of fans, wherein fans of the fan modules are configured as smaller fans to fit on the rear side of the cooling system housing;a heat exchanger disposed within the cooling system housing, wherein the heat exchanger comprises a V-shaped coil;conduits for facilitating circulating a cooling fluid through the heat exchanger during operation; andwherein the plurality of fan modules creates improved air flow spread and the V-shaped coil produces increased surface area of the heat exchanger to increase cooling efficiency of the cooling system.