Patent Application
20100097751
The following disclosure relates generally to air conditioning systems and associated methods for cooling computer systems.
Supercomputers and other large computer systems typically include a large number of computer cabinets arranged in close proximity to one another.
Many of the electronic devices typically found in supercomputers, such as processors, generate considerable heat during operation. This heat can damage the electronic devices and/or degrade the performance of supercomputers if not dissipated. Consequently, supercomputers typically include both active and passive cooling systems to maintain device temperatures at acceptable levels.
To dissipate heat generated by the computer modules 112, the supercomputer system 100 further includes a plurality of fans 120 mounted to upper portions of corresponding computer cabinets 110. In operation, each of the fans 120 draws cooling air into the corresponding computer cabinet 110 through a front inlet 114 and/or a back inlet 115 positioned toward a bottom portion of the computer cabinet 110. The cooling air flows upward through the computer cabinet 110, past the computer modules 112, and into a central inlet 122 of the fans 120. The fans 120 then exhaust the cooling air outward in a radial pattern through a circumferential outlet 124.
As the power consumption of the electronic devices increases, the computer modules 112 in the module compartments 118 heat the incoming cooling air to higher temperatures. Conventional techniques for dealing with the higher temperatures of the cooling air entering subsequent module compartments 118 include increasing the air flow rate through the individual computer cabinets 110. The higher air flow rate, however, increases the pressure drop over the computer modules 112, and the fans 120 may be unable to compensate for the increased pressure drop. As a result, the cooling air flowing past the computer modules 112 may be insufficient to prevent overheating, which may adversely affect the performance of the computer system 100.
The following disclosure describes several embodiments of air-cooled systems and associated methods for cooling computer systems. Other embodiments of the invention can have different configurations, components, or procedures than those described below. A person of ordinary skill in the art, therefore, will accordingly understand that the invention can have other embodiments with additional elements, or the invention can have other embodiments without several of the features shown and described below with reference to
In the Figures, identical reference numbers identify identical or at least generally similar elements. To facilitate the discussion of any particular element, the most significant digit or digits of any reference number refer to the Figure in which that element is first introduced. Element 202, for example, is first introduced and discussed with reference to
Many features of the computer cabinet 210 can be at least generally similar in structure and function to corresponding features of the computer cabinet 110 described above with reference to
The computer cabinet 210 can also include an air mover assembly 202 positioned toward the bottom portion of the computer cabinet 210 to drive cooling air through the computer cabinet 210. The air mover assembly 202 can include an air mover 220 attached to a mounting plate 230 that includes an outlet opening 204 positioned proximate to the air mover 220. In one embodiment, the air mover 220 can include a vane-axial blower. In other embodiments, the air mover 220 can include a centrifugal fan, an axial fan, and/or other types of suitable air moving devices known in the art. In further embodiments, the air mover assembly 202 may be positioned toward the top portion of the computer cabinet 210.
The airflow restrictor 206 can be positioned proximate to the air outlet 224 on the computer cabinet 210. The airflow restrictor 206 can include a panel or planar member (e.g., a plate, a sheet, and/or other suitable panel or cover member) having one or more open portions 203 (two are shown for purposes of illustration) proximate to a plurality of restricted portions 205. An enlarged plan view of the airflow restrictor 206 is illustrated in
As described in greater detail below, the open portions 203 can be aligned, or at least generally aligned with airflow passageways through the computer cabinet 210 in which processors and/or other high-power microelectronic devices are located. Conversely, the restricted portions 205 can be aligned, or at least generally aligned with other passageways in which memory modules, network interface modules, and/or other low-power microelectronic devices are located. As used hereinafter, the phrases “high-power” and “low-power” are generally relative terms. For example, a memory module may be considered a high-power device because its power consumption is higher than, e.g., a network interface module, but may also be considered a low-power device because its power consumption is lower than, e.g., a processor. As a result, the memory module may be a high-power microelectronic device in one arrangement, but a low-power microelectronic device in a different arrangement.
Optionally, the computer cabinet 210 can include an inlet heat exchanger 222 positioned between the air mover assembly 202 and the first module compartment 218a. The inlet heat exchanger 222 can be configured to receive a coolant (e.g., a refrigerant, water, etc.) from an external source (not shown) that absorbs heat from the incoming cooling air. As a result, the cooling air can enter the first module compartment 218a at a desired temperature. One suitable inlet heat exchanger 222 is disclosed in U.S. patent application Ser. No. 10/805,875, the disclosure of which is incorporated herein by reference in its entirety. In other embodiments, the inlet heat exchanger 222 can include a plate-and-frame heat exchanger, a tube-and-shell heat exchanger, and/or other suitable types of heat exchanger. In certain embodiments, the inlet heat exchanger 222 can operate continuously. In other embodiments, the inlet heat exchanger 222 can operate intermittently; for example, when a temperature in the room 201 exceeds a threshold temperature (e.g., 80° C.). In further embodiments, the inlet heat exchanger 222 may be omitted.
The computer cabinet 210 can also optionally include one or more sensors (not shown) for monitoring operating conditions of the computer modules 212. For example, the computer cabinet 210 can include one or more temperature sensors (e.g., thermocouples, resistive temperature detectors, infrared temperature monitors, etc.), flow sensors (e.g., flow switches and flow transmitters), pressure sensors (e.g., pressure switches, pressure transmitters, etc.), and/or other types of sensors capable of measuring parameters indicative of operating conditions of the computer modules 212. For instance, the computer cabinet 210 can include thermocouples (not shown) positioned in each module compartment 218 to monitor operating temperatures inside the computer cabinet 210. In another embodiment, the computer cabinet 210 can include a flow transmitter (not shown) positioned toward the top portion of the computer cabinet 210 to measure the flow rate of cooling air through the top portion.
As shown in
Each of the first and second heat exchanging portions 242a and 242b can include a plurality of heat exchanging elements 243 arranged in a generally parallel fashion between an inlet header 248 and an outlet header 249. The inlet header 248 can be configured to receive a circulating coolant (e.g., a refrigerant, water, etc., (not shown)) from an external heat removal system (e.g., a cooling tower, not shown). The outlet header 249 can be configured to return the coolant to the external heat removal system after the coolant flows through the heat exchanging elements 243. Embodiments of the first and second heat exchanging portions 242a and 242b and the heat exchanging elements 243 having fins and passage portions are described in more detail below with reference to
The overhead heat exchanger 240 can optionally include a flow element 250 for redistributing cooling air in the overhead heat exchanger 240. For example, in the illustrated embodiment, the flow element 250 includes a diffuser 251 having an inlet 252a positioned to receive air from the air outlet 224 of the computer cabinet 210, and outlets 252b, 252c that open into the enclosed space 246. The inlet 252a and the outlets 252b, 252c are generally perpendicular to each other. In other embodiments, the overhead heat exchanger 240 can also include baffle plates, static mixers, orifice plates, and/or other suitable device and structures for distributing air into the enclosed space 246.
Referring to
As explained above, the airflow restrictor 206 can modify the flow pattern of cooling air flowing through individual passageways in the computer cabinet 210. As a result, the cooling air can efficiently absorb the heat from the computer modules 212 without causing the computer modules 212 in the upper module compartments (e.g., the second and third module compartments 218b and 218c) to overheat, as described in more detail below with reference to
The overhead heat exchanger 240 with the enclosed space 246 and the optional flow element 250 can at least partially homogenize velocities and/or temperatures of the cooling air streams exiting the computer cabinet 210 through the airflow restrictor 206. For example, the flow element 250 can change a flow direction of the cooling air streams into the enclosed space 246. The enclosed space 246 can include a sufficiently large cross sectional area such that the combination of the enclosed space 246 and the optional flow element 250 can reduce the velocities of the air streams (e.g., high-power air streams) leaving the airflow restrictor 206. The enclosed space 246 can also provide a sufficiently large residence time such that the combination of the enclosed space 246 and the optional flow element 250 can promote adequate mixing of the air streams with one another in the overhead heat exchanger 240 to reach a generally uniform temperature. As a result, the cooling air streams can have a generally uniform temperature and/or velocity profile when approaching the heat exchanging elements 243.
The overhead heat exchanger 240 can then remove the heat from the cooling air before discharging the cooling air into the room 201. In the illustrated embodiment, the overhead heat exchanger 240 receives a coolant (e.g., a refrigerant, water, etc.) from an external coolant source (not shown) via the inlet header 248. The inlet header 248 distributes the coolant to the heat exchanging elements 243. The coolant (represented by arrows 231) flows across the heat exchanging elements 243 to the outlet header 249. As the coolant flows through the heat exchanging elements 243, cooling air (represented by arrows 229) flows past the heat exchanging elements 243, and the coolant absorbs heat from the cooling air. In one embodiment, the coolant is a partially vaporized, two-phase refrigerant (e.g., R134a). In other embodiments, the coolant includes a single-phase liquid or gas when flowing across the heat exchanging elements 243. The outlet header 249 then collects and discharges the coolant to the external coolant source and the cycle repeats.
Several embodiments of the computer cabinet 210 can efficiently remove heat from the computer modules 212 without using a refrigerated coolant, or with a reduced requirement for a refrigerated coolant. The term “refrigerated coolant” as used herein generally refers to a coolant at a temperature lower than that achievable using an atmospheric cooling tower. Without being bound by theory, it is believed that as the cooling air flows through the module compartments 218, the temperature of the cooling air increases, and thus the heat capacitance of the cooling air decreases. As a result, the temperature of the third module compartment 218c can be higher than that of the first and second module compartments 218a-b. This temperature gradient requires either an increased amount of cooling air flow or lower cooling air temperatures to adequately cool the computer modules 212 in the third module component 218c. One system utilizes intercoolers placed between adjacent module compartments 218 to reduce the temperature of the cooling air entering the second and third module compartments 218b and 218c. However, such intercoolers may not efficiently remove heat from the cooling air without a refrigerated coolant because the heat flux in the cooling air may be small after flowing through one of the module compartments 218. As a result, a refrigeration unit is typically needed to provide the refrigerated coolant in order to provide a sufficiently large temperature differential between the coolant and the cooling air for adequately removing heat from the cooling air. The refrigeration unit, however, consumes a considerable amount of energy in operation, and thus may be environmentally unfriendly. Another drawback of utilizing intercoolers is that the cooling air may bypass certain portions of the intercoolers and adversely affect computer modules 212 in a subsequent module compartment 218.
In one embodiment, the combination of the overhead heat exchanger 240 and the airflow restrictor 206 can sufficiently cool computer modules 212 in the computer cabinet 210 without utilizing intercoolers. As a result, the cooling air carries a greater heat flux and an increased caloric rise per unit volume of cooling air than a conventional system when the cooling air enters the overhead heat exchanger 240. The greater heat flux in the cooling air allows the coolant flowing through the overhead heat exchanger 240 to have a higher inlet temperature at the inlet header 248 than in a conventional system while still providing a sufficient temperature differential between the coolant and the cooling air. As a result, a refrigeration unit may not be needed to cool the coolant flowing in the inlet header, or may only be intermittently needed for this purpose. Accordingly, several embodiments of the computer system 200 can operate in an environmentally friendly fashion by reducing its power consumption.
In other embodiments, the overhead heat exchanger 240 can also improve the heat transfer efficiency between the heated air from the computer cabinet 210 and the coolant flowing through the heat exchanging elements 243, such that the computer cabinet 210 can be at least approximately “room neutral.” The term “room neutral” generally refers to drawing the cooling air from the room 201 and discharging the air to the room 201 at the same, or approximately the same, temperature. Without being bound by theory, it is believed that high velocities of the heated air flowing through the overhead heat exchanger 240 may result in temperature gradients between and/or within certain components (e.g., fins and/or passage portions) of the heat exchanging elements 243. For example, it is believed that a temperature gradient may exist between the fins 406 (
Even though the airflow restrictor 206 is used in the computer cabinet 210 for modifying the flow profile of the cooling air, in other embodiments, the computer cabinet 210 can also include other types of components for increasing the flow rates in the high-power passageways. For example, the computer cabinet 210 can also include louvers, dampers, valves, and/or other flow elements between individual module compartments 218 for modulating flow rates in the computer cabinet 210, or the restrictor 206 can be omitted.
The individual computer modules 212a-c can include a motherboard 301 with a plurality of dividers 316 that separate the computer modules 212a-c into discrete regions 312 (identified individually as first to fifth regions 312a-e, respectively). Each region 312 can hold various types of microelectronic devices. For example, in the illustrated embodiment, the motherboard 301 carries memory modules 314, network interface modules 315, and/or other suitable low-power microelectronic devices in the first, third, and fifth regions 312a, 312c, and 312e, respectively (hereinafter referred to as the “low-power regions”). The motherboard 301 also carries processors with cooling fins 317 and/or other high-power microelectronic devices in the second and fourth regions 312b and 312d, respectively (hereinafter referred to as the “high-power regions”). In other embodiments, the motherboard 301 can have the dividers 316 in other arrangements and/or can carry different microelectronic devices in at least one of the regions 312a-e.
The individual computer modules 212a-c can also include a plurality of shrouds (not shown) corresponding to one or more of the individual regions 312a-e. The shrouds and the dividers 316 together form airflow passageways 302 (identified individually as first to fifth passageways 302a-e, respectively) generally corresponding to each of the regions 312. For example, the first, third, and fifth passageways 302a, 302c, and 302d (hereinafter referred to as “low-power passageways”) generally correspond to the low-power regions. The second and fourth passageways 302b and 302d (hereinafter referred to as “high-power passageways”) generally correspond to the high-power regions. In the illustrated embodiment, the passageways 302 of the computer modules 212a-c are generally aligned vertically in the computer cabinet 210. In other embodiments, the passageways 302 of individual computer modules 212a-c may be offset from one another or may be aligned in other directions.
In the illustrated embodiment, the airflow restrictor 206 is positioned adjacent to the third computer module 212c and the outlet 224. In this embodiment, the open portions 203 are generally aligned with the high-power passageways, and the restricted portions 205 are generally aligned with the low-power passageways. In other embodiments, other correspondence can be used, e.g., in certain embodiments, at least one of the open portions 203 can be generally aligned with at least one of the low-power passageways.
In operation, the air mover assembly 202 (
As the cooling air flows through the third module compartment 218c, the airflow restrictor 206 can restrict the low-power air streams more than the high-power air streams. For example, as shown in
Without being bound by theory, it is believed that the airflow restrictor 206 can thus increase the mass flow rates and velocities of the high-power air streams with increasing velocities and mass flow rates generally corresponding to (e.g., proportional to) the increase in air temperature past the computer modules 212, while decreasing the flow rates of the adjacent low-power air streams. For example, as the low-power air streams leave the second module compartment 218b, the restricted portions 205 increase the pressure drop in the low-power air streams through the airflow restrictor 206 and force a portion of the cooling air to flow laterally (as indicated by arrows 223) through the second gap 217b into the high-power passageways. As a result, the high-power air streams have higher mass flow rates entering the third module compartment 218c and higher velocities flowing past the third computer module 212c than those entering the second module compartment 218b. The higher mass flow rates and velocities are believed to improve heat transfer efficiency between the computer modules 212 to the cooling air.
In several embodiments of the computer system 200, by restricting a portion of the cooling air exiting the computer cabinet 210 and allowing cross-mixing of cooling air between adjacent module compartments 218 as disclosed herein, the amount of cooling air supplied to the high-power passageways of the third computer module 212c can be increased without significantly increasing the pressure drop across the computer cabinet 210. Furthermore, the airflow restrictor 206 can also drive a portion of the cooling air to flow laterally (as indicated by arrows 225) through the first gap 217a into the high-power passageways of the second computer module 212b. As a result, the high-power air streams flowing into the third module compartment 218c can have increased mass flow rates and velocity as the cooling air flows from one module compartment 218 to the next. As a result, the high-power air streams can sufficiently cool the third computer module 212c without requiring inter-cooling between the module compartments 218.
Even though the computer cabinet 210 is shown in
The heat exchanging elements 243 can also include a plurality of fins 406 extending between adjacent passage portions 404. In one embodiment, the fins 406 can be convoluted or corrugated to form air flow passages for the cooling air to flow through. In other embodiments, the fins 406 can be eliminated, and the passage portions 404 can be separated by spacers. In a further embodiment, the space between the passage portions 404 can be entirely open. One embodiment of the passage portion 404 is described in more detail below with reference to
In operation, the coolant (represented by arrow 403a) enters the overhead heat exchanger 240 through the inlet port 402a. The inlet header 248 distributes the coolant to the passage portions 404. The coolant (represented by arrow 231) flows across the passage portions 404 to the outlet header 249. As the coolant flows through the passage portions 404, cooling air (represented by arrow 229) flows through the fins 406 and past the passage portions 404. The coolant absorbs heat from the cooling air as the coolant flows across the passage portions 404. In one embodiment, the coolant is a partially vaporized, two-phase refrigerant. As a result, the coolant has an at least approximate constant temperature across the length L of the passage portions 404. In other embodiments, the coolant can have a single phase when flowing across the passage portions 404. The outlet header 249 then collects and discharges the coolant (represented by arrow 403b) from the outlet port 402b to the external coolant source.
Even though the heat exchanging elements 243 are shown to have one layer of passage portions 404, in other embodiments, the heat exchanging elements 243 can have two, three, or any desired number of layers of passage portions 404 between the inlet header 248 and the outlet header 249. In further embodiments, the heat exchanging elements 243 can have two, three, or any desired number of layers of passage portions 404 individually coupled to corresponding inlet and outlet headers (not shown). In further embodiments, other types of heat exchanges can be used. Accordingly, the present invention is not limited to the particular embodiments of heat exchangers disclosed herein, but includes other types of heat exchangers known in the art.
In certain embodiments, the first and second heat exchanging assemblies 840a and 840 can be coupled to the same external coolant supply (not shown). In other embodiments, the first heat exchanging assembly 840a can be coupled to a first external coolant supply (not shown), and the second heat exchanging assembly 840b can be coupled to a second external coolant supply (not shown) different from the first external coolant supply. In operation, if one of the first and second external coolant supplies fails, the other can still supply a coolant to one of the first and second heat exchanging assemblies 840a and 840 for removing heat from the cooling air exiting the air outlet 224 of the computer cabinet 210. As a result, the computer modules 212 in the computer cabinet 210 can continue to operate, and thus the impact of the operational upset can be at least ameliorated.
In the illustrated embodiment, the overhead heat exchanger 840 includes a diffuser 850 between the first heat exchanging assembly 840a and the air outlet 224 of the computer cabinet 210. The diffuser 850 includes a panel or planar member (e.g., a plate, a sheet, and/or other suitable panel or cover member) having a plurality of apertures 853. In other embodiments, the diffuser 850 can include slots, channels, other types of perforations, and/or other components suitable for modifying a flow pattern of the cooling air exiting the computer cabinet 210 through the airflow restrictor 206. In further embodiments, the overhead heat exchanger 840 can also include another diffuser (e.g., generally similar to or structurally different from the diffuser 850, not shown) between the first and second heat exchanging assemblies 840a and 840b. In yet further embodiments, the diffuser 850 can be omitted.
Even though the overhead heat exchanger 840 is shown in
From the foregoing, it will be appreciated that specific embodiments of the invention have been described herein for purposes of illustration, but that various modifications may be made without deviating from the spirit and scope of the invention. For example, although elements of the invention described above have been presented in one or more arrangements, in other embodiments, other arrangements are possible depending on the particular situation. Further, while advantages associated with certain embodiments of the invention have been described in the context of those embodiments, other embodiments may also exhibit such advantages, and not all embodiments need necessarily exhibit such advantages to fall within the scope of the invention. Accordingly, the invention is not limited, except as by the appended claims.
