The following disclosure relates generally to cooling systems for use with computer systems.
Supercomputers and other large computer systems typically include a large number of computer cabinets arranged in close proximity to each other.
Many of the electronic devices typically found in supercomputers, such as fast processing devices, can generate considerable heat during operation. This heat can damage the device and/or degrade performance if not dissipated during operation. To dissipate this heat and maintain device temperatures at acceptable levels, the prior art supercomputer system 100 further includes a plurality of fans 120 mounted to upper portions of corresponding computer cabinets 110. In operation, each of the fans 120 draws cooling air into the corresponding computer cabinet 110 through a front inlet 114 and/or a back inlet 115 positioned toward a bottom portion of the computer cabinet 110. The cooling air flows upwardly through the computer cabinet 110, past the computer modules 112, and into the fan 120. The cooling air then flows out of the fan 120 and into the surrounding room.
One problem associated with the prior art supercomputer system 100 is the uneven distribution of heat in the computer cabinet 110. For example, the different computer modules 112 typically carry different arrangements of electronic devices depending on the particular application. The different devices can operate at different temperatures due to their varying power consumption. As a result, as the cooling air flows past the computer modules 112, high-power devices transfer more heat to the cooling air than low-power devices. The uneven heat transfer causes the cooling air to have uneven temperature profiles in the computer cabinet 110. As a consequence, the high temperature cooling air may not sufficiently cool some of the electronic devices due to its reduced heat capacitance.
One example of a conventional technique for improving cooling in a computer system uses a re-circulating water cooling system.
In operation, heat flows from the processing device 232 into the water circulating through the heat exchanger 238. The pump 241 moves the heated water from the heat exchanger 238 to the radiator 240. The fan 244 moves cooling air through the radiator 240 to cool the heated water. The pump 241 then re-circulates the cooled water back to the heat exchanger 238 via the water line 242a in a continuous cooling cycle.
There are a number of shortcomings associated with the re-circulating type water cooling system described above. For example, the heat exchanger 238 and the radiator 240 occupy a considerable amount of space in the housing 234. As a result, the housing 234 might not be able to accommodate additional processing devices if desired. Furthermore, the heat exchanger/radiator combination does not address the problem of uneven heat distribution. Consequently, some locations in the housing 234 might be at higher temperatures than others because of the arrangement of different heat-generating devices (e.g., video cards or memory chips) on the computer module 236.
The following disclosure describes several embodiments of cooling systems for use with computers and other systems. One aspect of the invention is directed toward a computer system having a first computer module spaced apart from a second computer module to define a space therebetween. The first computer module carries an electronic device. The computer system further includes a cooling system positioned in the space between the first and second computer modules. The cooling system can include a first heat exchanging portion containing a working fluid that absorbs heat from the electronic device. The cooling system can further include a second heat exchanging portion that receives the heated working fluid from the first heat exchanging portion to cool the heated working fluid. In one embodiment, a fluid mover is operably coupled to the first and second heat exchanging portions to circulate the working fluid through the first and second heat exchanging portions.
Another aspect of the invention is directed toward a computer module assembly positioned in a cabinet. The computer module assembly includes an electronic device mounted to a substrate. The computer module assembly further includes a cooling system having a first heat exchanging portion positioned at least proximate to the electronic device and containing a working fluid that absorbs heat from the electronic device. The cooling system further includes a second heat exchanging portion positioned in an air flow path in the cabinet. The second heat exchanging portion receives the heated working fluid from the first heat exchanging portion to cool the heated working fluid in the air flow path. In one embodiment, a fluid mover is operably coupled to the first and second heat exchanging portions to circulate the working fluid through the first and second heat exchanging portions.
A further aspect of the invention is directed toward a method for cooling an electronic device mounted to a first computer module in a cabinet. The method includes positioning a first heat exchanger proximate to the electronic device and a second heat exchanger in the space between the first computer module and a second computer module. The method further includes moving a working fluid through the first heat exchanger to absorb heat from the electronic device, and then moving the working fluid through the second heat exchanger to transfer heat from the working fluid to air flowing past the second heat exchanger.
Specific details of several embodiments of the invention are described below with reference to
In the Figures, identical reference numbers identify identical or at least generally similar elements. To facilitate the discussion of any particular element, the most significant digit or digits of any reference number refer to the Figure in which that element is first introduced. Element 300, for example, is first introduced and discussed with reference to
The computer module 300 can include a substrate 303 (e.g., a motherboard) carrying various types of electronic devices including, for example, high-power processing devices 304 (identified individually as processing devices 304a-d), low-power processing devices 306 (identified individually as processing devices 306a-d), memory devices 308 (identified individually as memory devices 308a-b), other devices (identified individually as other devices 310a and 310b, e.g., modems, soundcards, etc.), and terminal blocks 312. The high-power processing devices 304 can include, for example, high speed processors and/or other types of processors. The low-power processing devices 306 can include, for example, signal processors, A/D converters, transmitters, etc. The memory devices 308 can include, for example, DRAM, SRAM, or other types of volatile or non-volatile memory devices. In the illustrated embodiment, the processing devices 304 and 306 are positioned toward one end of the substrate 303, and the memory devices 308 are positioned toward the other end of the substrate 303. In other embodiments, the various devices on the substrate 303 can have other arrangements.
In one aspect of this embodiment, each of the low-power processing devices 306 and each of the memory devices 308 can include a plurality of corresponding fins 309 (identified as fins 309a-f) for dissipating heat. The fins 309a, for example, project outwardly from the memory device 308a and into a flow of cooling air. The fins 309a absorb heat generated by the memory device 308a during operation via conduction and transfer the heat to the cooling air 301. The fins 309 can be constructed from any suitable material known in the art including, for example, aluminum, copper, steel, iron, and/or any other suitable material.
In another aspect of this embodiment, the cooling system 302 is mounted to the substrate 303 for cooling the high-power processing devices 304. The cooling system 302 can include a fluid reservoir 314 connected in series to a fluid mover 316, a first heat exchanging portion 318, and a second heat exchanging portion 320 to form a closed-loop circulation system. The working fluid (not shown) in the cooling system 302 can be a liquid (e.g., water, glycol, aqueous ammonia, etc.), a gas, a two-phase fluid such as, for example, a refrigerant (e.g., R134a), etc.
In the illustrated embodiment, the reservoir 314 includes an inlet 313a, an outlet 313b, and, optionally, a vent (not shown) for relieving internal pressure. The reservoir 314 can be constructed from any suitable material including, for example, aluminum, copper, steel, iron, plastic, glass, and/or any other suitable material known in the art. Although not shown, the reservoir 314 can optionally be insulated with types of material including, for example, alumina, asbestos, glass, cotton, wood, polymers, silica, etc.
The fluid mover 316 can include an inlet 315a connected to the outlet 313b of the reservoir 314, and an outlet 315b connected to the first heat exchanging portion 318. In the illustrated embodiment, the fluid mover 316 can include a pump, such as a positive displacement pump (e.g., Model No. GP-10) manufactured by Mesoscopic Devices LLC, of Broomfield, Colo., or a micro gear pump (e.g., Model No. MZR®-2942) manufactured by HNP Mikrosysteme of Germany. In other embodiments, however, the fluid mover 316 can include other types of devices for moving the working fluid through the cooling system 302. Such devices can include, for example, a blower, a compressor, a fan, etc.
In the illustrated embodiment, the first heat exchanging portion 318 is positioned at least proximate to the high-power processing devices 304 to absorb heat from these devices. The first heat exchanging portion 318 can include a plurality of first heat exchangers 317 (e.g., first heat exchangers 317a-d) arranged in a generally parallel fashion between a first inlet header 322a and a first outlet header 322b. The first inlet header 322a is connected to the outlet 315b of the fluid mover 316 to receive working fluid from the reservoir 314. The first heat exchangers 317 can have any suitable fluid heat exchanger configuration including, for example, a shell-and-tube configuration, a plate-and-frame configuration, a tube-and-fin configuration, and/or a heat conducting passage configuration (e.g., micro-channels). One embodiment of the first heat exchangers 317 is described in more detail below with reference to
The second heat exchanging portion 320 is positioned in the air flow path 301 to distribute the heat flux across the surface of the computer module 300. The second heat exchanging portion 320 can include a second heat exchanger 319 extending between a second inlet header 324a and a second outlet header 324b. The second inlet header 324a is in fluid communication with the first outlet header 322b to receive heated working fluid from the first heat exchanging portion 318. The second outlet header 324b is in fluid communication with the reservoir 314 to transfer cooled working fluid to the reservoir 314. In one embodiment, the second heat exchanging portion 320 can be positioned adjacent to the first heat exchanging portion 318 as shown in
In another aspect of this embodiment, the second heat exchanging portion 320 is positioned in the air flow path 301 so that at least a portion of the cooling air flowing past the computer module 300 flows through the second heat exchanging portion 320. In the illustrated embodiment, for example, a substantial portion of the cooling air flows through or across the second heat exchanging portion 320. In other embodiments, however, a smaller portion of the cooling air can flow through or across the second heat exchanging portion 320.
In operation, the fluid mover 316 draws working fluid from the reservoir 314 and moves the working fluid to the first heat exchanging portion 318. The working fluid enters the first heat exchangers 317a-d via the first inlet header 322a and flows across first heat exchangers 317a-d toward the first outlet header 322b (as indicated by arrow A). As the working fluid flows across the first heat exchangers 317a-d, the working fluid absorbs heat from the high-power processing devices 304a-d via, e.g., conduction and/or forced convection. In one embodiment, the working fluid can be a liquid (e.g. refrigerant R134, ammonia, Freon, etc.) that can at least partially vaporize after absorbing heat from the high-power processing devices 304. One advantage of using a partially vaporizing working fluid is that the working fluid can be at a constant temperature, or at an at least approximately constant temperature during heat exchange because the absorbed heat supplies the latent heat of vaporization to the working fluid. In other embodiments, the working fluid can be a vapor (e.g., nitrogen, argon, carbon dioxide, etc.) or a non-vaporizing liquid (e.g., water, oil, etc.) after absorbing heat from the high-power processing devices 304.
The heated working fluid flows from the first heat exchanging portion 318 into the second heat exchanging portion 320 via the second inlet header 324a. The working fluid flows across the second heat exchanger 319 toward the second outlet header 324b (as indicated by arrow B). As the working fluid flows across the second heat exchanger 319, the cooling air 301 flowing through and/or across the second heat exchanger 319 cools the working fluid. In one embodiment, the working fluid can be at least partially vaporized (i.e., a two-phase fluid) at the second inlet header 324a, and can be at least substantially condensed upon reaching the second outlet header 324b. In another embodiment, the working fluid can be sub-cooled at the second outlet header 324b. In a further embodiment, the working fluid can be a two-phase fluid at the second inlet header 324a and the second outlet header 324b, and the reservoir 314 can separate the working fluid into a liquid phase and a vapor phase. In all these embodiments, the cooled working fluid returns to the reservoir 314 and the fluid mover 316 re-circulates at least a portion of the working fluid in the manner described above in a continuous cooling cycle.
There are a number of advantages associated with the embodiments of the cooling system 302 described above. One advantage is that the cooling system 302 can achieve more efficient heat dissipation from the high-power processing devices 302 than simple air cooling because the second heat exchanging portion 320 provides additional heat transfer area. Another advantage is that the second heat exchanging portion 320 can spread heat flux length-wise and width-wise across the air flow path 301. Without being bound by theory, in one embodiment, it is believed that the heat flux can be at least approximately constant across substantially the entire length L of the computer module 300 when the working fluid is partially vaporized in the second heat exchanging portion 320. As is known, heat flux (Q) is proportional to flow rate (F), heat capacity (Cp), and temperature differential (ΔT) between a hot stream and a cold stream as shown in the following formula:
Q=F×Cp×ΔT
The hot stream in this example (i.e., the working fluid) is at an at least approximately constant temperature because the working fluid is, in this embodiment, a two-phase fluid. Thus, as the working fluid flows across the second heat exchanging portion 320, an at least approximately constant temperature differential between the working fluid and the cooling air is believed to be achieved along the length L and the width W of the space. As a result, the heat flux is at least approximately evenly distributed along the length L and the width W. Consequently, the flow of cooling air can have a substantially even temperature profile after flowing through the second heat exchanging portion 320. In other embodiments, however, the methods and systems disclosed herein can be used in different ways to achieve different results.
Although the illustrated embodiment shows a closed-loop arrangement, in other embodiments, the cooling system 302 can have an open-loop arrangement or a closed-loop arrangement with purging. For example, in another embodiment, the cooling system 302 can include a purge port and a make-up port (not shown) at suitable locations along the circulation loop. The working fluid can be purged from the cooling system 302 via the purge port and replenished via the make-up port at substantially the same rate. In another embodiment, the cooling system 302 can include additional devices including, for example, filtration devices (e.g., filters, strainers, etc.), sensors (e.g., pressure and temperature transmitters, gauges, etc.), valves (e.g., block valves, pressure relief valves, control valves, etc.), and other suitable devices. Accordingly, the present invention is not limited to the particular closed-loop cooling arrangement shown in
Although the illustrated embodiment shows the first heat exchanging portions 318 positioned adjacent and/or proximate to corresponding high-power processing devices 304, in other embodiments, the first heat exchanging portions 318 can be positioned at least proximate to the high-power processing devices 304 and the low-power processing devices 306, or proximate to all the electronic devices carried by the computer module 300. Accordingly, the present invention is not limited to positioning the first heat exchanging portion 318 proximate to the high-power processing devices 304 in the particular arrangement of
In one aspect of this embodiment, multiple computer modules 300 are positioned side-by-side and separated by a space between each pair. The space can have a length L approximately equal to the length of the substrate 303 and a width W approximately equal to the distance between the adjacent computer modules. In the cabinet configuration of
In another aspect of this embodiment, the computer cabinet 410 can optionally include air coolers or intercoolers 402 (identified individually as 402a and 402b) positioned proximate to (e.g., above and/or below) the computer module 300 in the air flow path 301. The air coolers 402 are shown schematically in
In operation, the flow of cooling air in the air flow path 301 absorbs heat from the working fluid flowing through the second heat exchanging portion 320. The heated cooling air then passes through the second air cooler 402b. The coolant circulating through the second air cooler 402b absorbs heat from the cooling air and reduces the corresponding air temperature. The cooled air can then flow into an adjacent (e.g., “upstream”) module compartment and past additional computer modules positioned in the computer cabinet 410.
One advantage associated with the embodiment of the cooling system 302 described above is the increased efficiency of heat transfer between the cooling air and the second air cooler 402b. For example, after passing through the second heat exchanging portion 320, the cooling air has an at least approximately even temperature profile along the length L of the computer module 300. As a result, the heat flux flowing from the cooling air to the second air cooler 402b is at least substantially constant along the length L of the computer module 300. The substantially constant heat flux can reduce inconsistent heat transfer and undesirable bypass between the cooling air and the coolant in the second air cooler 402b, and thus improve overall cooling efficiency in the computer cabinet 410.
In the illustrated embodiment, the air coolers 402 span across at least a substantial portion of the entire computer module compartment of the computer cabinet 410. In other embodiments, the air coolers 402 can have other sizes, or can be omitted. In still further embodiments, more or fewer air coolers, computer modules, etc., can be used. Accordingly, the present invention is not limited to the particular air cooler/computer module arrangement shown in
In one aspect of this embodiment, each of the passage portions 501 can include a generally flat plate having one or more internal channels (e.g., micro-channels, not shown) through which working fluid flows. The channels can have any suitable configuration including, for example, straight-through, serpentine, and/or any other desired configuration. One embodiment of the passage portions 501 includes micro-channels having internal corrugated fins as described in more detail below with reference to
In operation, the working fluid (represented by arrow 510a) enters the first inlet header 322a via the first inlet port 506a. The first inlet header 322a distributes the working fluid to each of the passage portions 501a-d. The working fluid (represented by arrows 510b) then flows through the passage portions 501a-d to reach the first outlet header 322b. While flowing through the passage portions 501, the working fluid absorbs heat from heat sources (e.g., the high-power processing devices 304) positioned proximate to the passage portions 501. The heated working fluid then flows into the first outlet header 322b and is discharged (represented by arrow 510c) via the first outlet port 506b.
In another aspect of the invention, the second heat exchanging portion 320 includes a plurality of fins 706 separating adjacent passage portions 704. In one embodiment, the fins 706 can be corrugated to form air flow passages for the cooling air to flow past the computer module 300 (
In operation, the heated working fluid (represented by arrow 703a) enters the second heat exchanging portion 320 through the second inlet port 702a. The inlet header 324a distributes the working fluid to the passage portions 704. The working fluid (represented by arrow 703b) flows across the passage portions 704 to the second outlet header 324b. As the working fluid flows through the passage portions 704, cooling air flows through the fins 706 and past the passage portions 704. The cooling air absorbs heat from the working fluid as the working fluid flows across the passage portions 704. The second outlet header 324b then collects and discharges the working fluid (represented by arrow 703c) from the second outlet port 702b to the reservoir 314.
One advantage associated with embodiment of the second heat exchanging portion 320 described above with reference to
From the foregoing, it will be appreciated that specific embodiments of the invention have been described herein for purposes of illustration, but that various modifications may be made without deviating from the spirit and scope of the invention. For example, although the fluid mover circulates the working fluid in the illustrated embodiments, in other embodiments, the fluid mover can be omitted. Instead, the working fluid can be circulated in the cooling system via natural convection. Further, while advantages associated with certain embodiments of the invention have been described in the context of those embodiments, other embodiments may also exhibit such advantages, and not all embodiments need necessarily exhibit such advantages to fall within the scope of the invention. Accordingly, the invention is not limited, except as by the appended claims.
Number | Name | Date | Kind |
---|---|---|---|
3317798 | Chu et al. | May 1967 | A |
4315300 | Parmerlee et al. | Feb 1982 | A |
4874127 | Collier | Oct 1989 | A |
5035628 | Casciotti et al. | Jul 1991 | A |
5060716 | Heine | Oct 1991 | A |
5150277 | Bainbridge et al. | Sep 1992 | A |
5161087 | Frankeny et al. | Nov 1992 | A |
5273438 | Bradley | Dec 1993 | A |
5323847 | Koizumi et al. | Jun 1994 | A |
5329425 | Leyssens et al. | Jul 1994 | A |
5339214 | Nelson | Aug 1994 | A |
5345779 | Feeney | Sep 1994 | A |
5365402 | Hatada et al. | Nov 1994 | A |
5376008 | Rodriguez | Dec 1994 | A |
5395251 | Rodriguez et al. | Mar 1995 | A |
5402313 | Casperson et al. | Mar 1995 | A |
5410448 | Barker, III et al. | Apr 1995 | A |
5572403 | Mills | Nov 1996 | A |
5603375 | Salt et al. | Feb 1997 | A |
5718628 | Nakazato et al. | Feb 1998 | A |
6046908 | Feng | Apr 2000 | A |
6115242 | Lambrecht | Sep 2000 | A |
6158502 | Thomas | Dec 2000 | A |
6167948 | Thomas | Jan 2001 | B1 |
6185098 | Benavides | Feb 2001 | B1 |
6310773 | Yusuf et al. | Oct 2001 | B1 |
6416330 | Yatskov | Jul 2002 | B1 |
6435266 | Wu | Aug 2002 | B1 |
6515862 | Wong et al. | Feb 2003 | B1 |
6519955 | Marsala | Feb 2003 | B2 |
6550530 | Bilski | Apr 2003 | B1 |
6557357 | Spinazzola et al. | May 2003 | B2 |
6564858 | Stahl | May 2003 | B1 |
6644384 | Stahl | Nov 2003 | B2 |
6661660 | Prasher et al. | Dec 2003 | B2 |
6679081 | Marsala | Jan 2004 | B2 |
6772604 | Bash et al. | Aug 2004 | B2 |
6776707 | Koplin | Aug 2004 | B2 |
6904968 | Beitelmal et al. | Jun 2005 | B2 |
6914780 | Shanker et al. | Jul 2005 | B1 |
6992889 | Kashiwagi et al. | Jan 2006 | B1 |
6999316 | Hamman | Feb 2006 | B2 |
7051946 | Bash et al. | May 2006 | B2 |
7120027 | Yatskov et al. | Oct 2006 | B2 |
7177156 | Yatskov et al. | Feb 2007 | B2 |
7193851 | Yatskov | Mar 2007 | B2 |
20010052412 | Tikka | Dec 2001 | A1 |
20020172007 | Pautsch | Nov 2002 | A1 |
20020181200 | Chang | Dec 2002 | A1 |
20030010477 | Khrustalev et al. | Jan 2003 | A1 |
20030056941 | Lai et al. | Mar 2003 | A1 |
20040008491 | Chen | Jan 2004 | A1 |
20040052052 | Rivera | Mar 2004 | A1 |
20040250990 | Schaper | Dec 2004 | A1 |
20050120737 | Borror et al. | Jun 2005 | A1 |
20050162834 | Nishimura | Jul 2005 | A1 |
20050168945 | Coglitore | Aug 2005 | A1 |
20050225936 | Day | Oct 2005 | A1 |
20060018094 | Robbins et al. | Jan 2006 | A1 |
20060102322 | Madara et al. | May 2006 | A1 |
20080078202 | Luo | Apr 2008 | A1 |
20080092387 | Campbell et al. | Apr 2008 | A1 |
Number | Date | Country |
---|---|---|
2004-79754 | Aug 2002 | JP |
WO-0186217 | Nov 2001 | WO |
WO-2005027609 | Mar 2005 | WO |
Number | Date | Country | |
---|---|---|---|
20070279861 A1 | Dec 2007 | US |