The present invention is related generally to systems and methods of cooling heat generating components of a computer server or other systems that operate in an enclosed data processing environment, and computer servers and systems incorporating the cooling system.
Electronic systems, such as, for example, computer systems include several integrated circuit (IC) devices that generate heat during operation. For effective operation of the computer system, the temperature of the IC devices have to be maintained within acceptable limits. While the problem of heat removal from IC devices is an old one, this problem has increased in recent years due to greater numbers of transistors that are packed into a single IC device while reducing the physical size of the device. Increasing number of transistors compacted into a smaller area results in a greater concentration of heat that must be removed from that smaller area. Bundling multiple computer systems together, such as, for example, in a server, further aggravates the heat removal problem by increasing the amount of heat that has to be removed from a relatively small area.
In a typical computer server (“server”), multiple computer server modules (“modules”) are stacked together in a rack or a case to consolidate network resources and minimize floor space. Modules which are designed for use in a server configuration are typically characterized by a motherboard comprising heat generating electronic components (such as IC devices) housed in a modular chassis or case, which in turn is mounted together with other similar modules, in a rack, blade cabinet, blade server, or other support structure. In practice, multiple servers (each comprising several modules) are typically located in an enclosed space such as a server room or a data center. During operation, the electronic components in the individual modules generate heat which must be removed for effective functioning of the server.
It is known that a large portion (greater than about 31%) of the energy consumption of a typical server room is used in the operation of the CRAC system, and that significant energy savings and resultant green house gas reduction can be achieved by improving the efficiency of the CRAC system. “Data Center Energy Characterization Study Site Report,” February 2001, available at http://hightech.lbl.gov/documents/DATA_CENTERS/DC_Benchmarking/Data_Center_Facility1.pdf; “Energy Consumption of Information Technology Data Centers,” and references cited therein, Iyengar et al., December 2010, available at http://www.electronics-cooling.com/2010/12/energy-consumption-of-information-technology-data-centers/. Improving the cooling efficiency of servers housed in a server room thereby enables more efficient utilization and conservation of available energy resources, and green house gas emission reduction.
The disclosed liquid cooling systems and methods are directed to an energy efficient approach of cooling one or more servers located in an enclosed environment, such as a server room.
In one aspect, a method of cooling a computer server that includes a plurality of server modules, and is positioned in an enclosed room, is disclosed. The method includes transferring heat generated by a server module of the plurality of server modules to a hot plate of a liquid cooling system. The liquid cooling system may be positioned within the server module, and the hot plate may have a surface exposed to the enclosed room. The method may also include positioning a cold plate of a room-level cooling system in thermal contact with the hot plate. The method may further include directing a cooling medium through the room-level cooling system to transfer heat from the hot plate to a cooling unit positioned outside the room.
In another aspect, a method of cooling a computer server including a plurality of server modules is disclosed. The method may include maintaining a flow of air within a server module of the plurality of server modules to absorb heat from one or more heat generating devices of the server module. The method may also include directing the flow of air through an air-to-liquid heat exchanger of a closed loop liquid cooling system to transfer the absorbed heat to a coolant of the liquid cooling system. The liquid cooling system may be positioned within the server module. The method may also include directing the coolant to a hot plate of the liquid cooling system. The hot plate may be positioned such that at least a heat exchange surface of the hot plate is exposed outside the server module. The method may further include transferring heat from the hot plate to a location remote from the computer server using a cooling medium of a second closed loop cooling system positioned outside the server module.
In yet another aspect, a method of cooling a plurality of computer servers positioned in a server room is disclosed. The method may include transferring heat generated by each computer server of the plurality of computer servers to an exterior of the computer server using a closed loop liquid cooling system positioned within the computer server. The method may also include thermally coupling a second closed loop cooling system to the liquid cooling system of the computer server. The method may also include circulating a cooling medium through the second closed loop cooling system to transfer heat from the liquid cooling system of the computer server to a location outside the server room.
The following detailed description illustrates the cooling system by way of example and not by way of limitation. Although the description below describes an application of a liquid cooling system to servers housed in an enclosed environment, embodiments of the disclosed cooling systems may be applied to cool heat generating components in any application. For example, embodiments of the current disclosure may be used to cool portable computers that operate while being docked to a docking station. The description enables one skilled in the art to make and use the present disclosure for cooling any electronic component within a console or a chassis.
Reference will now be made to exemplary embodiments of the invention, examples of which are illustrated in the accompanying drawings. Wherever possible, the same reference numbers will be used throughout the drawings to refer to the same or like parts. Elements or parts designated using the same reference numbers in different figures perform similar functions. Therefore, for the sake of brevity, these elements may not be described with reference to every figure. In the description that follows, if an element is not described with reference to a figure, the description of the element made with reference to another figure applies.
The liquid cooling system 20 may include one or more air-to-liquid heat exchangers (HEX 16) for interacting with the circulating internal air 32 and transferring the heat from the air 32 to the coolant 22. The liquid cooling system 20 may also include one or more hot plates 18. Although, for the sake of clarity, only one hot plate 18 is illustrated in
HEX 16 may be any type of heat exchanger that is configured to transfer heat from hotter air 32 flowing outside HEX 16 to cooler coolant 22 flowing within HEX 16. For instance, in some embodiments, HEX 16 may be a cross-flow, parallel-flow, or a counter-flow heat exchanger that is used to transfer heat from air to liquid circulating within the heat exchanger. The air 32 within modules 10A and 10B of
With reference to
That is, module 10 may not include passages and other openings that are typically provided in the chassis of a computer system to allow air to flow into and out of the computer system. In these embodiments, substantially all the air 32 within the module 10 may stay within the module 10. However, it should be noted that a perfect seal between the module 10 and the server room 100 is not a requirement, and some transfer of air between the module 10 and the server room 100 may be unavoidable due to leaks, gaps between panels of the module chassis, cracks in the panels, etc. That is, in an embodiment of the module 10 that is substantially sealed to prevent the flow of air between the server room 100 and the module 10, the module 10 may be substantially free of openings and other passages that permit the free transfer of air between the module 10 and the server room 100. In such a module 10, a majority of heat from the module 10 may be removed by the liquid cooling system 20. The heated air 32 in the module 10 may heat the chassis of the module 10, and some amount of heat transfer may occur as a result of heat transfer from the chassis to the server room, and as a result of leakage of air 32 from the module 10. However, it is expected that a majority of heat from module 10 may be transferred through the liquid cooling system 20.
Liquid cooling system 20 may transfer the heat absorbed in module 10 to a second cooling system 40. The second cooling system may be a cooling system that is associated with server room 100 or the enclosed environment within which the modules 10 are located. Second cooling system 40 may circulate a thermal transfer medium 42 (any fluid, such as a liquid or a gas) therethrough to absorb heat from the liquid cooling systems 20 associated with different modules 10, and discharge the heat remote from these modules 10. Any type of fluid, such as water, alcohol, mixtures thereof, a gas, etc. may be used as thermal transfer medium 42. It is also contemplated that, in some embodiments, a phase change material may be used as the thermal transfer medium 42. In some embodiments, second cooling system 40 may be a closed loop cooling system. However, it is contemplated that in other embodiments, the second cooling system 40 may be an open loop system. In some embodiments, as illustrated in
The second cooling system 40 may consist of one or more cold plate elements 48, a cooling device 46 disposed external to server room 100, and conduits to transfer the thermal transfer medium 42 between the cooling device 46 and the cold plate elements 48. The thermal transfer medium 42, may be circulated between the cooling device 46 and the cold plate elements 48 of the modules 10 of several servers positioned in the server room. The circulating thermal transfer medium 42 may thus draw heat from the hot plates 18 of these modules 10 and discharge the heat external to the server room 100. In some embodiments, pumps and/or other control devices may be provided to assist in directing the thermal transfer medium 42 through the second cooling system 40. Transferring the heat generated by the servers outside the server room 100 avoids heating the air in the server room, and thus reduces the cooling load of the server room cooling system. It is also contemplated that the heat removed from the server room by thermal transfer medium 42 may be used to do useful work.
For instance, this removed heat may be used in an HVAC system to heat a building. In a server application, as illustrated in
In some embodiments (such as in blade server applications where each module 10 may not be enclosed in a separate chassis), each module 10 of a rack 50 may not be individually sealed from the server room 100. In these embodiments, air 32 may flow between the modules 10 in a rack 50, and the rack 50 may be substantially sealed from the server room 100. Although a particular flow path of the thermal transfer medium 42 is illustrated in
In some server applications, in addition to the heat generated in the modules 10, the rack 50 may itself generate heat. For instance, in some server applications, the modules 10 in a rack 50 may not include separate power supplies. Instead, the power supplies may be located in the rack 50, and the rack 50 may deliver the required power to the modules 10 mounted in the rack 50. In such embodiments, as illustrated in
In some embodiments, as illustrated in
A hot plate (18, 68) and a cold plate (48, 58) may be any component that enables heat transfer between a coolant and a heat exchange surface. In some embodiments, a hot plate and a cold plate may be substantially similar components that mate with each to transfer heat therebetween. For the sake of brevity, only hot plate 18 of liquid cooling system 20 may be described herein. The other hot plates (such as, hot plate 68) and cold plates (48, 58) may be substantially similar in structure to hot plate 18.
Conductive plate 72 of hot plate 18 may include a first surface 72a exposed to reservoir 76 and an opposing second surface 72b. First surface 72a may include fins 73 that project from the first surface 72a into the reservoir 76. These fins 73 may include multiple plates oriented parallel to each other. These fins 73 may be adapted to absorb heat from the coolant 22 that passes through reservoir 76. The fins 73 may function to increase the area of contact of the coolant 22 to the first surface 72a and serve to generate turbulence in the coolant 22 flowing through the reservoir 76. Although the fins 73 are depicted as parallel plates in
The disclosed server cooling system in which a liquid cooling system 20 of a module 10 of a server rack 50 mates with and transfers heat to a second cooling system 40 of the server room 100, enables the servers to be cooled without transferring the heat to the server room 100 Since the server room 100 is not heated, the necessity of large CRAC systems are eliminated. As discussed in the background section, the electrical power consumed to operate a CRAC system of a server room accounts for a large portion of the total server room power consumption. Although the cooling device 46 of the second cooling system 40 consumes power, this power consumption will be significantly less than that necessary to operate the CRAC system. Eliminating the need for large CRAC systems to cool the server room 100 thereby reduces power consumption associated with cooling the server room. This reduction in power consumption enables more efficient utilization and conservation of available energy resources, and concomitant reduction in green house gas emissions. Since additional modules 10 can be added to a server rack 50 without breeching a liquid cooling system, the danger of liquid spillage within a server is also eliminated.
It will be apparent to those skilled in the art that various modifications and variations can be made to the disclosed cooling systems. Other embodiments will be apparent to those skilled in the art from consideration of the specification and practice of the disclosed cooling systems. It is intended that the specification and examples be considered as exemplary only, with a true scope being indicated by the following claims and their equivalents.
This application is a continuation of U.S. application Ser. No. 14/186,397, filed on Feb. 21, 2014, which claims priority to U.S. application Ser. No. 13/215, 384, filed on Aug. 23, 2011, which claims priority to Provisional Application No. 61/377,249, filed on Aug. 26, 2010, each of which are incorporated herein by reference in their entirety.
Number | Name | Date | Kind |
---|---|---|---|
6763880 | Shih | Jul 2004 | B1 |
6796372 | Bear | Sep 2004 | B2 |
6807056 | Kondo et al. | Oct 2004 | B2 |
6819563 | Chu et al. | Nov 2004 | B1 |
6896612 | Novotny | May 2005 | B1 |
7012807 | Chu et al. | Mar 2006 | B2 |
7277282 | Tate | Oct 2007 | B2 |
7318322 | Ota et al. | Jan 2008 | B2 |
7372698 | Tilton et al. | May 2008 | B1 |
7420804 | Leija et al. | Sep 2008 | B2 |
7438124 | Bhatti et al. | Oct 2008 | B2 |
7525207 | Clidaras et al. | Apr 2009 | B2 |
7593227 | Campbell et al. | Sep 2009 | B2 |
7599184 | Upadhya et al. | Oct 2009 | B2 |
7757506 | Ellsworth, Jr. et al. | Jul 2010 | B2 |
7957132 | Fried | Jun 2011 | B2 |
8077463 | Lee | Dec 2011 | B2 |
8094453 | Campbell et al. | Jan 2012 | B2 |
8274787 | Alyaser et al. | Sep 2012 | B2 |
8289710 | Spearing et al. | Oct 2012 | B2 |
8427831 | Wei | Apr 2013 | B2 |
8437129 | Tung et al. | May 2013 | B2 |
8441789 | Wu et al. | May 2013 | B2 |
8493738 | Chainer et al. | Jul 2013 | B2 |
20030128525 | Berry et al. | Jul 2003 | A1 |
20040095721 | Ellsworth et al. | May 2004 | A1 |
20050128705 | Chu et al. | Jun 2005 | A1 |
20060187638 | Vinson et al. | Aug 2006 | A1 |
20070297136 | Konshak | Dec 2007 | A1 |
20080029250 | Carlson et al. | Feb 2008 | A1 |
20080068793 | Ishimine | Mar 2008 | A1 |
20090027856 | McCoy | Jan 2009 | A1 |
20090056910 | Mallia et al. | Mar 2009 | A1 |
20090080151 | Kalms et al. | Mar 2009 | A1 |
20090086434 | Hodes et al. | Apr 2009 | A1 |
20090126909 | Ellsworth, Jr. et al. | May 2009 | A1 |
20090126910 | Campbell et al. | May 2009 | A1 |
20090154096 | Iyengar et al. | Jun 2009 | A1 |
20090161312 | Spearing et al. | Jun 2009 | A1 |
20090262495 | Neudorfer | Oct 2009 | A1 |
20090284924 | Konshak et al. | Nov 2009 | A1 |
20100032140 | Copeland et al. | Feb 2010 | A1 |
20100085708 | Martin et al. | Apr 2010 | A1 |
20120106071 | Eagle | May 2012 | A1 |
Number | Date | Country |
---|---|---|
WO 2010054786 | May 2010 | WO |
Entry |
---|
International Search Report and Written Opinion for International Application No. PCT/US2011/048735 dated Dec. 2, 2011, 12 pages. |
Declaration of Himanshu Pokharna, Ph.D., in Inter Partes Review Case No. 2014-01172, dated Jul. 16, 2014, (71 pages). |
HP Modular Cooling System: Technology Overview and Application Brief, © 2006 Hewlett-Packard Development Company, L.P., (13 pages). |
Notice of Allowance from U.S. Appl. No. 14/186,397, mailed Apr. 3, 2014, (7 pages). |
Patterson, Michael K et al., The State of Data Center Cooling, A Review of Current Air and Liquid Cooling Solutions, Intel Corporation, Mar. 2008, (12 pages). |
Petition for Inter Partes Review of U.S Patent No. 8,749,968, filed Jul. 16, 2014, (61 pages). |
Random House Webster's College Dictionary, Random House, Inc., New York, 2000, p. 230, (3 pages). |
U.S. Appl. No. 61/377,249, filed Aug. 26, 2010, (23 pages). |
Number | Date | Country | |
---|---|---|---|
20140246178 A1 | Sep 2014 | US |
Number | Date | Country | |
---|---|---|---|
61377249 | Aug 2010 | US |
Number | Date | Country | |
---|---|---|---|
Parent | 14186397 | Feb 2014 | US |
Child | 14275066 | US | |
Parent | 13215384 | Aug 2011 | US |
Child | 14186397 | US |