Any discussion of the prior art throughout the specification should in no way be considered as an admission that such prior art is widely known or forms part of common general knowledge in the field.
A server farm within a data center is comprised of a large number of computer servers (e.g. 100, 1,000, 5,000, 10,000) used by a company to perform various functions (e.g. web hosting, cluster computing). Performance in larger server farms is typically limited by the performance of the data center's cooling systems rather than by the performance of the computer servers. The critical design parameter for server farms commonly is the performance per watt of generated heat instead of performance per processor.
Increased thermal efficiency for a server farm reduces the required size of the data center because of the reduced number of computer servers required. It is becoming increasingly important to reduce the size of data centers while maintaining the same level performance. Conventional air thermal management systems have significant limitations in managing a large server farm. Hence, liquid thermal management systems are becoming the desired choice to thermally manage the computer servers within a server farm.
Single-phase liquid thermal management systems (e.g. liquid cold plates) and multi-phase liquid thermal management systems (e.g. spray cooling, pool boiling, flow boiling, jet impingement cooling, falling-film cooling, parallel forced convection, curved channel cooling and capillary pumped loops) have been in use for years for thermally managing various types of heat producing devices. Spray cooling technology is being adopted today as the most efficient option for thermally managing electronic systems. U.S. Pat. No. 5,220,804 entitled High Heat Flux Evaporative Spray Cooling to Tilton et al. describes the earlier versions of spray technology. U.S. Pat. No. 6,108,201 entitled Fluid Control Apparatus and Method for Spray Cooling to Tilton et al. also describes the usage of spray technology to cool a printed circuit board.
While liquid thermal management systems are highly efficient in removing heat from server farms in a data center, they also require constant monitoring to ensure that liquid coolant levels are maintained at acceptable levels. Monitoring and filling each thermal management unit corresponding to one or more computer servers is time consuming and labor intensive. Each thermal management unit must be individually monitored by an individual and manually filled when the coolant level falls below a threshold level because of leaks, permeation and the like. Hence, there is a need for a server farm liquid thermal management system that is efficiently maintained.
The general purpose of the present invention is to provide a server farm liquid thermal management system that has many of the advantages of the server farm thermal management systems mentioned heretofore. The invention generally relates to a server farm thermal management system which includes a coolant reservoir fluidly connected to a plurality of thermal management units. A supply line from the coolant reservoir is fluidly connected to the thermal management units with a plurality of fill valves positioned within the supply line to selectively control flow to the thermal management units. A return line is fluidly connected to the thermal management units with a plurality of drain valves positioned within the return line to selectively control the draining of the thermal management units. A control unit monitors the coolant levels within each of the thermal management units thereby supplying or removing liquid coolant within each to maintain a desired coolant level.
There has thus been outlined, rather broadly, some of the features of the invention in order that the detailed description thereof may be better understood, and in order that the present contribution to the art may be better appreciated. There are additional features of the invention that will be described hereinafter and that will form the subject matter of the claims appended hereto.
In this respect, before explaining at least one embodiment of the invention in detail, it is to be understood that the invention is not limited in its application to the details of construction or to the arrangements of the components set forth in the following description or illustrated in the drawings. The invention is capable of other embodiments and of being practiced and carried out in various ways. Also, it is to be understood that the phraseology and terminology employed herein are for the purpose of the description and should not be regarded as limiting.
An object is to provide a server farm liquid thermal management system that is efficiently maintained.
Another object is to provide a server farm liquid thermal management system that reduces the amount time and labor required to monitor and maintain liquid coolant levels.
Another object is to provide a server farm liquid thermal management system that facilitates filling an entire data center populated with newly installed liquid cooled servers.
An additional object is to provide a server farm liquid thermal management system that efficiently dissipates conducted heat within the coolant.
Other objects and advantages of the present invention will become obvious to the reader and it is intended that these objects and advantages are within the scope of the present invention. To the accomplishment of the above and related objects, this invention may be embodied in the form illustrated in the accompanying drawings, attention being called to the fact, however, that the drawings are illustrative only, and that changes may be made in the specific construction illustrated and described within the scope of the appended claims.
Various other objects, features and attendant advantages of the present invention will become fully appreciated as the same becomes better understood when considered in conjunction with the accompanying drawings, in which like reference characters designate the same or similar parts throughout the several views, and wherein:
Turning now descriptively to the drawings, in which similar reference characters denote similar elements throughout the several views,
The coolant reservoir 20 may be comprised of any structure (e.g. tank) capable of storing a volume of liquid coolant. The coolant reservoir 20 may be comprised of any size and configuration capable of storing a volume of liquid coolant. The liquid coolant may be comprised of various types of coolants including but not limited to Fluorinet (a trademark of the 3M Corporation) water, alcohol, Dow Corning's OS-10, an azeotrope such as Dow Corning's OS-120, and the like.
The coolant reservoir 20 is preferably positioned centrally within a server farm. However, the coolant reservoir 20 may be positioned away from the server farm. In addition, the coolant reservoir 20 may be positioned externally from the data center.
The coolant reservoir 20 may be sized to store various volumes of liquid coolant. However, the coolant reservoir 20 is preferably capable of storing a significant volume of the liquid coolant to maintain a large number of thermal management units 30 active over long periods of time without intermediate maintenance. It is preferable to have the coolant reservoir 20 sized to approximately 105% to 115% of the total coolant requirements for all of the thermal management units. The extra 5% to 15% of the total coolant requirements is for compensating for permeation, leakage, spillage, loss during servicing and etc. For example, if each thermal management unit 30 requires 2 gallons of coolant and there are 500 thermal management units 30 in a data center, it is preferable that the coolant reservoir 20 is sized to store approximately 1,050 gallons to 1,150 gallons of coolant.
As shown in
The coolant reservoir 20 is may also be used to thermally condition the waste liquid coolant from the thermal management units 30. The coolant reservoir 20 may thermally condition the waste liquid coolant through simple conduction through a tank wall or a heat exchanger 60 may be thermally connected to the coolant reservoir 20 to increase the thermal management capability of the system.
As shown in
The thermal management units 30 are comprised of a single phase or multi-phase liquid thermal management system such as but not limited to spray cooling or cold plates. An exemplary spray cooling system is illustrated in U.S. Pat. No. 6,104,610 and is hereby incorporated by reference into this application.
The plurality of thermal management units 30 are preferably comprised of a one to one ratio of thermal management units 30 to computer servers in a server farm. It can be appreciated that a smaller or larger ratio of thermal management units 30 may be utilized in the present invention to accommodate various sizes of server farms.
As shown in
As further shown in
Each of the supply valves 42 is in communication with and activated by the control unit 24 in a preferably automated manner. It can be appreciated that the supply valves 42 may be directly activated by the remote monitoring station in various situations.
One or more of the supply valves 42 are opened when the coolant level within one or more of the thermal management units 30 is below a minimum level as preferably determined by the level sensors 32. The minimum level is preferably comprised of a predetermined approximate level that prevents damage to the thermal management unit 30 and the electronic device 12 being thermally managed.
One or more of the supply valves 42 are closed when the coolant level within the plurality of thermal management units 30 is at a desired level as preferably determined by the level sensors 32. The desired level may be approximately equal to the minimum level or it may be approximately greater than the minimum level (e.g. a range of levels).
As shown in
A return pump 72 is preferably fluidly connected to the return line 50 to draw the waste liquid coolant from the thermal management units 30 and to return the liquid coolant to the coolant reservoir 20. The return pump 72 may be comprised of any commonly utilized pressure pump device similar to the supply pump 70. Alternatively, the return pump 72 may be comprised of the coolant reservoir 20 positioned below the thermal management units 30 to receive the waste liquid coolant via a gravity feed. The expansion of the coolant vapor may also force the waste liquid coolant to the coolant reservoir 20.
As shown in
The plurality of return valves 52 are selectively opened when the coolant level within the plurality of thermal management units 30 exceeds a maximum level to prevent overfilling of the thermal management units 30. The opening of the return valves 52 allows for the waste coolant within the thermal management units 30 to pass through and to the coolant reservoir 20. The return valves 52 are preferably closed when the coolant level within the plurality of thermal management units 30 is at the desired level as determined by the level sensors 32.
While the coolant reservoir 20 may directly thermally condition the waste coolant from the thermal management units 30, a heat exchanger 60 is preferably fluidly connected to the return line 50 to thermally condition the liquid coolant within the return line 50 prior to returning the coolant to the coolant reservoir 20. The heat exchanger 60 may be comprised of any conventional heat transfer technology suitable for usage in single phase or multi-phase liquid thermal management systems.
In another alternative embodiment shown in
The control unit 24 is in communication with the thermal management units 30 and computer servers to determine at least one coolant characteristic (e.g. coolant level, coolant temperature). As shown in
The control unit 24 monitors the coolant level within each of the thermal management units 30 to determine if liquid coolant needs to be supplied to or removed from the respective thermal management unit 30. The control unit 24 ensures that a desired level of coolant is maintained within each thermal management unit 30 at all times during operation and for all phases of operation including but not limited to a maintenance phase.
In addition, the control unit 24 preferably automatically opens one or more supply valves 42 and one or more of the return valves 52 to circulate the liquid coolant from the thermal management units 30 to the coolant reservoir 20. The circulation of the liquid coolant between the thermal management units 30 and the coolant reservoir 20 serves to increase thermal conditioning of the liquid coolant by removing heat from the coolant in the coolant reservoir 20 (and the heat exchanger 60).
Additionally, liquid coolant may be circulated through a thermal management unit 30 to facilitate preconditioning of newly installed printed circuit assemblies. For example, a supply valve 42 could be opened with the corresponding return valve 52 opened to allow for washing of the newly installed printed circuit assemblies to remove any contaminants and other debris. Alternatively a second liquid may be pumped through a secondary set of lines to wash the newly installed printed circuit assemblies.
One or more level sensors 32 are connected to each of the thermal management units 30 to determine a coolant level within the thermal management units 30. One or more temperature sensors 36 are thermally connected to each of the thermal management units 30 to monitor a temperature within or outside of the thermal management units 30 (e.g. coolant temperature, electronic device temperature).
One or more flow sensors 34 are fluidly connected between the plurality of supply valves 42 and the plurality of thermal management units 30 to monitor a volume (and flow rate) of coolant flowing to or from each of the thermal management units 30. The flow sensors 34 allow for direct monitoring of the amount of liquid coolant used by each thermal management unit 30. The flow sensor data may be utilized to determine a defective thermal management unit 30 or for billing purposes where the thermal management units 30 are thermally managing electronic devices 12 owned by different clients of the company. A defective (e.g. leaky) thermal management unit 30 may continue to receive additional coolant until such time as the defective thermal management unit 30 can be properly shut down and or service or replaced.
The sensors 32, 34, 36 are all preferably in communication with the control unit 24 directly, however the sensors 32, 34, 36 may be in communication indirectly with the control unit 24. For example, the sensors 32, 34, 36 may communicate directly with the electronic device 12 (e.g. computer server) which then communicates the data to the control unit 24.
In use, the coolant reservoir 20 is filled with liquid coolant to a level sufficient to provide a backup coolant supply for the server farm. The control unit 24 monitors the coolant characteristics within each of the thermal management units 30 such as coolant level.
If the coolant level within a first thermal management unit 30 is below the minimum level, the control unit 24 preferably automatically communicates to the corresponding first supply valve to open and activates the supply pump 70 to provide a supply of liquid coolant to the first thermal management unit 30. The first supply valve remains open until the coolant level within the first thermal management unit 30 is at least above the minimum coolant level and then the first supply valve is closed by the control unit 24 as illustrated in
If the coolant level within a first thermal management unit 30 is above the maximum level, the control unit 24 preferably automatically communicates to the corresponding first return valve to open and activates the return pump 72 to allow the waste coolant to flow from the first thermal management unit 30 to the coolant reservoir 20. The first return valve remains open until the coolant level within the first thermal management unit 30 is at least below the maximum coolant level and then the first return valve is closed by the control unit 24 as further illustrated in
In addition, the control unit 24 may open both the first supply valve and the first return valve for the first thermal management unit 30 to allow for circulation of the liquid coolant. This may be done to thermally condition the liquid coolant if the coolant temperature is exceeding a desired temperature. This may be done to a selected single or a plurality of thermal management units 30. Also, the circulation of coolant may be done globally through all of the thermal management units 30.
In addition, while it is preferable that the control unit 24 automatically perform the above-stated operations, the remote monitoring station may also communicate commands to the control unit 24 or the devices directly to provide maintenance of the thermal management system.
What has been described and illustrated herein is a preferred embodiment of the invention along with some of its variations. The terms, descriptions and figures used herein are set forth by way of illustration only and are not meant as limitations. Those skilled in the art will recognize that many variations are possible within the spirit and scope of the invention, which is intended to be defined by the following claims (and their equivalents) in which all terms are meant in their broadest reasonable sense unless otherwise indicated. Any headings utilized within the description are for convenience only and have no legal or limiting effect.
Number | Name | Date | Kind |
---|---|---|---|
4698728 | Tustaniwskyj et al. | Oct 1987 | A |
4721996 | Tustaniwskyj et al. | Jan 1988 | A |
5226471 | Stefani | Jul 1993 | A |
5293754 | Mizuno | Mar 1994 | A |
5522452 | Mizuno et al. | Jun 1996 | A |
5731954 | Cheon | Mar 1998 | A |
6234240 | Cheon | May 2001 | B1 |
6996996 | Cader | Feb 2006 | B1 |
7012807 | Chu et al. | Mar 2006 | B2 |
7013662 | Tilton et al. | Mar 2006 | B1 |
7043933 | Knight | May 2006 | B1 |
7159414 | Tilton et al. | Jan 2007 | B2 |
7270174 | Chu et al. | Sep 2007 | B2 |
7308801 | Tilton et al. | Dec 2007 | B1 |
7401471 | Tilton | Jul 2008 | B1 |
20030147214 | Patel et al. | Aug 2003 | A1 |
20040040328 | Patel et al. | Mar 2004 | A1 |
20050122685 | Chu et al. | Jun 2005 | A1 |
20050126747 | Chu et al. | Jun 2005 | A1 |
20050168948 | Cader et al. | Aug 2005 | A1 |
20070193721 | Tilton et al. | Aug 2007 | A1 |
20080066889 | Knight et al. | Mar 2008 | A1 |