COOLING SERVERS WITH HYBRID WATER TO AIR AND HEAT PIPE AUGMENTATION TO CHIP LEVEL COOLING OUTSIDE OF SERVER

Abstract

A cooling system for cooling chips in a server rack uses a heat pipe, providing a cooled connection to the chips in a server rack. A coolant for the heat pipe is located outside the rack, so that water never needs to be brought into the rack.

Description

BACKGROUND OF THE INVENTION

Computing and other equipment can be housed in racks along with other computing equipment.

These racks of computer equipment can often be housed in facilities known as computer data centers which house the electronic hardware in rack based cabinets.

SUMMARY

The inventor recognized the need for a new and effective cooling technology.

Embodiments as described herein define novel apparatus, systems, and methods for efficiently cooling computing devices having heat-generating electronic components, such as, for example, chips in an independently operable servers in a closed loop cooling environment.

Embodiments describe a system that extends heat pipes outside the server boundary, so that no cooling water needs to be brought inside the server case. The cooling can be in a sealed enclosure that has cooler elements, with each cooler element associated with a single heat pipe, and each heat pipe associated with a single chip.

The embodiments describe adaptive cooling that carries out cooling as needed for a specific environment.

BRIEF DESCRIPTION OF THE DRAWINGS

The drawings show aspects of the invention as described herein, and specifically:

FIG. 1 shows a schematic of cooling by extending heat pipes outside the cooled part of the cabinet;

FIG. 2 shows the cooling flow;

FIG. 3 shows different parts for receiving and returning water cooling from a cooling line; and

FIG. 4 shows the parts of a rack of an embodiment.

DETAILED DESCRIPTION

The present application describes a hybrid cooling server, that operates using smart modulating valves and a push pull fan to carry out a simultaneous chip level cooling of multiple items in an equipment rack, including cooling of “chips”, specifically CPUs and GPUs in the equipment rack.

The term “hybrid” is used to connote the configuration system used herein, which uses front to back air cooling along with a hybrid combining heat pipe that connects to individually cooled chips. This allows for more cooling efficiency.

Heat pipe technology is used to pull heat off the CPU and GPU chips 15. These heat pipes cool the chips themselves or a heat sink connected to the chips. In a traditional heat pipe, the equipment is cooled using ambient air, thus filtering the heat into a large room.

As explained herein, the present application extends the cooling outside the server as part of a closed loop cooling system. This closed loop design used for the CPU and GPU heat pipe cooling takes the technology a step further, by conducting the heat from the CPU/GPUs to a location outside the server part of the cooling rack, while still maintaining the closed loop system with airflow. The liquid cooling supply is not brought into the server 14 part of the rack, but rather stays outside of the server portion 14.

FIG. 1 shows a schematic diagram of an embodiment. A server case 14 includes plural heat producing elements to be cooled. In this embodiment, the elements to be cooled are “chips” which herein can include graphic processing units GPU's and central processing units or CPUs. The GPUs and CPUs may be themselves connected to heat sinks.

The cooled chip 15 is cooled via a heat pipe 13. The heat pipe 13 includes a cold supply 8, which receives cold from a sealed, cooled encasement 4. The cold 8 is conducted to the chips 15, which release their heat. The heat released from the chips is circulated back to the encasement as a hot line 9. The hot line 9 forms a hot side flow which transfers the heat received from the chips to the encasement. The encasement houses multiple cooler units 5 that are cooled by the fluid, e.g, cooled water, in the encasement 4. The cooler unit 5 can be a cooling fin sitting in the cooled water in the encasement. Each cooler unit 5 is individually associated with each chip; however, multiple cooling units 5 can be located within a single one of the sealed encasements 4.

The cooler 5 receives the cold water supply and is cooled using cooling from the water. That cooling is conducted to the chips 15 via the heat pipes 13. The heat from the chips is received via the heat pipes 13, and conducted to the coolers 5 to be cooled outside the server part of the case 14. This operates to extend the heat pipes 13, so the cooling fins for the heat pipe are located outside the server case 14.

The encasement 4 is sealed, and receives chilled/cold water. The encasement 4 has a cold side manifold 22 which receives the cold water via the line 2 into a connection 3 that connects into the sealed encasement 4. The cooled water cools the multiple coolers 5 in the sealed encasement 4. The water in the sealed encasement is heated as it passes over the coolers 5. This heated water is exhausted via a connection 30 to hot water line 1 e.g. a flex hose, and out to the hot water manifold 16. The connections can be via quick disconnects tied to manifolds located on both sides of the rack 101, so that the rack can be easily relocated,

In a similar way, there is another encasement 40 that is connected to cold water manifold 17 and hot water manifold 18.

In embodiments, the encasements 4 and 40 are physically on opposite sides of the rack. In one embodiment, one of the encasements is on the left of the rack and the other is on the right of the rack. In another embodiment, one of the encasements is on the front of the rack and the other at the back of the rack.

An embodiment as described herein has one encasement 4 on the left of the rack, referred to as the left side of the rack, and the other encasement 40 on the right side of the rack. The encasements are supplied via the supply “Cold” 17, 22 water, and the heated water is returned via the “Hot” lines 16, 18.

In an embodiment, the multiple cold supplies and the multiple hot supplies can be respectively tied together on the outside of the rack with a smart valve shown as 83 in FIG. 3. The smart valve allows isolation of cooling requirements in the rack. The invention uses front to back cooling and deltas based on manufacturer requirements for cooling.

In this way, CPUs; GPUs and other heat sources can be cooled outside the server part of the rack without bringing water into the server part of the rack.

Using direct communications using current APIs, the flow can be maintained based on temperatures on both CPUs and GPUs to maintain the most efficient and controlled environment maintained in this configuration. This structure works in conjunction with an integrated control that manages a psychometric chart based on sensors that are managed between internal and external locations. AI and Learning designs are used by a rack controller to maintain both front to rack cooling, as well as a chip specific algorithm also working in conjunction on front server and back sensors. Working with API to the BIOS level and support allows any specific relationship on both power management and required performance needed.

In addition to the heat pipe cooling, there is also air cooling used in the rack, thus producing the hybrid effect of both air cooling and heat pipe-based conduction cooling. FIG. 2 illustrates the rack and the air cooling path that is used in an embodiment. The system uses two fans 99, 100, configured in a push pull configuration. The fan 99 is in a pull configuration on the hot side 200 of the rack, and the fan 100 is in the push configuration on the cold side 202 of the rack 199. This pushes air across the cooled items in the rack in addition to the heat pipes, thus creating the hybrid cooling.

Manifold supply lines are also shown in FIG. 2, with a right side hot side manifold, 18 and a right side cold side manifold 17. In a similar way, the rack includes a left side hot side manifold 16 and the left side cold side manifold supply 22. The different sides of the rack are cooled not only by separate encasements, but also by separate airflows, in an embodiment.

FIG. 3 shows the valving operation from the hot and cold water lines. The cold water line on the right 17 is connected by a number of smart valves, which can be opened as needed, e.g, when more water cooling is detected to be necessary. In a similar way, the left side cold supply 22 is also connected to a number of smart valves. The water, once heated by the chips, is returned to the right side hot line 18 and the left side hot line 16.

In an embodiment, there can also be a top of rack cold supply 300. The manifolds can receive the cold water, and return the hot water, there being a right side manifold hot return 80, and a top of rack right side manifold return 81. The return side can also include a smart valve 83, connected via the manifold return 84. 85 is the manifold side hot return.

Each location of connection can have a quick connect connection. For example, the supply connection 310 to a chip 15 can be via quick connect 311. In a similar way, the hot supply, from the manifold or from the chip 15 can be connected via a quick connect 312.

The manifold smart valve 83 sits between the manifold returns 81, 85 for the left and right side of the rack respectively. These are driven to coolers, and return via the return 82 to the manifold cold side 305. The water from or the coolant from the cold side 305 is sent via a flexible hose 310 to load 15, e.g, the chip requiring cooling. In a similar way, the heated coolant, after cooling the chip 92 is returned via a flexible hose to the hot side.

At various locations along both the hot side 300 and the cold side 305, there are a number of quick disconnects 90, each of which can be connected to either hot side of a coolant element or a cold side of the coolant element.

The rack with the coolant structure therein is shown in FIG. 4 as 400. A main cold water supply 60 brings cold water into the rack, while the hot water return 61 removes the hot water from the rack for cooling. The hot water is directed, as described herein, to a water disconnect assembly 58, which includes a plurality of different water disconnect connectors. As conventional, a power distribution unit 59, 64 supplies power to the different electronic devices in the rack.

A network management switch 55 carries out the maintaining of supply in the rack.

The left rack side can include an automatic air vent valve, 57 and a power distribution unit 59. The right side can similarly include an automatic air vent valve 63 and power distribution unit 64. The water is supplied via the main cold water hose 60, and exhausted via the main hot water hose 61. A solenoid valve 67 can be used to control the supply of cooling water according to the water control.

Although only a few embodiments have been disclosed in detail above, other embodiments are possible and the inventors intend these to be encompassed within this specification. The specification describes certain technological solutions to solve the technical problems that are described expressly and inherently in this application. This disclosure describes embodiments, and the claims are intended to cover any modification or alternative or generalization of these embodiments which might be predictable to a person having ordinary skill in the art. For example, other kinds of fans can be used.

In one or more exemplary embodiments, the functions described may be implemented in hardware, software, firmware, or any combination thereof. If implemented in software, the functions may be stored on or transmitted over as one or more instructions or code on a computer-readable medium. Functions can also be carried out by programmed computer readable media which can be an article comprising a machine-readable non-transitory tangible medium embodying information indicative of instructions that when performed by one or more machines result in computer implemented operations comprising the actions described throughout this specification.

Also, the inventor(s) intend that only those claims which use the words “means for” are intended to be interpreted under 35 USC 112, sixth paragraph. Moreover, no limitations from the specification are intended to be read into any claims, unless those limitations are expressly included in the claims.

Where a specific numerical value is mentioned herein, it should be considered that the value may be increased or decreased by 20%, while still staying within the teachings of the present application, unless some different range is specifically mentioned. Where a specified logical sense is used, the opposite logical sense is also intended to be encompassed.

The previous description of the disclosed exemplary embodiments is provided to enable any person skilled in the art to make or use the present invention. Various modifications to these exemplary embodiments will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other embodiments without departing from the spirit or scope of the invention. Thus, the present invention is not intended to be limited to the embodiments shown herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.

Claims

1. (canceled)

2. A cooling enclosure, comprising: a rack, comprising: a server portion;a plurality of central processing units (CPUs) arranged within the server portion; anda plurality of graphics processing units (GPUs) arranged within the server portion;a liquid cooling enclosure, comprising: a plurality of cooling units;an inlet connection configured to provide liquid to the liquid cooling enclosure; andan outlet connection configured to remove liquid from the liquid cooling enclosure;a plurality of heat pipes extending from the liquid cooling enclosure to the sever portion; andan air cooling enclosure, comprising: a first fan at a cold side of the air cooling enclosure; anda second fan at a hot side of the air cooling enclosure;wherein one or more manifolds associated with the inlet connection or the outlet connection are positioned along the hot side of the air cooling enclosure and the second fan is configured to drive cooled air over the server portion and along the one or more manifolds to the first fan.

3. The cooling enclosure of claim 2, wherein the liquid is not directed into the rack from the liquid cooling enclosure.

4. The cooling enclosure of claim 2, wherein each cooling unit of the plurality of cooling units is individually associated with a designated CPU of the plurality of CPUs or a designated GPU of the plurality of GPUs.

5. The cooling enclosure of claim 2, further comprising: a second liquid cooling enclosure configured to receive liquid from the outlet connection of the liquid cooling enclosure.

6. The cooling enclosure of claim 2, further comprising: a controller configured to regulate a flow of the liquid into the liquid cooling enclosure based, at least in part, of one or more temperature values associated with the rack.

7. The cooling enclosure of claim 6, further comprising: one or more valves configured to regulate the flow of the liquid into the liquid cooling enclosure responsive to a signal from the controller.

8. The cooling enclosure of claim 2, wherein the plurality of cooling units comprise one or more fins.

9. The cooling enclosure of claim 2, further comprising: a flexible inlet hose extending from the inlet connection to a cooling water source; anda flexible outlet hose extending from the outlet connection to a heated water return.

10. The cooling enclosure of claim 2, wherein the air cooling enclosure is axially above the rack and the liquid cooling enclosure is positioned next to the rack.

11. A cooling system for a server rack, comprising: a plurality of heat pipes extending from a cooling enclosure, each heat pipe of the plurality of heat pipes configured to be connected to one or more heat producing elements within the server rack;a plurality of cooling units, wherein individual cooling units of the plurality of cooling units are coupled to individual heat pipes of the plurality of heat pipes; andthe cooling enclosure for the plurality of cooling units, wherein cooling water is directed into the cooling enclosure and heated water is directed out of the cooling enclosure;wherein the cooling water is not directed into the server rack.

12. The cooling system of claim 11, further comprising: a first fan within an air cooling enclosure coupled to the server rack; anda second fan within the air cooling enclosure coupled to the server rack;wherein the first fan and the second fan direct air into the server rack using a push-pull configuration.

13. The cooling system of claim 12, further comprising: a manifold associated with the cooling enclosure positioned within an air flow pathway of the second fan.

14. The cooling system of claim 11, wherein the plurality of cooling units include cooling fins.

15. The cooling system of claim 11, further comprising: an inlet connection configured to direct water into the cooling enclosure; andan outlet connection configured to direct water out of the cooling enclosure.

16. The cooling system of claim 11, further comprising: a second cooling enclosure having a second plurality of cooling units, wherein individual cooling units of the second plurality of cooling units are coupled to individual heat pipes of the plurality of heat pipes.

17. The cooling system of claim 11, wherein the one or more heat producing elements include at least one of central processing units (CPUs) or graphics processing units (GPUs).

18. A cooling system, comprising: a liquid cooling enclosure, comprising: a plurality of cooling units;an inlet connection configured to provide liquid to the liquid cooling enclosure; andan outlet connection configured to remove liquid from the liquid cooling enclosure;a plurality of heat pipes extending from the cooling enclosure and coupled to respective cooling units of the plurality of cooling units; andan air cooling enclosure, comprising: a first fan; anda second fan.

19. The cooling system of claim 18, wherein liquid is not directed into the plurality of heat pipes and associated heat producing elements, cooled by the plurality of heat pipes, are not exposed to the liquid.

20. The cooling system of claim 18, wherein each cooling unit of the plurality of cooling units is individually associated with a designated central processing unit (CPU) of a plurality of CPUs or a designated graphics processing unit (GPU) of a plurality of GPUs.

21. The cooling system of claim 20, further comprising: a controller configured to regulate a flow of the liquid into the liquid cooling enclosure based, at least in part, of one or more temperature values associated with at least one of a CPU of the plurality of CPUs or a GPU of the plurality of GPUs.