The present invention relates to a system for cooling electronic units in a multi-unit rack. In particular the present invention is directed to the cooling of computer servers. The field of the invention however extends more generally to the cooling of electronic units of other types that are stacked.
High power datacenter servers, power electronics modules and telecom data transmission equipment are commonly installed in electronics racks with a requirement of high density of heat dissipation per unit volume in the rack. Thus, these racks need to be effectively and efficiently cooled to thermally manage the operating temperatures of the installed electronics to stay within their allowable working range. The technical challenge is to remove a large quantity of heat from a confined/compact volume using as little energy to drive the cooling system as possible.
Current cooling technologies are available principally in four forms: (i) air-cooling with fans blowing air over heat sinks with or without embedded heat pipes, (ii) water-cooling with pump(s) driving the water through heat sinks, (iii) immersion cooling in which the entire rack is emerged in a liquid cooled bath of dielectric liquid, and (iv) individual thermosyphon heat sinks cooled by air with fans placed in each server.
Air-cooling is an expensive electrical energy consumer and cannot handle the very high heat densities of the new powerful electronics as the air flow rate and fan noise become prohibitive. Water-cooling is a high risk if any leak or drip occurs into the electronics during operation or servicing. Immersion cooling requires twice as much floor space to install the tall rack horizontally and creates additional maintenance issues. Individual air-cooled thermosyphons, which are a mini-thermosyphon for each individual electronic component cooled by air flow within the server, extend the range of air-cooling to higher heat loads than (i) but do not handle the high heat loads in 1U servers (1.75 inch or 44.4 mm height) commonly used in densely packed racks and in any case still have the air flow rate and fan noise problems.
Cooling stacked computer servers with thermosyphons are described for instance in US 20190107333, US 20200015387, US 20200113083, and WO 2007102978. The advantage of thermosyphons is their ability to transfer large amounts of heat in a compact configuration compared to air-cooled systems. However, in conventional systems, the coupling of the computer servers to the thermosyphon network renders the system complex and configurations with different numbers of servers or the replacement of individual units is time consuming and laborious.
In view of the foregoing, it is an object of the invention to provide a cooling system for a multi-unit stack of electronic devices that is compact with a high heat transfer capability, yet that is economical to manufacture, configure and install.
It is advantageous to provide a cooling system for a multi-unit electronic apparatus that allows easy and economical replacement of electronic units.
It is advantageous to provide a cooling system for a multi-unit electronic apparatus that is reliable and can be easily and economically adapted for different numbers of electronic units.
It is advantageous to provide a cooling system for a multi-unit electronic apparatus that can be easily and economically integrated into existing electronic units.
Various objects of the invention have been achieved by providing a cooling system according to the independent claims.
Dependent claims set out various advantageous features of embodiments of the invention.
Disclosed herein is a cooling system for a multi-unit electronic apparatus stack comprising a plurality of stacked electronic units. The cooling system comprises a plurality of unit cooling systems incorporated in, on or between each electronic unit.
According to a first aspect, each unit cooling system comprises one or more fluid flow circuits configured as:
According to a second aspect, each unit cooling system comprises one or more fluid flow circuits configured as:
The riser and downcomer may be placed at any convenient position along any side or at any corner of the multi-unit electronic apparatus stack to allow easy access to the electronic units.
In an advantageous embodiment, the riser pipe comprises a substantially rectangular cross-section.
In an advantageous embodiment, the riser pipe comprises a single integrally formed outer wall and internal walls separating adjacent said channels of the riser pipe.
In an advantageous embodiment, the riser pipe cross-section has a length L to width W ratio L/W in a range of 30/1 to 3/1. The cross-sectional dimensions of the riser pipe may be constant or may vary along the height of the stack. For instance, to take into account the increase in volume as coolant changes phase from liquid to gas, the riser pipe may be provided with a greater cross-sectional area at the upper part compared to the lower part thereof. The increase may be stepwise and/or continuous.
In an advantageous embodiment, the riser pipe has substantially flat opposed surfaces and the thermal interface coupling comprises a flat surface for clamping against the flat surface of the riser pipe.
In variants, the riser pipe may have circular, polygonal or irregular shaped cross-sectional profiles, provided that the shape of the thermal interface coupling of the unit cooling systems is adapted thereto to ensure sufficient thermal coupling to the riser pipe.
In an advantageous embodiment, the pipe of the unit cooling system comprises a plurality of channels.
In an advantageous embodiment, the plurality of channels are arranged in a serpentine shape to form a pulsating heat pipe (PHP).
In an advantageous embodiment, the pipe of the unit cooling system comprises an evaporator end thermal interface coupling having a major surface for thermally coupling against a heat generating electronic component of the electronic unit.
In an advantageous embodiment, the pipe of the unit cooling system comprises a condenser end thermal interface coupling having a major surface for thermally coupling against a heat absorbing component of the rack cooling system.
In an advantageous embodiment, the pipe of the unit cooling system is formed of an extruded metal piece, for instance an extruded aluminum piece.
In an advantageous embodiment, the downcomer of the stack cooling system comprises a single channel pipe.
In an embodiment, the downcomer pipe may include a liquid accumulator.
In an advantageous embodiment, the principal condenser is arranged above the top of the multi-unit electronic apparatus stack.
In an advantageous embodiment, the principal condenser comprises an air-liquid heat exchanger.
In an advantageous embodiment, the principal condenser further comprises a liquid-liquid heat exchanger including channels for flow of the coolant of the stack cooling system and channels separate therefrom for flow of a cooling liquid, which may for instance come from the air-liquid heat exchanger.
In an advantageous embodiment, the channels include alternating layers of separate micro-cooling channels, the micro-cooling channels of each layer arranged in a single block for each fluid flow with respective inlet and outlet connecting openings.
In an advantageous embodiment, the micro-cooling channels have a generally rectangular shape with a height H to width W ratio H/W in a range of 1.5 to 15, preferably in a range of 2 to 5.
In an advantageous embodiment, the liquid-liquid heat exchanger is a single integrally formed 3D printed part
In an advantageous embodiment, the liquid-liquid heat exchanger is made of metal.
In an advantageous embodiment, the riser pipe comprises a constant continuous geometry extending vertically across a plurality of electronic units configured to allow clamping of plate shaped thermal interface couplings of the unit cooling system at any position along the riser pipe.
Further advantageous features of the invention will be apparent from the following detailed description of embodiments of the invention and the accompanying illustrations.
The generic conceptual channel layout and fluid flow within a per se known loop thermosyphon and pulsating heat pipe are shown in
Basically, a LTS has a gravity-driven internal coolant flow. The coolant is partially evaporated in the Evaporator removing the heat from the electronics and flows up the Riser due to buoyancy. The flow passes through the Condenser where the heat is removed to the secondary coolant (air, liquid or another two-phase flow) converting the vapor back to liquid, and finally gravity pulls the liquid down the Downcomer where the coolant reenters the Evaporator to continue the flow around the loop. It is also sometimes useful to include a liquid accumulator in the LTS loop at the exit of the condenser to manage the liquid inventory in the LTS over a wide range of operating conditions, as shown, but it is not always needed and can be removed from the loop.
A pulsating heat pipe, also known as an oscillating heat pipe, is a closed or open serpentine loop in which a fraction of the internal volume of the serpentine is filled by the liquid coolant and the remaining internal volume is filled by its vapor. The coolant boils at the evaporator end and condenses at the condenser end while the flow inside is created by instabilities from the creation and collapse of the vapor bubbles, making the flow passively oscillate from one direction to the opposite direction inside the serpentine.
All of these systems, LTS and PHP, include a filling or charging port to evacuate the loop or serpentine and to put the coolant inside them.
Referring to the
In a typical application of the invention, the electronic units may consist of computer servers, for instance computer servers of a data center. The invention however may be employed with other types of electronic units that are stacked together and require cooling.
A cooling system 2 according to embodiments of the invention is integrated with the multi-unit electronic apparatus stack.
The cooling system 2 comprises a large or principal cooling system 4 that we shall refer to herein as the stack cooling system 4, and a plurality of unit cooling systems 6 that are thermally coupled to the stack cooling system 4. The unit cooling systems 6 are incorporated in each electronic unit 3 or may be provided for a group of electronic units 3 that form a portion of the multi-unit electronic apparatus stack 1.
In the embodiments illustrated, the unit cooling system 6 comprises cooling fluid flow circuits 13, that are mounted within the housings 7 of each electronic unit, however in variants (not illustrated) the unit cooling system could be mounted as part of the housing 7 or on the outside of the electronic units 3, for instance at interfaces between two electronic units 3. In the latter case, heat sinks and heat conductive materials may bridge the heat producing electronic components 5 (for instance processors) to the housing 7 coupled to the unit cooling system.
The stack cooling system 4 comprises a principal condenser 12 and a cooling fluid flow circuit 8 configured as a thermosyphon cooling circuit. The fluid flow circuit 8 comprises a downcomer 8a and a riser 8b. The principal condenser 12 serves to cool the coolant flowing in the fluid flow circuit 8 and is preferably arranged at the top of the stack cooling system 4.
The principal condenser 12 comprises at least one heat exchanger 26a, 26b. In a preferred embodiment, the principal condenser 12 comprises an air-liquid heat exchanger 26b, and a liquid-liquid heat exchanger 26a coupled to the air-liquid heat exchanger 26b, that may be positioned above the multi-unit apparatus stack 1. The air-liquid heat exchanger 26b may be positioned at a certain distance from the stack 1 and may either be cooled by indoor air, or by environmental air (outside air), passively by natural convection, or by forced convection using fans 32, or various such heat exchanger systems being per se well known and do not need to be described further herein.
In embodiments illustrated in
In the embodiment of
In an advantageous embodiment, the heat exchanger block 29 including the channels and inlets and outlets of both of the hot and cool liquid circuits may advantageously be made as a single integrally formed part by additive manufacturing techniques, for instance 3D printing of thermally conductive materials, preferably of 3D printable metals.
The liquid-liquid heat exchanger 26a according to embodiments of the invention, which serves as a condenser for the thermosyphon stack cooling system 4 is important for the proper thermal-hydraulic operation to achieve high thermal performance to cool the high heat loads of the electronics racks and thus is an integral part of the cooling system. A very flexible and easily modified geometry is required to handle the broad range of heat loads to be cooled by the condenser depending on the power of the electronics installed the rack and secondly on the coolant to be used for the condenser. The heat exchanger 26a requires a very low pressure drop flow path for the thermosyphon working fluid passing through it, in order to greatly reduce resistance to flow (by 50% or more) and thus increase the flow rate of the thermosyphon working fluid to attain higher electronics cooling capacities (by 20% or more) than achievable utilizing conventional tubular and plate heat exchangers on a per unit volume basis. Furthermore, this heat exchanger 26a is much smaller (e.g. by a factor of three) in volume and much lighter in weight (e.g. by a factor of three or more) compared to equivalent conventional thermal capacity conventional units to enable it to fit on top of the rack and to be safely installed on the top of rack. This very compact geometry in addition significantly reduces the amount of working fluid required to operate the thermosyphon of the stack cooling system 4 whilst its reduced weight also means the thermosyphon system is able to react faster to transient operation of the electronics and their temperatures.
Advantageous aspects of the fabrication, features and advantages of the heat exchanger block 29 compared to conventional heat exchangers include:
Fabrication by the 3D printing process here includes the following processes: selective laser sintering (SLS), direct metal laser sintering (DMLS), selective laser melting (SLM), multi jet fusion (MJF), high-speed sintering (HSS) and electron beam melting (EBM). SLS is the most common for plastics, DMLS and SLM are the most common for metals. Also encompassed are numerous other variations of these 3D printing processes proposed by manufacturers for metal powders and plastics (and polymers).
In the embodiment of
As illustrated in
For thermosyphons, this heat exchanger may also be employed for an evaporating cooling fluid entering the top going through a boiling process while the fluid entering the bottom is going through a condensing process. For waste heat recovery from a thermosyphon, or other some other similar process, the heat exchanger is also applicable to a broader application of only single-phase liquids flowing through it, one to be heated and one to be cooled. For example, the heat exchanger may be employed for disposing of the recovered heat to a district heating line. For a thermosyphon condenser cooled by an evaporating fluid flow, the choice of the respective microchannel widths to optimize heat transfer and reduce pressure drops of both fluids is feasible here.
Furthermore, it is possible with simple geometrical changes to add an additional third or fourth fluid flow circuit within this unit for more complex applications where the third or fourth fluid are not to be mixed with the first two fluids. For example, if the thermosyphon is cooled by two different fluid circuits of water (for example one going to heat dissipation in the environment and the other going to waste heat recovery), one single heat exchanger can handle this by modifying the flow circuit to a left-side and a right-side flow through the microchannels by making simple changes in the inlet and outlet headers and adding additional inlet and outlet piping connections.
For 3D printing, one advantage is the ability to produce the printed object as light in weight as possible to reduce the material input, e.g. powder, and to reduce the printing time and thus reduce its fabrication cost. The thermosyphon condenser is one of the most expensive components of the rack thermosyphon system and thus it is useful to reduce its fabrication cost. The present heat exchanger 26a for the thermosyphon rack cooling system 4 is able to be fabricated with very thin internal walls between neighboring channels and between the layers (range of dimensions and aspect ratios were cited above). The walls and inlet and outlet piping connections of the heat exchanger are made thicker based on a mechanical stress analysis to the necessary thickness.
From a sustainability viewpoint, 3D printing requires only one material in its fabrication; that is no solders, brasing or welding materials, no metal waste or shavings, and no cleaning fluid to remove residuals of conventional fabrication processes. The powder remaining inside a 3D printed object at the end of its fabrication processes is removed and is recycled into the 3D printing of the next object).
In a variant, the principal condenser 12 may comprise only an air-liquid heat exchanger 26b, the liquid circuit thereof being connected to the riser and downcomer of the stack cooling system.
The principal condenser 12 thus receives the coolant fluid flowing in from the riser 8b and outputs the coolant fluid into the downcomer 8a that is cooled by the one or more heat exchangers 26a, 26b.
The air-liquid heat exchanger 26b, in the embodiments where it is implemented, may receive gravity-driven thermosyphon coolant rising from and returning to one or more liquid-liquid heat exchangers 26a, for instance as illustrated in
The riser 8b includes a riser pipe 24 that may have one or a plurality of channels 39 (e.g. as illustrated in
The internal walls 41 within the riser pipe 24 increase the surface area and heat exchange with the coolant fluid flowing in the riser pipe.
The riser has a plurality of evaporator sections that may simply be sections of the riser pipe against which thermal interface couplings 16 may be mounted for transferring heat from the unit cooling system 6 to the riser pipe 24.
The downcomer 8a comprises a downcomer pipe that may have the same but may have a different shape from the riser pipe and may also comprise a single channel instead of multiple channels.
In a preferred embodiment, the downcomer is not coupled thermally to individual unit cooling systems 6 and simply serves as a return line for supplying cooling fluid to the riser 8b.
The riser pipe may advantageously comprise an extruded metal construction, for instance extruded aluminum.
The riser pipe may advantageously have a substantially rectangular shape with opposed flat major outer surfaces 27 for clamping plates thereagainst that serve as a thermal interface coupling 16. The riser pipe rectangular cross-sectional profile preferably has a length L to width W ratio L/W in a range of 3/1 to 30/1 and preferably in a range of 4/1 to 20/1. These proportions provide an optimum compromise between structure rigidity, manufacturability, minimum flow resistance, and heat exchange surface area available for attaching the unit cooling system 6.
According to an aspect of the invention, the riser pipe may advantageously have a substantially linear geometry (constant profile) across a plurality of electronic units 3, for instance from the top to the bottom of the stack, such that the unit cooling systems 6 may be coupled there along at any position vertically with respect to the riser pipe without special considerations. This provides great flexibility in positioning and coupling of unit cooling systems 6 of electronic units 3 and ease of maintenance and installation.
Each unit cooling system 6 comprises a fluid flow circuit 13 in which a coolant or possibly a plurality of coolants flow configured as a LTS or PHP cooling system. For the LTS, the fluid flow circuit 13 comprises an evaporator line (or pipe) 14a that is connected as an input to a thermal interface coupling 16 thermally coupled to the riser 8b of the stack cooling system 4, and as an output to a thermal interface coupling 15 thermally coupled to a heat generating component 5 of the electronic unit 3, for instance a processor thereof. The fluid flow circuit 13 also comprises a condenser line (or pipe) 14b that is connected as an output to the thermal interface coupling 16 thermally coupled to the riser 8b of the stack cooling system 4, and that is connected as an input to the thermal interface coupling 15 thermally coupled to the heat generating component 5 of the electronic unit 3. Each unit cooling system 6 can be attached to one or more heat generating components 5, here illustrated with two heat generating components. The housing 7 may be horizontal, or in other commonly used orientation, as long as the elevation of the condenser thermal interface coupling 16 is above that of the evaporator thermal interface coupling 15.
In an advantageous embodiment for the PHP, illustrated in
The use of PHP or LTS cooling systems within each electronic unit 3 that are separate fluid circuits from the principal cooling system 4 of the stack (the stack cooling system 4) yet thermally coupled thereto along the riser 8b, provide a very flexible arrangement in which individual electronic units can be decoupled and coupled to the multi-unit electronic apparatus stack 1 and the associated stack cooling system 4 without interfering with the other electronic units. Moreover a fault in the cooling circuit of one of the unit cooling system 6 affects only a single electronic unit and thus the overall reliability and safety of the cooling system is improved.
The use of PHP and LTS cooling circuits in both the individual electronic units and the stack of electronic units provide a very compact cooling arrangement with a high power heat transfer per unit volume while yet a flexible, easy to install and reliable arrangement.
Number | Date | Country | Kind |
---|---|---|---|
21208623.5 | Nov 2021 | EP | regional |
Filing Document | Filing Date | Country | Kind |
---|---|---|---|
PCT/EP2022/081895 | 11/15/2022 | WO |