Hybrid immersion cooling system for rack-mounted electronic assemblies

Information

  • Patent Grant
  • 11924998
  • Patent Number
    11,924,998
  • Date Filed
    Tuesday, March 22, 2022
    2 years ago
  • Date Issued
    Tuesday, March 5, 2024
    4 months ago
Abstract
The disclosed systems and structures are directed to providing a hybrid liquid-cooling system for at least one rack-mounted immersion case containing at least one electronic assembly submerged in dielectric immersion cooling liquid. The hybrid liquid cooling system comprises a closed-loop fluid distribution arrangement configured to circulate channelized fluid, an external cooling module configured to thermally condition the channelized fluid circulated by the closed-loop fluid distribution arrangement, a serpentine convection coil structured to internally convey channelized fluid to operatively cool ambient temperatures of the dielectric immersion cooling liquid, and one or more fluid cooling blocks arranged to be in direct thermal contact with one or more heat-generating electronic processing components of the at least one electronic assembly.
Description
CROSS-REFERENCE TO RELATED APPLICATIONS

This application claims benefit to European Application No. EP 21305427.3, entitled “IMMERSION COOLING CONCEPTS FOR SERVERS”, filed on Apr. 1, 2021, and to European Application No. EP 21306171.6, entitled “HYBRID IMMERSION COOLING SYSTEM FOR RACK-MOUNTED ELECTRONIC ASSEMBLIES”, filed on Aug. 30, 2021, the contents of both of which are incorporated by reference herein in their entirety.


FIELD

The present disclosure generally relates to the cooling of rack-mounted electronic equipment and, in particular, to a hybrid liquid cooling system for such equipment.


BACKGROUND

Electronic equipment such as, for example, processing servers, memory storage systems, etc. are typically arranged in equipment racks. Large computing facilities servicing the increased demand for processing resources may contain thousands of racks to support such electronic equipment.


Such electronic equipment racks, including support equipment mounted on their backplanes, consume large amounts of electric power for proper operations which, in turn, results in the generation of substantial amounts of heat. For example, certain components of electronic assemblies, such as, processing units, generate so much heat during operations that they are susceptible to failure within seconds without adequate cooling. Accordingly, cooling measures/techniques are of particular import to electronic equipment racks.


In conventional implementations, fans are mounted within the electronic equipment racks to provide forced-air cooling to the rack-mounted equipment housing electronic assemblies. However, this implementation merely displaces some of the heat generated within the rack-mounted equipment to the general ambient environment which, in turn, requires further ambient cooling measures.


Recently, liquid cooling methods have been introduced as an addition and/or alternative to conventional fan forced-air cooling of electronic equipment racks. One such method is a direct cooling plate block technique that comprises cooling plate blocks having internal channels for circulating cooled water that are directly mounted to heat-generating electronic components, such as processing units, to displace the heat generated therefrom towards mounted heat-exchanging units. In turn, the mounted heat-exchanging units may employ finned tubes or plate structures having relatively large surface areas to adequately displace heat (e.g., in similar fashion to radiators) away from the electronic components.


Another liquid cooling method is an immersion cooling technique, in which electronic components are fully submerged in a casing containing a non-conductive cooling liquid, such as, for example, an oil-based dielectric cooling liquid. The immersion of the electronic components achieves adequate thermal contact between the electronic components and the dielectric cooling liquid. However, certain electronic components, such as, for example, processing units tend to generate more heat than other devices, such as, for example, memory boards.


As such, the immersion cooling technique generally requires circulation of the dielectric cooling liquid within the casing that is maintained at a lower temperature level sufficient to cool the hotter generating electronic components. To do so, the immersion cooling technique typically employs pumps, heat sink structures, heat exchangers, sealed evaporative equipment, etc. that either consume large amounts of energy to operate, require sealed casings with environmentally unfriendly chemicals, or occupy relatively large surface areas that limit the number of electronic components that can be implemented.


Even though the recent developments noted above have shown to provide some limited benefits, improvements are still desirable in achieving higher efficiencies and increasing the overall cooling performance of rack-mounted liquid-cooled electronic assemblies.


The subject matter discussed in the background section should not be assumed to be prior art merely as a result of its mention in the background section. Similarly, a problem mentioned in the background section or associated with the subject matter of the background section should not be assumed to have been previously recognized in the prior art.


SUMMARY

The embodiments of the present disclosure are provided based on developers' understanding of the limitations associated with the prior art, in achieving higher efficiencies, increasing the overall cooling performance of rack-mounted liquid-cooled electronic assemblies, and improving the power consumption of such electronic assemblies.


In addressing such limitations, the embodiments of the present disclosure provides a hybrid liquid cooling system (100) for at least one rack-mounted immersion case (104) housed within a rack frame (102) in which the at least one immersion case (104) contains a volume of dielectric immersion cooling liquid (106) and at least one electronic assembly (108) submerged in the dielectric immersion cooling liquid (106) in which the at least one electronic assembly (108) comprises one or more one heat-generating electronic processing component (110, 112).


The hybrid liquid cooling system (100) further comprises a closed-loop fluid distribution arrangement (134) configured to circulate channelized fluid to and from fluidly-coupled elements associated with at least one immersion case (104) and an external cooling module (130) configured to thermally condition the channelized fluid circulated by the closed-loop fluid distribution arrangement (134). The external cooling module (130) comprises a fluidly-coupled input configured to receive the higher-temperature channelized fluid via the closed-loop fluid distribution arrangement (134) and a fluidly-coupled output configured to forward the conditioned lower-temperature channelized fluid via the closed-loop fluid distribution arrangement (134).


The hybrid liquid cooling system (100) further comprises a serpentine convection coil (120) submerged within the dielectric immersion cooling liquid (106) and separately disposed from the at least one electronic assembly (108), the serpentine convection coil (120) configured with a fluidly-coupled upper port and a fluidly-coupled lower port to fluidly communicate with the closed-loop fluid distribution arrangement (134), the serpentine convection coil (120) structured to internally convey the channelized fluid to operatively cool ambient temperatures of the dielectric immersion cooling liquid (106) through thermal convection flow based on the lower-temperature channelized fluid provided by the cooling module (130) via the closed-loop fluid distribution arrangement (134).


The hybrid liquid cooling system (100) also comprises one or more fluid cooling blocks (110A, 112A) arranged to be in direct thermal contact with the one or more heat-generating electronic processing components (110, 112), the one or more fluid cooling blocks (110A, 112A) fluidly-coupled to the closed-loop fluid distribution arrangement (134) and configured to cool the one or more heat-generating electronic processing components (110, 112) based on the lower-temperature channelized fluid forwarded by the cooling module (130) via the closed-loop fluid distribution arrangement (134).


In various aspects of the present disclosure, the closed-loop fluid distribution arrangement (134) of the hybrid liquid cooling system (100) comprises a tube channel network (136) configured to facilitate the circulation of channelized fluid between the fluidly-coupled serpentine convection coil (120), the fluidly-coupled one or more fluid cooling blocks (110A, 112A), and the fluidly-coupled external cooling module (130). The tube channel network may be constructed from flexible materials (e.g., rubber, plastic, etc.), rigid materials (e.g., metal, PVC piping, etc.), or any combination of such materials.


In certain implementations consistent with the present disclosure, the tube channel network (136) is structured to route the lower-temperature channelized fluid from the external cooling module (130) to at least one fluid cooling block (110A) and route a resulting higher-temperature channelized fluid output from the at least one cooling block (112A) to the upper port of the serpentine convection coil (120), wherein the lower port of the serpentine convection coil (120) forwards the higher-temperature channelized fluid to the external cooling module (130) for thermal conditioning into the lower-temperature channelized fluid.


In certain implementations consistent with the present disclosure, the tube channel network (136) is structured to route the lower-temperature channelized fluid from the external cooling module (130) to at least one fluid cooling block (110A) and route a resulting higher-temperature channelized fluid output from the at least one fluid cooling block (110A) to the lower port of the serpentine convection coil (120), wherein the upper port of the serpentine convection coil (120) forwards the higher-temperature channelized fluid to the external cooling module (130) for thermal conditioning into the lower-temperature channelized fluid.


In certain implementations consistent with the present disclosure, the tube channel network (136) is structured to route the lower-temperature channelized fluid from the external cooling module (130) to the lower port of the serpentine convection coil (120) and route the lower-temperature channelized fluid from the upper port of the serpentine convection coil (120) to at least one fluid cooling block (110A), wherein a resulting higher-temperature channelized fluid output from the at least one fluid cooling block (110A) is forwarded to the external cooling module (130) for thermal conditioning into the lower-temperature channelized fluid.


In certain implementations consistent with the present disclosure, the tube channel network (136) is structured to route the lower-temperature channelized fluid from the external cooling module (130) to the upper port of the serpentine convection coil (120) and route the lower-temperature channelized fluid from the lower portion port of the serpentine convection coil (120) to at least one fluid cooling block (110A), wherein a resulting higher-temperature channelized fluid output from the at least one fluid cooling block (110A) is forwarded to the external cooling module (130) for thermal conditioning into the lower-temperature channelized fluid.


In the context of the present specification, unless expressly provided otherwise, a computer system may refer, but is not limited to, an “electronic device”, an “operation system”, a “system”, a “computer-based system”, a “controller unit”, a “monitoring device”, a “control device” and/or any combination thereof appropriate to the relevant task at hand.


In the context of the present specification, unless expressly provided otherwise, the expression “computer-readable medium” and “memory” are intended to include media of any nature and kind whatsoever, non-limiting examples of which include RAM, ROM, disks (CD-ROMs, DVDs, floppy disks, hard disk drives, etc.), USB keys, flash memory cards, solid state-drives, and tape drives. Still in the context of the present specification, “a” computer-readable medium and “the” computer-readable medium should not be construed as being the same computer-readable medium. To the contrary, and whenever appropriate, “a” computer-readable medium and “the” computer-readable medium may also be construed as a first computer-readable medium and a second computer-readable medium.


In the context of the present specification, unless expressly provided otherwise, the words “first”, “second”, “third”, etc. have been used as adjectives only for the purpose of allowing for distinction between the nouns that they modify from one another, and not for the purpose of describing any particular relationship between those nouns.


Implementations of the present technology each have at least one of the above-mentioned object and/or aspects, but do not necessarily have all of them. It should be understood that some aspects of the present technology that have resulted from attempting to attain the above-mentioned object may not satisfy this object and/or may satisfy other objects not specifically recited herein.


Additional and/or alternative features, aspects and advantages of implementations of the present technology will become apparent from the following description, the accompanying drawings and the appended claims.





BRIEF DESCRIPTION OF THE FIGURES

Further features and advantages of the present disclosure will become apparent from the following detailed description, taken in combination with the appended drawings, in which:



FIG. 1 is a conceptual block diagram of a hybrid liquid cooling system, in accordance with the embodiments of the present disclosure;



FIG. 2 is a functional block diagram of a hybrid liquid cooling system implementation, in accordance with the embodiments of the present disclosure;



FIG. 3 is a functional block diagram of another hybrid liquid cooling system implementation, in accordance with the embodiments of the present disclosure;



FIG. 4 is a functional block diagram of yet another hybrid liquid cooling system implementation, in accordance with the embodiments of the present disclosure;



FIG. 5 is a functional block diagram of an additional hybrid liquid cooling system implementation, in accordance with the embodiments of the present disclosure; and



FIGS. 6, 7 are conceptual views of a hybrid liquid cooling system containing multiple serpentine convection coils, in accordance with the embodiments of the present disclosure.





DETAILED DESCRIPTION

The instant disclosure is directed to address at least some of the deficiencies of the current technology. In particular, the instant disclosure presents a hybrid liquid-cooling system for at least one rack-mounted immersion case containing at least one electronic assembly submerged in dielectric immersion cooling liquid.


The examples and conditional language recited herein are principally intended to aid the reader in understanding the principles of the present technology and not to limit its scope to such specifically recited examples and conditions. It will be appreciated that those skilled in the art may devise various arrangements that, although not explicitly described or shown herein, nonetheless embody the principles of the present technology.


Furthermore, as an aid to understanding, the following description may describe relatively simplified implementations of the present technology. As persons skilled in the art would understand, various implementations of the present technology may be of a greater complexity.


In some cases, what are believed to be helpful examples of modifications to the present technology may also be set forth. This is done merely as an aid to understanding, and, again, not to define the scope or set forth the bounds of the present technology. These modifications are not an exhaustive list, and a person skilled in the art may make other modifications while nonetheless remaining within the scope of the present technology. Further, where no examples of modifications have been set forth, it should not be interpreted that no modifications are possible and/or that what is described is the sole manner of implementing that element of the present technology.


Moreover, all statements herein reciting principles, aspects, and implementations of the present technology, as well as specific examples thereof, are intended to encompass both structural and functional equivalents thereof, whether they are currently known or developed in the future. Thus, for example, it will be appreciated by those skilled in the art that any block diagrams herein represent conceptual views of illustrative systems embodying the principles of the present technology.


With these fundamentals in place, we will now consider some non-limiting examples to illustrate various implementations of aspects of the present disclosure.


In particular, FIG. 1 depicts a conceptual block diagram of a hybrid liquid cooling system 100, in accordance with the embodiments of the present disclosure. The hybrid liquid-cooling system 100 is configured to provide a novel integration of specific immersion-cooling and direct channelized liquid-cooling fluid techniques.


With this said, FIG. 1 shows that hybrid liquid-cooling system 100 comprises a rack frame 102 that houses at least one rack-mounted immersion case 104 containing a volume of non-conductive dielectric immersion fluid 106 and at least one electronic assembly 108 that is submerged in the dielectric immersion cooling liquid 106.


For illustrative purposes and ease of understanding only, the figures depict a single rack-mounted immersion case 104 and a single electronic assembly 108. Such depictions should not be interpreted as being limiting, as the inventive concepts presented herein cover and contemplate the use of multiple immersion cases 104 and/or multiple electronic assemblies 108.


By having electronic assembly 108 submerged in the dielectric immersion cooling liquid 106, rack-mounted immersion case 104 provides immersion-cooling of electronic assembly 108. Specifically, submerged electronic assembly 108 may contain processing, RAM, ROM, hard disk drives, etc. components. By being submerged, the electronic assembly 108 components are arranged to come in direct contact with the dielectric immersion cooling liquid 106, thereby effectively reducing the operating temperatures of such components.


The rack-mounted immersion case 104 may also contain a serpentine convection coil 110 that is also submerged within the dielectric immersion cooling liquid 106. The serpentine convection coil 110 is structured with multiple hollow-channel coils to provide a high surface area exposure relative to the dielectric immersion cooling liquid 106 while also maintaining compact overall length and width dimensions. The serpentine convection coil 110 is also structured with a fluidly-coupled upper port and a fluidly-coupled lower port.


With this structure, serpentine convection coil 110 is configured to cool the ambient temperature and induce thermal convection in the the dielectric immersion cooling liquid 106 through direct channelized liquid-cooling. That is, serpentine convection coil 110 internally conveys a circulating channelized cooling fluid that operates to cool the dielectric immersion cooling liquid 106. It is to be understood that the channelized cooling fluid may consist of a different liquid from the dielectric immersion cooling liquid 106. That is, the channelized cooling fluid may comprise water, alcohol, or any suitable liquid capable of sustaining adequate cooling temperatures.


Moreover, in an effort to optimize the thermal convection flow of the dielectric immersion cooling liquid 106, serpentine convection coil 120 may be strategically positioned separate from electronic assembly 108 while in an area within immersion case 104 approximate to the relative locations of heat-generating components 110, 112 associated with electronic assembly 108.


As noted above, electronic assembly 108 comprises electronic components that are also submerged within dielectric immersion cooling liquid 106. In many implementations, at least one of the electronic components may comprise a heat-generating electronic processing component 110, 112. Such electronic processing heat-generating components 110, 112 may take the form of general processing units and/or specialized processing units. Examples of such processing units include, but are not limited to, central processing units (CPUs), graphics processing units (GPUs), neural processing units (NPUs), tensor processing units (TPUs), power supply circuitry, and application specific integrated circuits (ASICs), including, for example, ASICs configured for high-speed cryptocurrency mining.


In order to provide further cooling to these particularly heat-generating electronic processing components 110, 112, and as a supplement to the overall immersion cooling of electronic assembly 108 within rack-mounted immersion case 104, direct channelized liquid-cooling fluid may be implemented. That is, cooling blocks 110A, 112A may be arranged to be in direct thermal contact with the one or more heat-generating electronic processing components 110, 112. The fluid cooling blocks 110A, 112A are structured to convey the circulating channelized cooling fluid to provide additional cooling measures to heat-generating electronic processing components 110, 112.


Turning back to FIG. 1, hybrid liquid cooling system 100 further comprises a closed-loop fluid distribution arrangement 134. The closed-loop fluid distribution arrangement 134 operates to circulate lower temperature (“cool”) channelized fluid, e.g. 30°-45° C., to components within the immersion case 104 and commensurately circulate higher temperature (“hot”) channelized fluid, e.g. ≥50° C., back from those components. To this end, closed-loop fluid distribution arrangement 134 is structured with a tube channel network 136 arranged to provide the overall distribution and circulation of “cool” and “hot” channelized fluid to and from fluidly-coupled components within rack-mounted immersion case 104.


As shown, closed-loop fluid distribution arrangement 134 is fluidly-coupled to an external cooling module CM 130. The cooling module CM 130 is configured to thermally condition the higher temperature “hot” channelized fluid received from the fluidly-coupled components within rack-mounted immersion case 104, via tube channel network 136, into lower-temperature “cool” channelized fluid. The cooling module CM 130 is further configured to forward the conditioned lower-temperature “cool” channelized fluid to the fluidly-coupled components, via tube channel network 136.


As also shown, cooling module CM 130 is configured to fluidly communicate with an external cooling source 132 that operates to supply cooling module CM 130 with lower temperature fluid flow to facilitate the thermal conditioning by the external cooling module 130 of the higher-temperature channelized fluid into the lower-temperature channelized fluid. The external cooling source 132 may comprise an external cool water supply, a dry cooling unit, or any other suitable measure capable of providing adequate cooling temperature fluid flow to external cooling module 130 for proper thermal conditioning operations by external cooling module 130.


In addition, closed-loop fluid distribution arrangement 134 comprises at least one pump 140 that is fluidly-coupled to the external cooling module CM 130 to provide an adequate circulatory flow rate, e.g., 0.35-0.55 liters/min. In particular, pump 140 is configured to receive the higher-temperature “hot” channelized fluid from the higher temperature “hot” channelized fluid received from the fluidly-coupled components, such as, serpentine convection coil 110 and fluid cooling blocks 110A, 112A within rack-mounted immersion case 104, via tube channel network 136, and forward the “hot” channelized fluid to cooling module CM 130 for lower temperature conditioning.


The pump 140 is also configured to receive the conditioned lower temperature “cool” channelized fluid from cooling module CM 130 and forward, via tube channel network 136, the “cool” channelized fluid to the fluidly-coupled components within rack-mounted immersion case 104, such as, serpentine convection coil 110 and fluid cooling blocks 110A, 112A.


Therefore, the infrastructure of hybrid liquid-cooling system 100 described above provides for the circulation of lower-temperature “cool” channelized fluid from the external cooling module 130 to the fluidly-coupled serpentine convection coil 120 and/or the fluidly-coupled one or more fluid cooling blocks 110A, 112A for component cooling operations as well as the circulation higher-temperature “hot” channelized fluid from the fluidly-coupled serpentine convection coil 120 and/or the fluidly-coupled one or more fluid cooling blocks 110A, 112A back to the external cooling module 130 for conditioning into lower-temperature channelized fluid.


By virtue of the infrastructure, hybrid liquid-cooling system 100 is capable of maintaining a relatively narrow thermal variance between the input “cool” channelized fluid and the output “hot” channelized fluid of ΔT=20K as well as achieving a rack cooling partial Power Use Effectiveness (pPUE) equal to 1.00.


Given the overall hybrid liquid-cooling system 100 concept of integrating specific immersion-cooling and direct channelized liquid-cooling fluid techniques as presented above, the following descriptions detail various non-limiting implementations of the hybrid liquid-cooling system 100 that generally embody the disclosed concepts.



FIG. 2 is a functional block diagram of a hybrid liquid cooling system implementation 200, in accordance with the embodiments of the present disclosure. FIG. 2 illustrates similar structural features as FIG. 1, so identical reference characters are used and the previous descriptions of such features and attributes are omitted for purposes of brevity.



FIG. 2 depicts hybrid liquid-cooling system implementation 200 that is configured to provide both the immersion-cooling and direct channelized liquid-cooling fluid techniques described above. The particular configuration of implementation 200 offers one solution for optimizing the liquid cooling of submerged components. Specifically, hybrid liquid-cooling system implementation 200 comprises immersion case 104 containing a volume of dielectric immersion fluid 106, submerged electronic assembly 108 having heat-generating electronic processing components 110, 112, submerged memory (RAM) 116, hard disk storage 118, and submerged serpentine convection coil 120.


In the hybrid liquid-cooling system implementation 200, the tube channel network 136 is structured to route the lower-temperature “cool” channelized fluid from the external cooling module 130 to at least one fluid cooling block 110A. The resulting higher-temperature “hot” channelized fluid output from the at least one cooling block 110A is then routed to the upper port of the serpentine convection coil 120. The lower port of the serpentine convection coil 120 subsequently forwards the higher-temperature channelized fluid to the external cooling module 130 for thermal conditioning and conversion into the lower-temperature channelized fluid.



FIG. 3 depicts hybrid liquid-cooling system implementation 300 that is also configured to provide both the immersion-cooling and direct channelized liquid-cooling fluid techniques described above. The particular configuration of implementation 300 offers another solution for optimizing the liquid cooling of submerged components.


Like implementation 200, hybrid liquid-cooling system implementation 300 comprises immersion case 104 containing a volume of dielectric immersion fluid 106, submerged electronic assembly 108 having heat-generating electronic processing components 110, 112, submerged memory (RAM) 116, hard disk storage 118, and submerged serpentine convection coil 120. However, in hybrid liquid-cooling system implementation 300, the tube channel network 136 is structured to route the lower-temperature “cool” channelized fluid from the external cooling module 130 to at least one fluid cooling block 110A. The resulting higher-temperature “hot” channelized fluid output from the fluid cooling block 110A is then routed to the lower port of the serpentine convection coil 120. The upper port of the serpentine convection coil 120 subsequently forwards the higher-temperature channelized fluid to the external cooling module 130 for thermal conditioning/conversion into the lower-temperature channelized fluid.



FIG. 4 depicts hybrid liquid-cooling system implementation 400 that is also configured to provide both the immersion-cooling and direct channelized liquid-cooling fluid techniques described above. The particular configuration of implementation 400 offers another solution for optimizing the liquid cooling of submerged components.


Like implementations 200, 300 hybrid liquid-cooling system implementation 400 comprises immersion case 104 containing a volume of dielectric immersion fluid 106, submerged electronic assembly 108 having heat-generating electronic processing components 110, 112, submerged memory (RAM) 116, hard disk storage 118, and submerged serpentine convection coil 120. However, in hybrid liquid-cooling system implementation 400, the tube channel network 136 is structured to route the lower-temperature “cool” channelized fluid from the external cooling module 130 to the lower port of the serpentine convection coil 120. The lower-temperature channelized fluid is then routed from the upper port of the serpentine convection coil 120 to at least one fluid cooling block 110A. The resulting higher-temperature “hot” channelized fluid output from the fluid cooling block 110A is subsequently forwarded to the external cooling module 130 for thermal conditioning/conversion into the lower-temperature channelized fluid.



FIG. 5 depicts hybrid liquid-cooling system implementation 500 that is also configured to provide both the immersion-cooling and direct channelized liquid-cooling fluid techniques described above. The particular configuration of implementation 500 offers yet another solution for optimizing the liquid cooling of submerged components.


Like implementations 200, 300, 400 hybrid liquid-cooling system implementation 500 comprises immersion case 104 containing a volume of dielectric immersion fluid 106, submerged electronic assembly 108 having heat-generating electronic processing components 110, 112, submerged memory (RAM) 116, hard disk storage 118, and submerged serpentine convection coil 120. However, in hybrid liquid-cooling system implementation 500, the tube channel network 136 is structured to route the lower-temperature “cool” channelized fluid from the external cooling module 130 to the upper port of the serpentine convection coil 120. The lower-temperature channelized fluid from the lower portion port of the serpentine convection coil 120 is then routed to at least one fluid cooling block 110A. The resulting higher-temperature “hot” channelized fluid output from the fluid cooling block 110A is subsequently forwarded to the external cooling module 130 for thermal conditioning/conversion into the lower-temperature channelized fluid.


It will be appreciated that hybrid liquid-cooling system implementations 200, 300, 400, 500 may comprise more than one fluid cooling block 110A. That is, as shown, implementations 200, 300, 400, 500 may comprise first fluid cooling block 110A and a second fluid cooling block 112A that are fluidly-coupled in series with each other to maintain the closed-loop connectivity of closed-loop fluid distribution arrangement 134.


It is contemplated that some operational environments and equipment implementations may require additional immersion cooling measures. Accordingly, FIGS. 6, 7 provide conceptual views of hybrid liquid cooling system configurations, 600, 700, respectively containing multiple serpentine convection coils, in accordance with the embodiments of the present disclosure. As shown, configurations, 600, 700 indicate the respective routing of the channelized liquid-cooling fluid to and from cooling module 130 and between the serpentine coils to maintain the closed-loop connectivity of closed-loop fluid distribution arrangement 134.


It is further contemplated that the infrastructure of hybrid liquid-cooling system implementations 200, 300, 400, 500 allows for hot water recycling measures by repurposing the higher-temperature channelized fluid to assist in the operations of other heat generating mechanisms, such as, for example, boilers, engine cogeneration, carbon filter plants, etc.


With this said, it will be understood that, although the embodiments presented herein have been described with reference to specific features and structures, it is clear that various modifications and combinations may be made without departing from such disclosures. The specification and drawings are, accordingly, to be regarded simply as an illustration of the discussed implementations or embodiments and their principles as defined by the appended claims, and are contemplated to cover any and all modifications, variations, combinations or equivalents that fall within the scope of the present disclosure.

Claims
  • 1. A hybrid liquid cooling system for at least one rack-mounted immersion case housed within a rack frame, comprising: the at least one immersion case containing a volume of dielectric immersion cooling liquid and at least one electronic assembly submerged in the dielectric immersion cooling liquid, the at least one electronic assembly comprising one or more one heat-generating electronic processing components;a closed-loop fluid distribution arrangement configured to circulate channelized fluid to and from fluidly-coupled elements associated with the at least one immersion case, the closed-loop fluid distribution arrangement comprising a tube channel network;an external cooling module configured to thermally condition the channelized fluid circulated by the closed-loop fluid distribution arrangement in which the channelized fluid having a higher temperature is conditioned into channelized fluid having a lower temperature, the external cooling module comprising a fluidly-coupled input configured to receive the higher-temperature channelized fluid via the closed-loop fluid distribution arrangement and a fluidly-coupled output configured to forward the conditioned lower-temperature channelized fluid via the closed-loop fluid distribution arrangement;a serpentine convection coil, comprising a plurality of helical coils, that is submerged in a vertical orientation within the dielectric immersion cooling liquid and separately disposed from the at least one electronic assembly, the vertically-oriented serpentine convection coil configured with a fluidly-coupled upper port and a fluidly-coupled lower port to fluidly communicate with the closed-loop fluid distribution arrangement, the vertically-oriented serpentine convection coil structured to internally convey the channelized fluid to operatively cool ambient temperatures of the dielectric immersion cooling liquid via thermal convection flow and the lower-temperature channelized fluid forwarded by the cooling module via the closed-loop fluid distribution arrangement; andone or more fluid cooling blocks arranged to be in direct thermal contact with the one or more heat-generating electronic processing components, the one or more fluid cooling blocks fluidly-coupled to the closed-loop fluid distribution arrangement and configured to cool the one or more heat-generating electronic processing components based on the lower-temperature channelized fluid forwarded by the cooling module via the closed-loop fluid distribution arrangement.
  • 2. The hybrid liquid cooling system of claim 1, further comprising an external cooling source configured to provide lower temperature fluid flow to the external cooling module to facilitate the thermal conditioning by the external cooling module of the higher-temperature channelized fluid into the lower-temperature channelized fluid.
  • 3. The hybrid liquid cooling system of claim 2, wherein the external cooling source comprises a dry cooling unit configured to provide lower temperature air flow to the external cooling module.
  • 4. The hybrid liquid cooling system of claim 1, wherein the tube channel network of the closed-loop fluid distribution arrangement is configured to facilitate the circulation of the channelized fluid between the fluidly-coupled serpentine convection coil, the fluidly-coupled one or more fluid cooling blocks, and the fluidly-coupled external cooling module.
  • 5. The hybrid liquid cooling system of claim 1, wherein the closed-loop fluid distribution arrangement comprises at least one pump fluidly-coupled to the external cooling module and the tube channel network and configured to displace and circulate the channelized fluid.
  • 6. The hybrid liquid cooling system of claim 1, wherein the one or more one heat-generating electronic processing components comprise general processing units and/or specialized processing units.
  • 7. The hybrid liquid cooling system of claim 1, wherein the at least one electronic assembly comprises one or more random access memory units and/or one or more hard disk storage units.
  • 8. The hybrid liquid cooling system of claim 1, wherein the vertically-oriented serpentine convection coil is structured to have a compact overall length and width dimensions, in which the compact length is greater than the compact width.
  • 9. The hybrid liquid cooling system of claim 1, wherein the vertically-oriented serpentine convection coil is positioned adjacent to locations of the one or more heat-generating electronic processing components disposed on the at least one electronic assembly.
  • 10. The hybrid liquid cooling system of claim 1, wherein the tube channel network is configured to: circulate the lower-temperature channelized fluid from the external cooling module to the fluidly-coupled vertically-oriented serpentine convection coil and/or the fluidly-coupled one or more fluid cooling blocks for cooling operations, andcirculate the higher-temperature channelized fluid from the fluidly-coupled vertically-oriented serpentine convection coil and/or the fluidly-coupled one or more fluid cooling blocks back to the external cooling module for conditioning into the lower-temperature channelized fluid.
  • 11. The hybrid liquid cooling system of claim 1, wherein the tube channel network is structured to: route the lower-temperature channelized fluid from the external cooling module to at least one fluid cooling block; androute a resulting higher-temperature channelized fluid output from the at least one cooling block to the upper port of the vertically-oriented serpentine convection coil,wherein the lower port of the vertically-oriented serpentine convection coil forwards the higher-temperature channelized fluid to the external cooling module for thermal conditioning into the lower-temperature channelized fluid.
  • 12. The hybrid liquid cooling system of claim 1, wherein the tube channel network is structured to: route the lower-temperature channelized fluid from the external cooling module to at least one fluid cooling block; androute a resulting higher-temperature channelized fluid output from the at least one fluid cooling block to the lower port of the vertically-oriented serpentine convection coil,wherein the upper port of the vertically-oriented serpentine convection coil forwards the higher-temperature channelized fluid to the external cooling module for thermal conditioning into the lower-temperature channelized fluid.
  • 13. The hybrid liquid cooling system of claim 1, wherein the tube channel network is structured to: route the lower-temperature channelized fluid from the external cooling module to the lower port of the vertically-oriented serpentine convection coil; androute the lower-temperature channelized fluid from the upper port of the vertically-oriented serpentine convection coil to at least one fluid cooling block,wherein a resulting higher-temperature channelized fluid output from the at least one fluid cooling block is forwarded to the external cooling module for thermal conditioning into the lower-temperature channelized fluid.
  • 14. The hybrid liquid cooling system of claim 1, wherein the tube channel network is structured to: route the lower-temperature channelized fluid from the external cooling module to the upper port of the vertically-oriented serpentine convection coil; androute the lower-temperature channelized fluid from the lower portion port of the vertically-oriented serpentine convection coil to at least one fluid cooling block,wherein a resulting higher-temperature channelized fluid output from the at least one fluid cooling block is forwarded to the external cooling module for thermal conditioning into the lower-temperature channelized fluid.
  • 15. The hybrid liquid cooling system of claim 1, wherein the at least one fluid cooling block comprises a first fluid cooling block and a second fluid cooling block that are fluidly-coupled in series with each other.
Priority Claims (2)
Number Date Country Kind
21305427 Apr 2021 EP regional
21306171 Aug 2021 EP regional
US Referenced Citations (177)
Number Name Date Kind
2115501 Sergius Apr 1938 A
2316296 Simonds Apr 1943 A
3938689 De Munnik Feb 1976 A
4619316 Nakayama Oct 1986 A
4888664 Rojc Dec 1989 A
5268814 Yakubowski Dec 1993 A
5307956 Richter et al. May 1994 A
5669524 Loedel Sep 1997 A
5907473 Przilas et al. May 1999 A
6023934 Gold Feb 2000 A
6746388 Edwards et al. Jun 2004 B2
7369410 Chen et al. May 2008 B2
7403392 Attlesey et al. Jul 2008 B2
7414845 Attlesey et al. Aug 2008 B2
7527085 Ijima et al. May 2009 B2
7724517 Attlesey et al. May 2010 B2
7885070 Campbell et al. Feb 2011 B2
7905106 Attlesey Mar 2011 B2
7911782 Attlesey et al. Mar 2011 B2
7911793 Attlesey Mar 2011 B2
8009419 Attlesey et al. Aug 2011 B2
8014150 Campbell et al. Sep 2011 B2
8089764 Attlesey Jan 2012 B2
8089765 Attlesey Jan 2012 B2
8089766 Attlesey Jan 2012 B2
8305759 Attlesey et al. Nov 2012 B2
8467189 Attlesey Jun 2013 B2
8619425 Campbell et al. Dec 2013 B2
8654529 Tufty et al. Feb 2014 B2
8934244 Shelnutt et al. Jan 2015 B2
8953317 Campbell et al. Feb 2015 B2
9049800 Shelnutt et al. Jun 2015 B2
9051502 Sedarous et al. Jun 2015 B2
9086859 Tufty et al. Jul 2015 B2
9128681 Tufty et al. Sep 2015 B2
9144179 Shelnutt et al. Sep 2015 B2
9155230 Eriksen Oct 2015 B2
9176547 Tufty et al. Nov 2015 B2
9195282 Shelnutt et al. Nov 2015 B2
9223360 Tufty et al. Dec 2015 B2
9328964 Shelnutt et al. May 2016 B2
9335802 Shelnutt et al. May 2016 B2
9351429 Shelnutt et al. May 2016 B2
9426927 Shafer et al. Aug 2016 B2
9436235 Damaraju et al. Sep 2016 B2
9464854 Shelnutt et al. Oct 2016 B2
9529395 Franz et al. Dec 2016 B2
9699938 Shelnutt et al. Jul 2017 B2
9699939 Smith Jul 2017 B2
9717166 Eriksen Jul 2017 B2
9756766 Best Sep 2017 B2
9773526 Shelnutt et al. Sep 2017 B2
9781859 Wishman et al. Oct 2017 B1
9795065 Shelnutt et al. Oct 2017 B2
9839164 Shelnutt et al. Dec 2017 B2
9844166 Shelnutt et al. Dec 2017 B2
9921622 Shelnutt et al. Mar 2018 B2
9968010 Shelnutt et al. May 2018 B2
9992914 Best et al. Jun 2018 B2
10010013 Shelnutt et al. Jun 2018 B2
10018425 Shelnutt et al. Jul 2018 B2
10020242 Katsumata et al. Jul 2018 B2
10064314 Shelnutt et al. Aug 2018 B2
10130008 Shepard et al. Nov 2018 B2
10143113 Shelnutt et al. Nov 2018 B2
10143114 Shelnutt et al. Nov 2018 B2
10146231 Shelnutt et al. Dec 2018 B2
10149408 Fujiwara et al. Dec 2018 B2
10156873 Shelnutt et al. Dec 2018 B2
10172262 Shelnutt et al. Jan 2019 B2
10206312 Shelnutt et al. Feb 2019 B2
10212857 Eriksen Feb 2019 B2
10225958 Gao Mar 2019 B1
10238010 Shelnutt et al. Mar 2019 B2
10271456 Tufty et al. Apr 2019 B2
10321609 Hirai et al. Jun 2019 B2
10331144 Shelnutt et al. Jun 2019 B2
10399190 North et al. Sep 2019 B2
10542635 Nishiyama Jan 2020 B2
10617042 Shelnutt et al. Apr 2020 B2
10622283 Leobandung Apr 2020 B2
10624236 Inano et al. Apr 2020 B2
10624242 Best Apr 2020 B2
10638641 Franz et al. Apr 2020 B2
10645841 Mao et al. May 2020 B1
10653036 Gao May 2020 B1
10667434 Mao et al. May 2020 B1
10674641 Shepard et al. Jun 2020 B2
10729039 Shelnutt et al. Jul 2020 B2
10791647 Miyamura et al. Sep 2020 B1
10871807 Best et al. Dec 2020 B2
10888032 Wakino Jan 2021 B2
10917998 Shelnutt et al. Feb 2021 B2
10932390 Korikawa Feb 2021 B2
10939580 Gao Mar 2021 B2
10939581 Chen et al. Mar 2021 B1
10990144 Wang et al. Apr 2021 B2
11006547 Gao May 2021 B2
11032939 Tufty et al. Jun 2021 B2
11071238 Edmunds et al. Jul 2021 B2
11268739 Wang et al. Mar 2022 B2
11751359 Heydari Sep 2023 B2
11822398 Heydari Nov 2023 B2
20020159233 Patel et al. Oct 2002 A1
20050150637 Tan et al. Jul 2005 A1
20070227756 Doerr et al. Oct 2007 A1
20090146294 Hillman et al. Jun 2009 A1
20090205590 Vetrovec Aug 2009 A1
20090260777 Attlesey Oct 2009 A1
20100103620 Campbell et al. Apr 2010 A1
20100108292 Bhunia et al. May 2010 A1
20100118494 Campbell et al. May 2010 A1
20100328889 Campbell et al. Dec 2010 A1
20110026776 Liang et al. Feb 2011 A1
20110028617 Hill et al. Feb 2011 A1
20110267768 Attlesey Nov 2011 A1
20110284194 Sarkar et al. Nov 2011 A1
20110286177 Attlesey Nov 2011 A1
20110317367 Campbell et al. Dec 2011 A1
20120007579 Apblett et al. Jan 2012 A1
20120075797 Attlesey Mar 2012 A1
20120120599 Chua et al. May 2012 A1
20130105120 Campbell et al. May 2013 A1
20140123492 Campbell et al. May 2014 A1
20140218845 Peng et al. Aug 2014 A1
20140218861 Shelnutt et al. Aug 2014 A1
20150109730 Campbell et al. Apr 2015 A1
20150237767 Shedd et al. Aug 2015 A1
20150330718 St Rock et al. Nov 2015 A1
20160305565 Miller et al. Oct 2016 A1
20160330874 Sato et al. Nov 2016 A1
20160360637 Harvilchuck et al. Dec 2016 A1
20170105313 Shedd et al. Apr 2017 A1
20170127565 Campbell et al. May 2017 A1
20170181328 Shelnutt et al. Jun 2017 A1
20170265328 Sasaki et al. Sep 2017 A1
20180008467 Cater et al. Jan 2018 A1
20180027695 Wakino et al. Jan 2018 A1
20180042138 Campbell et al. Feb 2018 A1
20180070477 Saito Mar 2018 A1
20180084671 Matsumoto et al. Mar 2018 A1
20180092243 Saito Mar 2018 A1
20180153058 Hirai et al. May 2018 A1
20180196484 Saito Jul 2018 A1
20180246550 Inaba Aug 2018 A1
20180295745 De Meijer et al. Oct 2018 A1
20180338388 Wei Nov 2018 A1
20190014685 So et al. Jan 2019 A1
20190090383 Tufty et al. Mar 2019 A1
20190098796 Wakino et al. Mar 2019 A1
20190218101 Huang et al. Jul 2019 A1
20190223324 Le et al. Jul 2019 A1
20190297747 Wakino et al. Sep 2019 A1
20200025451 Stone et al. Jan 2020 A1
20200093037 Enright et al. Mar 2020 A1
20200196489 Chang et al. Jun 2020 A1
20200214169 Tsunoda Jul 2020 A1
20200267872 Harada et al. Aug 2020 A1
20200288600 Gao Sep 2020 A1
20200305307 Amos et al. Sep 2020 A1
20200323100 Chiu et al. Oct 2020 A1
20200323108 Bilan et al. Oct 2020 A1
20200389998 Tung et al. Dec 2020 A1
20200390007 Edmunds et al. Dec 2020 A1
20210051815 Van et al. Feb 2021 A1
20210076531 Tung et al. Mar 2021 A1
20210102294 Miljkovic Apr 2021 A1
20210112683 Mohajer et al. Apr 2021 A1
20210185850 Kulkarni et al. Jun 2021 A1
20210321526 Kulkarni et al. Oct 2021 A1
20210327787 Yang et al. Oct 2021 A1
20210385971 Gorius et al. Dec 2021 A1
20210410292 Yang et al. Dec 2021 A1
20210410319 Manousakis et al. Dec 2021 A1
20210410320 Yang et al. Dec 2021 A1
20210410328 Yang et al. Dec 2021 A1
20220256744 Le Aug 2022 A1
Foreign Referenced Citations (39)
Number Date Country
211184672 Aug 2020 CN
110430725 Feb 2021 CN
2321849 May 2011 EP
2331412 Sep 2012 EP
3236727 Oct 2017 EP
3249496 Nov 2017 EP
3236727 Jan 2018 EP
3346491 Jul 2018 EP
3402316 Nov 2018 EP
3731611 Oct 2020 EP
3742097 Nov 2020 EP
2321849 Jan 2022 EP
2575680 Jan 2020 GB
2574632 Jul 2020 GB
H043451 Jan 1992 JP
2000092819 Mar 2000 JP
2020065002 Apr 2020 JP
1006486 Jan 1999 NL
I 678 961 Dec 2019 TW
2011006150 Jan 2011 WO
2014169230 Oct 2014 WO
2016076882 May 2016 WO
2017040217 Mar 2017 WO
2018025016 Feb 2018 WO
2018054462 Mar 2018 WO
2019006437 Jan 2019 WO
2019060576 Mar 2019 WO
2019068916 Apr 2019 WO
2019068916 Jun 2019 WO
2020102090 May 2020 WO
2020170079 Aug 2020 WO
2020183038 Sep 2020 WO
2020216954 Oct 2020 WO
2020234600 Nov 2020 WO
2020223806 Nov 2020 WO
2020234600 Nov 2020 WO
2020254917 Dec 2020 WO
2021040841 Mar 2021 WO
2021161026 Aug 2021 WO
Non-Patent Literature Citations (30)
Entry
Extended European Search Report with regard to the counterpart EP Patent Application No. 22305018.8 completed Jun. 24, 2022.
“HP Expands Workstation Series to Include Desk-side, Mobile and Small Form Factor Mode”, TechPowerUp, Mar. 24, 2010, https://www.techpowerup.com/118323/hp-expands-workstation-series-to-include-desk-side-mobile-and-small-form-factor-mode, retrieved on Jul. 19, 2021, 6 pages.
“IBM's Hot-Water Supercomputer Goes Live”, Data Center Knowledge, retrieved on Jul. 19, 2021, 9 pages.
Extended European Search Report with regard to the EP Patent Application No. 21306771.3 completed May 23, 2022.
Extended European Search Report with regard to the EP Patent Application No. 21306173.2 completed Feb. 18, 2022.
Extended European Search Report with regard to the EP Patent Application No. 21306174.0 completed Feb. 14, 2022.
Extended European Search Report with regard to the EP Patent Application No. 21306172.4 completed Feb. 15, 2022.
English Abstract for JP2020065002 retrieved on Espacenet on Jun. 2, 2022.
Extended European Search Report with regard to the EP Patent Application No. 21306186.4 completed Feb. 10, 2022.
Extended European Search Report with regard to the EP Patent Application No. 21306187.2 completed Feb. 10, 2022.
Extended European Search Report with regard to the EP Patent Application No. 21306175.7 completed Apr. 8, 2022.
Extended European Search Report with regard to the EP Patent Application No. 21306188.0 completed Feb. 10, 2022.
English Abstract for JPH043451 retrieved on Feb. 22, 2022.
Extended European Search Report with regard to the EP Patent Application No. 21306171.6 completed Feb. 11, 2022.
Extended European Search Report with regard to the EP Patent Application No. 21306189.8 completed Feb. 10, 2022.
Extended European Search Report with regard to the EP Patent Application No. 21306170.8 completed Feb. 12, 2022.
English Abstract for NL 1006486 retrieved on Espacenet on Jun. 3, 2022.
Office Action with regard to the counterpart U.S. Appl. No. 17/697,452 dated May 11, 2023.
Notice of Allowance with regard to the counterpart U.S. Appl. No. 17/691,494 dated Apr. 17, 2023.
Office Action with regard to the counterpart U.S. Appl. No. 17/698,480 dated Sep. 7, 2023.
International Search Report and Written Opinion with regard to PCTIB2022053071 dated Jun. 28, 2022.
International Search Report and Written Opinion with regard to PCT/IB2022/052975 dated Jun. 20, 2022.
International Search Report and Written Opinion with regard to PCTIB2022052330 dated May 30, 2022.
International Search Report and Written Opinion with regard to PCT/IB2022/052976 dated Jun. 17, 2022.
International Search Report and Written Opinion with regard to PCT/IB2022/052977 dated Jun. 20, 2022.
European Search Report with regard to EP21306170.8 dated Feb. 12, 2022.
European Search Report with regard to EP21306189.8 dated Feb. 10, 2022.
Office Action with regard to the counterpart U.S. Appl. No. 17/694,765 dated Dec. 21, 2023.
Office Action with regard to the counterpart U.S. Appl. No. 17/697,264 dated Nov. 22, 2023.
Office Action with regard to the counterpart U.S. Appl. No. 17/697,452 dated Nov. 22, 2023.
Related Publications (1)
Number Date Country
20220322575 A1 Oct 2022 US