Systems and associated methods for controllably cooling computer components

Information

  • Patent Grant
  • 9420729
  • Patent Number
    9,420,729
  • Date Filed
    Tuesday, April 3, 2012
    12 years ago
  • Date Issued
    Tuesday, August 16, 2016
    7 years ago
Abstract
Computer systems and associated methods for cooling computer components are disclosed herein. One embodiment of a computer system includes a computer cabinet having an air inlet spaced apart from an air outlet. The computer system also includes heat exchangers positioned in the computer cabinet, and a heat removal system in fluid communication with the heat exchangers. The computer system additionally includes at least one sensor for monitoring heat transfer between the computer cabinet and the room. The computer system further includes a control system operatively coupled to the at least one sensor, the control system including a computer-readable medium holding instructions for determining whether heat transfer between the computer cabinet and the room is balanced based on information from the sensor, and if not, adjusting a parameter to balance the heat transfer.
Description
TECHNICAL FIELD

The present disclosure relates generally to cooling systems and related methods for controllably cooling computer components.


BACKGROUND

Supercomputers and other large computer systems typically include a large number of computer modules housed in cabinets arranged in banks. The computer modules are typically positioned in close proximity to each other. In operation, the modules can generate considerable heat, and the close proximity of the modules can make dissipating the heat difficult. If not dissipated, the heat can damage the modules or significantly reduce system performance.


One conventional technique for computer module cooling includes drawing cooling air into the cabinet to cool the computer modules, and discharging the heated cooling air to the room. Typically, the heat transfer between the cooling air and the computer modules is uncontrolled. This can reduce cooling efficiency and the performance of the computer modules. Accordingly, there is a need to effectively dissipate heat generated by computer modules during operation.





BRIEF DESCRIPTION OF THE DRAWINGS


FIG. 1 is a partially schematic elevation view of a computer system having an air temperature control system configured in accordance with an embodiment of the invention.



FIG. 2 is a functional diagram showing software modules configured in accordance with an embodiment of the invention for controlling the air temperature control system of FIG. 1.



FIG. 3 is a block diagram illustrating a process module suitable for use in the air temperature control system of FIG. 2.



FIG. 4 is a flow chart illustrating a method for cooling a computer system in accordance with an embodiment of the invention.



FIG. 5 is a flow chart illustrating a method of closing valves in the air temperature control system of FIG. 1, suitable for use in the method of FIG. 4.



FIG. 6 is a flow chart illustrating a method of opening valves in the air temperature control system of FIG. 1, suitable for use in the method of FIG. 4.





DETAILED DESCRIPTION

The following disclosure describes several embodiments of cooling systems for use with computers and other systems. Several other embodiments of the invention can have different configurations, components, or procedures than those described in this section. A person of ordinary skill in the art, therefore, will accordingly understand that the invention can have other embodiments with additional elements, or the invention can have other embodiments without several of the features shown and described below with reference to FIGS. 1-6.



FIG. 1 is a partially schematic elevation view of a computer system 100 having an air temperature control system 108 configured in accordance with an embodiment of the invention. The computer system 100 can include a computer cabinet 102 in a room 101 and coolant lines 106 (identified individually as a supply line 106a and a return line 106b) connecting the computer cabinet 102 to a heat removal system 104. In the illustrated embodiment, the heat removal system 104 is situated in the room 101 and spaced apart from the computer cabinet 102. In other embodiments, however, the heat removal system 104 can be integrated into the computer cabinet 102, positioned outside the room 101, or situated in other suitable places.


The computer cabinet 102 can include an air inlet 114 for receiving cooling air from the room 101, an air outlet 116 for discharging air to the room 101, and a plurality of computer module compartments 120a-c arranged vertically between the air inlet 114 and the air outlet 116 in a chassis 110. Individual compartments 120a-c can hold a plurality of computer modules 112 oriented edgewise with respect to a flow of the cooling air through the chassis 110.


The computer cabinet 102 can also include a plurality of heat exchangers 118a-d in the chassis 110. As described in greater detail below, individual heat exchangers 118a-d can be configured to receive working fluid (not shown) from the heat removal system 104 via the supply line 106a. After flowing through the heat exchangers 118a-d, the working fluid returns to the heat removal system 104 via the return line 106b. The working fluid can include hydrofluorocarbons, hydrochlorofluorocarbons, chlorofluorocarbons, ammonia, and/or other suitable refrigerants. The working fluid can be a vapor phase fluid, a liquid phase fluid, or a two-phase fluid when flowing through the heat exchangers 118a-d.


The computer cabinet 102 can additionally include an air mover 130 (e.g., a fan) positioned proximate to the air inlet 114 to facilitate movement of the cooling air through the chassis 110 in an air flow path 117. The air mover 130 can draw air from the room 101 into the chassis 110 through the air inlet 114. The air then flows through the chassis 110 past the computer modules 112 and exits the chassis 110 via the air outlet 116. In the illustrated embodiment, the air mover 130 is operatively coupled to a speed drive 132. In other embodiments, the speed drive 132 can be omitted.


The heat removal system 104 can include a pump 124 in fluid communication with a condenser 122. The condenser 122 can be a shell-and-tube type heat exchanger, a plate-and-frame type heat exchanger, or other suitable type of heat exchanger known in the art. The condenser 122 can include a working fluid inlet 126a for receiving heated working fluid returning from the computer cabinet 102, and a working fluid outlet 126b for supplying cooled working fluid to the pump 124. The condenser 122 can also include a coolant inlet 128a and a coolant outlet 128b for circulating chilled water, cooling water, or other suitable coolant (not shown) to cool the working fluid. The pump 124 can include a positive displacement pump, a centrifugal pump, or other suitable type of pump for circulating the working fluid back to the heat exchangers 118a-d via the supply line 106a.


The air temperature control system 108 (“control system 108”) is configured to controllably cool the computer cabinet 102. The control system 108 can include an air inlet temperature sensor 134 positioned at or near the air inlet 114, compartment temperature sensors 136a-c positioned in the individual compartments 120a-c, respectively, module temperature sensors 121 positioned at individual computer modules 112 (only one is shown for purposes of illustration), and an air outlet temperature sensor 138 positioned at the air outlet 116. The control system 108 can also include a room temperature sensor 137, a working fluid temperature sensor 142 positioned at or near the discharge of the pump 124, and a coolant temperature sensor 140 positioned upstream of the coolant inlet 128a. The foregoing temperature sensors can include thermocouples, resistive temperature detectors, and/or other types of suitable temperature sensors known in the art. Although not shown in detail, the control system 108 can also include pressure sensors, flow rate sensors, humidity sensors, and/or other types of suitable sensors for detecting various operational parameters of the control system 108.


The control system 108 can also include a plurality of valves (e.g., block valves 144a-d and optional modulating valves 146a-d) on individual branches of the supply line 106a corresponding to the heat exchangers 118a-d. The block valves 144a-d can include solenoid valves or other suitable valves for allowing, stopping, or otherwise controlling the flow of working fluid to the individual heat exchangers 118a-d. The block valves 144a-d can also include positional switches that indicate the current state (i.e., open/close) of the corresponding block valves 144a-d to a processor 147. The modulating valves 146a-d can include globe valves, butterfly valves, ball valves, and/or other types of valves with corresponding actuators. The modulating valves 146a-d can have a liner flow characteristic, an equal-percentage flow characteristic, a parabolic flow characteristic, or other flow characteristics to control the flow rate of the working fluid supplied to the individual heat exchangers 118a-d.


The processor 147 can be operatively coupled to the temperature sensors 121, 134, 136a-c, 137, 138, 140, and 142, the block valves 144a-d, and the modulating valves 146a-d. The processor 147 can include a process logic controller, a system logic controller, or any other suitable logic controller. The control system 108 can optionally include a display 148 operatively coupled to the processor 147 for receiving operator input and/or outputting process parameters to an operator.


In operation, the air mover 130 draws air into the chassis 110 through the air inlet 114. The first heat exchanger 118a then cools the heated air before the air flows into the first compartment 120a. As the air flows through the first compartment 120a, the computer modules 112 in the first compartment 120a transfer heat to the air. The second heat exchanger 118b then cools the air before the air passes into the second compartment 120b by transferring heat from the air into the working fluid. The air is similarly inter-cooled by the third heat exchanger 118c before flowing into the third compartment 120c. The fourth heat exchanger 118d then cools the heated air leaving the third compartment 120c before the air is discharged to the room 101 via the air outlet 116.


In one embodiment, the working fluid is in phase transition between a liquid and a vapor when the working fluid leaves the heat exchangers 118a-d. In other embodiments, the working fluid can have other phase conditions at this time. The heated working fluid from the heat exchangers 118a-d returns to the condenser 122 via the return line 106b. The coolant in the condenser 122 cools the working fluid before the pump 124 circulates the working fluid back to the heat exchangers 118a-d.


In operation, the temperature sensors can monitor heat transfer between the computer cabinet 102 and the room 101. For example, the air inlet temperature sensor 134 can measure a temperature of the air flowing into the chassis 110 (TIN), and the air outlet temperature sensor 138 can measure a temperature of the air flowing out of the chassis 110 (TOUT). TIN and TOUT can be transmitted to the processor 147 to determine whether heat transfer between the computer cabinet 102 and the room 101 is balanced. As described in greater detail below, if not, the processor 147 can adjust a process parameter such that the imbalance is at least reduced.


In one embodiment, the processor 147 can calculate a temperature differential (ΔT) between the inlet temperature and outlet temperature as follows:

ΔT=TIN−TOUT

If ΔT is greater than a first threshold (ΔT1) for a period of time, then the processor 147 can cause one of the block valves 144a-d to at least partially close. For example, if the fourth block valve 144d is open, then the processor 147 can close the fourth block valve 144d and stop the flow of working fluid to the fourth heat exchanger 118d. Consequently, the air discharged from the computer cabinet 102 to the room 101 will be at a higher temperature than before because the air leaving the third compartment 120c is not cooled, or is less cooled, by the working fluid. If the fourth block valve 144d is closed, the processor 147 can check another block valve, e.g., the third block valve 144c, for closure.


If ΔT is still above the first threshold ΔT1 after closing one of the block valves 144a-d for a period of time, the processor 147 can cause another block valve to close until ΔT is lower than ΔT1, or until all the block valves 144a-d are closed.


If ΔT is less than a second threshold (ΔT2), where ΔT2 is less than ΔT1, for a period of time, then the processor 147 can transmit an electrical signal to cause one of the block valves 144a-d to open. For example, if the first block valve 144a is open and the others are closed, then the processor 147 can cause the second block valve 144b to open. If ΔT is still less than the second threshold ΔT2 after a period of time, then the processor 147 can cause the third block valve to open. This process can be repeated until ΔT is greater than the second threshold ΔT2, or until all of the block valves 144a-d are open.


If ΔT is greater than ΔT2 but less than ΔT1, the processor 147 can modulate a process parameter to move ΔT is equal toward a desired temperature differential (e.g., zero). For example, in one embodiment, the processor 147 can vary the speed of the air mover 130 by adjusting the output of the speed drive 132. In another embodiment, the processor 147 can modulate the optional modulating valves 146a-d. For example, the fourth modulating valve 146d can be modulated using a proportional-integral-differential (PID) controller with ΔT as a process variable.


Several embodiments of the control system 108 can reduce the risk of overloading the heat removal system 104 by balancing the temperature between the computer cabinet 102 and the room 101. For example, in one embodiment, the air outlet temperature TOUT can be at least close to the room temperature (e.g., 32° C.). In conventional cooling systems, as the room temperature increases, the cooling load on the first heat exchanger 118a increases to compensate for the increased heat flux. Meanwhile, the cooling loads on the other heat exchangers 118b-d stay relatively constant because they only remove the heat generated by the computer modules 112. As a result, the air discharged into the room 101 can be at a lower temperature than the air flowing into the computer cabinet 102 because of the greater temperature drops at the first heat exchanger 118a. The increased load at the first heat exchanger 118a can potentially overload the heat removal system 104 and reduce the cooling efficiency of the heat exchangers 118b-d. Thus, the cooling loads on the individual heat exchangers 118a-d can be controlled by modulating the optional modulating valves 146a-d and/or the air mover 130, and by selectively closing/opening the block valves 144a-d, thereby preventing an overload of the heat removal system 104.


Although the control system 108 described above uses the temperature differential ΔT calculated by subtracting the air outlet temperature TOUT from the air inlet temperature TIN, in other embodiments, a temperature differential calculated by subtracting the air inlet temperature TIN from the air outlet temperature TOUT can also be used. Moreover, other process parameters can also be used for controllably cooling the computer system 100. For example, the control system 108 can also use the compartment temperature(s), the computer module temperature(s), the room temperature, the working fluid temperature(s), the coolant temperature(s), and/or other suitable process parameters. In other embodiments, the processor 147 can also modulate the optional modulating valves 146a-d based on the individual compartment temperature(s), the computer module temperature(s), and/or other parameters. Even though only one computer module temperature sensor is shown in FIG. 1, in other embodiments, the control system 108 can include any desired number of computer module temperature sensors.


In any of the foregoing embodiments, certain interlock conditions can override the control actions of the processor 147. For example, if one of the compartment temperature sensors 136a-c or the computer module sensor 121 indicates a temperature that exceeds a threshold, the processor 147 can force the block valves 144a-d to open irrespective of the current temperature differential ΔT. Other interlock conditions can include high room temperature, high working fluid temperature, high coolant temperature, and/or other threshold conditions.


Only a single computer cabinet 102 is shown in FIG. 1 for purposes of illustration and ease of reference. In other embodiments, however, supercomputers and other large computer systems can include a plurality of computer cabinets arranged in banks or other configurations. In such embodiments, the heat removal system 104 can provide working fluid to one or more of the computer cabinets 102 via an appropriately configured piping circuit. Further, although the heat exchangers 118a-d have been described above in the context of working fluid-type heat exchangers, in other embodiments, other types of heat exchangers can be used to inter-cool the air moving through the compartments 120 without departing from the spirit or scope of the present invention. One example is disclosed in U.S. patent application Ser. No. 10/805,875, filed Mar. 22, 2004, the disclosure of which is incorporated herein in its entirety.



FIG. 2 illustrates a functional diagram showing software modules suitable for use in the processor 147 of FIG. 1. Each component can be a computer program, procedure, or process written as source code in a conventional programming language, such as the C++ programming language, and can be presented for execution by the processor 147. In another embodiment, the software modules can be presented for execution by the CPU of a network server in a distributed computing scheme. The various implementations of the source instructions and object and byte instructions can be stored on a computer-readable storage medium or embodied on a transmission medium in a carrier wave. In the illustrated embodiment, the modules include an input module 162, a database module 164, a process module 166, an output module 168, and optionally, a display module 170. In other embodiments, the modules can also include a network module and/or other modules.


In operation, the input module 162 accepts operating input from an operator and communicates the accepted information or selections to other components for further processing. For example, the input module 162 can accept a temperature differential setpoint and/or other process setpoints from an operator. The input module 162 can also accept start/stop commands for the air mover 130 (FIG. 1), open/close commands for the individual block valves 144a-d (FIG. 1), and/or other control selections.


The database module 164 organizes records, including operating parameters 182, operator activities 184, and alarms 186, and facilitates storing and retrieving these records to and from a database 180. Any type of database organization can be utilized, including a flat file system, hierarchical database, relational database, or distributed database, such as provided by a database vendor such as the Oracle Corporation of Redwood Shores, Calif.


The process module 166 can generate control signals based on input signals 172, e.g., operator input, and/or internal components (e.g., a clock, a sequencer, timers, counters, PID control loops, etc.), as described in more detail below with reference to FIG. 4. The output module 168 can generate output signals 174 based on the control signals from the process module 166. For example, the output module 168 can convert the control signals into 4-20 mA output signals 174 suitable for controlling the modulating valves 146a-d (FIG. 1), or into discrete signals for actuating the block valves 144a-d. The processor 147 can optionally include the display module 170 for displaying, printing, or downloading the input signals 172 and output signals 174 via devices such as the display 148 (FIG. 1). A suitable display module 170 can include a video driver that enables the processor 147 to output the input signals 172 on the display 148.



FIG. 3 is a block diagram showing an embodiment of the process module 166 of FIG. 2. The process module 166 can include a sensing module 188, a calculation module 190, an alarm module 192, a control module 194, and an interlock module 196 interconnected to each other. The individual modules can include computer programs, procedures, or routines written as source instructions in conventional programming languages, or one or more of the modules can include hardware modules.


The sensing module 188 can receive and convert the input signals 172 into parameters in desired units. For example, the sensing module 188 can receive the input 172 as electrical signals (e.g., as 4-20 mA analog signals) and convert the electrical signals into instant temperatures in, e.g., Celsius. The sensing module 188 can include various routines, such as linear interpolation, logarithmic interpolation, data mapping, and/or other routines to associate the input 172 with parameters in desired units.


The calculation module 190 can perform addition, subtraction, multiplication, quotient, integration, differentiation, and other types of calculations to facilitate operation of the other modules. For example, the calculation module 190 can derive the temperature differential ΔT based on the sensed air inlet temperature and air outlet temperature.


The alarm module 192 can generate alarms based on output from the calculation module 190 and/or the sensing module 188. For example, the alarm module 192 can compare the temperature differential ΔT determined by the calculation module 190 to a threshold value. If the average temperature exceeds the threshold value, the alarm module 192 can issue an alarm by raising a flag or by providing some other type of response. In response to the alarm flag, the display 148 (FIG. 1) can issue a notification by displaying a flashing message, sounding a horn, turning on a warning light, and/or providing another visual, tactile, and/or audible indicator.


The control module 194 can generate the output signals 174 for modulating the modulating valves 146a-d and/or closing/opening the block valves 144a-d. The control module 194 can include comparators, PID loops, timers, counters, and/or other logic modules for generating control variables. For example, the control module 194 can include a comparator that compares the calculated temperature differential ΔT to a threshold value and generates an output signal based on the results of the comparison.


The interlock module 196 can continuously monitor operating parameters received from the sensing module 188 and/or the calculation module 190, and the interlock module 196 can interrupt operation of the control module 194 when the operating parameters exceed certain threshold values. For example, the interlock module 196 can cause the control module 194 to terminate operation (i.e., have zero output value) when the compartment temperatures from the calculation module 190 exceed a preset threshold value.



FIG. 4 is a flow chart illustrating a method 200 for cooling a computer system in accordance with an embodiment of the invention. The method 200 can be implemented as a computer program for the processor 147 of FIGS. 1 and 2, or can be carried out manually. The method 200 is described below in the context of the computer system 100 of FIG. 1 for purposes of illustration. Those of ordinary skill in the art will understand, however, that the method 200 can also be performed in other computer systems having similar or different configurations.


Referring to FIGS. 1 and 4 together, the method 200 can include suitable sensors for measuring process variables of the computer system 100 (block 202). The process variables can include the room temperature, the air inlet temperature, the air outlet temperature, the compartment temperature(s), the working fluid temperature(s), the coolant temperature(s), and/or other temperatures. The process variables can also include the current status of the block valves 144a-d, the optional modulating valves 146a-d, the pump 124, the air mover 130, and/or other equipment of the computer system 100. The process variables can further include various pressures (e.g., the discharge pressure of the pump 124), flow rates (e.g., the air flow rate in the chassis 110), and/or other parameters.


The method 200 can further include calculating derived parameters from the measured process variables (block 204). For example, the air temperature differential ΔT of the computer cabinet 102 can be calculated by subtracting the air outlet temperature TOUT from the air inlet temperature TIN. In another example, an average temperature can be calculated based on the measured temperatures over a period of time according to the following formula:







T
avg

=




T
i


N






where Ti is a measured temperature, Tavg is the average temperature, and N is the number of temperature records. Other averaging techniques, such as an exponential moving average, can also be used. In yet another example, a rate of change for the measured temperatures can be calculated according to the following formula:









T



t






T

i
+
1


-

T
i



Δ





t







where Ti+1 is the temperature record number i+1, Ti is the previous temperature record, and Δt is the time difference between the two temperature records. In further examples, calculating derived parameters can also include applying accumulation, integration, differentiation, and/or other types of data processing techniques to the measured process variables.


The method 200 can include checking for interlock conditions (block 206). The interlock conditions can include those indicating an unsafe or undesired operating state. For example, the following is a non-exhaustive list of interlock conditions:

    • (1) At least one of the measured compartment temperatures exceeds a maximum temperature threshold (e.g., about 40° C. to about 45° C.).
    • (2) The computer module temperature exceeds a maximum temperature threshold (e.g., about 45° C.).
    • (3) The room temperature exceeds a maximum temperature threshold (e.g., about 32° C.).
    • (4) The working fluid temperature exceeds a maximum temperature threshold (e.g., about 25° C.).
    • (5) The coolant temperature exceeds a maximum temperature threshold (e.g., about 20° C.).


If any interlock condition exists, then the process enters an interlock mode (block 208). In the interlock mode, the processor 147 can command all of the block valves 144a-d to open and the optional modulating valves 146a-d and the speed drive 132 to be at 100% output. As a result, a maximum amount of the working fluid is supplied to the heat exchangers 118a-d, and the air mover 130 is operating at full speed (e.g., 1800 rpm). The processor 147 can also issue an alarm via the display 148 and/or perform other control actions to alert an operator of the interlock mode. After entering the interlock mode, the method 200 reverts to measuring process variables at block 202.


If no interlock condition exists, the method 200 continues to check whether one or more of the block valves 144a-d should be closed (block 210). The conditions for closing one or more of the block valves 144a-d can include those indicating a temperature imbalance in the computer cabinet 102 with respect to the room 101, and/or overload of the heat removal system 104. For example, the following is a non-exhaustive list of such conditions:

    • (1) The temperature differential ΔT is greater than the first threshold ΔT1 for a preset period of time (e.g., 1 minute).
    • (2) The working fluid temperature exceeds a maximum temperature threshold (e.g., about 20° C.).
    • (3) The pump 124 is cavitating.


      If such a condition exists, then the processor 147 can close one of the block valves 144a-d (block 212), as described in more detail below with reference to FIG. 5. Next, the method 200 reverts to measuring process variables at block 202.


If no valve closing conditions exist, the method 200 proceeds to check whether one of the block valves 144a-d should be open (block 214). The conditions for opening one of the block valves 144a-d can include those indicating insufficient cooling in the computer cabinet 102. For example, the following is a non-exhaustive list of such conditions:

    • (1) At least one of the measured compartment temperatures exceeds a maximum temperature threshold (e.g., about 35° C.).
    • (2) The air outlet temperature exceeds a maximum temperature threshold (e.g., about 32° C.).
    • (3) The working fluid temperature exceeds a minimum temperature threshold (e.g., about 15° C.).


      If one or more of these conditions exist, then the processor 147 can open one or more of the block valves 144a-d (block 216), as described in more detail below with reference to FIG. 6. Next, the method 200 reverts to measuring process variables at block 202.


If no valve opening conditions exist, the method 200 proceeds to enter a modulating mode (block 218). In the modulating mode, the processor 147 can modulate various components of the computer system 100 to achieve a temperature balance between the computer cabinet 102 and the room 101, and/or to achieve another result. In one embodiment, the processor 147 can modulate the speed of the air mover 130 by using a PID loop to vary the output of the speed drive 132. In another embodiment, the processor 147 can modulate at least one of the optional modulating valves 146a-d by using a PID loop to vary the output to the modulating valves 146a-d.


The method 200 can further include determining whether to continue the process (block 220). The determination can be made based on, for example, whether the computer system 100 is operating, or some other operating conditions. If not, the process ends; otherwise, the method 200 reverts to measuring process variables at block 202.


Several embodiments of the method 200 can improve computer system cooling over conventional techniques. With conventional techniques, the heat transfer between the working fluid and the cooling air at the heat exchangers is generally uncontrolled. As a result, when at least one of the process parameters starts to vary, the heat exchanging performance may suffer. For example, with conventional techniques, the flow rate of the working fluid cannot be easily adjusted to compensate for increases in cooling air temperature and/or flow rate. As a result, the cooling air flowing into individual compartments may be at elevated temperatures, which may reduce the performance of the computer modules in the compartments. Thus, improved performance of the computer system can be achieved by monitoring and actively controlling the cooling process in the computer system.



FIG. 5 is a flow chart illustrating a method 212 of sequentially closing valves in a computer system in accordance with an embodiment of the invention. The method 212 can be used in the method 200 of FIG. 4. For purposes of illustration, in this example and in other examples, valves are numbered from 1 to N (an integer greater than 1) with valve No. 1 being proximate to the air inlet and valve N being proximate to the air outlet. Other numbering conventions can also be used.


The method 212 can include initiating a counter i with an initial value of N (block 222). Using the computer system 100 of FIG. 1 as an example, the initialized value of i would be 4 because there are four block valves in the computer system 100. The method 212 can also include checking whether valve i is closed (block 224) by monitoring a position switch operatively coupled to valve i, monitoring the current output to valve i, monitoring a flow rate of the working fluid passing valve i, and/or by utilizing other techniques. If valve i is open, then the method 212 continues to close valve i (block 226). If valve i is closed, the method 212 continues to set i=i−1 (block 228). The method 212 then determines whether i is greater than 1 (block 230). If yes, then the process reverts to block 224; otherwise, the process returns.



FIG. 6 is a flow chart illustrating a method 216 of opening valves in a computer system in accordance with an embodiment of the invention. The method 216 can be used in the method 200 of FIG. 4. The method 216 can include initiating a counter i with an initial value of 1 (block 232). The method 216 can also include checking whether valve number i is open (block 234). If valve i is closed, then the method 216 proceeds to open valve i (block 236). If valve i is open, the method 216 proceeds to set i=i+1 (block 238). The method 216 then determines whether i is less than N (block 240). If yes, then the process reverts to block 234; otherwise, the process returns.


From the foregoing, it will be appreciated that specific embodiments of the invention have been described herein for purposes of illustration, but that various modifications may be made without deviating from the spirit and scope of the invention. Further, while advantages associated with certain embodiments of the invention have been described in the context of those embodiments, other embodiments may also exhibit such advantages, and not all embodiments need necessarily exhibit such advantages to fall within the scope of the invention. Accordingly, the invention is not limited, except as by the appended claims.

Claims
  • 1. A computer system, comprising: a computer cabinet having an air inlet spaced apart from an air outlet, and at least a first computer module compartment spaced apart from a second computer module compartment, wherein the air inlet, the air outlet, and the computer module compartments define an air flow path through the computer cabinet;at least one sensor operatively coupled to the computer cabinet;at least a first heat exchanger positioned upstream of the first computer module compartment in the air flow path, a second heat exchanger positioned between the first and second computer module compartments in the air flow path, and a third heat exchanger positioned downstream of the second computer module compartment in the air flow path;a heat removal system in fluid communication with the heat exchangers for circulating working fluid between the heat removal system and the heat exchangers;a control system operatively coupled to the at least one sensor, the control system having a computer-readable medium containing instructions for sequentially controlling the flow of working fluid to the third heat exchanger, the second heat exchanger, and then the first heat exchanger based on heat transfer between the computer cabinet and a room in which the computer cabinet is placed, as measured by the at least one sensor; andan air mover that moves cooling air through the computer cabinet along the air flow path and past the first and second heat exchangers to cool the working fluid circulating therethrough.
  • 2. The computer system of claim 1 wherein the at least one sensor includes: an air inlet temperature sensor positioned proximate to the air inlet for measuring an inlet air temperature; andan air outlet temperature sensor positioned proximate to the air outlet for measuring an outlet air temperature.
  • 3. The computer system of claim 2 wherein the computer-readable medium includes instructions for comparing the air inlet temperature to the air outlet temperature.
  • 4. The computer system of claim 2 wherein the computer-readable medium further includes instructions for calculating a temperature differential according to the following formula: ΔT =TIN−TOUT
  • 5. The computer system of claim 4 wherein the computer-readable medium further includes instructions for stopping a flow of the working fluid to one of the heat exchangers if the calculated temperature differential is greater than a threshold.
  • 6. The computer system of claim 4 wherein the control system further includes a plurality of valves in a plurality of working fluid conduits corresponding to individual heat exchangers, and wherein the computer-readable medium further includes instructions for closing at least one of the valves if the calculated temperature differential is greater than a threshold.
  • 7. The computer system of claim 4 wherein the computer-readable medium further includes instructions for starting a flow of the working fluid to one of the heat exchangers if the calculated temperature differential is less than a threshold.
  • 8. The computer system of claim 4 wherein the control system further includes a plurality of valves in a plurality of working fluid conduits corresponding to individual heat exchangers, and wherein the computer-readable medium further includes instructions for opening at least one of the valves if the calculated temperature differential is less than a threshold.
  • 9. The computer system of claim 4 wherein the computer cabinet further includes an air mover, and wherein the computer-readable medium further includes instructions for adjusting a speed of the air mover based on the calculated temperature differential.
  • 10. The computer system of claim 4 wherein the control system further includes a plurality of modulating valves positioned in a plurality of working fluid conduits corresponding to individual heat exchangers, and the computer-readable medium further includes instructions for modulating a flow rate of the working fluid to at least one of the heat exchangers based on the calculated temperature differential.
  • 11. A method for controlling heat transfer between a computer cabinet and a room in which the computer cabinet is placed, the method comprising: moving a flow of cooling air through the computer cabinet along an air flow path from an air inlet to an air outlet, wherein the computer cabinet contains: first and second computer module compartments positioned in the air flow path; andfirst heat and second heat exchangers positioned in the air flow path, wherein the first heat exchanger is positioned between the first and second computer module compartments, and wherein the second computer module compartment is positioned between the first and second heat exchangers;circulating working fluid through the first and second heat exchangers;assessing heat transfer between the computer cabinet and the room, wherein assessing heat transfer between the computer cabinet and the room includes periodically calculating a temperature differential between the air flowing into the computer cabinet and the air flowing out of the computer cabinet; andwhen the heat transfer between the computer cabinet and the room is not balanced within a desired range, adjusting a parameter of at least one of the air flow and the working fluid to reduce the imbalance of the heat transfer between, the computer cabinet and the room, wherein adjusting a parameter includes reducing the flow of working fluid to the second heat exchanger if the calculated temperature differential is greater than a threshold at a first time, and reducing the flow of working fluid to the first heat exchanger if the calculated temperature differential is greater than the threshold at a second time, after the first time.
  • 12. The method of claim 11 wherein the first and second computer module compartments are arranged vertically between the air inlet and the air outlet, and wherein the first and second computer module compartments individually hold a plurality of computer modules oriented edgewise with respect to the air flow path through the computer cabinet.
  • 13. The method of claim 11 wherein the second heat exchanger is positioned downstream of the second computer module compartment.
  • 14. The method of claim 11 wherein moving a flow of cooling air includes moving a flow of cooling air with an air mover positioned in the computer cabinet.
  • 15. The method of claim 11 wherein adjusting a parameter further includes increasing the flow of working fluid to at least one of the first and second heat exchangers if the calculated temperature differential is less than the threshold at the first time or the second time.
  • 16. The method of claim 11 wherein adjusting a parameter further includes increasing the flow of cooling air through the computer cabinet if the calculated temperature differential is less than the threshold at the first time or the second time.
  • 17. The method of claim 11 wherein reducing the flow of working fluid to at least one of the first and second heat exchangers includes modulating the flow of working fluid.
  • 18. A method for controlling heat transfer between a computer cabinet and a room in which the computer cabinet is placed, the method comprising: moving a flow of cooling air through the computer cabinet along an air flow path, from an air inlet to an air outlet, wherein the computer cabinet contains: first and second computer module compartments positioned in the air flow path; andfirst heat and second heat exchangers positioned in the air flow path, wherein the first heat exchanger is positioned between the first and second computer module compartments, wherein the second computer module compartment is positioned between the first and second heat exchangers, and wherein the second heat exchanger is positioned downstream of the second computer module compartment;circulating working fluid through the first and second heat exchangers;assessing heat transfer between the computer cabinet and the room, wherein assessing heat transfer between the computer cabinet and the room includes periodically calculating a temperature differential at a first time and a second time, after the first time, according to the following formula: ΔT =TIN−TOUT  where ΔT is the temperature differential, TIN is the air inlet temperature, and TOUT is the air outlet temperature; andwhen the heat transfer between the computer cabinet and the room is not balanced within a desired range, adjusting a parameter of at least one of the air flow and the working fluid to reduce the imbalance of the heat transfer between the computer cabinet and the room, wherein adjusting a parameter includes reducing the flow of working fluid to the second heat exchanger if the calculated temperature differential is greater than a threshold at the first time, and reducing the flow of working fluid to the first heat exchanger if the calculated temperature differential is greater than the threshold at the second time.
  • 19. The method of claim 18 wherein the first and second computer module compartments are arranged vertically between the air inlet and the air outlet, and wherein the first and second computer module compartments individually hold a plurality of computer modules oriented edgewise with respect to the air flow path through the computer cabinet.
  • 20. The method of claim 18 wherein adjusting a parameter further includes increasing the flow of working fluid to at least one of the first and second heat exchangers if the calculated temperature differential is less than the threshold at the first time or the second time.
CROSS-REFERENCE TO RELATED APPLICATION(S)

This application is a continuation of U.S. patent application Ser. No. 12/029,124 filed Feb. 11, 2008, now U.S. Pat. No. 8,170,724, entitled “SYSTEMS AND ASSOCIATED METHODS FOR CONTROLLABLY COOLING COMPUTER COMPONENTS,” which is incorporated herein by reference in its entirety.

US Referenced Citations (279)
Number Name Date Kind
2628018 Koch Feb 1953 A
2673721 Dickinson Mar 1954 A
2861782 Swartz Nov 1958 A
3120166 Lyman Feb 1964 A
3192306 Skonnord Jun 1965 A
3236296 Dubin Feb 1966 A
3317798 Chu et al. May 1967 A
3348609 Dubin et al. Oct 1967 A
3525385 Liebert Aug 1970 A
3559728 Lyman et al. Feb 1971 A
3648754 Sephton Mar 1972 A
3903404 Beall et al. Sep 1975 A
3942426 Binks et al. Mar 1976 A
4016357 Abrahamsen Apr 1977 A
4158875 Tajima et al. Jun 1979 A
4261519 Ester Apr 1981 A
4270362 Lancia et al. Jun 1981 A
4271678 Liebert Jun 1981 A
4306613 Christopher Dec 1981 A
4313310 Kobayashi et al. Feb 1982 A
4315300 Parmerlee et al. Feb 1982 A
4386651 Reinhard Jun 1983 A
4449579 Miyazaki et al. May 1984 A
4458296 Bryant et al. Jul 1984 A
4473382 Cheslock Sep 1984 A
4513351 Davis et al. Apr 1985 A
4528614 Shariff et al. Jul 1985 A
4535386 Frey, Jr. et al. Aug 1985 A
4600050 Noren Jul 1986 A
4642715 Ende Feb 1987 A
4644443 Swensen et al. Feb 1987 A
4691274 Matouk et al. Sep 1987 A
4702154 Dodson Oct 1987 A
4728160 Mondor et al. Mar 1988 A
4767262 Simon Aug 1988 A
4774631 Okuyama et al. Sep 1988 A
4797783 Kohmoto et al. Jan 1989 A
4798238 Ghiraldi Jan 1989 A
4802060 Immel Jan 1989 A
4860163 Sarath Aug 1989 A
4874127 Collier Oct 1989 A
4901200 Mazura Feb 1990 A
4911231 Horne et al. Mar 1990 A
4993482 Dolbear et al. Feb 1991 A
5000079 Mardis Mar 1991 A
5019880 Higgins, III. May 1991 A
5035628 Casciotti et al. Jul 1991 A
5060716 Heine Oct 1991 A
5090476 Immel Feb 1992 A
5101320 Bhargava et al. Mar 1992 A
5131233 Cray et al. Jul 1992 A
5150277 Bainbridge et al. Sep 1992 A
5161087 Frankeny et al. Nov 1992 A
5165466 Arbabian Nov 1992 A
5168925 Suzumura et al. Dec 1992 A
5196989 Zsolnay Mar 1993 A
5263538 Amidieu et al. Nov 1993 A
5273438 Bradley et al. Dec 1993 A
5297990 Renz et al. Mar 1994 A
5323847 Koizumi et al. Jun 1994 A
5326317 Ishizu et al. Jul 1994 A
5329425 Leyssens et al. Jul 1994 A
5339214 Nelson Aug 1994 A
5345779 Feeney Sep 1994 A
5365402 Hatada et al. Nov 1994 A
5376008 Rodriguez Dec 1994 A
5395251 Rodriguez et al. Mar 1995 A
5402313 Casperson et al. Mar 1995 A
5410448 Barker, III et al. Apr 1995 A
5414591 Kimura et al. May 1995 A
5467250 Howard et al. Nov 1995 A
5467609 Feeney Nov 1995 A
5471850 Cowans Dec 1995 A
5491310 Jen Feb 1996 A
5493474 Schkrohowsky et al. Feb 1996 A
5547272 Paterson et al. Aug 1996 A
5570740 Flores et al. Nov 1996 A
5572403 Mills Nov 1996 A
5603375 Salt Feb 1997 A
5603376 Hendrix Feb 1997 A
5684671 Hobbs et al. Nov 1997 A
5685363 Orihira et al. Nov 1997 A
5707205 Otsuka et al. Jan 1998 A
5709100 Baer et al. Jan 1998 A
5718628 Nakazato et al. Feb 1998 A
5749702 Datta et al. May 1998 A
5782546 Iwatare Jul 1998 A
5793610 Schmitt et al. Aug 1998 A
5829676 Ban et al. Nov 1998 A
5849076 Gaylord et al. Dec 1998 A
5880931 Tilton et al. Mar 1999 A
5927386 Lin Jul 1999 A
5979541 Saito et al. Nov 1999 A
6021047 Lopez et al. Feb 2000 A
6024165 Melane et al. Feb 2000 A
6026565 Giannatto et al. Feb 2000 A
6034870 Osborn et al. Mar 2000 A
6039414 Melane et al. Mar 2000 A
6046908 Feng Apr 2000 A
6052278 Tanzer et al. Apr 2000 A
6104608 Casinelli et al. Aug 2000 A
6115242 Lambrecht Sep 2000 A
6132171 Fujinaka et al. Oct 2000 A
6135875 French Oct 2000 A
6158502 Thomas Dec 2000 A
6164369 Stoller Dec 2000 A
6167948 Thomas Jan 2001 B1
6182787 Kraft et al. Feb 2001 B1
6183196 Fujinaka Feb 2001 B1
6185098 Benavides Feb 2001 B1
6205796 Chu et al. Mar 2001 B1
6208510 Trudeau et al. Mar 2001 B1
6236564 Fan May 2001 B1
6272012 Medin et al. Aug 2001 B1
6305180 Miller et al. Oct 2001 B1
6310773 Yusuf et al. Oct 2001 B1
6332946 Emmett et al. Dec 2001 B1
6351381 Bilski et al. Feb 2002 B1
6359779 Frank, Jr. et al. Mar 2002 B1
6361892 Ruhl et al. Mar 2002 B1
6396684 Lee May 2002 B2
6416330 Yatskov Jul 2002 B1
6435266 Wu Aug 2002 B1
6439340 Shirvan Aug 2002 B1
6462944 Lin Oct 2002 B1
6481527 French et al. Nov 2002 B1
6501652 Katsui Dec 2002 B2
6515862 Wong et al. Feb 2003 B1
6519955 Marsala Feb 2003 B2
6524064 Chou et al. Feb 2003 B2
6536510 Khrustalev et al. Mar 2003 B2
6542362 Lajara et al. Apr 2003 B2
6546998 Oh et al. Apr 2003 B2
6550530 Bilski Apr 2003 B1
6554697 Koplin Apr 2003 B1
6557357 Spinazzola et al. May 2003 B2
6557624 Stahl et al. May 2003 B1
6564571 Feeney May 2003 B2
6564858 Stahl et al. May 2003 B1
6582192 Tseng et al. Jun 2003 B2
6587340 Grouell et al. Jul 2003 B2
6609592 Wilson Aug 2003 B2
6621698 Chang Sep 2003 B2
6628520 Patel et al. Sep 2003 B2
6631078 Alcoe et al. Oct 2003 B2
6644384 Stahl Nov 2003 B2
6646879 Pautsch Nov 2003 B2
6661660 Prasher et al. Dec 2003 B2
6679081 Marsala Jan 2004 B2
6684457 Holt Feb 2004 B2
6690576 Clements et al. Feb 2004 B2
6695041 Lai et al. Feb 2004 B2
6705625 Holt et al. Mar 2004 B2
6714412 Chu et al. Mar 2004 B1
6724617 Amaike et al. Apr 2004 B2
6742068 Gallagher et al. May 2004 B2
6742583 Tikka Jun 2004 B2
6745579 Spinazzola et al. Jun 2004 B2
6755280 Porte et al. Jun 2004 B2
6761212 DiPaolo Jul 2004 B2
6772604 Bash et al. Aug 2004 B2
6775137 Chu et al. Aug 2004 B2
6776707 Koplin Aug 2004 B2
6789613 Ozaki et al. Sep 2004 B1
6796372 Bear Sep 2004 B2
6801428 Smith et al. Oct 2004 B2
6819563 Chu et al. Nov 2004 B1
6836407 Faneuf et al. Dec 2004 B2
6854287 Patel et al. Feb 2005 B2
6854659 Stahl et al. Feb 2005 B2
6860713 Hoover Mar 2005 B2
6867966 Smith et al. Mar 2005 B2
6875101 Chien Apr 2005 B1
6876549 Beitelmal et al. Apr 2005 B2
6881898 Baker et al. Apr 2005 B2
6882531 Modica Apr 2005 B2
6896095 Shah et al. May 2005 B2
6904968 Beitelmal et al. Jun 2005 B2
6909611 Smith et al. Jun 2005 B2
6914780 Shanker et al. Jul 2005 B1
6932443 Kaplan et al. Aug 2005 B1
6952667 Kempe Oct 2005 B2
6975510 Robbins et al. Dec 2005 B1
6992889 Kashiwagi et al. Jan 2006 B1
6997245 Lindemuth et al. Feb 2006 B2
6997741 Doll et al. Feb 2006 B2
6999316 Hamman Feb 2006 B2
7016191 Miyamoto et al. Mar 2006 B2
7046513 Nishiyama et al. May 2006 B2
7051802 Baer May 2006 B2
7051946 Bash et al. May 2006 B2
7059899 Doll et al. Jun 2006 B2
7114555 Patel et al. Oct 2006 B2
7120017 Shieh Oct 2006 B2
7120027 Yatskov et al. Oct 2006 B2
7123477 Coglitore et al. Oct 2006 B2
7133285 Nishimura Nov 2006 B2
7144320 Turek et al. Dec 2006 B2
7152418 Alappat et al. Dec 2006 B2
7154748 Yamada Dec 2006 B2
7177156 Yatskov et al. Feb 2007 B2
7182208 Tachibana Feb 2007 B2
7185696 Schaper Mar 2007 B2
7187549 Teneketges et al. Mar 2007 B2
7193846 Davis et al. Mar 2007 B1
7193851 Yatskov Mar 2007 B2
7209351 Wei Apr 2007 B2
7215552 Shipley et al. May 2007 B2
7218516 Yu et al. May 2007 B2
7222660 Giacoma et al. May 2007 B2
7226353 Bettridge et al. Jun 2007 B2
7227751 Robbins et al. Jun 2007 B2
7242579 Fernandez et al. Jul 2007 B2
7255640 Aldag et al. Aug 2007 B2
7259963 Germagian et al. Aug 2007 B2
7286351 Campbell et al. Oct 2007 B2
7304842 Yatskov Dec 2007 B2
7312985 Lee et al. Dec 2007 B2
7314113 Doll Jan 2008 B2
7315448 Bash et al. Jan 2008 B1
7330350 Hellriegel et al. Feb 2008 B2
7362571 Kelley et al. Apr 2008 B2
7365976 Fujiya et al. Apr 2008 B2
7367384 Madara et al. May 2008 B2
7382613 Vinson et al. Jun 2008 B2
7385810 Chu et al. Jun 2008 B2
7397661 Campbell et al. Jul 2008 B2
7411785 Doll Aug 2008 B2
7418825 Bean, Jr. Sep 2008 B1
7420805 Smith et al. Sep 2008 B2
7430118 Noteboom et al. Sep 2008 B1
7508663 Coglitore Mar 2009 B2
7513923 Lewis et al. Apr 2009 B1
7534167 Day May 2009 B2
7542287 Lewis, II et al. Jun 2009 B2
7554803 Artman et al. Jun 2009 B2
7630198 Doll Dec 2009 B2
7641101 Campbell et al. Jan 2010 B2
7657347 Campbell et al. Feb 2010 B2
7679909 Spearing et al. Mar 2010 B2
7707880 Campbell et al. May 2010 B2
7710720 Fuke et al. May 2010 B2
7830658 Van Andel Nov 2010 B2
7855890 Kashirajima et al. Dec 2010 B2
7895854 Bash et al. Mar 2011 B2
8118084 Harvey Feb 2012 B2
20020072809 Zuraw Jun 2002 A1
20030053928 Takano Mar 2003 A1
20040008491 Chen Jan 2004 A1
20040020225 Patel et al. Feb 2004 A1
20040052052 Rivera Mar 2004 A1
20050120737 Borror et al. Jun 2005 A1
20050161205 Ashe et al. Jul 2005 A1
20050186070 Zeng et al. Aug 2005 A1
20050207116 Yatskov et al. Sep 2005 A1
20050217837 Kudija Oct 2005 A1
20050241810 Malone et al. Nov 2005 A1
20060044758 Spangberg Mar 2006 A1
20060180301 Baer Aug 2006 A1
20070030650 Madara et al. Feb 2007 A1
20070224084 Holmes et al. Sep 2007 A1
20080078202 Luo Apr 2008 A1
20080098763 Yamaoka May 2008 A1
20080112128 Holland May 2008 A1
20080158814 Hattori Jul 2008 A1
20080212282 Hall et al. Sep 2008 A1
20080216493 Lin et al. Sep 2008 A1
20090154091 Yatskov Jun 2009 A1
20090201644 Kelley et al. Aug 2009 A1
20090236006 Farese et al. Sep 2009 A1
20090244826 Doll Oct 2009 A1
20090259343 Rasmussen et al. Oct 2009 A1
20090260384 Champion et al. Oct 2009 A1
20100097751 Doll et al. Apr 2010 A1
20100097752 Doll et al. Apr 2010 A1
20100242505 Thybo et al. Sep 2010 A1
20110112694 Bash et al. May 2011 A1
20110255237 Doll Oct 2011 A1
20120008275 Doll et al. Jan 2012 A1
Foreign Referenced Citations (7)
Number Date Country
2197195 Aug 1990 JP
07-030275 Jan 1995 JP
2002026548 Jan 2002 JP
2002237692 Aug 2002 JP
2004079754 Mar 2004 JP
WO-01-86217 Nov 2001 WO
WO-2005027609 Mar 2005 WO
Non-Patent Literature Citations (20)
Entry
Baer, D.B., “Emerging Cooling Requirements & Systems in Telecommunications Spaces,” Telecommunications Energy Conference 2001, Oct. 14-18, 2001, pp. 95-100.
Bleier, F. P., “FAN Handbook, Selection, Application, and Design,” McGraw Hill, 1998, pp. 7.50-7.51.
Final Office Action for U.S. Appl. No. 11/958,114, Mail Date Apr. 9, 2010, 28 pages.
Hannemann, R. et al., “Pumped Liquid Multiphase Cooling,” ASME, 2004, IMECE 2004, Paper IMECE2004-60669, Anaheim, CA, 5 pages.
JAMSTEC/Earth Simulator Center, “Processor Node (PN) Cabinet,” http://www.es.jamstec.go.jp/esc/eng/Hardware/pnc.html, 1 page, [accessed Mar. 5, 2004].
Liebert Corporation, “Managing Extreme Heat Cooling Strategies for High-Density Computer Systems,” Dec. 7, 2003, Columbus, OH, 16 pages.
Marsala, J., “Pumped Liquid/Two Phase Cooling for High Performance Systems,” Thermal Form & Function LLC, May 13, 2003, Scottsdale, AZ, 19 pages.
Non-Final Office Action for U.S. Appl. No. 11/371,272, Mail Date Mar. 19, 2009, 13 pages.
Non-Final Office Action for U.S. Appl. No. 11/958,114, Mail Date Aug. 25, 2009, 22 pages.
Non-Final Office Action for U.S. Appl. No. 12/029,124, Mail Date Dec. 11, 2009, 27 pages.
Non-Final Office Action for U.S. Appl. No. 12/060,377, Mail Date Sep. 23, 2009, 10 pages.
Notice of Allowance for U.S. Appl. No. 12/029,124, Mail Date Oct. 28, 2011, 21 pages.
Novel Concepts, Inc., “Heat Spreaders,” http://www.novelconceptsinc.com/heatspreaders.htm, 2 pages. [accessed Jun. 14, 2004].
Pitasi, M. “Thermal Management System Using Pumped Liquid R-134a with Two Phase Heat Transfer,” Thermal Form & Function LLC, Manchester, MA, Mar. 2002, pp. 1-9, http:/www.coolingzone.com/Guest/News/NL—MAR—2002/TFF/Tff.html.
Thermacore International, Inc., “Frequently Asked Questions about Heat Pipes,” http://www.thermacore.com/hpt—faqs.htm, 3 pages [accessed Jun. 14, 2004].
Thermacore Thermal Management Solutions, “Therma-base-Heat Sink,” 3 pages, [accessed Jun. 14, 2005].
Thermal Form & Function LLC, “Box/Blade Cooling System,” http://www.thermalformandfunction.com/boxsystem.html, Manchester, MA, 2005, 1 page [accessed May 10, 2006].
Thermal Form & Function LLC, “Thermal Form & Function—Rack Cooling System (RCS),” 2005, Manchester, MA, 1 page, http:/www.thermalformandfunction.com/racksystem.html, [accessed May 11, 2006].
Vogel, M. et al., “Low Profile Heat Sink Cooling Technologies for Next Generation CPU Thermal Designs,” Electronic Cooling Online, Feb. 17, 2005, 11 pages.
Webb, W., “Take the heat: Cool that hot embedded design,” EDN, May 13, 2004, 5 pages.
Related Publications (1)
Number Date Country
20120188706 A1 Jul 2012 US
Continuations (1)
Number Date Country
Parent 12029124 Feb 2008 US
Child 13438735 US