This disclosure relates to air-cooled systems, and particularly to methods and systems directed toward monitoring airflow within an equipment enclosure or rack.
Cooling consumes a large part of energy expenditures for data centers. This creates a need to allocate cooling within a data center as efficiently as possible. To reach this goal, many data center operators rely on airflow and temperature sensors to adjust cooling to achieve adequate airflow and temperatures for servers and racks used to support the servers. To estimate airflow, one known method is to assume that the airflow is proportional to a known airflow amount (e.g., from a rack PDU) or estimated rack power, e.g., 125 cfm/kW. While this technique is widely used across the data center community, it is not very accurate. Equipment racks supporting IT equipment may vary in airflow from, such as 40 cfm/kW up to 300 cfm/kW or more. Further, in order to minimize fan power, IT airflow rate typically changes dynamically in response to inlet temperature and current workload.
Another method of estimating airflow is to calculate rack airflow rate from measured inlet and outlet temperatures along with rack power. This technique involves understanding that if the net temperature rise across the rack and power are both known, then the airflow rate is also known from the conservation-of-energy principle (taken from the lst Law of Thermodynamics). However, it is very difficult to measure the temperature rise across the rack with meaningful accuracy. Measuring rack exhaust temperature is particularly difficult because of the distribution of IT equipment fans that create some regions with high velocity and other “dead spots.” This technique calls for a velocity-weighted temperature measurement, which requires a very large number of measurement locations to produce accurate measurements. Furthermore, measurements made closer to a rear door of the rack than the rear of the actual IT equipment will include a large amount of additional entrained air, which should not be included in the energy/airflow calculation.
One aspect of the disclosure is directed to a rack airflow monitoring system configured to measure airflow through an equipment rack having a housing and a perforated front door to enable air to flow into an interior of the housing. In one embodiment, the system comprises a control module, and a plurality of airflow sensors secured to the front door of the equipment rack and coupled to the control module. Each airflow sensor is configured to detect a parameter used to measure airflow and communicate detected parameters to the control module. The control module is configured to obtain temperature, airflow velocity, and airflow directionality from the plurality of airflow sensors at the front door of the equipment rack.
Embodiments of the system further may include fifteen airflow sensors evenly spaced across the front door of the equipment rack. The plurality of sensors may be secured to a rear door of the equipment rack instead of the front door. The plurality of airflow sensors may be connected to the control module by a plurality of wires. The plurality of airflow sensors may be powered by a battery or a wired connection. The control module may include a microprocessor in communication with equipment rack and/or data center processing equipment. Each airflow sensor may include an elongate tube, a thermistor disposed within an interior of the tube, and a heater provided adjacent to the thermistor within the interior of the tube. Each airflow sensor further may include an LED indicator to inform an operator whether the particular sensor is “hot” or “cold.” Airflow rate may be measured using a transient heating and cooling method, with the thermistor being heated up to a known increment above ambient temperature and then allowed to cool at a natural rate, which can be correlated to air velocity. Each airflow sensor further may include a heating element to provide a heat source with which airflow direction may be determined. The heating element may include a resistor. The tube may have a length approximately three times greater than a diameter of the tube. The tube may have a diameter of 0.5 inches and a length of 1.5 inches. The system further may comprise sealing components to seal gaps around the front door or across a server mounting plane to ensure that IT airflow flows through the front door of the equipment rack and is subject to monitoring. The system further may comprise one or more blanking panels to be secured between server mounting rails at locations unoccupied by servers.
Another aspect of the disclosure is directed to a process for determining airflow velocity from an airflow sensor, with the airflow sensor including a thermistor. In one embodiment, the process comprises: performing an initial calibration of the thermistor until a steady-state voltage and a steady-state temperature of the thermistor are achieved; begin a timer; reading a voltage of the thermistor; calculating an ambient temperature of the thermistor; calculating upper and lower voltage thresholds and upper and lower temperature thresholds of the thermistor; applying a source voltage to the thermistor until the voltage reaches the upper voltage threshold; reading the voltage of the thermistor; if the voltage of the thermistor is greater than the upper voltage threshold, then continue applying the source voltage to the thermistor for a predetermined time period; if the voltage of the thermistor is less than the upper voltage, an ending time is recorded, the voltage is removed from the thermistor, and a characteristic cooling time is calculated; and calculating an airflow velocity.
Embodiments of the method further may include determining an airflow direction. Determining the airflow direction may include taking several voltage readings of the thermistor to determine a steady-state ambient temperature, once the a steady-state ambient temperature is achieved, reading a voltage of the thermistor and converting the voltage to a temperature to establish a starting ambient temperature, applying a voltage to a heater in fluid communication with the thermistor, after a short delay, reading a voltage of the thermistor, calculating an ambient temperature of the thermistor, if a temperature increase of the thermistor is above a threshold temperature margin, then the airflow direction is recorded as “inflow,” and if a temperature increase is below a threshold temperature margin, then the airflow direction is recorded as “outflow.” The threshold temperature margin may be a variable with respect to an expected or recently-measured airflow velocity. The process further may include calculating a total equipment rack airflow by employing a plurality of sensors on a front of the equipment rack.
The accompanying figures are not intended to be drawn to scale. In the figures, each identical or nearly identical component that is illustrated in various figures is represented by a like numeral. For purposes of clarity, not every component may be labeled in every figure. In the figures:
For the purposes of illustration only, and not to limit the generality, the present disclosure will now be described in detail with reference to the accompanying figures. This disclosure is not limited in its application to the details of construction and the arrangement of components set forth in the following description or illustrated in the drawings. The principles set forth in this disclosure are capable of other embodiments and of being practiced or carried out in various ways. In addition, the phraseology and terminology used herein is for the purpose of description and should not be regarded as limiting. The use of “including,” “comprising,” “having,” “containing,” “involving,” and variations thereof herein, is meant to encompass the items listed thereafter and equivalents thereof as well as additional items.
Embodiments of the rack airflow monitoring system enable airflow of IT equipment housed within an equipment rack to be continuously monitored and reported to data center management software. While, there has been steady growth in the quantity and quality of measured parameters in the data center (e.g., temperatures, power consumption, cooling-unit-specific data, etc.), airflow rate through an equipment rack is not among them. This is despite the fact that rack airflow rate is one of the most important variables affecting data center cooling and, and therefore, energy consumption. The rack airflow monitoring system is capable of managing and troubleshooting an existing data center, compiling a database of IT airflow with which future facilities may be designed and managed, creating accurate thermal/airflow models of data centers, and optimizing energy-efficiency through control of data center cooling resources. The rack airflow monitoring system is configured to measure airflow using thermistors secured to the equipment rack, which result in airflow measurements being tolerant of dispersed IT populations, highly-variable IT airflow rates, and airflow direction. The system utilizes inexpensive, thermistor-based airflow velocity measurements with the ability to determine airflow direction (e.g., “in” or “out”).
For example, for hot-aisle-containment installation systems, it has proven very difficult to control cooling airflow based on hot aisle pressure measurement (the installation system is oftentimes too leaky to provide sufficient hot-aisle suction pressure resolution). Embodiments of the rack airflow monitoring system are easily and efficiently controlled based on the airflow measurements described herein. The rack airflow monitoring system is simple to install and operate, and provides greater efficiency.
Referring to the drawings, and more particularly to
To measure airflow, the equipment rack 10 is provided with a rack airflow monitoring system of embodiments of the present disclosure, which is generally indicated at 20. The rack airflow monitoring system 20 is capable of obtaining temperature, airflow velocity, and airflow directionality by a plurality of sensors (sometimes referred to as “airflow sensors”), each indicated at 22, which are distributed over the front door 14 of the equipment rack 10 as illustrated in
Referring to
Referring to
As mentioned above, the airflow and temperature measurements from the airflow sensors 22 of the rack airflow monitoring system 20 can be transmitted wirelessly to data center management software, such as a StruxureWare® Operations for Data Centers offered by Schneider Electric, or a dedicated computer or mobile application. In addition to net IT airflow through the equipment rack 10 and average temperature of the entering airflow, the distribution of airflow and temperature can be displayed as shown in
The spatial distribution data gives data center operators the opportunity to assess the uniformity of cooling and, for example, choose to locate IT equipment in particular equipment rack locations accordingly. The airflow and temperature distributions over the front face of the equipment rack may be shown in precise correspondence to the number of airflow sensors (e.g., sixty sensors in the example of
In addition to the display of airflow and temperature data via (remote) software, the rack airflow monitoring system 10 is configured to provide a visual indication of measured quantities through the LED indicators 36 or some other type of local display described above. For example, each airflow sensor 22 is configured with the LED indicator 36, with each LED indicator being configured to be illuminated in “yellow” to identify temperatures between recommended and maximum-allowable values, and being configured to be illuminated in “red” or “green” to identify temperatures that are hotter or cooler, respectively.
In certain embodiments, airflow is measured through the front door 14 (as opposed to the rear door) of the equipment rack 10, since drawing airflow is much smoother and more uniform than driving or forcing airflow, and since the front of the equipment rack between the front door and the front face of the servers (server mounting plane) may be isolated from leakage airflow without great difficulty. The system can be provided with sealing components that are configured to seal any gaps around the front door or across the server mounting plane.
In configuring the system, several factors are considered, including, but not limited to limiting the airflow sensors to a practical and economical number, measuring only the component of airflow which enters or exits (is perpendicular to) the front door, and determining the direction (“in” or “out”) of this airflow. In determining sensor distribution, CFD modeling can be employed to determine a good balance between accuracy and sensor count. Models of equipment racks located in different but representative data center environments (e.g., raised-floor cooling with a range of airflow rates, row-based-cooling with a range of airflow rates, positions and orientations relative to other equipment racks, etc.) were created. Exemplary airflow sensor placements are shown in
For each environment, the combinations of sensor distributions and IT populations shown in
One aspect of the configuration of the airflow sensors of the system is to ensure that the perpendicular component is measured by placing the thermistor inside the tube as shown in
In one embodiment, a tube diameter is 0.5 inch is selected, as this provides a reasonable clearance for the thermistor. Using this fixed diameter (e.g., 0.5 inch), additional (transient) CFD simulations are performed in which the tube length is varied while airflow approached the end of the tube at a worst-case 45 angle relative to the rack front door. In each case, a time constant is recorded, and a corresponding velocity is determined from the known correlation between the time constant and the corresponding velocity. Additionally, the true airflow rate through the tube (in the direction perpendicular to the equipment rack door) is also recorded as measured directly by the CFD model.
As shown in
Referring to
where β is a known constant related to the thermistor construction, and V0 is the measured reference voltage at a known reference temperature T0. Equation 1 provides thermistor temperature as a function of measured voltage Vth.
As noted above, airflow velocity measurements are achieved utilizing simple and economical two-wire thermistors, which are heated and allowed to cool in a transient manner.
where M is the mass of the thermistor, cp is the specific heat of the thermistor, h is the heat transfer coefficient to the surrounding fluid, and A is the surface area of the thermistor which is exposed to the surrounding airstream. For a given thermistor, only the heat transfer coefficient h is variable and it depends (strongly) on local airflow velocity. Consequently, the shape of the temperature profile during the cooling phase yields a time constant which, in turn, can be correlated to airflow.
Referring to
A source voltage is then applied to the thermistor (Step 114; see
If the thermistor voltage is lower than Vcool (Step 128), then Tth≧Tcool, and a delay is applied to let the thermistor temperature fall (Step 130). Alternatively, if the measured thermistor voltage exceeds Vcool, then the ending time, tstart, is recorded, and the characteristic cooling time, tcool, is computed (Step 132). Finally, the air velocity is computed from the original sensor calibration which relates velocity v to characteristic cooling time tcool with an optional minor correction for ambient temperature (Step 134).
With the sensor assembly shown in
Embodiments of the system disclosed herein include processes for both determining the velocity and flow direction for a single sensor. Assuming that the velocity v is known at every sensor location and is given a positive sign for “inflow” and a negative sign for “outflow”, the total rack airflow rate Qnet is calculated as:
where Adoor is the overall frontal rack open area (i.e., total perforated area), n is the number of sensors (e.g., 15), and αi is a weighting factor associated with each sensor i. In the simplest interpretation, the sensors are assumed to be distributed uniformly over the face of the equipment rack and that all sensor locations contribute equally to total airflow rate. In this instance, αi=1 for all sensors and the total airflow calculation reduces to the product of the open door area and the average velocity of all of the sensors. However, depending on the equipment rack shape, preferred sensor locations, etc., it may be desirable to employ a more complex weighting. In this case, the best values of weighting coefficients may be determined empirically through measurement and or CFD modeling.
Finally, ideally, the equipment rack sensors will provide the same resistance to airflow as the equipment rack front door's perforated openings. This ensures that the airflow will not “avoid” the sensors because they “look like” a larger flow obstruction. The system concept is constructed accordingly; however, it may be possible to calibrate the sensors further by scaling up or down the total airflow rate prediction of Equation 3 accordingly. For example, calibration can include a method of automated, on-board calibration that allows the rack airflow monitoring system to establish, for each individual sensor, the particular cool-down time (or thermal time constant) associated with the condition of a known specified air speed incident upon that particular sensor (where the preferred embodiment is to perform the calibration at zero air speed because that is the easiest condition to produce). Further, a mathematical model that, based on the cool-down time of a particular sensor in relation to the statistical average properties of the batch of sensors from which the sensor originates, maps each of a given sensor's future readings to a modified reading that can be used as an input for the mathematical relationship that maps cool-down time to air speed. Due to manufacturing variability, the cool-down time of a given sensor with a particular air speed incident upon it may vary considerably from any other sensor at the same air speed. This can be an issue when performing the methods disclosed herein. An operator of the system is able to configure the system in such a manner that a known air speed (zero air speed being the preferred embodiment) is incident over all of the airflow sensors, and then have the system record the cool-down time of each airflow sensor at the given air speed. The system is configured to compare the particular cool-down time of each airflow sensor to the average cool-down time for the batch of airflow sensors, and add some correction factor to any future readings from the particular airflow sensor. A correction factor can be determined as the difference between some known sensor population-average cool down time and the cool down time for a particular sensor.
Embodiments of the system can include providing LED lights at each of the fifteen sensor locations (
Various aspects and functions described herein, including the simulation-based optimization methodology discussed above, may be included as specialized hardware or software components executing in one or more computer systems. For example, the computer module 24 and/or one or more acts of the method described above may be performed with a computer, where at least one act is performed in a software program housed in a computer. Non-limiting examples of computer systems include, among others, network appliances, personal computers, workstations, mainframes, networked clients, servers, media servers, application servers, database servers and web servers. Other examples of computer systems may include mobile computing devices, such as cellular phones and personal digital assistants, and network equipment, such as load balancers, routers and switches. Further, aspects may be located on a single computer system or may be distributed among a plurality of computer systems connected to one or more communications networks.
For example, various aspects and functions may be distributed among one or more computer systems configured to provide a service to one or more client computers, or to perform an overall task as part of a distributed system. Additionally, aspects may be performed on a client-server or multi-tier system that includes components distributed among one or more server systems that perform various functions. Consequently, examples are not limited to executing on any particular system or group of systems. Further, aspects and functions may be implemented in software, hardware or firmware, or any combination thereof. Thus, aspects and functions may be implemented within methods, acts, systems, system elements and components using a variety of hardware and software configurations, and examples are not limited to any particular distributed architecture, network, or communication protocol.
Referring to
As illustrated in
The memory 512 stores programs and data during operation of the computer system 502. Thus, the memory 512 may be a relatively high performance, volatile, random access memory such as a dynamic random access memory (“DRAM”) or static memory (“SRAM”). However, the memory 512 may include any device for storing data, such as a disk drive or other nonvolatile storage device. Various examples may organize the memory 512 into particularized and, in some cases, unique structures to perform the functions disclosed herein. These data structures may be sized and organized to store values for particular data and types of data.
Components of the computer system 502 are coupled by an interconnection element such as the interconnection element 514. The interconnection element 514 may include one or more physical busses, for example, busses between components that are integrated within a same machine, but may include any communication coupling between system elements including specialized or standard computing bus technologies such as IDE, SCSI, PCI and InfiniBand. The interconnection element 514 enables communications, such as data and instructions, to be exchanged between system components of the computer system 502.
The computer system 502 also includes one or more interface devices 516 such as input devices, output devices and combination input/output devices. Interface devices may receive input or provide output. More particularly, output devices may render information for external presentation. Input devices may accept information from external sources. Examples of interface devices include keyboards, mouse devices, trackballs, microphones, touch screens, printing devices, display screens, speakers, network interface cards, etc. Interface devices allow the computer system 502 to exchange information and to communicate with external entities, such as users and other systems.
The data storage element 518 includes a computer readable and writeable nonvolatile, or non-transitory, data storage medium in which instructions are stored that define a program or other object that is executed by the processor 510. The data storage element 518 also may include information that is recorded, on or in, the medium, and that is processed by the processor 510 during execution of the program. More specifically, the information may be stored in one or more data structures specifically configured to conserve storage space or increase data exchange performance. The instructions may be persistently stored as encoded signals, and the instructions may cause the processor 510 to perform any of the functions described herein. The medium may, for example, be optical disk, magnetic disk or flash memory, among others. In operation, the processor 510 or some other controller causes data to be read from the nonvolatile recording medium into another memory, such as the memory 512, that allows for faster access to the information by the processor 510 than does the storage medium included in the data storage element 518. The memory may be located in the data storage element 518 or in the memory 512, however, the processor 510 manipulates the data within the memory, and then copies the data to the storage medium associated with the data storage element 518 after processing is completed. A variety of components may manage data movement between the storage medium and other memory elements and examples are not limited to particular data management components. Further, examples are not limited to a particular memory system or data storage system.
Although the computer system 502 is shown by way of example as one type of computer system upon which various aspects and functions may be practiced, aspects and functions are not limited to being implemented on the computer system 502. Various aspects and functions may be practiced on one or more computers having a different architectures or components than that shown in
The computer system 502 may be a computer system including an operating system that manages at least a portion of the hardware elements included in the computer system 502. In some examples, a processor or controller, such as the processor 510, executes an operating system. Examples of a particular operating system that may be executed include a Windows-based operating system, such as the Windows 8 operating system, available from the Microsoft Corporation, a MAC OS X operating system or an iOS operating system available from Apple Computer, one of many Linux-based operating system distributions, for example, the Enterprise Linux operating system available from Red Hat Inc., a Solaris operating system available from Sun Microsystems, or a UNIX operating systems available from various sources. Many other operating systems may be used, and examples are not limited to any particular operating system.
The processor 510 and operating system together define a computer platform for which application programs in high-level programming languages are written. These component applications may be executable, intermediate, bytecode or interpreted code which communicates over a communication network, for example, the Internet, using a communication protocol, for example, TCP/IP. Similarly, aspects may be implemented using an object-oriented programming language, such as .Net, SmallTalk, Java, C++, Ada, C# (C-Sharp), Python, or JavaScript. Other object-oriented programming languages may also be used. Alternatively, functional, scripting, or logical programming languages may be used.
Additionally, various aspects and functions may be implemented in a non-programmed environment, for example, documents created in HTML, XML or other format that, when viewed in a window of a browser program, can render aspects of a graphical-user interface or perform other functions. Further, various examples may be implemented as programmed or non-programmed elements, or any combination thereof. For example, a web page may be implemented using HTML while a data object called from within the web page may be written in C++ or Python. Thus, the examples are not limited to a specific programming language and any suitable programming language could be used. Accordingly, the functional components disclosed herein may include a wide variety of elements, e.g. specialized hardware, executable code, data structures or objects, which are configured to perform the functions described herein.
In some examples, the components disclosed herein may read parameters that affect the functions performed by the components. These parameters may be physically stored in any form of suitable memory including volatile memory (such as RAM) or nonvolatile memory (such as a magnetic hard drive). In addition, the parameters may be logically stored in a propriety data structure (such as a database or file defined by a user mode application) or in a commonly shared data structure (such as an application registry that is defined by an operating system). In addition, some examples provide for both system and user interfaces that allow external entities to modify the parameters and thereby configure the behavior of the components.
It should be observed that the systems and methods disclosed herein are capable of continuously monitoring the flow rate, direction, and temperature of air passing through IT equipment in an equipment rack. This data, in turn, may be used for, among other things:
1) managing and troubleshooting the existing data center;
2) compiling a database of IT airflow with which future facilities may be designed and managed;
3) accurately inputting thermal/airflow models of the data center, which provide additional design and operational benefits; and
4) controlling data center cooling resources to optimize energy efficiency.
In one embodiment, the system includes fifteen airflow/temperature sensors, distributed across the front door of the equipment rack, which indicate the distribution and aggregate values of rack airflow and inlet temperature. The system can be constructed as a complete equipment rack, a replacement equipment rack front door, or a retrofit to existing equipment racks.
The system includes the ability to continuously measure total rack airflow rate. Airflow measurements are tolerant of dispersed populations of IT equipment and/or highly variable IT airflow rates, and the presence of “reverse” airflow, and strong airflow components parallel to the equipment rack front door. Airflow measurements are made using inexpensive, simple two-wire thermistors using an energy-efficient transient method. Additional resistors provide a heat source which allows the flow direction to be detected.
Those skilled in the art will readily appreciate that the various parameters and configurations described herein are meant to be exemplary and that actual parameters and configurations will depend upon the specific application for which the embodiments directed toward the air flow fault detection methods and system of the present disclosure are used. Those skilled in the art will recognize, or be able to ascertain using no more than routine experimentation, many equivalents to the specific embodiments described herein. For example, those skilled in the art may recognize that embodiments according to the present disclosure may further include a plurality or network of power modules or may include a component of a production process using the power modules. It is, therefore, to be understood that the foregoing embodiments are presented by way of example only and that, within the scope of the appended claims and equivalents thereto, the disclosed air flow fault detection methods and systems may be practiced otherwise than as specifically described. The present systems and methods are directed to each individual feature or method described herein. In addition, any combination of two or more such features, apparatus or methods, if such features, apparatus or methods are not mutually inconsistent, is included within the scope of the present disclosure.
Further, it is to be appreciated various alterations, modifications, and improvements will readily occur to those skilled in the art. Such alterations, modifications, and improvements are intended to be part of this disclosure, and are intended to be within the spirit and scope of the disclosure. For example, an existing process may be modified to utilize or incorporate any one or more aspects of the disclosure. Thus, in some embodiments, embodiments may involve connecting or configuring an existing process to comprise the air flow fault detection methods and systems. For example, an existing air-cooling process may be retrofitted to involve use of a fault detection method in accordance with one or more embodiments. Accordingly, the foregoing description and drawings are by way of example only. Further, the depictions in the drawings do not limit the disclosures to the particularly illustrated representations.
While exemplary embodiments have been disclosed, many modifications, additions, and deletions may be made therein without departing from the spirit and scope of the disclosure and its equivalents, as set forth in the following claims.