The present disclosure relates to the physical arrangement of components including equipment racks within a data center. The arrangement is facilitated by liquid cooling electrical components with equipment racks.
Specifically, embodiments of the present disclosure enable a person arranging equipment racks in the data center to decrease or eliminate the space taken for a hot aisle between two rows of equipment racks and to better distribute high power amongst IT equipment racks via direct connection to common horizontal busbars. Further, embodiments of the present disclosure enable fans to be removed from servers thereby enabling smaller servers.
Power distribution consists of either busway overhead (requiring tap-off units and cabling to and from busway) or a power distribution unit (PDU) and/or remote power panels (RPPs) requiring cable connection between distribution panels and each rack.
One aspect of the present disclosure is directed to an equipment rack arrangement comprising a first row of equipment racks and at least one horizontal busbar extending horizontally through the equipment racks of the first row of equipment racks. The at least one horizontal busbar is configured to provide power to electronic equipment supported by the equipment racks of the first row of equipment racks.
Embodiments of the equipment rack arrangement further may include at least one vertical busbar extending vertically through equipment racks of the first row of equipment racks. The first row of equipment racks may include at least one first power converter cabinet and at least two first IT equipment racks. The first row of equipment racks further may include at least one generic rack. The equipment rack arrangement further may include a second row of equipment racks positioned next to the first row of equipment racks. The at least one horizontal busbar may extend horizontally through the equipment racks of the second row of equipment racks. The at least one horizontal busbar may be configured to provide power to electronic equipment supported by the equipment racks of the second row of equipment racks. Relatively cold air may be configured to enter fronts of equipment racks of the first row of equipment racks and fronts of equipment racks of the second row of equipment racks and relatively hot air may be configured to exit tops of equipment racks of the first row of equipment racks and tops of equipment racks of the second row of equipment racks. The equipment rack arrangement further may include an airflow divider positioned between the first row of equipment racks and the second row of equipment racks. The equipment rack arrangement further may include at least one fan configured to move the relatively cold air through fronts of the equipment racks of the first row of equipment racks and through fronts of the equipment racks of the second row of equipment racks and to move relatively hot air through tops of the equipment racks of the first row of equipment racks and through tops of the equipment racks of the second row of equipment racks. The equipment rack arrangement further may include at least one vertical busbar extending vertically through equipment racks of the first row of equipment racks and equipment racks of the second row of equipment racks. The first row of equipment racks may include at least one first power converter cabinet and at least two first IT equipment racks and the second row of equipment racks may include at least one second power converter cabinet and at least two second IT equipment racks. The at least one first power converter cabinet may be positioned adjacent to the at least one second power converter cabinet, and the at least two first IT equipment racks may be positioned adjacent to the at least two second IT equipment racks. The at least one horizontal busbar may extend between the at least one first power converter cabinet and the at least one second power converter cabinet and between the at least two first IT equipment racks and the at least two second IT equipment racks. The equipment rack arrangement further may include at least one fan configured to move the relatively cold air through fronts of the equipment racks of the first row of equipment racks and to move relatively hot air through tops of the equipment racks of the first row of equipment racks. The equipment rack arrangement further may include a liquid cooling system configured to provide liquid cooling to the electronic equipment supported by the equipment racks of the first row of equipment racks. The equipment rack arrangement further may include a partition to electrically isolate the at least one horizontal busbar.
Another aspect of the present disclosure is directed to a method of installing equipment racks, comprising: installing a first row of equipment racks; and installing at least one horizontal busbar to extend horizontally through the equipment racks of the first row of equipment racks. The at least one horizontal busbar is configured to provide power to electronic equipment supported by the equipment racks of the first row of equipment racks.
Embodiments of the method further may include installing at least one vertical busbar through equipment racks of the first row of equipment racks. The first row of equipment racks may include at least one first power converter cabinet and at least two first IT equipment racks. The first row of equipment racks further may include at least one generic rack. The method further may include installing a second row of equipment racks next to the first row of equipment racks. The at least one horizontal busbar may extend horizontally through the equipment racks of the second row of equipment racks. The at least one horizontal busbar may be configured to provide power to electronic equipment supported by the equipment racks of the second row of equipment racks. The method further may include moving relatively cold air through fronts of equipment racks of the first row of equipment racks and through fronts of equipment racks of the second row of equipment racks, and moving relatively hot air through tops of equipment racks of the first row of equipment racks and tops of equipment racks of the second row of equipment racks. Moving relatively cold air and moving relatively hot air may be achieved by at least one fan. The method further may include installing at least one vertical busbar through equipment racks of the first row of equipment racks and equipment racks of the second row of equipment racks. The method further may include installing an airflow divider between the first row of equipment racks and the second row of equipment racks. The method further may include moving relatively cold air through fronts of equipment racks of the first row of equipment racks and moving relatively hot air through tops of equipment racks of the first row of equipment racks. The method further may include providing liquid cooling to the electronic equipment supported by the equipment racks of the first row of equipment racks. The method further may include installing a partition to electrically isolate the at least one busbar.
Yet another aspect of the present disclosure is directed to an equipment rack arrangement comprising a first row of equipment racks and a second row of equipment racks. The backs of equipment racks of the first row of equipment racks face and are proximate to the backs of equipment racks of the second row of equipment racks. Relatively cold air is configured to enter fronts of equipment racks of the first row of equipment racks and fronts of equipment racks of the second row of equipment racks and relatively hot air is configured to exit tops of equipment racks of the first row of equipment racks and tops of equipment racks of the second row of equipment racks.
In some embodiments, the first and/or second row of equipment racks includes at least one power converter cabinet, energy storage rack, IT equipment rack or generic rack.
Another aspect of the present disclosure is directed to a method of installing equipment racks, comprising: installing a first row of equipment racks; and installing a second row of equipment racks, with the backs of equipment racks of the first row of equipment racks facing and being proximate to the backs of equipment racks of the second row of equipment racks. Relatively cold air is configured to enter fronts of equipment racks of the first row of equipment racks and fronts of equipment racks of the second row of equipment racks and relatively hot air is configured to exit tops of equipment racks of the first row of equipment racks and tops of equipment racks of the second row of equipment racks.
Another aspect of the present disclosure is directed to an equipment rack arrangement, comprising a first row of equipment racks, a second row of equipment racks, and at least one horizontal busbar extending horizontally through the equipment racks of the first row of equipment racks and equipment racks of the second row of equipment racks. The at least one horizontal busbar is configured to provide power to electronic equipment supported by the equipment racks of the first row of equipment racks and to provide power to electronic equipment supported by the equipment racks of the second row of equipment racks.
Embodiments of the equipment rack arrangement further may include at least one vertical busbar extending vertically through equipment racks of the first row of equipment racks and equipment racks of the second row of equipment racks. The first row of equipment racks may include at least one first power converter cabinet and at least two first IT equipment racks and the second row of equipment racks may include at least one second power converter cabinet and at least two second IT equipment racks, the at least one power converter. The at least one first power converter cabinet may be positioned adjacent to the at least one second power converter cabinet, and the at least two first IT equipment racks may be positioned adjacent to the at least two second IT equipment racks. The at least one horizontal busbar may extend between the at least one first power converter cabinet and the at least one second power converter cabinet and between the at least two first IT equipment racks and the at least two second IT equipment racks. The first row of equipment racks further may include at least one generic rack and the second row of equipment racks further includes at least one generic rack. Relatively cold air may be configured to enter fronts of equipment racks of the first row of equipment racks and fronts of equipment racks of the second row of equipment racks and relatively hot air may be configured to exit tops of equipment racks of the first row of equipment racks and tops of equipment racks of the second row of equipment racks. The equipment rack arrangement further may include an airflow divider positioned between the first row of equipment racks and the second row of equipment racks. The equipment rack arrangement further may include at least one fan configured to move the relatively cold air through fronts of the equipment racks of the first row of equipment racks and through fronts of the equipment racks of the second row of equipment racks and to move relatively hot air through tops of the equipment racks of the first row of equipment racks and through tops of the equipment racks of the second row of equipment racks. The equipment rack arrangement further may include a liquid cooling system configured to provide liquid cooling to the electronic equipment supported by the equipment racks of the first row of equipment racks and to the electronic equipment supported by the equipment racks of the second row of equipment racks. The equipment rack arrangement further may include a partition to electrically isolate the at least one horizontal busbar.
Yet another aspect of the present disclosure is directed to a method of installing equipment racks, comprising: installing a first row of equipment racks; installing a second row of equipment racks; and installing at least one horizontal busbar to extend horizontally through the equipment racks of the first row of equipment racks and equipment racks of the second row of equipment racks. The at least one horizontal busbar is configured to provide power to electronic equipment supported by the equipment racks of the first row of equipment racks and to provide power electronic equipment supported by the equipment racks of the second row of equipment racks.
Embodiments of the method further may include installing at least one vertical busbar through equipment racks of the first row of equipment racks and equipment racks of the second row of equipment racks. The first row of equipment racks may include at least one first power converter cabinet and at least two first IT equipment racks and the second row of equipment racks includes at least one second power converter cabinet and at least two second IT equipment racks, the at least one power converter. The at least one first power converter cabinet may be positioned adjacent to the at least one second power converter cabinet, and the at least two first IT equipment racks are positioned adjacent to the at least two second IT equipment racks. The at least one busbar may extend between the at least one first power converter cabinet and the at least one second power converter cabinet and between the at least two first IT equipment racks and the at least two second IT equipment racks. The first row of equipment racks further may include at least one generic rack and the second row of equipment racks further includes at least one generic rack. The method further may include moving relatively cold air through fronts of equipment racks of the first row of equipment racks and through fronts of equipment racks of the second row of equipment racks, and moving relatively hot air through tops of equipment racks of the first row of equipment racks and tops of equipment racks of the second row of equipment racks. Moving relatively cold air and moving relatively hot air may be achieved by at least one fan. The method further may include installing an airflow divider between the first row of equipment racks and the second row of equipment racks. The method further may include providing liquid cooling to the electronic equipment supported by the equipment racks of the first row of equipment racks and to the electronic equipment supported by the equipment racks of the second row of equipment racks. The method further may include installing a partition to electrically isolate the at least one busbar.
Various aspects of at least one embodiment are discussed below with reference to the accompanying figures, which are not intended to be drawn to scale. The figures are included to provide an illustration and a further understanding of the various aspects and embodiments, and are incorporated in and constitute a part of this specification, but are not intended as a definition of the limits of any particular embodiment. The drawings, together with the remainder of the specification, serve to explain principles and operations of the described and claimed aspects and embodiments. In the figures, each identical or nearly identical component that is illustrated in various figures is represented by a like numeral. For purposes of clarity, not every component may be labeled in every figure. In the figures:
This disclosure is not limited in its application to the details of construction and the arrangement of components set forth in the following descriptions or illustrated by the drawings. The disclosure is capable of other embodiments and of being practiced or of being carried out in various ways. Also, the phraseology and terminology used herein is for description purposes and should not be regarded as limiting. The use of “including,” “comprising,” “having,” “containing,” “involving,” and variations herein, are meant to be open-ended, i.e., “including but not limited to.”
Referring to the drawings, and more particularly to
In one embodiment, each IT equipment rack 30, 32 includes a chassis or frame structure that defines an enclosure. The chassis of each IT equipment rack 30, 32 includes an open front having several mounting slots that are each configured to slidably receive electronic equipment, e.g., servers, each indicated at 34. It should be noted that each equipment rack 30, 32 can be configured to accommodate any number of pieces of electronic equipment, with the size of the mounting slots being dependent on the size of the equipment received within the mounting slots. As shown in
In some embodiments, in place of two IT equipment racks, e.g., IT equipment racks 30, 32, a single enclosure can be provided with two columns of servers, or two enclosure mounted flush back-to-back with one another.
In some embodiments, an airflow divider, indicated at 42, can be disposed between the backs of the two IT equipment racks 30, 32. The air divider 42 separates air directed to the front of the equipment rack 30 of the first row of equipment rack and the front of the equipment rack 32 of the second row of equipment racks. For each equipment rack 30, 32, the air divider 42 is provided to ensure that the cool air 38 entering through the front of the equipment rack travels upwardly through the equipment rack to the top of the equipment rack and not to the equipment rack in the other row.
In some embodiments, an exhaust fan 44 may be provided to draw relatively cool air from a cold aisle and to exhaust air out of the equipment racks. In one embodiment, the exhaust fan 44 may be provided between the equipment rack 30 of the first row of equipment racks and the equipment rack 32 of the second row of equipment racks. The exhaust fan 44 may be configured to draw or otherwise move air from a front of the equipment rack 30 of the first row of equipment racks and a front of the equipment rack 32 of the second row of equipment racks. The exhaust fan 44 further may be configured to exhaust or otherwise move air through a top of the equipment rack 30 of the first row of equipment racks and through a top of the equipment rack 32 of the second row of equipment racks. The exhaust fan 44 embody a fan module having a fan, with the fan module being coupled to a controller, e.g., controller 82 described below, configured to control the operation of the fan module. In this embodiment, air is configured to be exhausted or removed from the equipment rack 30 of the first row of equipment racks and the equipment rack 32 of the second row of equipment racks and delivered to a return plenum positioned above the equipment racks 30, 32.
In some embodiments, there may be several exhaust fans 44 provided along the lengths of the first and second rows of equipment racks, which are spaced from one another.
In another embodiment, an exhaust fan 46a may be provided at top of the equipment rack 30 of the first row of equipment racks and an exhaust fan 46b may be provided at a top of the equipment rack 32 of the second row of equipment racks. Exhaust fan 46a may be configured to draw or otherwise move air from a front of the equipment rack 30 of the first row of equipment racks and to exhaust or otherwise move air through the top of the equipment rack 30 of the first row of equipment racks. Similarly, exhaust fan 46b may be configured to draw or otherwise move air from a front of the equipment rack 32 of the second row of equipment racks and to exhaust or otherwise move air through the top of the equipment rack 32 of the second row of equipment racks. Each exhaust fan 46a, 46b may be coupled to a controller configured to control the operation of each fan module. In this embodiment, air is configured to be exhausted or removed from each equipment rack 30, 32 and delivered to one or more plenums positioned above the equipment racks 30, 32.
In some embodiments, server-based fans can be provided to push/pull air horizontally through the servers in each equipment rack and to exhaust air through the center/top of the equipment rack.
Referring to
The power converter cabinets 50a, 50b, 50c, 50d, each can be configured to include power equipment including integrated alternating current (AC) to direct current (DC) converters or DC to DC converters. The power converter cabinets 50a, 50b, 50c, 50d each can be configured to include, without limitation, UPSs. The IT equipment racks 52a, 52b, 52c, 52d, 52c, 52f, 52g, 52h each can be configured to include IT equipment, such as servers, telecommunications and networking equipment and hardware, displays, and related equipment. The generic racks 54a, 54b, 54c, 54d, 54c, 54f each can be configured to include other types of equipment, such as battery modules, cooling modules, and the like.
As shown, the fronts of the power converter cabinets 50a, 50b, 50c, 50d, the IT equipment racks 52a, 52b, 52c, 52d, 52e, 52f, 52g, 52h and the generic racks 54a, 54b, 54c, 54d, 54c, 54f face outwardly, and the backs of the power converter cabinets, the IT equipment racks and the generic racks face inwardly towards one another, with little or no space between the respective pieces of equipment. The arrangement is such that the backs of power converter cabinets 50a, 50b face the backs of power converter cabinets 50c, 50d, respectively, the backs of IT equipment racks 52a, 52b, 52c, 52d face the backs of IT equipment racks 52e, 52f, 52g, 52h, and the backs of generic racks 54a, 54b, 54c face the backs of generic racks 54d, 54c, 54f. As described above with the description of
Referring to
In one embodiment, the power converters of the power converter cabinets 50c, 50d are directly connected to the busbars 60 and power supply units of the IT equipment racks 52c, 52f, 52g, 52h are directly connected to the busbars. In the power converter cabinets, vertical busbars, each indicated at 62, are provided to provide power to the power converters stacked within the power converter cabinets 50c, 50d. In the IT equipment racks, the power supply units, which are optional, are configured to provide power to the modules, e.g., servers, within the IT equipment racks 52e, 52f, 52g, 52h. The power supply units are provided to reduce voltage required for the electronic equipment housed within the IT equipment racks.
As noted, the horizontal busbars 60 are configured to provide power to the electronic equipment supported by the equipment racks of the first row of equipment racks and to provide power to electronic equipment supported by the equipment racks of the second row of equipment racks. The vertical busbars 62 are configured to provide power to the electronic equipment supported by adjacently placed particular equipment racks. The size (cross-sectional area) and material of each busbar 60, 62 can be selected based on the amount of current to be delivered to the electronic equipment supported by the power converter cabinets, the IT equipment racks and optionally the generic racks. Further, the busbars 60, 62 are each suitably supported by the power converter cabinets, the IT equipment racks and optionally the generic racks in such a manner that the busbars 60, 62 are electrically isolated from the power converter cabinets, the IT equipment racks and optionally the generic racks.
As will be described below, power converter cabinets 50a, 50b similarly can be configured to include horizontal busbars and vertical busbars to deliver power to power converters supported by the power converter cabinets, and IT equipment racks 52a, 52b, 52c, 52d similarly can be configured to include horizontal busbars to deliver power to modules supported by the IT equipment racks.
In one example, with reference to
It should be understood that each row of equipment racks can be configured to include a horizontal busbar and vertical busbars to power electronic equipment contained in the equipment racks.
Referring to
Referring to
In some embodiments, the servers 116 of the IT equipment racks 110a, 110b are cooled by a liquid cooling system 124. As shown, each server 116 is connected to the liquid cooling system 124 to provide liquid cooling to the server.
In some embodiments, an exhaust fan 126 may be provided to exhaust air out of the equipment racks. In one embodiment, the exhaust fan 126 may be provided between the equipment rack 110a of the first row of equipment racks and the equipment rack 110b of the second row of equipment racks. The exhaust fan 126 may be configured to draw or otherwise move air from a front of the equipment rack 110a of the first row of equipment racks and a front of the equipment rack 110b of the second row of equipment racks. The exhaust fan 126 further may be configured to exhaust or otherwise move air through a top of the equipment rack 110a of the first row of equipment racks and through a top of the equipment rack 110b of the second row of equipment racks. The exhaust fan 126 embody a fan module having a fan, with the fan module being coupled to a controller, e.g., controller 82, configured to control the operation of the fan module. In this embodiment, air is configured to be exhausted or removed from the equipment rack 110a of the first row of equipment racks and the equipment rack 110b of the second row of equipment racks and delivered to a return plenum positioned above the equipment racks 110a, 110b.
In some embodiments, there may be several exhaust fans 126 provided along the lengths of the first and second rows of equipment racks, which are spaced from one another.
In another embodiment, an exhaust fan 128a may be provided at top of the equipment rack 110a of the first row of equipment racks and an exhaust fan 128b may be provided at a top of the equipment rack 110b of the second row of equipment racks. Exhaust fan 128a may be configured to draw or otherwise move air from a front of the equipment rack 110a of the first row of equipment racks and to exhaust or otherwise move air through the top of the equipment rack 110a of the first row of equipment racks. Similarly, exhaust fan 128b may be configured to draw or otherwise move air from a front of the equipment rack 110b of the second row of equipment racks and to exhaust or otherwise move air through the top of the equipment rack 110b of the second row of equipment racks. Each exhaust fan 128a, 128b may be coupled to a controller configured to control the operation of each fan module. In this embodiment, air is configured to be exhausted or removed from each equipment rack 110a, 110b and delivered to one or more plenums positioned above the equipment racks 110a, 110b.
In some embodiments, server-based fans can be provided to push/pull air horizontally through the servers in each equipment rack and to exhaust air through the center/top of the equipment rack.
Various controllers may execute various operations discussed above. For example, as discussed above, the controller, such as controller 82, may control the power modules of the power converter cabinet. Using data stored in associated memory and/or storage, the controller may execute one or more instructions stored on one or more non-transitory computer-readable media, which the controller may include and/or be coupled to, that may result in manipulated data. In some examples, the controller may include one or more processors or other types of controllers. In one example, the controller is or includes at least one processor. In another example, the controller performs at least a portion of the operations discussed above using an application-specific integrated circuit tailored to perform particular operations in addition to, or in lieu of, a general-purpose processor. As illustrated by these examples, examples in accordance with the present disclosure may perform the operations described herein using many specific combinations of hardware and software and the disclosure is not limited to any particular combination of hardware and software components. Examples of the disclosure may include a computer-program product configured to execute methods, processes, and/or operations discussed above. The computer-program product may be, or include, one or more controllers and/or processors configured to execute instructions to perform methods, processes, and/or operations discussed above.
It should be understood that embodiments of the present disclosure offer a high-density IT row with front-to-top airflow allowing power conversion and IT equipment to be racked/installed from both sides, and combining two legacy rows into a single row. Further, integrated horizontal busbars are provided between power conversion racks and IT enclosure with power converters and IT PSUs directly connected the horizontal through-bus (from both sides).
In some embodiments, the airflow and power arrangements are independent of each other.
In some embodiments, the arrangement increases the power density of IT rows by eliminating the hot aisle. Further, the arrangement simplifies high-power distribution by eliminating cabling, connectors and separate overhead busway.
In some embodiments, an optional arrangement may include a row rectifier feeding LVDC within a row via integrated busbars. Voltage and protection are options, but many other voltages and protection schemes may be used.
In some embodiments, liquid cooling may be provided using horizontal pipes.
Having thus described several aspects of at least one embodiment, it is to be appreciated various alterations, modifications, and improvements will readily occur to those skilled in the art. Such alterations, modifications, and improvements are intended to be part of this disclosure and are intended to be within the scope of the disclosure. Accordingly, the foregoing description and drawings are by way of example only.
This application claims the benefit under 35 U.S.C. § 119 of U.S. Provisional Patent Application Ser. No. 63/543,981, filed Oct. 13, 2023, and titled EQUIPMENT RACK ARRANGEMENT, which is hereby incorporated herein by reference in its entirety for all purposes.
| Number | Date | Country | |
|---|---|---|---|
| 63543981 | Oct 2023 | US |