Data Center Housing High Performance Supercomputer Cluster: Above Floor Thermal Measurements Compared To CFD Analysis
Authors:
- 1 June 2010
- journal article
- Published by ASME International in Journal of Electronic Packaging
- Vol. 132 (2) , 021009
Abstract
With the ever increasing heat dissipated by information technology (IT) equipment housed in data centers, it is becoming more important to project the changes that can occur in the data center as the newer higher powered hardware is installed. The computational fluid dynamics (CFD) software that is available has improved over the years. CFD software specific to data center thermal analysis has also been developed. This has improved the time lines of providing some quick analysis of the effects of new hardware into the data center. But it is critically important that this software provide a good report to the user of the effects of adding this new hardware. It is the purpose of this paper to examine a large cluster installation and compare the CFD analysis with environmental measurements obtained from the same site. This paper shows measurements and CFD data for high powered racks as high as 27 kW clustered such that heat fluxes in some regions of the data center exceeded 700 W per square foot. This paper describes the thermal profile of a high performance computing cluster located in an data center and a comparison of that cluster modeled via CFD. The high performance advanced simulation and computing (ASC) cluster had a peak performance of 77.8 TFlop/s, and employed more than 12,000 processors, 50 Tbytes of memory, and 2 Pbytes of globally accessible disk space. The cluster was first tested in the manufacturer’s development laboratory in Poughkeepsie, New York, and then shipped to Lawrence Livermore National Laboratory in Livermore, California, where it was installed to support the national security mission of the U.S. Detailed measurements were taken in both data centers and were previously reported. The Poughkeepsie results will be reported here along with a comparison to CFD modeling results. In some areas of the Poughkeepsie data center, there were regions that did exceed the equipment inlet air temperature specifications by a significant amount. These areas will be highlighted and reasons given on why these areas failed to meet the criteria. The modeling results by region showed trends that compared somewhat favorably but some rack thermal profiles deviated quite significantly from measurements.Keywords
This publication has 14 references indexed in Scilit:
- Prediction of Cold Aisle End Airflow Boundary Conditions Using Regression ModelingIEEE Transactions on Components and Packaging Technologies, 2007
- Modeling of data center airflow and heat transfer: State of the art and future trendsDistributed and Parallel Databases, 2007
- Convective Transport Processes in Data CentersNumerical Heat Transfer, Part A: Applications, 2006
- Thermo-Fluids Provisioning of a High Performance High Density Data CenterDistributed and Parallel Databases, 2006
- Optimization of Data Center Room Layout to Minimize Rack Inlet Air TemperatureJournal of Electronic Packaging, 2006
- An Exergy-Based Figure-of-Merit for Electronic PackagesJournal of Electronic Packaging, 2005
- Viability of Dynamic Cooling Control in a Data Center EnvironmentJournal of Electronic Packaging, 2005
- Balance of Power: Dynamic Thermal Management for Internet Data CentersIEEE Internet Computing, 2005
- Cluster of High-Powered Racks Within a Raised-Floor Computer Data Center: Effect of Perforated Tile Flow Distribution on Rack Inlet Air TemperaturesJournal of Electronic Packaging, 2004
- Efficient Thermal Management of Data Centers—Immediate and Long-Term Research NeedsHVAC&R Research, 2003