EfiMon: A Process Analyser for Granular Power Consumption Prediction
Preprint
Abstract
High-performance computing (HPC) and supercomputing are critical in Artificial Intelligence (AI) research, development, and deployment. The extensive use of supercomputers for training complex AI models, which can take from days to months, raises significant concerns about energy consumption and carbon emissions. Traditional methods for estimating the energy consumption of HPC workloads rely on metering reports from computing nodes power supply units, assuming exclusive use of the entire node. This assumption is increasingly untenable with the advent of next-generation supercomputers that share resources to accelerate workloads, as seen in initiatives like Acceleration as a Service (XaaS) and cloud computing. This paper introduces EfiMon, an agnostic and non-invasive tool designed to extract detailed information about process execution, including instructions executed within specific time windows and CPU and RAM usage. Additionally, it captures comprehensive system metrics, such as power consumption reported by CPU sockets and PSUs. This data enables the development of prediction models to estimate the energy consumption of individual processes without requiring isolation. Using a regression-based mathematical model, our tool is able to estimate single processes' power consumption in isolated and shared resource environments. In shared scenarios, the model demonstrates robust performance, deviating by a maximum of 2.2% on Intel-based machines and 4.4% on AMD systems compared to non-shared cases. This significant accuracy showcases EfiMon's potential for enhancing energy accounting in supercomputing, contributing to more efficient and energy-aware optimisation strategies in HPC.Keywords
All Related Versions
This publication has 14 references indexed in Scilit:
- XaaS: Acceleration as a Service to Enable Productive High-Performance Cloud ComputingComputing in Science & Engineering, 2024
- Energy Consumption of Assembly Instructions in Load-Store Microprocessor Architectures2021
- Energy Predictive Models of Computing: Theory, Practical Implications and Experimental Analysis on Multicore ProcessorsIEEE Access, 2021
- A review of power consumption models of servers in data centersApplied Energy, 2020
- Modeling temperature distribution and power consumption in IT server enclosures with row-based cooling architecturesApplied Energy, 2020
- Data Center Energy Consumption Modeling: A SurveyIEEE Communications Surveys & Tutorials, 2015
- Maximizing Throughput of Overprovisioned HPC Data Centers Under a Strict Power Budget2014
- Energy-Aware Data Transfer Tuning2014
- A Systematic Methodology to Generate Decomposable and Responsive Power Models for CMPsIEEE Transactions on Computers, 2012
- Power Management for Real-Time Embedded Systems on Block-Partitioned Multicore Platforms2008