Abstract
Large-scale systems face strict power limits when running heterogeneous CPU–GPU applications that exhibit varying responses to power caps. Existing power capping methods either target GPUs or CPUs alone or require extensive per-application profiling, making them impractical for production environments. We present SmartCap, an online framework that coordinates CPU–GPU power capping to reduce energy consumption while bounding performance degradation under a user specified threshold. SmartCap combines an offline phase, which builds a performance model and initializes a performance–power matrix, with an online phase that employs lightweight profiling and collaborative filtering to infer performance across the CPU–GPU cap space. Performance evaluation on three heterogeneous systems with a diverse workload suite shows that SmartCap achieves 95% mean prediction accuracy and as much as 20% energy savings, with negligible runtime overhead for most applications, demonstrating its practicality for performance-aware energy optimization in production environments.