Abstract
AI’s exponential growth intensifies computational demands and energy challenges. While practitioners employ various optimization techniques, that we refer as “knobs” in this paper, to tune model efficiency, these are typically afterthoughts and applied in isolation without understanding their combined effects on energy efficiency. The goal of this exploratory empirical study is to emphasize on treating energy efficiency as the firstclass design consideration by demonstrating how strategic knob selection across five AI pipeline stages (data, model, training, system, inference) creates cascading efficiency gains. We evaluate 30 experimental variants on ModernBERT, an encoderonly architecture, examining individual techniques and their orthogonal combinations. Results shows that model pruning provides the highest single-knob energy savings (up to 84.6%), while orthogonal combinations reduce energy consumption by up to 94.6% while preserving 95.95% of baseline F1 score. This work provides actionable frameworks for informed green AI that balance efficiency, performance, and environmental responsibility in AI systems.

This publication has 4 references indexed in Scilit: