Learning to Be Green: Carbon-Aware Online Control for Edge Intelligence with Colocated Learning and Inference
Authors:
- 1 July 2023
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 567-578
Abstract
Edge intelligence is an emerging paradigm that leverages edge computing to pave the last mile delivery of artificial intelligence. While pilot efforts on edge intelligence have mostly focused on the performance and power issues, the sustainability dilemma along with the upcoming carbon peaking and neutrality era has largely been overlooked. To green edge intelligence, we propose a carbon-aware online control framework (CARE) in this paper. CARE colocates learning and inference tasks within an edge node and dynamically adapts their configurations based on the temporal variation of carbon intensity and renewable energy availability. With such a colocation setup, CARE aims to minimize the long-term inference accuracy loss under the long-term carbon emission cap. The underlying long-term optimization problem is nontrivial since it involves uncertain information (e.g., renewable energy availability) and is NP-hard. To address these dual challenges, CARE first designs an online learning module to make fractional decisions by learning from previous system dynamics and configuration adaptation results. Then, CARE further designs a randomized rounding module, which converts the fractional decision into integer without violating the long-term carbon emission cap. The effectiveness of CARE is verified by rigorous theoretical analysis and extensive trace-driven simulations.Keywords
Funding Information
- National Science Foundation of China (62172454,U20A20159)
- Fundamental Research Funds for the Central Universities (23lgbj006)
This publication has 26 references indexed in Scilit:
- Edge Computing for Smart Grid: An Overview on Architectures and Solutions2018
- Multiple Granularity Online Control of Cloudlet Networks for Edge Computing2018
- On Enabling Sustainable Edge Computing with Renewable Energy ResourcesIEEE Communications Magazine, 2018
- Demo abstract: Distributed machine learning at resource-limited edge nodes2018
- An Online Convex Optimization Approach to Proactive Network Resource AllocationIEEE Transactions on Signal Processing, 2017
- Online Learning for Offloading and Autoscaling in Renewable-Powered Mobile Edge Computing2016
- Carbon-Aware Energy Capacity Planning for Datacenters2012
- Online Learning and Online Convex OptimizationFoundations and Trends in Machine Learning, 2012
- Geographical load balancing with renewablesACM SIGMETRICS Performance Evaluation Review, 2011
- Jevons’ Paradox revisited: The evidence for backfire from improved energy efficiencyEnergy Policy, 2009