Policy Compression for Low-Power Intelligent Scaling in Software-Based Network Architectures
Authors:
- 6 May 2024
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 1-7
Abstract
Modern networks, characterized by their complexity and heterogeneity, are transitioning from manual to automated and intelligent management, according to the vision of Autonomous Networks (ANs). Leveraging data-driven techniques, ANs aim to provide the "Zero-X" and "Self-X" experience, where intelligent and adaptable network operations are key cornerstones. Such is the case of intelligent resource scaling, where the goal is to optimize resource orchestration to maximize efficiency, reduce latency, and maintain high-quality service, even amid fluctuating network loads and changing service requirements. Unfortunately, current approaches for auto-scaling are computationally expensive to deploy in resource-constrained devices such as those found at the edge or beyond. This paper introduces an innovative four-phase approach to train a compact, data-driven Deep Reinforcement Learning (DRL) scaler that can be deployed on low-power devices. Our results demonstrate the scalability and efficiency of this model, achieving state-of-the-art scaling with up to 1003x fewer parameters, enhancing interpretability and computational efficiency, making it a robust solution for intelligent resource scaling in network environments. The resulting 1487x runtime speed improvement and 28.5x reduction in memory requirements allow the scaler to be deployed on low-power devices and still operate in real-time, which is essential for mission-critical and latency-sensitive applications.Keywords
This publication has 8 references indexed in Scilit:
- Network Intelligence for NFV Scaling in Closed-Loop ArchitecturesIEEE Communications Magazine, 2023
- gym-hpa: Efficient Auto-Scaling via Reinforcement Learning for Complex Microservice-based Applications in Kubernetes2023
- Towards Autonomous VNF Auto-scaling using Deep Reinforcement Learning2021
- Towards Chain-Aware Scaling Detection in NFV with Reinforcement Learning2021
- Intelligent Autoscaling of Microservices in the Cloud for Real-Time ApplicationsIEEE Access, 2021
- Deep-Reinforcement Learning for Fair Distributed Dynamic Spectrum Access in Wireless Networks2021
- Horizontal and Vertical Scaling of Container-Based Applications Using Reinforcement Learning2019
- Performance evaluation of integrated smart energy solutions through large-scale simulations2011