Scalable Hybrid Switching-Driven Software Defined Networking Issue: From the Perspective of Reinforcement Learning Standpoint
Open Access
- 10 April 2024
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 12, 63334-63350
Abstract
The Software-Defined Networking technology promises to enhance network performance and cost reduction for service providers by providing scalability, flexibility, and programmability through the separation of the control plane from the data plane. However, the separation between the control plane and data plane in the implementation of SDN presents scalability issues, as the controller has limited computational resources. To address the SDN scalability issues identified, we create a scalable hybrid switching solution using machine learning algorithms. We propose an SDN OpenFlow model switch which collaborates with the traditional switch to represent a scalable framework of Hybrid Routing with Reinforcement Learning (sHRRL). We implement a reinforcement algorithm to randomly explore new routes and discover the most optimal path through the Q-learning algorithm. This primitive and model-free form of reinforcement learning utilizes the Markov Decision Process and Bellman’s equation to reiteratively update Q-values in the Q-table for every transition in the network environment state until Q-function has converged to the best Q-values. The proposed hybrid switching model is benchmarked against the standard SDN OpenFlow switch in terms of network performance metrics, including throughput, packet exchange transmission rates, CPU load, and delay. When statistically comparing simulation results, it is evident that the proposed switching model, incorporating machine learning algorithms, can effectively tackle scalability challenges in the design of SDN controller networks, especially in Data Centre environments where rapid switching speeds are crucial.Keywords
This publication has 30 references indexed in Scilit:
- Development Of Scalable Hybrid Switching Based Software Defined Networking2020
- An adaptive greedy flow routing algorithm for performance improvement in software‐defined networkInternational Journal of Numerical Modelling: Electronic Networks, Devices and Fields, 2019
- Machine Learning-Based Routing and Wavelength Assignment in Software-Defined Optical NetworksIEEE Transactions on Network and Service Management, 2019
- SDCoR: Software Defined Cognitive Routing for Internet of VehiclesIEEE Internet of Things Journal, 2018
- A survey: Control plane scalability issues and approaches in Software-Defined Networking (SDN)Computer Networks, 2017
- An Overview on SDN Architectures with Multiple ControllersJournal of Computer Networks and Communications, 2016
- A roadmap for traffic engineering in SDN-OpenFlow networksComputer Networks, 2014
- Reinforcement learning algorithms with function approximation: Recent advances and applicationsInformation Sciences, 2014
- DevoFlowACM SIGCOMM Computer Communication Review, 2011
- Scalable flow-based networking with DIFANEACM SIGCOMM Computer Communication Review, 2010